Evolve on Graph: Self-Evolving Knowledge Graph Reasoning
What it is
This paper introduces Evolve on Graph (EoG), a framework that enables Large Language Models (LLMs) to self-improve their knowledge graph reasoning capabilities without requiring human-annotated question-answer pairs. It utilizes a self-play mechanism where a Proposer generates verifiable questions based on synthesized graph topologies, and a Solver answers them, with a curriculum strategy that adjusts question difficulty to match the Solver's current ability.
The problem it solves
Existing methods for improving LLM knowledge graph reasoning rely heavily on question-answer annotations, which are scarce or unavailable in real-world domains like finance and industry, and static training data cannot adapt to the agent's changing capabilities.
What you could use it for
- Improving LLM multi-hop reasoning on knowledge graphs in domains lacking QA annotations, such as finance and industry
- Training reinforcement learning agents for graph reasoning without relying on closed-source model synthesis for training data
- Dynamic curriculum learning where task complexity adapts to the model's evolving performance
Why it matters
Enables cost-effective and scalable improvement of LLM reasoning on real-world knowledge graphs by eliminating the bottleneck of manual or expensive synthetic QA data creation.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.