Where vs What: Decomposing Structural and Content Failures in LLM-Generated Structured Outputs
What it is
This paper introduces Structure-Content Decomposition (SCD), a framework that separates structural placement errors from content value errors in LLM-generated structured outputs like JSON and tables. It proposes SA-RLVR, a reinforcement learning method that uses SCD metrics as rewards to improve structural addressing, demonstrating significant gains in value placement accuracy across multiple models and domains.
The problem it solves
Current evaluation methods for LLM structured outputs treat failures monolithically, conflating structural placement errors with content value errors, which obscures the specific cause of failure and hinders targeted improvement.
What you could use it for
- Diagnosing why LLMs fail at generating valid JSON or tables by distinguishing between wrong values and misplaced values
- Training LLMs to better understand output topology using structure-aware reinforcement learning rewards
- Evaluating the structural fidelity of LLMs across different model sizes and reasoning capabilities
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.