DR Pixel: Page-Native Deep Research with Vision-Language Models
What it is
DR Pixel is a proposed open-source end-to-end multimodal deep research agent that uses rendered document page images as its sole retrieval and reasoning unit, instead of OCR-extracted text, over a corpus of 1.06M pages. The paper also introduces DRPixelBench, a benchmark of scientific papers requiring reasoning over text, figures, tables, and equations, and a training method called counterfactual credit reweighting that weights individual reasoning and action steps by their counterfactual contribution to the final answer. Reported results claim page-native retrieval beats OCR-based baselines without training and that training improves retrieval recall by ~15 points and final accuracy by >10 points on DRPixelBench.
The problem it solves
Existing deep research agents reduce complex documents to OCR-extracted text, discarding or degrading information held in tables, figures, and equations, which hurts retrieval and reasoning quality on scientific papers.
What you could use it for
- Deep research over scientific paper corpora where tables, figures, and equations carry key information
- Retrieval-augmented question answering that must reason over rendered page images rather than extracted text
- Benchmarking multimodal deep research agents on DRPixelBench
- Training agentic deep research policies with step-level credit assignment from noisy teacher trajectories
Why it matters
If the reported results hold, it would suggest the conventional OCR-then-retrieve pipeline is unnecessary and suboptimal for complex documents, making deep research over scientific literature both more accurate and more tool-call efficient, and it would provide an open benchmark and training recipe for multimodal research agents.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.