Every card below was actually executed by the lab — under-the-radar repos that installed clean and did what they claim, verified in the sandbox, not guessed from the README. From 1,250 repos tested so far.
ThetaEvolve
ThetaEvolve is an open-source pipeline that extends AlphaEvolve to enable efficient Reinforcement Learning (RL) and in-context learning at test time.
Insight The demo actually ran and produced real output.
github.com/ypwang61/ThetaEvolve ↗
PaCoRe: Parallel Coordinated Reasoning
PaCoRe is a framework that scales test-time compute by shifting from sequential reasoning to coordinated parallel breadth.
Insight The project has a clear structure, published model checkpoints, training data, and a functional Python package with a public API.
github.com/stepfun-ai/PaCoRe ↗
Biomni
Biomni is a general-purpose biomedical AI agent that integrates Large Language Model (LLM) reasoning with retrieval-augmented planning and code execution.
Insight The demo actually ran and produced real output.
github.com/snap-stanford/Biomni ↗
RouteLLM
RouteLLM is a framework designed to reduce LLM costs by routing queries to smaller, cheaper models based on complexity.
Insight RouteLLM is a framework designed to reduce LLM costs by routing queries to smaller, cheaper models based on complexity.
github.com/lm-sys/RouteLLM ↗
Evidently
Evidently is an open-source observability framework for evaluating, testing, and monitoring machine learning and LLM systems.
Insight The demo actually ran and produced real output.
github.com/evidentlyai/evidently ↗
DeepEval
DeepEval is an open-source LLM evaluation framework designed for unit testing LLM applications, including AI agents and RAG pipelines.
Insight The demo actually ran and produced real output.
github.com/confident-ai/deepeval ↗