Pramana API
What it is
An open-source backend service for crowdsourced LLM drift detection that tracks model output consistency over time. It uses SHA-256 hashing to identify when the same prompt and model produce different results, aggregating user-submitted data for visualization on a public dashboard.
The problem it solves
LLM providers silently update models, causing the same prompts to return different or degraded results over time without explicit notification.
What you could use it for
- Monitoring LLM provider model updates for silent behavior changes
- Tracking output consistency of specific prompts across different model versions
- Crowdsourced benchmarking of LLM stability
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.