Comparison of techniques for fine-tuning open-weight models for entity extraction from radiology reports
What it is
This paper evaluates whether fine-tuning the open-weight Gemma-3-12B model can match GPT-4o for extracting intracranial hemorrhage acuity from radiology reports. It compares discriminative classification heads against generative instruction fine-tuning using both distilled real data and synthetic data, finding that distilling real reports is the critical factor for achieving parity with proprietary models.
The problem it solves
Hosted proprietary models for clinical text extraction raise significant privacy, cost, and reproducibility concerns, while un-tuned open-weight models often lack the accuracy required for high-stakes medical tasks.
What you could use it for
- Extracting structured labels from free-text radiology reports for cohort building
- Deploying private, on-premises clinical NLP models to avoid data privacy concerns
- Reducing costs associated with hosted proprietary LLM APIs for medical text processing
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.