From Pixels to Privacy-Sensitive Features: An Information-Theoretic Framework for Reconstruction Bounds
What it is
This paper derives an information-theoretic framework to calculate lower bounds on the reconstruction error of data records from models trained with DP-SGD. It separates the information leaked during training from the inherent uncertainty in the data distribution, using rate-distortion theory to quantify privacy guarantees in specific feature spaces like pixels or LPIPS.
The problem it solves
Standard (ε,δ)-differential privacy guarantees do not directly answer how much data an adversary can actually recover or reconstruct from a trained model, leaving a gap between theoretical privacy and practical reconstruction risk.
What you could use it for
- Quantifying the privacy risk of machine learning models before deployment
- Evaluating the effectiveness of DP-SGD noise parameters against specific reconstruction attacks
- Establishing theoretical lower bounds for data reconstruction in high-dimensional image datasets
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.