E-Process-Authorized Thompson Sampling under Non-stationarity
What it is
This paper introduces e-ATS, a method for multi-armed bandits that uses anytime-valid e-processes to authorize when to switch from full-history to discounted states. It ensures that the probability of departing from optimistic Thompson sampling is bounded by a pre-specified alpha, providing rigorous control over adaptation under non-stationarity.
The problem it solves
Standard bandit algorithms assume stationarity, causing them to be misled by outdated history after environmental changes; existing adaptive methods often lack rigorous guarantees on when adaptation is justified.
What you could use it for
- Dynamic recommendation systems where user preferences change over time
- Clinical trial design with adaptive randomization
- Online advertising with shifting market conditions
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.