Reinforcement Learning Under Runtime Confounding
What it is
This paper addresses the problem of runtime confounding in reinforcement learning, where variables available during data logging are missing during deployment. It proposes policy learning algorithms, semi-parametric off-policy evaluation methods, and diagnostic tools to handle the resulting biases in adaptive systems.
The problem it solves
Standard RL assumes full observability at deployment, but legal, ethical, or logistical constraints often prevent access to key variables, leading to biased learning and evaluation in adaptive systems.
What you could use it for
- Training robust policies in healthcare where sensitive patient data is logged but restricted at inference time
- Evaluating off-policy performance in e-commerce or robotics when deployment constraints hide key decision drivers
Why it matters
Enables unbiased policy learning and evaluation in real-world RL applications where full observability is not possible at deployment time, preventing biased decision-making in critical domains.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.