A Unified Bellman Operator for Safety-Critical Reinforcement Learning
What it is
This paper proposes a novel Bellman operator that unifies task performance and safety objectives into a single joint value function for reinforcement learning. It uses a two-timescale stochastic approximation framework to ensure convergence, allowing the agent to maximize task return while strictly adhering to safety constraints at all times.
The problem it solves
Existing safe reinforcement learning methods force a trade-off between strict safety guarantees (which require prior knowledge) and joint learning (which only satisfies constraints on average), making it difficult to ensure safety at all times during learning and deployment.
What you could use it for
- Training autonomous vehicles that must avoid collisions while reaching destinations
- Developing robotic control policies for physical manipulation tasks with strict safety limits
- Optimizing industrial processes where safety violations are unacceptable
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.