Reinforcement Learning in Robotics Open access

Low-Complexity Policy Tessellations in Structured Markov Decision Processes

Fredy Pokou

arXiv (Cornell University) | Jun 24, 2026

Abstract

Abstract

We study optimal-policy geometry in structured Markov decision processes. While approximate dynamic programming and reinforcement learning typically approximate high-dimensional value functions, we show that optimal policies induce simpler decision tessellations. We propose boundary-based policy approximations that learn policy regions directly. A policy-loss decomposition links performance degradation to action margins and explains why errors concentrate near indifference boundaries. Inventory control and queue admission experiments show lower policy error, smaller value gaps, faster error decay, and stability than reinforcement learning baselines.

Direct answer

What can I do from this paper page?

Use this page to scan "Low-Complexity Policy Tessellations in Structured Markov Decision Processes" quickly: start with the summary and abstract, then check the authors, source, topics, and related papers. From here, open Scollr to follow Reinforcement Learning in Robotics research, save the paper, or map adjacent work.

Authors

Researchers on this paper

Fredy Pokou

first

Research areas

Follow related topics

Citation

BibTeX

@article{Pokou2026Complexity,
  title = {Low-Complexity Policy Tessellations in Structured Markov Decision Processes},
  author = {Fredy Pokou},
  journal = {arXiv (Cornell University)},
  year = {2026},
  doi = {10.48550/arxiv.2606.25593},
  url = {https://doi.org/10.48550/arxiv.2606.25593}
}

FAQ

Using this paper in a discovery workflow

How do I find related work for this paper?

Use the related papers and topic links on this page as starting points. In Scollr, you can also open the paper and build a literature map around its references, citing papers, and related work.

How can I keep up with new Reinforcement Learning in Robotics research papers?

Follow Reinforcement Learning in Robotics research in Scollr. New papers from the topic flow into a personalized feed, and you can save useful studies to revisit later.

Can I cite this paper from this page?

This page includes a static BibTeX block for Low-Complexity Policy Tessellations in Structured Markov Decision Processes. Always verify the DOI, source, and publication details against the publisher record before submitting a manuscript.

Follow this research in Scollr

Follow the topics and authors behind this paper, save useful studies, and build a literature map when you are ready to go deeper.

Get the app