Optical Imaging and Spectroscopy Techniques
Open access
Abstract
Abstract
Human-in-the-loop Reinforcement Learning has become a popular approach to training, finetuning, and aligning robot behavior with user preferences. Our paper explores the feasibility of using brain signals via functional near-infrared spectroscopy (fNIRS) to modulate robot learning in simulation. We compare agents trained on passive (observational) versus active (demonstrative) interaction tasks, and test multiple methods for enhancing the RL algorithm with the neural signal, focusing on parameter augmentation rather than replacement. We further examine how model granularity and noise affect agent learning. Our results show that this framework is effective: the neural signal improves learning when augmenting trajectory priorities and state-action q-values. Additionally, the framework learns successfully from offline data, offering a practical alternative for settings where real-time BCI setups are impractical or only limited data is available.
Direct answer
What can I do from this paper page?
Use this page to scan "An offline approach to fNIRS-guided reinforcement learning for robot behavior" quickly: start with the summary and abstract, then check the authors, source, topics, and related papers. From here, open Scollr to follow Optical Imaging and Spectroscopy Techniques research, save the paper, or map adjacent work.
Research areas
Follow related topics
Citation
BibTeX
@article{Santaniello2026offline,
title = {An offline approach to fNIRS-guided reinforcement learning for robot behavior},
author = {Julia Santaniello and Madelaine Brower and Benson Jiang and Donatello Sassaroli and Robert Jacob and Jivko Sinapov},
journal = {arXiv (Cornell University)},
year = {2026},
doi = {10.48550/arxiv.2607.14393},
url = {https://doi.org/10.48550/arxiv.2607.14393}
}FAQ
Using this paper in a discovery workflow
How do I find related work for this paper?
Use the related papers and topic links on this page as starting points. In Scollr, you can also open the paper and build a literature map around its references, citing papers, and related work.
How can I keep up with new Optical Imaging and Spectroscopy Techniques research papers?
Follow Optical Imaging and Spectroscopy Techniques research in Scollr. New papers from the topic flow into a personalized feed, and you can save useful studies to revisit later.
Can I cite this paper from this page?
This page includes a static BibTeX block for An offline approach to fNIRS-guided reinforcement learning for robot behavior. Always verify the DOI, source, and publication details against the publisher record before submitting a manuscript.
Follow this research in Scollr
Follow the topics and authors behind this paper, save useful studies, and build a literature map when you are ready to go deeper.
Get the app