Context-Aware Activity Recognition Systems Open access Peer reviewed

Foundation Models Defining A New Era In Sensor-based Human Activity Recognition: A Survey And Outlook

Sizhen Bian, Mengxi Liu, Lala Shakti Swarup Ray, Bo Zhou and 6 more

Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies | Jun 15, 2026

Scollr summary

What this paper is about

This survey synthesizes emerging foundation models for sensor-based HAR and identifies three dominant development trajectories: HAR-specific foundation models trained from scratch on large sensor corpora, adaptation of general time-series or multimodal foundation models to sensor-based HAR, and integration of large language models for reasoning, annotation, and human-AI interaction.

Full abstract

Read the full abstract

Sensor-based Human Activity Recognition (HAR) underpins many ubiquitous and wearable computing applications, yet current models remain limited by scarce labels, sensor heterogeneity, and weak generalization across users, devices, and contexts. Foundation models, which are generally pretrained at scale using self-supervised and multimodal learning, offer a unifying paradigm to address these challenges by learning reusable, adaptable representations for activity understanding. This survey synthesizes emerging foundation models for sensor-based HAR. We first clarify foundational concepts, definitions, and evaluation criteria, then organize existing work using a lifecycle-oriented taxonomy spanning input design, pretraining, adaptation, and utilization. Rather than enumerating individual models, we analyze recurring design patterns and trade-offs across nine technical axes, including modality scope, tokenization, architectures, learning paradigms, adaptation mechanisms, and deployment settings. From this synthesis, we identify three dominant development trajectories: (i) HAR-specific foundation models trained from scratch on large sensor corpora, (ii) adaptation of general time-series or multimodal foundation models to sensor-based HAR, and (iii) integration of large language models for reasoning, annotation, and human-AI interaction. We conclude by highlighting open challenges in data curation, multimodal alignment, personalization, privacy, and responsible deployment, and outline directions toward general-purpose, interpretable, and human-centered foundation models for activity understanding. A complete, continuously updated index of papers and models is available in our companion repository 1 .

Direct answer

What can I do from this paper page?

Use this page to scan "Foundation Models Defining A New Era In Sensor-based Human Activity Recognition: A Survey And Outlook" quickly: start with the summary and abstract, then check the authors, source, topics, and related papers. From here, open Scollr to follow Context-Aware Activity Recognition Systems research, save the paper, or map adjacent work.

Authors

Researchers on this paper

Sizhen Bian

first | University of Kaiserslautern | ORCID 0000-0001-6760-5539

Mengxi Liu

middle | German Research Centre for Artificial Intelligence | ORCID 0000-0003-0527-1208

Lala Shakti Swarup Ray

middle | German Research Centre for Artificial Intelligence | ORCID 0000-0002-7133-0205

Bo Zhou

middle | German Research Centre for Artificial Intelligence | ORCID 0000-0002-8976-5960

Bin Guo

middle | Northwestern Polytechnical University | ORCID 0000-0001-6097-2467

Zhiwen Yu

middle | Northwestern Polytechnical University | ORCID 0000-0002-9905-3238

Thomas Ploetz

middle | Georgia Institute of Technology | ORCID 0000-0002-1243-7563

Paul Lukowicz

middle | University of Kaiserslautern | ORCID 0000-0003-0320-6656

Siyu Yuan

middle | University of Kaiserslautern | ORCID 0009-0004-4439-0984

Vítor Fortes Rey

last | University of Kaiserslautern | ORCID 0000-0002-8371-2921

Research areas

Follow related topics

Citation

BibTeX

@article{Bian2026Foundation,
  title = {Foundation Models Defining A New Era In Sensor-based Human Activity Recognition: A Survey And Outlook},
  author = {Sizhen Bian and Mengxi Liu and Lala Shakti Swarup Ray and Bo Zhou and Bin Guo and Zhiwen Yu and Thomas Ploetz and Paul Lukowicz and Siyu Yuan and Vítor Fortes Rey},
  journal = {Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies},
  year = {2026},
  doi = {10.1145/3810230},
  url = {https://doi.org/10.1145/3810230}
}

FAQ

Using this paper in a discovery workflow

How do I find related work for this paper?

Use the related papers and topic links on this page as starting points. In Scollr, you can also open the paper and build a literature map around its references, citing papers, and related work.

How can I keep up with new Context-Aware Activity Recognition Systems research papers?

Follow Context-Aware Activity Recognition Systems research in Scollr. New papers from the topic flow into a personalized feed, and you can save useful studies to revisit later.

Can I cite this paper from this page?

This page includes a static BibTeX block for Foundation Models Defining A New Era In Sensor-based Human Activity Recognition: A Survey And Outlook. Always verify the DOI, source, and publication details against the publisher record before submitting a manuscript.

Follow this research in Scollr

Follow the topics and authors behind this paper, save useful studies, and build a literature map when you are ready to go deeper.

Get the app