Disaster Response and Management Open access Peer reviewed

Psychometric Evaluation of a START Triage Psychomotor Observation Instrument: Content Validity and Interrater Reliability

Julfilkar Adnan Irnu, Novia Faizatiwahida, Superzeki Zaidatul Fadilah, Desy Listyaningrum

Health and Technology Journal (HTechJ) | Aug 3, 2026

Scollr summary

What this paper is about

The START triage psychomotor observation sheet exhibits robust content validity and excellent interrater reliability, and provides educators with a standardized, objective tool for evaluating clinical competencies in disaster preparedness training, though future validation in high-fidelity simulation environments is recommended.

Full abstract

Read the full abstract

Accurate psychomotor assessment in Simple Triage and Rapid Treatment (START) is critical during mass-casualty incidents. Observation-based evaluations often yield inconsistent judgments when utilizing unvalidated instruments, compromising competency assessments. This study aimed to establish the content validity and interrater reliability of a newly developed psychomotor observation sheet for START triage among healthcare professionals. This methodological study evaluated a 12-item dichotomous observation sheet derived from standard START protocols. Content validity was determined by three emergency and disaster nursing experts using a four-point relevance scale, analyzed with Aiken's V. Interrater reliability was assessed with 36 medical staff members, independently evaluated by two trained raters. Agreement metrics included percent agreement and Cohen's kappa. Expert evaluation yielded a perfect Aiken's V of 1.00 across all 12 items, indicating exceptional content validity. Interrater reliability testing demonstrated percent agreement ranging from 94.44% to 100%, alongside Cohen's kappa coefficients between 0.85 and 1.00. These metrics significantly exceeded minimum acceptability thresholds, reflecting outstanding consistency and minimal scoring ambiguity among raters. The START triage psychomotor observation sheet exhibits robust content validity and excellent interrater reliability. This validated instrument provides educators with a standardized, objective tool for evaluating clinical competencies in disaster preparedness training, though future validation in high-fidelity simulation environments is recommended.

Direct answer

What can I do from this paper page?

Use this page to scan "Psychometric Evaluation of a START Triage Psychomotor Observation Instrument: Content Validity and Interrater Reliability" quickly: start with the summary and abstract, then check the authors, source, topics, and related papers. From here, open Scollr to follow Disaster Response and Management research, save the paper, or map adjacent work.

Authors

Researchers on this paper

Julfilkar Adnan Irnu

first | Jakarta State Polytechnic

Novia Faizatiwahida

middle | Universitas Jember

Superzeki Zaidatul Fadilah

middle | Universitas Jember

Desy Listyaningrum

last | Universitas Jember

Research areas

Follow related topics

Citation

BibTeX

@article{Irnu2026Psychometric,
  title = {Psychometric Evaluation of a START Triage Psychomotor Observation Instrument: Content Validity and Interrater Reliability},
  author = {Julfilkar Adnan Irnu and Novia Faizatiwahida and Superzeki Zaidatul Fadilah and Desy Listyaningrum},
  journal = {Health and Technology Journal (HTechJ)},
  year = {2026},
  doi = {10.53713/htechj.v4i4.739},
  url = {https://doi.org/10.53713/htechj.v4i4.739}
}

FAQ

Using this paper in a discovery workflow

How do I find related work for this paper?

Use the related papers and topic links on this page as starting points. In Scollr, you can also open the paper and build a literature map around its references, citing papers, and related work.

How can I keep up with new Disaster Response and Management research papers?

Follow Disaster Response and Management research in Scollr. New papers from the topic flow into a personalized feed, and you can save useful studies to revisit later.

Can I cite this paper from this page?

This page includes a static BibTeX block for Psychometric Evaluation of a START Triage Psychomotor Observation Instrument: Content Validity and Interrater Reliability. Always verify the DOI, source, and publication details against the publisher record before submitting a manuscript.

Follow this research in Scollr

Follow the topics and authors behind this paper, save useful studies, and build a literature map when you are ready to go deeper.

Get the app