Medical Education and Admissions Peer reviewed

Validity Evidence for Scores From a Rubric Used for Holistic Admissions—A Single Institution Study

Kathryn A. Champion, Muath AlDosari

Journal of Dental Education | Jun 23, 2026

Scollr summary

What this paper is about

The Holistic Admissions Assessment Rubric was developed to score applicant data from the Associated American Dental Schools Application Service applications at one institution as part of an overall holistic review process and demonstrated promising reliability and meaningful validity evidence across multiple sources.

Full abstract

Read the full abstract

PURPOSE: Few evidence-based tools exist to support holistic review in dental school admissions. The Holistic Admissions Assessment Rubric (HAAR) was developed to score applicant data from the Associated American Dental Schools Application Service (AADSAS) applications at one institution as part of an overall holistic review process. METHODS: Validity evidence was collected across four sources: content, response processes, internal structure, and consequences. Content evidence was gathered through a multi-institutional nominal group process. Response-process evidence was explored through rater training and calibration. Internal structure was examined using inter-rater reliability via intraclass correlation coefficient (ICC) and internal consistency (Cronbach's alpha). Consequences evidence was evaluated using logistic regression to determine whether HAAR scores predicted admissions decisions. RESULTS: The nominal group process produced a 16-item rubric across experiences, attributes, and metrics. Inter-rater reliability for overall HAAR scores was excellent (ICC = 0.85). Item discrimination ranged from 0.14 to 0.67, and inter-item correlations were low (0.05-0.08), indicating non-redundancy. Logistic regression showed HAAR scores significantly predicted likelihood of admission (OR = 1.28, p < 0.001). CONCLUSIONS: Scores from the HAAR demonstrated promising reliability and meaningful validity evidence across multiple sources. HAAR scores were strongly associated with admissions outcomes at one institution and appear to support more structured holistic review processes.

Direct answer

What can I do from this paper page?

Use this page to scan "Validity Evidence for Scores From a Rubric Used for Holistic Admissions—A Single Institution Study" quickly: start with the summary and abstract, then check the authors, source, topics, and related papers. From here, open Scollr to follow Medical Education and Admissions research, save the paper, or map adjacent work.

Authors

Researchers on this paper

Kathryn A. Champion

first | Missouri Southern State University

Muath AlDosari

last | Harvard University Press

Research areas

Follow related topics

Citation

BibTeX

@article{Champion2026Validity,
  title = {Validity Evidence for Scores From a Rubric Used for Holistic Admissions—A Single Institution Study},
  author = {Kathryn A. Champion and Muath AlDosari},
  journal = {Journal of Dental Education},
  year = {2026},
  doi = {10.1002/jdd.70294},
  url = {https://doi.org/10.1002/jdd.70294}
}

FAQ

Using this paper in a discovery workflow

How do I find related work for this paper?

Use the related papers and topic links on this page as starting points. In Scollr, you can also open the paper and build a literature map around its references, citing papers, and related work.

How can I keep up with new Medical Education and Admissions research papers?

Follow Medical Education and Admissions research in Scollr. New papers from the topic flow into a personalized feed, and you can save useful studies to revisit later.

Can I cite this paper from this page?

This page includes a static BibTeX block for Validity Evidence for Scores From a Rubric Used for Holistic Admissions—A Single Institution Study. Always verify the DOI, source, and publication details against the publisher record before submitting a manuscript.

Follow this research in Scollr

Follow the topics and authors behind this paper, save useful studies, and build a literature map when you are ready to go deeper.

Get the app