scientometrics and bibliometrics research Open access Peer reviewed

Methodological challenges in content‐based citation analysis: Expertise, reliability, and the primacy of citance identification

Zehra Taşkın

Journal of the Association for Information Science and Technology | Jun 26, 2026

Abstract

Abstract

Abstract Content‐based citation analysis seeks to capture the meaning and functions of citations but continues to face unresolved methodological challenges. This study analyzes a stratified sample of library and information science publications to examine how citance segmentation and annotator expertise influence the consistency of classification. Using two annotators with different professional backgrounds, the findings show that agreement is high when citances are defined identically, but reliability decreases sharply once text boundaries diverge. Citance length, rather than subject category or citation density, emerges as the strongest predictor of disagreement. These results identify segmentation as a methodological rather than a purely technical issue, shaping both human and automated tagging outcomes. By highlighting the interplay between expertise effects and boundary definitions, the study underscores the need for clearer operational frameworks in citation analysis. The contribution lies in demonstrating that methodological refinements in citance identification are essential for improving reproducibility, enhancing hybrid human–machine approaches, and strengthening the validity of citation‐based indicators in research evaluation.

Direct answer

What can I do from this paper page?

Use this page to scan "Methodological challenges in content‐based citation analysis: Expertise, reliability, and the primacy of citance identification" quickly: start with the summary and abstract, then check the authors, source, topics, and related papers. From here, open Scollr to follow scientometrics and bibliometrics research, save the paper, or map adjacent work.

Authors

Researchers on this paper

Zehra Taşkın

first | Adam Mickiewicz University in Poznań | ORCID 0000-0001-7102-493X

Research areas

Follow related topics

Citation

BibTeX

@article{Takn2026Methodological,
  title = {Methodological challenges in content‐based citation analysis: Expertise, reliability, and the primacy of citance identification},
  author = {Zehra Taşkın},
  journal = {Journal of the Association for Information Science and Technology},
  year = {2026},
  doi = {10.1002/asi.70102},
  url = {https://doi.org/10.1002/asi.70102}
}

FAQ

Using this paper in a discovery workflow

How do I find related work for this paper?

Use the related papers and topic links on this page as starting points. In Scollr, you can also open the paper and build a literature map around its references, citing papers, and related work.

How can I keep up with new scientometrics and bibliometrics research papers?

Follow scientometrics and bibliometrics research in Scollr. New papers from the topic flow into a personalized feed, and you can save useful studies to revisit later.

Can I cite this paper from this page?

This page includes a static BibTeX block for Methodological challenges in content‐based citation analysis: Expertise, reliability, and the primacy of citance identification. Always verify the DOI, source, and publication details against the publisher record before submitting a manuscript.

Follow this research in Scollr

Follow the topics and authors behind this paper, save useful studies, and build a literature map when you are ready to go deeper.

Get the app