StaTips Part III: Assessment of the repeatability and rater agreement for nominal and ordinal data

  • Giuseppe Perinetti University of Trieste, Department of Medical, Surgical and Health Sciences, Italy
DOI: https://doi.org/10.5937/sejodr4-15199

Abstract


Assessment of the repeatability and rater agreement for nominal and ordinal data is an important procedure in medical research. This analysis applies to several cases including: i) replicate recordings by the same rater using the same parameter; ii) agreement between/among raters using the same parameter; and iii) agreement between/among different parameters recorded by the same rater. Herein, the most common coefficients of agreement are presented along with criteria for their proper selection.

References

Perinetti G. StaTips Part II: Assessment of the repeatability of measurements for continuous data. South Eur J Orthod Dentofac Res. 2016;3(2):33-34.

Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20(1):37-46.

Fleiss JL, Levin B, Paik MC. Statistical methods for rates and proportions, 3rd ed. Wiley. 2003.

Kendall MG, Babington Smith B. The Problem of m Rankings. Ann Math Statist. 1939;10:275-87.

Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159-74.

Perinetti G. StaTips Part I: Choosing statistical test when dealing with differences. South Eur J Orthod Dentofac Res. 2016;3(1):4-5.

Brenner H, Kliebsch U. Dependence of weighted kappa coefficients on the number of categories. Epidemiology. 1996;7(2):199-202.

Published
2017/10/02
Issue
Vol. 4 No. 1 (2017)
Section
Short Communication

The Creative Commons Attribution License cc-by-nc-nd formalizes these and other terms and conditions of publishing articles.

Copyright on any open access article in a SEJODR journal published by Dentitio d.o.o. is retained by the author(s).
Authors grant Dentitio d.o.o. a license to publish the article and identify itself as the original publisher.
Authors also grant any third party the right to use the article freely as long as its integrity is maintained and its original authors, citation details and publisher are identified.
The Creative Commons Attribution License cc-by-nc-nd formalizes these and other terms and conditions of publishing articles.