Welcome to the website of the third edition of the "Handbook of Inter-Rater Reliability: The Definitive Guide to Measuring the Extent of Agreement Among Multiple Raters." In writing the third edition of this handbook, my primary goal was to allow researchers and students in all fields of research to be able to access in one place, detailed, well-organized, and readable materials on inter-rater reliability assessment. Chance-corrected agreement coefficients are covered in part II of the book, while part III is devoted to agreement coefficients in the family of intraclass correlations. Part IV covers several rank-based measures of association, in addition to discussing agreement within the framework of item analysis.
The methods and techniques developed in this edition of the handbook of inter-rater reliability can handle missing ratings, which are common in most experiments. This is an improvement over the second edition, which describes the methods for complete data sets only. Part III and Part IV contain new chapters aimed at providing researchers with a broader coverage of inter-rater reliability techniques. Even chance-corrected agreement coefficients, already covered in the second edition, are presented in the current edition with more depth and more clarity. Errors found in this third edition are documented on the Error Page.
You may learn more about the content of this book by downloading the table of contents and chapter descriptions below: