On this website, you will find Dr Gwet's online repository of Inter-rater reliability materials. You will be able to obtain the following:

• Free Articles
  You can read free articles. These are my published and unpublished papers.
• Computer Programs
  You can download computer programs (in R and SAS) for computing inter-rater and intra-rater reliability coefficients. The commercial option AgreeStat360 is available in both Excel/Windows and Cloud versions.
• Book Excerpts (new/old)
  You can review excerpts of my current and future books here as well.

AgreeStat360/Excel Windows

An Excel-based application for performing advanced statistical analysis of the extent of agreement among multiple raters.  You may compute Chance-corrected Agreement Coefficients (CAC) as well as Intraclass Correlation Coefficients (ICC).

Check the video below, which shows some of the key features of AgreeStat 360. For a better viewing experience, you may access this video on YouTube).



CAC statistics include Cohen's Kappa, Gwet's AC1/AC2, Krippendorff's alpha and more. ICC statistics on the hand, include various coefficients based on different ANOVA models.

You may also want to get a more comprehensive overview of AgreeStat/360 capabilities.

Download the (free) standard version of the program here.

If your Windows regional settings are not those of the US nor English Canada, temporarily adjust them (see instructions here) for AgreeStat360 to work smoothly.



 

 

Handbook of Inter-Rater Reliability, 5th Edition in 2 Volumes

In its 5th edition, the Handbook of Inter-Rater Reliability is released in 2 volumes. Volume 1 is devoted to the analysis of categorical ratings, whereas volume 2 focuses on the analysis of quantitative ratings.

AgreeStat360.com offers a point-and-click inter-rater reliability statistical analysis right in your browser. Please visit the site, where may register to access the trial version of the application.

The video below gives you a glimpse into the main features of this app. For a better viewing experience, you can access this video on YouTube.

Note that any paid license key for agreestat360.com can be used with AgreeStat360 for Excel/Windows.

AgreeTest/Cloud-Based

AgreeTest is a free cloud-based application, which allows you to test the difference between 2 agreement coefficients for statistical significance. All this is done right from your browser. Check it out here.