Cohen Kappa Inter-Rater Agreement
Compare two raters' labels for the same objects and calculate observed agreement and Cohen's kappa.
Cohen Kappa Inter-Rater Agreement User manual
- Fill in the parameters or select the file according to the form, and check the unit and format first.
- The same batch of samples will be marked as pass, not passed or pending, respectively, by the two graders of A and B respectively.
- Click the processing button to view the results, you can copy or download and save.
Calculation method and processing rules
Estimate chance agreement from the two raters' marginal frequencies, adjust observed agreement, and report cross-tabulated counts.
scope of use
Up to 5000 pairs, 30 categories; use unweighted nominal category Kappa, do not support multi-person or orderly weighted scoring, and have no definition in a single constant category.
Will the input content be saved on the server?
This tool handles input in the browser, and does not upload files or form content. Typing practice scores are only saved in the native browser.
Why may the result be different from other tools?
Up to 5000 pairs, 30 categories; use unweighted nominal category Kappa, do not support multi-person or orderly weighted scoring, and have no definition in a single constant category. Please compare the input unit, rounding method, applicable rules and data version first.