Current Slide

Small screen detected. You are viewing the mobile version of SlideWiki. If you wish to edit slides you will need to use a larger device.

Kappa Example

  • P(A) = 370/400 = 0.925

  • P(nonrelevant) = (10+20+70+70)/800 = 0.2125

  • P(relevant) = (10+20+300+300)/800 = 0.7878

  • P(E) = 0.2125^2 + 0.7878^2 = 0.665

  • Kappa = (0.925 – 0.665)/(1-0.665) = 0.776

  • Kappa > 0.8 = good agreement

  • 0.67 < Kappa < 0.8 -> “tentative conclusions” (Carletta ’96)

  • Depends on purpose of study

  • For >2 judges: average pairwise kappas 


Speaker notes:

Content Tools

Sources

There are currently no sources for this slide.