rater.bias {irr}R Documentation

Coefficient of rater bias

Description

Calculates a coefficient of systematic bias between two raters.

Usage

rater.bias(x)

Arguments

x c x c classification matrix or 2 x n or n x 2 matrix of classification scores into c categories.

Details

rater.bias calculates a reliability coefficient for two raters classifying n objects into any number of categories. It will accept either a c x c classification matrix of counts of objects falling into c categories or a 2 x n or n x 2 matrix of classification scores.
The function returns the absolute value of the triangular off-diagnonal sum ratio of the cxc classification table and the corresponding test statistic. A systematic bias between raters can be assumed when the ratio substantially deviates from 0.5 while yielding a significant Chi-squared statistic.

Value

method Name of the method
subjects Number of subjects
raters Number of raters (2)
irr.name Name of the coefficient: ratio of triangular off-diagnonal sums
value Value of the coefficient
stat.name Name of the test statistic
statistic Value of the test statistic
p.value the probability of the df 1 Chi-square variable

Author(s)

Jim Lemon

References

Bishop Y.M.M., Fienberg S.E., & Holland P.W. (1978) Discrete multivariate analysis: theory and practice. Cambridge, Massachusetts: MIT Press.

See Also

mcnemar.test

Examples

 # fake a 2xn matrix of three way classification scores
 ratings <- matrix(sample(1:3,60,TRUE), nrow=2)
 rater.bias(ratings)

 # Example from Bishop, Fienberg & Holland (1978), Table 8.2-1
 data(vision)
 rater.bias(vision)                      

[Package irr version 0.70 Index]