krippendorff_alpha#

scikitplot.corpus.krippendorff_alpha(ratings, *, level='nominal')[source]#

Krippendorff’s alpha for any number of raters, with missing ratings.

Parameters:

ratingsarray-like of shape (n_raters, n_units)

One row per rater, one column per unit (the krippendorff package’s reliability_data layout). None or NaN marks a missing rating. Units with fewer than two ratings are ignored.

level{“nominal”, “ordinal”, “interval”, “ratio”}, default=”nominal”

Measurement level. Every level but nominal needs real numbers; ratio also needs non-negative values.

Returns:

float

NaN (with a warning) when fewer than two pairable ratings exist or only one value occurs.

Raises:

ValueError

For an unknown level, or values the level cannot use.

Parameters:

• ratings (Any)

• level (str)

Return type:

float

Examples

Try it in your browser!

>>> round(krippendorff_alpha([[1, 2, 3, 3], [1, 2, 3, 4]], level="interval"), 4)
0.8889

Go BackOpen In Tab