0% found this document useful (0 votes)
146 views22 pages

Kappa Study Analysis - MSA Data

The document contains the results of a Kappa study with 3 factors (A, B, C) each with 2 levels (0,1). It shows: 1) Crosstabulations of the factors against each other and the reference values. 2) Calculations of P0 (observed agreement) and Kappa coefficients for each factor pair. 3) The overall Kappa comparing all factors to the reference is 0.88, indicating very good agreement beyond chance.
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as XLSX, PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
146 views22 pages

Kappa Study Analysis - MSA Data

The document contains the results of a Kappa study with 3 factors (A, B, C) each with 2 levels (0,1). It shows: 1) Crosstabulations of the factors against each other and the reference values. 2) Calculations of P0 (observed agreement) and Kappa coefficients for each factor pair. 3) The overall Kappa comparing all factors to the reference is 0.88, indicating very good agreement beyond chance.
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as XLSX, PDF, TXT or read online on Scribd

KAPPA STUDY - MSA

Part A-1 A-2 A-3 B-1 B-2 B-3 C-1 C-2


1 1 1 1 1 1 1 1 1
2 1 1 1 1 1 1 1 1
3 0 0 0 0 0 0 0 0
4 0 0 0 0 0 0 0 0
5 0 0 0 0 0 0 0 0
6 1 1 0 1 1 0 1 0
7 1 1 1 1 1 1 1 0
8 1 1 1 1 1 1 1 1
9 0 0 0 0 0 0 0 0
10 1 1 1 1 1 1 1 1
11 1 1 1 1 1 1 1 1
12 0 0 0 0 0 0 0 0
13 1 1 1 1 1 1 1 1
14 1 1 0 1 1 1 1 0
15 1 1 1 1 1 1 1 1
16 1 1 1 1 1 1 1 1
17 1 1 1 1 1 1 1 1
18 1 1 1 1 1 1 1 1
19 1 1 1 1 1 1 1 1
20 1 1 1 1 1 1 1 1
21 1 1 0 1 0 1 0 1
22 0 0 1 0 1 0 1 1
23 1 1 1 1 1 1 1 1
24 1 1 1 1 1 1 1 1
25 0 0 0 0 0 0 0 0
26 0 1 0 0 0 0 0 0
27 1 1 1 1 1 1 1 1
28 1 1 1 1 1 1 1 1
29 1 1 1 1 1 1 1 1
30 0 0 0 0 0 1 0 0
31 1 1 1 1 1 1 1 1
32 1 1 1 1 1 1 1 1
33 1 1 1 1 1 1 1 1
34 0 0 1 0 0 1 0 1
35 1 1 1 1 1 1 1 1
36 1 1 0 1 1 1 1 0
37 0 0 0 0 0 0 0 0
38 1 1 1 1 1 1 1 1
39 0 0 0 0 0 0 0 0
40 1 1 1 1 1 1 1 1
41 1 1 1 1 1 1 1 1
42 0 0 0 0 0 0 0 0
43 1 0 1 1 1 1 1 1
44 1 1 1 1 1 1 1 1
45 0 0 0 0 0 0 0 0
46 1 1 1 1 1 1 1 1
47 1 1 1 1 1 1 1 1
48 0 0 0 0 0 0 0 0
49 1 1 1 1 1 1 1 1
50 0 0 0 0 0 0 0 0
- MSA

C-3 Reference Ref value Code


1 1 0.476901 +
1 1 0.5709015 + 0
A
0 0 0.576459 - 1
0 0 -
0 0 -
0 1 X
1 1 X PA0 47/150
1 1 +
0 0 - PB0 50/150
1 1 +
1 1 +
0 0 X P(A0 U B0)
1 1 +
0 1 X
1 1 + 150 x (PA0 PB0)
1 1 +
1 1 + =
1 1 +
1 1 +
1 1 +
0 1 X A*
0 0 X
1 1 +
1 1 + A 0
0 0 -
1 0 X 1
1 1 +
1 1 +
1 1 +
0 0 X
1 1 +
1 1 +
1 1 +
1 0 X
1 1 + B*
1 1 X
0 0 -
1 1 + B 0
0 0 -
1 1 + 1
1 1 +
0 0 -
0 1 X
1 1 +
0 0 -
1 1 +
1 1 +
0 0 -
1 1 +
0 0 - A*

A 0

1
B
0 1
44 6 50
3 97 100
47 103 150

0.31333333333333

0.33333333333333

0.10444444444445

=150 x (47/150) x (50/150) =

15.67

A* B Crosstabulation
B
0 1 Total Kappa
Count 44 6 50 A
Expected count 15.7 34.3 50.0 B
Count 3 97 100 C
Expected count 31.3 68.7 100.0
Count 47 103 150
Expected count 47.0 103.0 150.0
A*B
P0 Kappa =

Pe =
B* C Crosstabulation
C P0
0 1 Total
Count 42 5 47 P0 =
Expected count 16.0 31.0 47.0
Count 9 94 103 Kappa =
Expected count 35.0 68.0 103.0
Count 51 99 150
Expected count 51.0 99.0 150.0
B*C
P0 Kappa =
Pe

Pe =

A* C Crosstabulation P0
C
0 1 Total P0 =
Count 43 7 50
Expected count 17.0 33.0 50.0 Kappa =
Count 8 92 100
Expected count 34.0 66.0 100.0
Count 51 99 150 A*C
Expected count 51.0 99.0 150.0 P0 Kappa =
Pe

Pe =

P0

P0 =

Kappa =
U

A* REF Crosstabulation

A B C
- 0.86 0.78 A 0 Count
0.86 - 0.79 Expected c
0.78 1 Count
Expected c
Count
Expected c
A*B
P0-Pe
1-Pe B* REF Crosstabulation

= (50/150)*(47/150) + (100/150)*(103/150)
0.562222 B 0 Count
= (44+97)/150 Expected c
0.94 1 Count
0.94 Expected c
Count
0.86 Expected c
C* REF Crosstabulation
B*C
P0-Pe
1-Pe C 0 Count
Expected c
= (47/150)*(51/150) + (100/150)*(99/150) 1 Count
0.559733 Expected c
= (42+94)/150 Count
0.906667 Expected c
0.906667

0.79

A*C
P0-Pe
1-Pe

= (50/150)*(51/150) + (100/150)*(99/150)
0.553333
= (43+92)/150
0.90
0.90

0.78
A* REF Crosstabulation
REF
0 1 Total
45 5 50
16.0 34.0 50.0
3 97 100
32.0 68.0 100.0
48 102 150
48.0 102.0 150.0
A*REF
P0 Kappa = P0-Pe
B* REF Crosstabulation 1-Pe
REF
0 1 Total Pe = = (50/150)*(48/150) + (100/150)*(102/
45 2 47 0.56
15.0 32.0 47.0 P0 = (45+97)/150
3 100 103 0.946667
33.0 70.0 103.0 P0 = 0.946667
48 102 150
48.0 102.0 150.0 Kappa = 0.88
C* REF Crosstabulation
REF B*REF Calculation
0 1 Total P0 Kappa = P0-Pe
42 9 51 Pe 1-Pe
16.3 34.7 51.0
6 93 99 Pe = = (47/150)*(48/150) + (103/150)*(102/
31.7 67.3 99.0 0.5672
48 102 150 P0 = (45+100)/150
48.0 102.0 150.0 0.97
P0 = 0.97

Kappa = 0.92

A*C
P0 Kappa = P0-Pe
A B C Pe 1-Pe
Kappa 0.88 0.92 0.77
Pe = = (51/150)*(48/150) + (102/150)*(99/1
0.5576
P0 = (43+93)/150
0.90
P0 = 0.90

Kappa = 0.77
REF

)*(48/150) + (100/150)*(102/150)
alculation

)*(48/150) + (103/150)*(102/150)

*C

)*(48/150) + (102/150)*(99/150)
KAPPA STUDY - MSA
Part A-1 A-2 A-3 B-1 B-2 B-3 C-1 C-2
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
C-3 Reference Ref value Code B
0 1
0
A
1
0 0

PA0

PB0

P(A0 U B0) 0

150 x (PA0 PB0)

= 0.00

A* B Crosstabulation

0
A 0 Count
Expected c 0.0
1 Count
Expected c 0.0
Count 0
Expected c 0.0

B* C Crosstabulation

0
B 0 Count
Expected c 0.0
1 Count
Expected c 0.0
Count 0
Expected c 0.0

A* C Crosstabulation

0
A 0 Count
Expected c 0.0
1 Count
Expected c 0.0
Count 0
Expected c 0.0
C
0 1
0 0 0
B
0 1 0
150 0 0 150

A
0 1
0 0
C
1 0
0 0 150

A* B Crosstabulation
B
1 Total Kappa A B C
0 A
0.0 0.0 B
0 C
0.0 0.0
0 150
0.0 0.0
A*B
P0 Kappa = P0-Pe
1-Pe

Pe =
B* C Crosstabulation
C P0
1 Total
0 P0 = 0
0.0 0.0
0 Kappa = 0.00
0.0 0.0
0 150
0.0 0.0
B*C
P0 Kappa = P0-Pe
Pe 1-Pe

Pe =

A* C Crosstabulation P0
C
1 Total P0 = 0
0
0.0 0.0 Kappa = 0.00
0
0.0 0.0
0 150 A*C
0.0 0.0 P0 Kappa = P0-Pe
Pe 1-Pe

Pe =

P0

P0 = 0.00

Kappa = 0.00
U

A* REF Crosstabulation
REF
0 1 Total
A 0 Count 0
Expected c 0.0 0.0 0.0
1 Count 0
Expected c 0.0 0.0 0.0
Count 0 0 150
Expected c 0.0 0.0 0.0

B* REF Crosstabulation
REF
0 1 Total
B 0 Count 0
Expected c 0.0 0.0 0.0
1 Count 0
Expected c 0.0 0.0 0.0
Count 0 0 150
Expected c 0.0 0.0 0.0
C* REF Crosstabulation
REF
0 1 Total
C 0 Count 0
Expected c 0.0 0.0 0.0
1 Count 0
Expected c 0.0 0.0 0.0
Count 0 0 150
Expected c 0.0 0.0 0.0

A B
Kappa
A*REF
P0 Kappa = P0-Pe
1-Pe

Pe =

P0

P0 = 0

Kappa = 0.00
B*REF Calculation
P0 Kappa = P0-Pe
Pe 1-Pe

Pe =

P0

P0 = 0.00

Kappa = 0.00

A*C
P0 Kappa = P0-Pe
C Pe 1-Pe

Pe =

P0

P0 = 0.00

Kappa = 0.00

You might also like