Domain labels (number of observationsa) | Number of residents | Occurrence (CI)b | Non-occurrence (CI)b | Cohen’s Kappa (CI)b | ICC Single (CI)b |
---|---|---|---|---|---|
Physiological: basic, 47 interventions | Â | Â | Â | Â | Â |
 Observers 3 & 4 (47*11 = 517) | 11 | 0.97 (0.96–0.98) | 0.97 (0.95–0.98) | 0.78 (0.67–0.89) | 0.64 (0.14–0.89) |
 Observers 2 & 4 (470) | 10 | 0.99 (0.98–1.00) | 0.99 (0.97–1.00) | 0.92 (0.84–0.99) | 0.94 (0.54–0.99) |
 Observers 3 & 1 (517) | 11 | 0.96 (0.94–0.97) | 0.96 (0.93–0.97) | 0.67 (0.54–0.81) | 0.97 (0.88–0.99) |
 Observers 1 & 2 (846) | 18 | 0.99 (0.99–1.00) | 0.99 (0.98–1.00) | 0.83 (0.69–0.97) | 0.87 (0.69–0.95) |
 Observers 1 & 2 (658) | 14 | 0.98 (0.97–0.99) | 0.98 (0.96–0.99) | 0.79 (0.69–0.90) | 0.95 (0.83–0.99) |
 Observers 3 & 4 (987) | 21 | 0.99 (0.98–1.00) | 0.99 (0.98–1.00) | 0.82 (0.70–0.94) | 0.99 (0.99–1.00) |
 Observers 3 & 4 (1081) | 23 | 0.99 (0.99–1.00) | 0.99 (0.99–1.00) | 0.76 (0.60–0.93) | 0.82 (0.63–0.92) |
Physiological: complex, 20 interventions | Â | Â | Â | Â | Â |
 Observers 3 & 4 (20*11 = 220) | 11 | 0.99 (0.97–1.00) | 0.99 (0.97–1.00) | 0.90 (0.77–1.00) | 0.81 (0.33–0.95) |
 Observers 2 & 4 (200) | 10 | 0.99 (0.97–1.00) | 0.99 (0.97–1.00) | 0.94 (0.82–1.00) | 0.67 (0.16–0.91) |
 Observers 3 & 1 (220) | 11 | 0.98 (0.95–0.99) | 0.98 (0.95–0.99) | 0.70 (0.42–0.99) | 0.58 (0.05–0.87) |
 Observers 1 & 2 (360) | 18 | 0.98 (0.97–0.99) | 0.98 (0.97–0.99) | 0.81 (0.64–0.98) | 0.48 (0.07–0.76) |
 Observers 1 & 2 (280) | 14 | 0.98 (0.96–0.99) | 0.98 (0.96–0.99) | 0.70 (0.43–0.96) | 0.93 (0.81–0.98) |
 Observers 3 & 4 (420) | 21 | 0.99 (0.98–1.00) | 0.99 (0.98–1.00) | 0.88 (0.74–1.00) | 0.59 (0.23–0.81) |
 Observers 3 & 4 (460) | 23 | 0.99 (0.98–1.00) | 0.99 (0.98–1.00) | 0.89 (0.77–1.00) | 0.72 (0.44–0.87) |
Behavioral, 28 interventions | Â | Â | Â | Â | Â |
 Observers 3 & 4 (28*11 = 308) | 11 | 0.99 (0.98–1.00) | 0.99 (0.98–1.00) | 0.50 (0.00–1.00) | 0.99 (0.95–1.00) |
 Observers 2 & 4 (280) | 10 | 0.99 (0.97–1.00) | 0.99 (0.97–1.00) | 0.40 (0.00–1.00) | 0.47 (−0.09–0.83) |
 Observers 3 & 1 (308) | 11 | 1.00 (0.98–1.00) | 1.00 (0.98–1.00) | 0.86 (0.57–1.00) | 0.43 (−0.25–0.81) |
 Observers 1 & 2 (504) | 18 | 0.99 (0.98–1.00) | 0.99 (0.98–1.00) | 0.78 (0.58–0.97) | 0.89 (0.73–0.96) |
 Observers 1 & 2 (392) | 14 | 0.99 (0.97–1.00) | 0.99 (0.97–1.00) | 0.75 (0.50–0.99) | 0.93 (0.80–0.98) |
 Observers 3 & 4 (588) | 21 | 1.00 (0.99–1.00) | 1.00 (0.99–1.00) | 0.75 (0.40–1.00) | 0.21 (−0.22–0.58) |
 Observers 3 & 4 (644) | 23 | 1.00 (0.99–1.00) | 1.00 (0.99–1.00) | 1.00 (1.00) | 0.00 (−0.40–0.40) |
Safety, 6 interventions | Â | Â | Â | Â | Â |
 Observers 3 & 4 (6*11 = 66) | 11 | 0.98 (0.92–1.00) | 0.98 (0.92–1.00) | 0.66 (0.00–1.00) | 0.29 (−0.33–0.74) |
 Observers 2 & 4 (60) | 10 | 1.00 (0.94–1.00) | 1.00 (0.94–1.00) | —c | 0.00 (−0.60–0.60) |
 Observers 3 & 1 (66) | 11 | 1.00 (0.95–1.00) | 1.00 (0.95–1.00) | — | — |
 Observers 1 & 2 (108) | 18 | 1.00 (0.97–1.00) | 1.00 (0.97–1.00) | — | — |
 Observers 1 & 2 (84) | 14 | 0.99 (0.94–1.00) | 0.99 (0.94–1.00) | 0.00 (0.00–1.00) | — |
 Observers 3 & 4 (126) | 21 | 1.00 (0.97–1.00) | 1.00 (0.97–1.00) | — | — |
 Observers 3 & 4 (138) | 23 | 0.99 (0.96–1.00) | 0.99 (0.96–1.00) | 0.00 (0.00–1.00) | 0.00 (−0.40–0.40) |
Family, 1 intervention | Â | Â | Â | Â | Â |
 Observers 3 & 4 (1*11 = 11) | 11 | 0.91 (0.62–0.98) | 0.83 (0.44–0.97) | 0.82 (0.48–1.00) | 0.43 (−0.14–0.80) |
 Observers 2 & 4 (10) | 10 | 0.70 (0.40–0.89) | 0.40 (0.12–0.77) | 0.40 (0.00–0.97) | 0.41 (−0.13–0.80) |
 Observers 3 & 1 (11) | 11 | 0.82 (0.52–0.95) | 0.67 (0.30–0.90) | 0.65 (0.20–1.00) | 0.80 (0.38–0.94) |
 Observers 1 & 2 (18) | 18 | 1.00 (0.82–1.00) | 1.00 (0.77–1.00) | 1.00 (1.00) | 0.99 (0.97–1.00) |
 Observers 1 & 2 (14) | 14 | 0.93 (0.69–0.99) | 0.80 (0.38–0.96) | 0.84 (0.53–1.00) | 0.94 (0.82–0.98) |
 Observers 3 & 4 (21) | 21 | 1.00 (0.85–1.00) | 1.00 (0.74–1.00) | 1.00 (1.00) | 0.24 (−0.18–0.60) |
 Observers 3 & 4 (23) | 23 | 0.87 (0.68–0.96) | 0.84 (0.62–0.95) | 0.64 (0.27–1.00) | 1.00 (−) |
Health System, 14 interventions | Â | Â | Â | Â | Â |
 Observers 3 & 4 (14*11 = 154) | 11 | 0.99 (0.95–1.00) | 0.99 (0.95–1.00) | 0.66 (0.19–1.00) | 0.38 (−0.20–0.78) |
 Observers 2 & 4 (140) | 10 | 0.94 (0.89–0.97) | 0.94 (0.89–0.97) | 0.30 (0.00–0.77) | 0.96 (0.85–0.99) |
 Observers 3 & 1 (154) | 11 | 0.94 (0.89–0.97) | 0.94 (0.89–0.97) | 0.65 (0.20–1.00) | 0.12 (−0.48–0.65) |
 Observers 1 & 2 (252) | 18 | 0.99 (0.97–1.00) | 0.99 (0.97–1.00) | 0.57 (0.08–1.00) | 0.03 (−0.38–0.46) |
 Observers 1 & 2 (196) | 14 | 0.93 (0.89–0.96) | 0.93 (0.88–0.96) | 0.63 (0.44–0.82) | 0.84 (0.57–0.95) |
 Observers 3 & 4 (294) | 21 | 0.99 (0.97–1.00) | 0.99 (0.97–1.00) | 0.40 (0.00–1.00) | 0.73 (0.44–0.88) |
 Observers 3 & 4 (322) | 23 | 0.97 (0.94–0.98) | 0.96 (0.94–0.98) | 0.76 (0.62–0.90) | 0.64 (0.33–0.83) |