10.10 Estimating Classification Accuracy using GDINA R package

The GDINA package can be used to calculate attribute level and pattern level accuracy using analytic approach.

Code

library(GDINA)
Y <- ecpe$dat
Q <- ecpe$Q
lcdm <- GDINA(Y, Q, model = "GDINA",verbose = 0)
CA(lcdm)

## Classification Accuracy 
## 
## Test level accuracy =  0.7522 
## 
## Pattern level accuracy: 
## 
##    000    100    010    001    110    101    011    111 
## 0.8932 0.0000 0.0000 0.4235 0.3092 0.1831 0.5902 0.9062 
## 
## Attribute level accuracy: 
## 
##     A1     A2     A3 
## 0.8978 0.8560 0.9165

Classification accuracy may not necessarily the best measure. Matthew and Sandip (2018) introduced several other measures that can be directly calculated from the $2\times 2$ table.

It is still unclear how these measures can be used for polytomous attributes.