Where A is a class (e.g. definite article), and B is another class (e.g. indefinite article). O is the null class.
The cat had a dog .
A O O B O O
v1
| Real | Predicted | Verdict |
|---|---|---|
| A | A_hat | TP for A |
| A | B_hat | FP for A |
| A | O_hat | FN for A |
| B | A_hat | FP for B |
| B | B_hat | TP for B |
| B | O_hat | FN for B |
| O | A_hat | FP for O |
| O | B_hat | FP for O |
| O | O_hat | IGNORE |
v2
| Real | Predicted | Verdict |
|---|---|---|
| A | A_hat | TP for A |
| A | B_hat | FP for A |
| A | O_hat | FN for A |
| B | A_hat | FP for B |
| B | B_hat | TP for B |
| B | O_hat | FN for B |
| O | A_hat | ERRANT for A |
| O | B_hat | ERRANT for B |
| O | O_hat | IGNORE |
TODO: How to include identity vs. correction?l TODO: How to include ACCEPT vs. REJECT? TODO: What about partially correct spans?