Skip to content

Instantly share code, notes, and snippets.

@tokestermw

tokestermw/ner_metrics.md

Last active September 15, 2018 19:15
Show Gist options
  • Save tokestermw/ffba2c56383078d62cda1e62a88bd6ce to your computer and use it in GitHub Desktop.
Save tokestermw/ffba2c56383078d62cda1e62a88bd6ce to your computer and use it in GitHub Desktop.
Download ZIP

Revisions

  1. tokestermw revised this gist Sep 15, 2018. 1 changed file with 3 additions and 3 deletions.
    6 changes: 3 additions & 3 deletions ner_metrics.md
    View file
    Original file line number Diff line number Diff line change
    @@ -33,6 +33,6 @@ v2
    | O | B | ERRANT for B |
    | O | O | IGNORE |

    TODO: How to include identity vs. correction?l
    TODO: How to include ACCEPT vs. REJECT?
    TODO: What about partially correct spans?
    * TODO: How to include identity vs. correction?l
    * TODO: How to include ACCEPT vs. REJECT?
    * TODO: What about partially correct spans?
  2. tokestermw revised this gist Sep 15, 2018. 1 changed file with 18 additions and 18 deletions.
    36 changes: 18 additions & 18 deletions ner_metrics.md
    View file
    Original file line number Diff line number Diff line change
    @@ -9,29 +9,29 @@ v1

    | Real | Predicted | Verdict
    | ----- | ------ | ----- |
    | A | A_hat | TP for A |
    | A | B_hat | FP for A |
    | A | O_hat | FN for A |
    | B | A_hat | FP for B |
    | B | B_hat | TP for B |
    | B | O_hat | FN for B |
    | O | A_hat | FP for O |
    | O | B_hat | FP for O |
    | O | O_hat | IGNORE |
    | A | A | TP for A |
    | A | B | FP for A |
    | A | O | FN for A |
    | B | A | FP for B |
    | B | B | TP for B |
    | B | O | FN for B |
    | O | A | FP for O |
    | O | B | FP for O |
    | O | O | IGNORE |

    v2

    | Real | Predicted | Verdict
    | ----- | ------ | ----- |
    | A | A_hat | TP for A |
    | A | B_hat | FP for A |
    | A | O_hat | FN for A |
    | B | A_hat | FP for B |
    | B | B_hat | TP for B |
    | B | O_hat | FN for B |
    | O | A_hat | ERRANT for A |
    | O | B_hat | ERRANT for B |
    | O | O_hat | IGNORE |
    | A | A | TP for A |
    | A | B | FP for A |
    | A | O | FN for A |
    | B | A | FP for B |
    | B | B | TP for B |
    | B | O | FN for B |
    | O | A | ERRANT for A |
    | O | B | ERRANT for B |
    | O | O | IGNORE |

    TODO: How to include identity vs. correction?l
    TODO: How to include ACCEPT vs. REJECT?
  3. tokestermw revised this gist Sep 15, 2018. 1 changed file with 5 additions and 3 deletions.
    8 changes: 5 additions & 3 deletions ner_metrics.md
    View file
    Original file line number Diff line number Diff line change
    @@ -1,7 +1,9 @@
    Where `A` is a class (e.g. definite article), and `B` is another class (e.g. indefinite article). `O` is the null class where no prediction is made.
    Where `A` is a class (e.g. definite article), and `B` is another class (e.g. indefinite article). `O` is the null class.

    I have a dog .
    O O B O O
    ```
    The cat had a dog .
    A O O B O O
    ```

    v1

  4. tokestermw revised this gist Sep 15, 2018. 1 changed file with 4 additions and 1 deletion.
    5 changes: 4 additions & 1 deletion ner_metrics.md
    View file
    Original file line number Diff line number Diff line change
    @@ -1,4 +1,7 @@
    Where `A` is a class (e.g. definite article), and `B` is another class (e.g. indefinite article). `O` is the null class where there is no class.
    Where `A` is a class (e.g. definite article), and `B` is another class (e.g. indefinite article). `O` is the null class where no prediction is made.

    I have a dog .
    O O B O O

    v1

  5. tokestermw revised this gist Sep 15, 2018. 1 changed file with 20 additions and 0 deletions.
    20 changes: 20 additions & 0 deletions ner_metrics.md
    View file
    Original file line number Diff line number Diff line change
    @@ -1,3 +1,5 @@
    Where `A` is a class (e.g. definite article), and `B` is another class (e.g. indefinite article). `O` is the null class where there is no class.

    v1

    | Real | Predicted | Verdict
    @@ -11,3 +13,21 @@ v1
    | O | A_hat | FP for O |
    | O | B_hat | FP for O |
    | O | O_hat | IGNORE |

    v2

    | Real | Predicted | Verdict
    | ----- | ------ | ----- |
    | A | A_hat | TP for A |
    | A | B_hat | FP for A |
    | A | O_hat | FN for A |
    | B | A_hat | FP for B |
    | B | B_hat | TP for B |
    | B | O_hat | FN for B |
    | O | A_hat | ERRANT for A |
    | O | B_hat | ERRANT for B |
    | O | O_hat | IGNORE |

    TODO: How to include identity vs. correction?l
    TODO: How to include ACCEPT vs. REJECT?
    TODO: What about partially correct spans?
  6. tokestermw revised this gist Sep 15, 2018. 1 changed file with 7 additions and 2 deletions.
    9 changes: 7 additions & 2 deletions ner_metrics.md
    View file
    Original file line number Diff line number Diff line change
    @@ -1,8 +1,13 @@
    v1

    | Real | Predicted | Verdict
    | ----- | ------ | ----- |
    | A | A_hat | TP for A |
    | A | B_hat | FP for A |
    | A | O_hat | FN for A |
    | O | A_hat | FP for O |
    | B | A_hat | FP for B |
    | O | O_hat | IGNORE |
    | B | B_hat | TP for B |
    | B | O_hat | FN for B |
    | O | A_hat | FP for O |
    | O | B_hat | FP for O |
    | O | O_hat | IGNORE |
  7. tokestermw created this gist Aug 9, 2018.
    8 changes: 8 additions & 0 deletions ner_metrics.md
    View file
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,8 @@
    | Real | Predicted | Verdict
    | ----- | ------ | ----- |
    | A | A_hat | TP for A |
    | A | B_hat | FP for A |
    | A | O_hat | FN for A |
    | O | A_hat | FP for O |
    | B | A_hat | FP for B |
    | O | O_hat | IGNORE |