Skip to content

Commit

Permalink
dealing with markdown mood
Browse files Browse the repository at this point in the history
  • Loading branch information
@kermitt2
kermitt2 committed Mar 20, 2021
1 parent 34fe823 commit 05a8649
Show file tree
Hide file tree
Showing 4 changed files with 22 additions and 2 deletions.
10 changes: 10 additions & 0 deletions doc/Benchmarking-biorxiv.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,7 @@ Evaluation on 1998 random PDF files out of 1998 PDF (ratio 1.0).
#### Strict Matching (exact matches)

**Field-level results**

| label | precision | recall | f1 | support |
|--- |--- |--- |--- |--- |
| abstract | 2.19 | 2.06 | 2.12 | 1988 |
Expand All @@ -37,6 +38,7 @@ Evaluation on 1998 random PDF files out of 1998 PDF (ratio 1.0).
#### Soft Matching (ignoring punctuation, case and space characters mismatches)

**Field-level results**

| label | precision | recall | f1 | support |
|--- |--- |--- |--- |--- |
| abstract | 55.12 | 51.96 | 53.5 | 1988 |
Expand All @@ -53,6 +55,7 @@ Evaluation on 1998 random PDF files out of 1998 PDF (ratio 1.0).
#### Levenshtein Matching (Minimum Levenshtein distance at 0.8)

**Field-level results**

| label | precision | recall | f1 | support |
|--- |--- |--- |--- |--- |
| abstract | 73.91 | 69.67 | 71.72 | 1988 |
Expand All @@ -69,6 +72,7 @@ Evaluation on 1998 random PDF files out of 1998 PDF (ratio 1.0).
#### Ratcliff/Obershelp Matching (Minimum Ratcliff/Obershelp similarity at 0.95)

**Field-level results**

| label | precision | recall | f1 | support |
|--- |--- |--- |--- |--- |
| abstract | 70.7 | 66.65 | 68.62 | 1988 |
Expand Down Expand Up @@ -104,6 +108,7 @@ Evaluation on 1998 random PDF files out of 1998 PDF (ratio 1.0).
#### Strict Matching (exact matches)

**Field-level results**

| label | precision | recall | f1 | support |
|--- |--- |--- |--- |--- |
| authors | 86.86 | 70.58 | 77.88 | 97092 |
Expand All @@ -126,6 +131,7 @@ Evaluation on 1998 random PDF files out of 1998 PDF (ratio 1.0).
#### Soft Matching (ignoring punctuation, case and space characters mismatches)

**Field-level results**

| label | precision | recall | f1 | support |
|--- |--- |--- |--- |--- |
| authors | 88.12 | 71.61 | 79.01 | 97092 |
Expand All @@ -148,6 +154,7 @@ Evaluation on 1998 random PDF files out of 1998 PDF (ratio 1.0).
#### Levenshtein Matching (Minimum Levenshtein distance at 0.8)

**Field-level results**

| label | precision | recall | f1 | support |
|--- |--- |--- |--- |--- |
| authors | 92.75 | 75.36 | 83.16 | 97092 |
Expand All @@ -170,6 +177,7 @@ Evaluation on 1998 random PDF files out of 1998 PDF (ratio 1.0).
#### Ratcliff/Obershelp Matching (Minimum Ratcliff/Obershelp similarity at 0.95)

**Field-level results**

| label | precision | recall | f1 | support |
|--- |--- |--- |--- |--- |
| authors | 89.91 | 73.06 | 80.61 | 97092 |
Expand Down Expand Up @@ -253,6 +261,7 @@ Evaluation on 1998 random PDF files out of 1998 PDF (ratio 1.0).
#### Strict Matching (exact matches)

**Field-level results**

| label | precision | recall | f1 | support |
|--- |--- |--- |--- |--- |
| figure_title | 3.29 | 2.73 | 2.99 | 13147 |
Expand All @@ -270,6 +279,7 @@ Evaluation on 1998 random PDF files out of 1998 PDF (ratio 1.0).
#### Soft Matching (ignoring punctuation, case and space characters mismatches)

**Field-level results**

| label | precision | recall | f1 | support |
|--- |--- |--- |--- |--- |
| figure_title | 64.44 | 53.45 | 58.43 | 13147 |
Expand Down
10 changes: 10 additions & 0 deletions doc/Benchmarking-pmc.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,7 @@ Evaluation on 1943 random PDF files out of 1941 PDF (ratio 1.0).
#### Strict Matching (exact matches)

**Field-level results**

| label | precision | recall | f1 | support |
|--- |--- |--- |--- |--- |
| abstract | 15.85 | 15.59 | 15.72 | 1911 |
Expand All @@ -35,6 +36,7 @@ Evaluation on 1943 random PDF files out of 1941 PDF (ratio 1.0).
#### Soft Matching (ignoring punctuation, case and space characters mismatches)

**Field-level results**

| label | precision | recall | f1 | support |
|--- |--- |--- |--- |--- |
| abstract | 59.2 | 58.24 | 58.72 | 1911 |
Expand All @@ -51,6 +53,7 @@ Evaluation on 1943 random PDF files out of 1941 PDF (ratio 1.0).
#### Levenshtein Matching (Minimum Levenshtein distance at 0.8)

**Field-level results**

| label | precision | recall | f1 | support |
|--- |--- |--- |--- |--- |
| abstract | 86.81 | 85.4 | 86.1 | 1911 |
Expand All @@ -67,6 +70,7 @@ Evaluation on 1943 random PDF files out of 1941 PDF (ratio 1.0).
#### Ratcliff/Obershelp Matching (Minimum Ratcliff/Obershelp similarity at 0.95)

**Field-level results**

| label | precision | recall | f1 | support |
|--- |--- |--- |--- |--- |
| abstract | 82.23 | 80.9 | 81.56 | 1911 |
Expand Down Expand Up @@ -102,6 +106,7 @@ Evaluation on 1943 random PDF files out of 1941 PDF (ratio 1.0).
#### Strict Matching (exact matches)

**Field-level results**

| label | precision | recall | f1 | support |
|--- |--- |--- |--- |--- |
| authors | 84.49 | 74.79 | 79.35 | 85778 |
Expand All @@ -121,6 +126,7 @@ Evaluation on 1943 random PDF files out of 1941 PDF (ratio 1.0).
#### Soft Matching (ignoring punctuation, case and space characters mismatches)

**Field-level results**

| label | precision | recall | f1 | support |
|--- |--- |--- |--- |--- |
| authors | 85.18 | 75.41 | 80 | 85778 |
Expand All @@ -140,6 +146,7 @@ Evaluation on 1943 random PDF files out of 1941 PDF (ratio 1.0).
#### Levenshtein Matching (Minimum Levenshtein distance at 0.8)

**Field-level results**

| label | precision | recall | f1 | support |
|--- |--- |--- |--- |--- |
| authors | 89.89 | 79.57 | 84.42 | 85778 |
Expand All @@ -159,6 +166,7 @@ Evaluation on 1943 random PDF files out of 1941 PDF (ratio 1.0).
#### Ratcliff/Obershelp Matching (Minimum Ratcliff/Obershelp similarity at 0.95)

**Field-level results**

| label | precision | recall | f1 | support |
|--- |--- |--- |--- |--- |
| authors | 87.3 | 77.28 | 81.99 | 85778 |
Expand Down Expand Up @@ -239,6 +247,7 @@ Evaluation on 1943 random PDF files out of 1941 PDF (ratio 1.0).
#### Strict Matching (exact matches)

**Field-level results**

| label | precision | recall | f1 | support |
|--- |--- |--- |--- |--- |
| figure_title | 27.92 | 21.75 | 24.45 | 7058 |
Expand All @@ -256,6 +265,7 @@ Evaluation on 1943 random PDF files out of 1941 PDF (ratio 1.0).
#### Soft Matching (ignoring punctuation, case and space characters mismatches)

**Field-level results**

| label | precision | recall | f1 | support |
|--- |--- |--- |--- |--- |
| figure_title | 73.19 | 57 | 64.09 | 7058 |
Expand Down
2 changes: 1 addition & 1 deletion doc/index.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -39,7 +39,7 @@

* [Description](Benchmarking.md)
* [Evaluation PubMed Central](Benchmarking-pmc.md)
* [Evaluation bioRxiv](Benchmarking-bioRxiv.md)
* [Evaluation bioRxiv](Benchmarking-biorxiv.md)

<h3>Annotation guidelines</h3>

Expand Down
2 changes: 1 addition & 1 deletion grobid-trainer/src/main/java/org/grobid/trainer/evaluation/Stats.java
View file
Original file line number Diff line number Diff line change
Expand Up @@ -352,7 +352,7 @@ public String getMarkDownReport() {
computeMetrics();

StringBuilder report = new StringBuilder();
report.append("| label | precision | recall | f1 | support |\n");
report.append("\n| label | precision | recall | f1 | support |\n");
report.append("|--- |--- |--- |--- |--- |\n");

long supportSum = 0;
Expand Down

0 comments on commit 05a8649

Please sign in to comment.