Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Submission of NLP Lab (Wits MSc NLP) - tn-en #176

Open
wants to merge 4 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2,932 changes: 2,932 additions & 0 deletions KorstiaanW_tn_en_Baseline.ipynb

Large diffs are not rendered by default.

Large diffs are not rendered by default.

Large diffs are not rendered by default.

39 changes: 39 additions & 0 deletions benchmarks/tn-en/KorstiaanW-baseline/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,39 @@
# Setswana to English

Author: Korstiaan Wapenaar

## Data

- The KorstiaanW Setswana - English.

## Model

- Default Masakhane Transformer translation model.
- The model https://drive.google.com/drive/folders/1--CUjOxH8uHnldxEFfsxbKp3WglAYFPI?usp=sharing

## Analysis

Example #0
Source: Mme fa re tlhaloganya se metsi a a tshelang a tla re direlang sone , ga re kitla re bona fela botlhokwa jwa go a nwa mme gape re tla batla go a nwa .
Reference: And when we understand what the living waters can mean for us , not only will we see the need to partake of them but we will also want to drink them .
Hypothesis: But if we understand what the water will do , we will not see the value of drinking but also want to drink .

Example #1
Source: Ke Boela Lovech
Reference: Coming Back to Lovech
Hypothesis: I Find Lovech

Example #2
Source: Mo lekgetlhong lengwe , ditsala dingwe tse di rategang tsa ga moaposetoloi Paulo di ile tsa tsamaya sekgala sa dikilometara tse di ka nnang 50 go tswa kwa Efeso go ya kwa Mileto go ya go kopana le ene .
Reference: On one occasion , dear friends of the apostle Paul traveled about 30 miles [ 50 km ] from Ephesus to Miletus to meet him .
Hypothesis: On one occasion , some dear friends of the apostle Paul have traveled about 50 miles [ 50 km ] from Ephesus to Mileto meet him .

Example #3
Source: “ Go ne ga isiwa manoko a kola , ga tlhajwa phelehu , ya apewa mme ya jewa ke botlhe ba ba neng ba le teng .
Reference: “ Kola nuts were offered , and a ram was slaughtered , boiled , and eaten by all those present .
Hypothesis: “ The seasons were made , the shortage of the clouds , and the cooking of all the attendants .


# Results
- BLEU dev : 31.46
- BLEU test : 37.96
Loading