Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Setswana to English #172

Open
wants to merge 6 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
57 changes: 57 additions & 0 deletions benchmarks/tn-en/jw300-baseline/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,57 @@
# Setswana to English

Author: Tebello Lebesa and Korstiaan Wapenaar

## Data

- The JW300 English-Setswana dataset.

## Model

- Default Masakhane Transformer translation model.
- [Link to google drive folder with models](https://drive.google.com/drive/folders/1bRyTQcUVoi2pK2VcLwWH3NHABqErFzYb?usp=sharing)

## Analysis

TO DO

Example 1
```sh
Source: Mme fa re tlhaloganya se metsi a a tshelang a tla re direlang sone , ga re kitla re bona fela botlhokwa jwa go a nwa mme gape re tla batla go a nwa .
Reference: And when we understand what the living waters can mean for us , not only will we see the need to partake of them but we will also want to drink them .
Hypothesis: But if we understand what the living water will do for us , we will not only see the importance of drinking but also want to drink .
2021-10-10 12:31:06,601 - INFO - joeynmt.training - Example #1
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this line is probably a copy-paste error :)

```

Example 2
```sh
Source: Ke Boela Lovech
Reference: Coming Back to Lovech
Hypothesis: I Find Lovech
```

Example 3
```sh
Source: Mo lekgetlhong lengwe , ditsala dingwe tse di rategang tsa ga moaposetoloi Paulo di ile tsa tsamaya sekgala sa dikilometara tse di ka nnang 50 go tswa kwa Efeso go ya kwa Mileto go ya go kopana le ene .
Reference: On one occasion , dear friends of the apostle Paul traveled about 30 miles [ 50 km ] from Ephesus to Miletus to meet him .
Hypothesis: On one occasion , some dear associates of the apostle Paul traveled a miles of about 50 miles [ 50 km ] from Ephesus to Mileto to meet him .
```

Example 4
```sh
Source: “ Go ne ga isiwa manoko a kola , ga tlhajwa phelehu , ya apewa mme ya jewa ke botlhe ba ba neng ba le teng .
Reference: “ Kola nuts were offered , and a ram was slaughtered , boiled , and eaten by all those present .
Hypothesis: “ The smoke was taken , not the phone , was cooked and was eaten by all the present .
```



# Results

BLEU dev : 35.00
BLEU test : 41.22


## BPE

- [Link to google drive folder with bpes](https://drive.google.com/drive/folders/1qThDEd3jw4fmyfL2CdrKTGslKlN6n3HH?usp=sharing)
Loading