-
Notifications
You must be signed in to change notification settings - Fork 0
FAQ
AI is a confusing term, at least for me, so I use the terms neural networks or machine learning instead.
When using machine learning, we need huge amount of data set, like a lot. There isn't much data set in Toki Pona because the language is young. Otherwise, the translation would be very inaccurate. There are already existing machine learning translator nonetheless.
The translator is rule-based: Meaning before translating, it recognizes the patterns and construction of the Toki Pona text through traditional programming instead of neural networks. This is a lot of effort but it's doable due to the relatively simple rules of Toki Pona.
If we instead start at English and translate it into Toki Pona, now we're dealing with the rules of English, which is very huge and inconsistent.
I personally think instead of rule-based approach, using neural networks would be preferable for English (or any language) to Toki Pona. That is, if there's enough data set available. Otherwise, the translation would be inaccurate. There are already existing machine learning translator nonetheless.
The translator is limited to translating at most 2 sentences. There are two reasons:
- The translator considers many ways the original Toki Pona text could be interpreted and outputs multiple results. If it accepts multiple sentences, the output would grow exponentially as there are many sentences.
- When the original Toki Pona text spans multiple sentences, it's important to take note of context, which the translator cannot do.
You can still give it complicated sentences like giving the word so many modifiers or give the sentence so many predicates. It may however give up if you give it complicated enough texts.