MITADS - Transcript roman numbers

[Mte90]

We have the issue that the text corpus include roman numbers but we need to convert those as usual numbers but also to spot fake positives and so on.

We need a way to detect roman numbers and not other text that include that letters.

[ilyasmg]

I see that there's a roman_numbers.py script. What's the problem? It's not accurate enough?

[Mte90]

It isn't perfect we had various fake positive with that.

[eziolotta]

Which importers do you have more sentences with Roman numbers?
About Ted Importer there is an issue refer roman number.
In function maybe_normalize (ted_importer.py) parameter roman_normalization is False
so function do_roman_normalization is not performed ( see utils.roman_numbers)

[Mte90]

We removed in ted that normalization because had a lot of fake positives