Problems in wikipedia-wordlist

[nisargjhaveri]

There seems to be some problem with wikipedia-wordlist. I'm not sure what it is exactly, but looks like all matra are removed from words or it doesn't contain any words with matra.

And it also contains some words with some latin or other characters, and not really proper Gujarati words.

[kartikm]

They were from http://dumps.wikimedia.org/backup-index.html and I guess requires lots of filtering :/