A 300 MB Turkish corpus and word analysis


Dalkılıç G., Çebi Y.

2nd International Conference on Advances in Information Systems, ADVIS 2002, İzmir, Türkiye, 23 - 25 Ekim 2002, cilt.2457, ss.205-212 identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Cilt numarası: 2457
  • Doi Numarası: 10.1007/3-540-36077-8_20
  • Basıldığı Şehir: İzmir
  • Basıldığı Ülke: Türkiye
  • Sayfa Sayıları: ss.205-212
  • Dokuz Eylül Üniversitesi Adresli: Evet

Özet

© Springer-Verlag Berlin Heidelberg 2002.In order to determine some properties of a language, a corpus of that language should be created. To analyze Turkish language, at first, a Turkish corpus having ~300 MB capacity and more than 44 million words was prepared by using 10 different web sites having Turkish content. Most frequently used word statistics of Turkish were calculated by using this corpus. Frequencies of most frequently used first 7 words were compared with their equivalent in English, and it was found out that most frequently used words are not nouns in natural languages Most frequently used words having 1 to 5 letters were determined and they were applied onto a randomly selected text in order to test the validity of the process.