A 300 MB Turkish corpus and word analysis

Dalkılıç G., Çebi Y.

ADVANCES IN INFORMATION SYSTEMS, cilt.2457, ss.205-212, 2002 (SCI-Expanded) identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 2457
  • Basım Tarihi: 2002
  • Dergi Adı: ADVANCES IN INFORMATION SYSTEMS
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED)
  • Sayfa Sayıları: ss.205-212
  • Dokuz Eylül Üniversitesi Adresli: Evet

Özet

In order to determine some properties of a language, a corpus of that language should be created. To analyze Turkish language, at first, a Turkish corpus having similar to300 MB capacity and more than 44 million words was prepared by using 10 different web sites having Turkish content. Most frequently used word statistics of Turkish were calculated by using this corpus. Frequencies of most frequently used first 7 words were compared with their equivalent in English, and it was found out that most frequently used words are not nouns in natural languages Most frequently used words having 1 to 5 letters were determined and they were applied onto a randomly selected text in order to test the validity of the process.