O'ZBEK TILIDAGI MATNLARNI AVTOMATIK TAHLIL QILISHDA ZAMONAVIY TRANSFORMER MODELLARI IMKONIYATLARI

Authors

  • Buriyeva Madina Aliyorovna Webster universiteti MA Tesol Magistratura talabasi
  • Mamatkulova Saidaxon Shukurjonovna O’zbekiston Jahon tillari universiteti Dotsent, filalogiya fanlari doktori

Keywords:

O'zbek tili, tabiiy tilni qayta ishlash (NLP), Transformer arxitekturasi, Self-Attention, UzbekBERT, mBERT, XLM-R, matnni avtomatik tahlil qilish, chuqur o'rganish.

Abstract

Mazkur maqolada tabiiy tilni qayta ishlash (NLP) sohasida tub burilish yasagan zamonaviy Transformer arxitekturasi va uning o'zbek tilidagi matnlarni avtomatik tahlil qilishdagi o'rni hamda imkoniyatlari atroflicha o'rganilgan. O'zbek tilining aglutinativ tabiati, boy so'z yasalish tizimi va sintaktik xususiyatlarini hisobga olgan holda mBERT, XLM-R va maxsus o'zbekcha pre-trained qilingan Uzbek-BERT modellarining ishlash prinsiplari tahlil qilingan. Matnlarni klassifikatsiya qilish, nomzod obyektlarni aniqlash (NER), mashinaviy tarjima va semantik tahlil vazifalarida Transformer modellarining afzalliklari eksperimental misollar va qiyosiy ko'rsatkichlar asosida yoritib berilgan.

References

Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., & Polosukhin, I.

(2017). Attention is all you need. Advances in Neural Information Processing Systems, 30, 5000-5010.

Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2018). BERT: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805.

Conneau, A., Khandelwal, K., Goyal, N., Chaudhary, V., Wenzek, G., Guzmán, F., Grave, E., Ott, M., Zettlemoyer, L., & Stoyanov, V. (2019). Unsupervised cross-lingual representation learning at scale. arXiv preprint arXiv:1911.02116.

Mikolov, T., Sutskever, I., Chen, K., Corrado, G. S., & Dean, J. (2013). Distributed representations of words and phrases and their compositionality. Advances in Neural Information Processing Systems, 26, 3111-3119.

Юсупов, Б. Р., & Рахимов, Ш. У. (2022). Ўзбек тилидаги матнларни табиий тилни айта ишлаш (NLP) усуллари ёрдамида талил илиш муаммолари. Ахборот технологиялари ва телекоммуникациялар муаммолари, 4(2), 45-52.

Karimova, M. A. (2023). Sentiment analysis in Turkic languages: Challenges and solutions for the Uzbek language. Journal of Intelligent Systems and Data Science, 11(1), 18-29.

Bojanowski, P., Grave, E., Joulin, A., & Mikolov, T. (2017). Enriching word vectors with subword information.

Transactions of the Association for Computational Linguistics, 5, 135-146.

Gensig, R., & O'Brien, S. (2021). Deep Learning for Natural Language Processing: Text Classification and Sentiment Analysis. Springer Nature, 312 p.

Downloads

Published

2026-09-10