`Axborot texnologiyalaridan foydalanishni yangi bosqichga ko`tarishning ilmiy asoslari va avtomatlashtirishning zamonaviy muammolari` mavzusida IV Xalqaro ilmiy anjuman

MODERN DIRECTIONS IN DEEP LEARNING MODELS FOR THE UZBEK LANGUAGE

Mualliflar

Raximov N.O., Pirimqulov O.D. , Erkinova D.A.


Annotatsiya
The present study analyses the performance of Deep Learning methods when working with the Uzbek language. The agglutinative makeup of Uzbek along with its complex morphological characteristics and scarcity of large textual data present multiple obstacles for natural language processing research. Due to these factors the research examines modern deep learning architectures and their applicability to text understanding together with machine translation along with text-to-speech (TTS) generation through the study of Transformer and LSTM and BERT. The study demonstrates both the necessity of creating specialized Uzbek-oriented language processing models which perform successfully in educational contexts and public services as well as diverse artificial intelligence settings.
Kalit soʻzlar:
Deep Learning, Artificial Intelligence (AI), Natural Language Processing (NLP), Transformer, BERT, LSTM, Speech Technologies (ASR, TTS).

Adabiyotlar roʻyxati
1. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., ... & Polosukhin, I. (2017). Attention Is All You Need. Advances in Neural Information Processing Systems, 30, 5998–6008.
2. Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2018). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv preprint arXiv:1810.04805.
3. Hochreiter, S., & Schmidhuber, J. (1997). Long Short-Term Memory. Neural Computation, 9(8), 1735–1780.
4. Graves, A., Mohamed, A., & Hinton, G. (2013). Speech Recognition with Deep Recurrent Neural Networks. 2013 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 6645–6649.
5. Ren, Y., Ruan, Y., Tan, X., Qin, T., Zhao, S., & Liu, T. (2019). FastSpeech: Fast, Robust, and Controllable Text to Speech. arXiv preprint arXiv:1905.09263.
6. Oord, A. v. d., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., ... & Kavukcuoglu, K. (2016). WaveNet: A Generative Model for Raw Audio. arXiv preprint arXiv:1609.03499.
7. Gulati, A., Qin, J., Chiu, C. C., Parmar, N., Zhang, Y., Yu, J., ... & Wu, Y. (2020). Conformer: Convolution-augmented Transformer for Speech Recognition. Interspeech 2020, 5036–5040.
8. Baevski, A., Zhou, H., Mohamed, A., & Auli, M. (2020). wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations. Advances in Neural Information Processing Systems, 33, 12449–12460.
9. Kim, J., Kim, J., & Kim, H. (2021). Glow-TTS: A Generative Flow for Text-to-Speech via Monotonic Alignment. arXiv preprint arXiv:2103.01245.
10. Local Uzbek NLP Research Publications (2021–2024). Challenges and Applications of Deep Learning for the Uzbek Language.