Article Sidebar

Download
PDF
Statistic
Read Counter : 191 Download : 139

Main Article Content

Abstract

ChatGPT, a multilingual translation application has made intercultural conversation simpler including local language. However, ChatGPT's translation accuracy should be reviewed due to limits in recognizing domain-specific terms and cultural context. The aim of this study is to find out the translation accuracy of ChatGPT in translating colloquial terms in Dawan language. This study used qualitative method. The participants of this study were from the sixth semester English department students of University of Timor. The data source of this study was the translation result in Dawan into Indonesian language. While, the data of this study are ChatGPT’s translation result obtained from students’ word list from Dawan into Indonesian language. The result of the analysis showed showed that ChatGPT performs relatively well in translating basic vocabulary and common expressions, with 60% of the translations deemed accurate. However, the tool demonstrated significant limitations in handling culturally embedded and context-dependent terms.

Keywords

Chat GPT Dawan Language Language Translation Translation Accuracy

Article Details

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

In submitting the manuscript to the FOSTER: Journal of English Language Teaching, the authors certify that:

  • They are authorized by their co-authors to enter into these arrangements.
  • The work described has not been formally published before, except in the form of an abstract or as part of a published lecture, review, thesis, or overlay journal.
  • That it is not under consideration for publication elsewhere,
  • The publication has been approved by the author(s) and by responsible authorities – tacitly or explicitly – of the institutes where the work has been carried out.
  • They secure the right to reproduce any material that has already been published or copyrighted elsewhere.
  • They agree to the following license and copyright agreement.

License and Copyright Agreement

Authors who publish with FOSTER: Journal of English Language Teaching agree to the following terms:

  1. Authors retain copyright and grant the FOSTER: Journal of English Language Teaching right of first publication with the work simultaneously licensed under Creative Commons Attribution License (CC BY 4.0) that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
  2. Authors can enter into separate, additional contractual arrangements for the non-exclusive distribution of the FOSTER: Journal of English Language Teaching published version of the work (e.g., post it to an institutional repository or edit it in a book), with an acknowledgement of its initial publication in this journal.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) before and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
How to Cite
Aprianti, I., Rahayu, Y., Dinamika, S. G., & Nasution, M. M. (2025). The Accuracy of ChatGPT in Translating Colloquial Terms in Dawan Language. FOSTER: Journal of English Language Teaching, 6(2), 94-102. https://doi.org/10.24256/foster-jelt.v6i2.251
Crossref
Scopus
Google Scholar
Europe PMC

References

  1. Aeni, R., Putera, L. J., & Melani, B. Z. (2024). The accuracy of ChatGPT in translating linguistics text in scientific journals. Didaktik: Jurnal Ilmiah PGSD STKIP Subang, 10(1), 59–68.
  2. Al-Salman, S., & Haider, A. S. (2024). Assessing the accuracy of MT and AI tools in translating humanities or social sciences Arabic research titles into English: Evidence from Google Translate, Gemini, and ChatGPT. International Journal of Data and Network Science. https://api.semanticscholar.org/CorpusID:271237784
  3. Anastasopoulos, A., & Neubig, G. (2019). Pushing the limits of low-resource morphological inflection. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 980–986.
  4. Bahdanau, D., Cho, K., & Bengio, Y. (2015). Neural machine translation by jointly learning to align and translate. International Conference on Learning Representations (ICLR).
  5. Bird, S. (2020). Decolonising speech and language technology. Proceedings of the 28th International Conference on Computational Linguistics (COLING 2020), 3504–3519.
  6. Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J. D., Dhariwal, P., ... & Amodei, D. (2020). Language models are few-shot learners. Advances in Neural Information Processing Systems, 33, 1877–1901.
  7. Ebrahimi, J., Rao, A., Lowd, D., & Dou, D. (2018). HotFlip: White-box adversarial examples for text classification. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 31–36.
  8. Faten, S. (2021). Challenges in translating indigenous languages: A cultural perspective. Journal of Translation Studies, 18(2), 122–134.
  9. Garciarena, U., Gonzalez-Agirre, A., & Rigau, G. (2020). Evaluating multiword expression identification in machine translation. Computational Linguistics, 46(1), 1–36.
  10. Graham, Y., Baldwin, T., Moffat, A., & Zobel, J. (2017). Can machine translation systems be evaluated without human references? Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP), 3769–3779.
  11. Grenoble, L. A., & Whaley, L. J. (2016). Saving languages: An introduction to language revitalization. Cambridge University Press.
  12. House, J. (2016). Translation as communication across languages and cultures. Routledge.
  13. Kasneci, E., Sessler, K., Yu, Y., Bannert, M., Dementieva, D., Fischer, F., & Schmidt, A. (2023). ChatGPT for good? Opportunities and challenges of large language models in education. Learning and Individual Differences, 103, 102274.
  14. Koehn, P., & Knowles, R. (2017). Six challenges for neural machine translation. Proceedings of the First Workshop on Neural Machine Translation, 28–39.
  15. Lewis, M. P., & Simons, G. F. (2021). Assessing endangerment: Expanding Fishman’s GIDS. Revue Roumaine de Linguistique, 66(1), 55–70.
  16. Lole, A. J. (2020). Cultural metaphors in Dawan language. Timor Linguistics Journal, 4(1), 23–35.
  17. Mendoza, M., et al. (2022). Enzymatic transfer of acetate on histones from lysine reservoir sites to lysine activating sites. Science Advances, 8(3), eabj5688.
  18. Munday, J. (2016). Introducing translation studies: Theories and applications (4th ed.). Routledge.
  19. Nida, E. A. (2015). Language, culture, and translating. Shanghai Foreign Language Education Press.
  20. Nurfaiza. (2024). Pengaruh penggunaan ChatGPT dalam pembelajaran terjemah Indonesia-Arab. At-Turost: Journal of Islamic Studies, 99–113.
  21. OpenAI. (2023). GPT-4 technical report. https://openai.com/research/gpt-4
  22. Popović, M. (2015). chrF: character n-gram F-score for automatic MT evaluation. Proceedings of the Tenth Workshop on Statistical Machine Translation, 392–395.
  23. Schapper, A. (2017). A grammar of Bunaq: A Papuan language of East Timor. De Gruyter Mouton.
  24. Sutanto, V. M., De Giacomo, G. G., Nakazawa, T., & Yamada, M. (2024). ChatGPT as a translation engine: A case study on Japanese-English. In Proceedings of the 30th Annual Conference of the Association for Natural Language Processing (pp. 2096–1201).
  25. Tang, R., et al. (2023). Evaluating ChatGPT’s translation capabilities: Benchmarks and breakdowns. AI & Society. https://doi.org/10.1007/s00146-023-01596-4
  26. Toral, A., & Way, A. (2018). What level of quality can neural machine translation attain on literary text? Translation Quality Assessment, 78–91.
  27. Venuti, L. (2017). The translator’s invisibility: A history of translation (3rd ed.). Routledge.
  28. Wu, Y., Schuster, M., Chen, Z., Le, Q. V., Norouzi, M., Macherey, W., ... & Dean, J. (2016). Google’s neural machine translation system: Bridging the gap between human and machine translation. arXiv preprint arXiv:1609.08144.