An exploratory approach to find a novel metric based optimum language model for automatic bangla word prediction

Md Tarek Habib, Abdullah Al-Mamun, Md Sadekur Rahman, Shah Md Tanvir Siddiquee, Farruk Ahmed

Research output: Contribution to journalArticlepeer-review

13 Scopus citations

Abstract

Word completion and word prediction are two important phenomena in typing that have intense effect on aiding disable people and students while using keyboard or other similar devices. Such auto completion technique also helps students significantly during learning process through constructing proper keywords during web searching. A lot of works are conducted for English language, but for Bangla, it is still very inadequate as well as the metrics used for performance computation is not rigorous yet. Bangla is one of the mostly spoken languages (3.05% of world population) and ranked as seventh among all the languages in the world. In this paper, word prediction on Bangla sentence by using stochastic, i.e. N-gram based language models are proposed for auto completing a sentence by predicting a set of words rather than a single word, which was done in previous work. A novel approach is proposed in order to find the optimum language model based on performance metric. In addition, for finding out better performance, a large Bangla corpus of different word types is used.

Original languageEnglish (US)
Pages (from-to)47-54
Number of pages8
JournalInternational Journal of Intelligent Systems and Applications
Volume10
Issue number2
DOIs
StatePublished - Feb 1 2018
Externally publishedYes

Keywords

  • Corpus
  • Eager learning
  • Language model
  • Machine learning
  • N-gram
  • Natural language processing
  • Performance metric
  • Word prediction

ASJC Scopus subject areas

  • Signal Processing
  • Modeling and Simulation
  • Human-Computer Interaction
  • Computer Science Applications
  • Computer Networks and Communications
  • Control and Optimization
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'An exploratory approach to find a novel metric based optimum language model for automatic bangla word prediction'. Together they form a unique fingerprint.

Cite this