Predicting Second Language Proficiency Level Using Linguistic Cognitive Task and Machine Learning Techniques

Yeong Wook Yang, Won Hee Yu, Heui Seok Lim

    Research output: Contribution to journalArticlepeer-review

    5 Citations (Scopus)

    Abstract

    This paper proposes a novel method for predicting second language proficiency based on linguistic cognitive ability measured in linguistic cognitive response test. Our method is based on an assumption that there is a correlation between language aptitude test scores and linguistic cognitive ability. Our proposed method for predicting L2 language proficiency uses as input learner’s linguistic cognition aptitude data. In our experiment, the method produced promising results with the predictive power as high as 70 %. Linguistic cognitive ability is measured through linguistic cognition tasks, which are: reading lexical decision tasks (LDT), listening LDT, translation recognition tasks, and semantic recognition tasks. Each type of the tasks is related to a different linguistic function in the brain. After measuring the learner’s linguistic cognitive aptitude, the result is fed as input for a machine learning model, which makes predictions for the corresponding language proficiency level. In training the linguistic proficiency classifier, we used multi-layer perceptron, Naive Bayes, logistic regression, and random forest model. For input data set in our experiment, we had 42 participants take our cognitive aptitude tests and used the result. Our classifier showed an accuracy >70 % in predicting proficiency level. Among the models, random forest model produced the best predictive power.

    Original languageEnglish
    Pages (from-to)271-285
    Number of pages15
    JournalWireless Personal Communications
    Volume86
    Issue number1
    DOIs
    Publication statusPublished - 2016 Jan 1

    Bibliographical note

    Funding Information:
    This research was supported by the ICT R&D program of MSIP/IITP. [2014, Development of distribution and diffusion service technology through individual and collective intelligence to digital contents]. This work was supported by the National Research Foundation of Korea (NRF) Grant funded by the Korean Government (MSIP) (No. NRF-2015R1A5A7037674).

    Publisher Copyright:
    © 2015, Springer Science+Business Media New York.

    Keywords

    • Cognitive ability
    • Language proficiency
    • Second language

    ASJC Scopus subject areas

    • Computer Science Applications
    • Electrical and Electronic Engineering

    Fingerprint

    Dive into the research topics of 'Predicting Second Language Proficiency Level Using Linguistic Cognitive Task and Machine Learning Techniques'. Together they form a unique fingerprint.

    Cite this