Considering Commonsense in Solving QA: Reading Comprehension with Semantic Search and Continual Learning

Seungwon Jeong, Dongsuk Oh, Kinam Park, Heuiseok Lim

Research output: Contribution to journalArticlepeer-review


Unlike previous dialogue-based question-answering (QA) datasets, DREAM, multiple-choice Dialogue-based REAding comprehension exaMination dataset, requires a deep understanding of dialogue. Many problems require multi-sentence reasoning, whereas some require commonsense reasoning. However, most pre-trained language models (PTLMs) do not consider commonsense. In addition, because the maximum number of tokens that a language model (LM) can deal with is limited, the entire dialogue history cannot be included. The resulting information loss has an adverse effect on performance. To address these problems, we propose a Dialogue-based QA model with Common-sense Reasoning (DQACR), a language model that exploits Semantic Search and continual learning. We used Semantic Search to complement information loss from truncated dialogue. In addition, we used Semantic Search and continual learning to improve the PTLM’s commonsense reasoning. Our model achieves an improvement of approximately 1.5% over the baseline method and can thus facilitate QA-related tasks. It contributes toward not only dialogue-based QA tasks but also another form of QA datasets for future tasks.

Original languageEnglish
Article number4099
JournalApplied Sciences (Switzerland)
Issue number9
Publication statusPublished - 2022 May 1

Bibliographical note

Funding Information:
Funding: This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (NRF-2021R1A6A1A03045425). In addition, it was also supported by the MSIT (Ministry of Science and ICT), Korea, under the ICT Creative Consilience program (IITP-2022-2020-0-01819) supervised by the IITP (Institute for Information & communications Technology Planning & Evaluation).

Publisher Copyright:
© 2022 by the authors. Licensee MDPI, Basel, Switzerland.


  • commonsense reasoning
  • deep learning
  • dialogue-based multiple-choice QA
  • pre-trained language models
  • semantic search

ASJC Scopus subject areas

  • General Materials Science
  • Instrumentation
  • General Engineering
  • Process Chemistry and Technology
  • Computer Science Applications
  • Fluid Flow and Transfer Processes


Dive into the research topics of 'Considering Commonsense in Solving QA: Reading Comprehension with Semantic Search and Continual Learning'. Together they form a unique fingerprint.

Cite this