Locally linear ensemble for regression

Seokho Kang, Pilsung Kang

Research output: Contribution to journalArticlepeer-review

12 Citations (Scopus)


Considerable research effort has been dedicated to the development of prediction models for yielding greater prediction accuracy in regression problems. Although non-linear models have achieved superior prediction accuracy by addressing the non-linearity of complex data, linear models are still favored because of their high prediction speed. In this study, a locally linear ensemble regression (LLER) is proposed in order to effectively address non-linearity while maintaining the advantage of linear models. The LLER predicts new instances based on multiple linear models that are trained on the regions that identify the local linearity of data. To achieve this, data are decomposed into several locally linear regions based on an expectation-maximization procedure, and linear models are built as local experts for each region to constitute an ensemble. We demonstrate the effectiveness of the LLER through experimental validation with benchmark datasets.

Original languageEnglish
Pages (from-to)199-209
Number of pages11
JournalInformation Sciences
Publication statusPublished - 2018 Mar

Bibliographical note

Funding Information:
This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT; Ministry of Science and ICT ) (Nos. NRF-2017R1C1B5075685, NRF-2016R1D1A1B03930729 , and NRF-2015R1A2A2A04007359 ). This work was also supported by Institute for Information & communications Technology Promotion (IITP) grant funded by the Korea government (MSIP) (No. 2017-0-00349, Development of Media Streaming system with Machine Learning using QoE (Quality of Experience)).

Publisher Copyright:
© 2017


  • Ensemble learning
  • Linear model
  • Local expert
  • Locally linear ensemble
  • Regression

ASJC Scopus subject areas

  • Software
  • Control and Systems Engineering
  • Theoretical Computer Science
  • Computer Science Applications
  • Information Systems and Management
  • Artificial Intelligence


Dive into the research topics of 'Locally linear ensemble for regression'. Together they form a unique fingerprint.

Cite this