Skip to main navigation Skip to search Skip to main content

Stochastic Compositional Kernel Estimation for Gaussian Process Models

  • Muluken Regas Eressa
  • , Hakim Badis
  • , Rami Langar
  • , Dorian Grosso
  • University Paris-Est
  • METRON - Energy Intelligence for Industries

Research output: Contribution to Book/Report types › Contribution to conference proceedings › peer-review

2 Citations (Scopus)

Abstract

In kernel-based learning, the choice of kernel can greatly impact the predictive performance of the model. Kernel selection is computationally intensive. However, various methods have been suggested for its optimal estimation. For example, exhaustive, grid, randomized and nonparametric search methods are few notable mentions. The effectiveness of these approaches is dependent on the intricacies of the data and the frameworks in which they operate. For instance, in Gaussian models, the dimension of the covariance matrix presents a challenge for suitable kernel assessment. In the case of variational and MCMC-based models, the time complexity required for the ELBO and posterior convergence hinders the implementation of optimal search. As such, in addition to the respective strategy, a computationally efficient exploration should take into account the limitations of the underlying model. This paper proposes a stochastic compositional kernel search algorithm. It follows a randomized point selection and cross validation in building the gaussian model. The root-mean squared error (RMSE) is applied as a criterion to evaluate the models and the optimality of the returned mixtures in explaining the given observations. We tested the algorithm on real and synthetic data. The experiments showed, the design iteratively offers possible kernel combinations by following the path with the least RMSE score. The sparsity in model building and the stochastic approach for kernel selection has afforded the algorithm a computational advantage over other exhaustive methods. As such, it can be used as an alternative technique for a suitable kernel selection that best explain the data.

Original languageEnglish
Title of host publicationICMLC 2023 - Proceedings of the 2023 15th International Conference on Machine Learning and Computing
PublisherAssociation for Computing Machinery
Pages86-91
Number of pages6
ISBN (Electronic)9781450398411
DOIs
Publication statusPublished - 17 Feb 2023
Externally publishedYes
Event15th International Conference on Machine Learning and Computing, ICMLC 2023 - Hybrid, Zhuhai, China
Duration: 17 Feb 2023 → 20 Feb 2023

Publication series

NameACM International Conference Proceeding Series

Conference

Conference15th International Conference on Machine Learning and Computing, ICMLC 2023
Country/TerritoryChina
CityHybrid, Zhuhai
Period17/02/23 → 20/02/23

Keywords

  • Approximation
  • Gaussian
  • Kernel
  • Search
  • Sparse
  • Stochastic

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software

Fingerprint

Dive into the research topics of 'Stochastic Compositional Kernel Estimation for Gaussian Process Models'. These topics are generated from the title and abstract of the publication. Together, they form a unique fingerprint.

Cite this