Skip to main navigation Skip to search Skip to main content

Emerging Results on Automated Support for Searching and Selecting Evidence for Systematic Literature Review Updates

  • Bianca Minetto Napoleão
  • , Ritika Sarkar
  • , Sylvain Hallé
  • , Fabio Petrillo
  • , Marcos Kalinowski
  • Université du Québec à Chicoutimi
  • Pontifícia Universidade Católica do Rio de Janeiro

Research output: Contribution to Book/Report types › Contribution to conference proceedings › peer-review

3 Citations (Scopus)

Abstract

Context: The constant growth of primary evidence and Systematic Literature Reviews (SLRs) publications in the Software Engineering (SE) field leads to the need for SLR Updates. However, searching and selecting evidence for SLR updates demands significant effort from SE researchers. Objective: We present emerging results on an automated approach to support searching and selecting studies for SLR updates in SE. Method: We developed an automated tool prototype to perform the snowballing search technique and to support the selection of relevant studies for SLR updates using Machine Learning (ML) algorithms. We evaluated our automation proposition through a small-scale evaluation with a reliable dataset from an SLR replication and its update. Results: Effectively automating snowballing-based search strategies showed feasibility with minor losses, specifically related to papers without Digital Object Identifier (DOI). The ML algorithm giving the highest performance to select studies for SLR updates was Linear Support Vector Machine with approximately 74% recall and 15% precision. The use of such algorithms with conservative thresholds to minimize the risk of missing papers can already significantly reduce evidence selection efforts. Conclusion: The preliminary results of our evaluation point in promising directions, indicating the potential of automating snowballing search efforts and of reducing the number of papers to be manually analyzed by about 2.5 times when selecting evidence for updating SLRs in SE.

Original languageEnglish
Title of host publicationProceedings - 2024 IEEE/ACM International Workshop on Methodological Issues with Empirical Studies in Software Engineering, WSESE 2024
PublisherAssociation for Computing Machinery, Inc
Pages34-41
Number of pages8
ISBN (Electronic)9798400705670
DOIs
Publication statusPublished - 9 Aug 2024
Event1st International Workshop on Methodological Issues with Empirical Studies in Software Engineering, WSESE 2024 - Lisbon, Portugal
Duration: 16 Apr 2024 → 16 Apr 2024

Publication series

NameProceedings - 2024 IEEE/ACM International Workshop on Methodological Issues with Empirical Studies in Software Engineering, WSESE 2024

Conference

Conference1st International Workshop on Methodological Issues with Empirical Studies in Software Engineering, WSESE 2024
Country/TerritoryPortugal
CityLisbon
Period16/04/24 → 16/04/24

Keywords

  • SLR update
  • searching for evidence
  • selecting evidence
  • systematic review update

ASJC Scopus subject areas

  • Software

Fingerprint

Dive into the research topics of 'Emerging Results on Automated Support for Searching and Selecting Evidence for Systematic Literature Review Updates'. These topics are generated from the title and abstract of the publication. Together, they form a unique fingerprint.

Cite this