Skip to main navigation Skip to search Skip to main content

TaPS: A Performance Evaluation Suite for Task-based Execution Frameworks

  • J. Gregory Pauloski
  • , Valerie Hayot-Sasson
  • , Maxime Gonthier
  • , Nathaniel Hudson
  • , Haochen Pan
  • , Sicheng Zhou
  • , Ian Foster
  • , Kyle Chard
  • The University of Chicago
  • Argonne National Laboratory

Research output: Contribution to Book/Report types › Contribution to conference proceedings › peer-review

6 Citations (Scopus)

Abstract

Task-based execution frameworks, such as parallel programming libraries, computational workflow systems, and function-as-a-service platforms, enable the composition of distinct tasks into a single, unified application designed to achieve a computational goal and abstract the parallel and distributed execution of those tasks on arbitrary hardware. Research into these task executors has accelerated as computational sciences increasingly need to take advantage of parallel compute and/or heterogeneous hardware. However, the lack of evaluation standards makes it challenging to compare and contrast novel systems against existing implementations. Here, we introduce TaPS, the Task Performance Suite, to support continued research in distributed task executor frameworks. TaPS provides (1) a unified, modular interface for writing and evaluating applications using arbitrary execution frameworks and data management systems and (2) an initial set of reference synthetic and real-world science applications. We discuss how the design of TaPS supports the reliable evaluation of frameworks and demonstrate TaPS through a survey of benchmarks using the provided reference applications.

Original languageEnglish
Title of host publicationProceedings - 2024 IEEE 20th International Conference on e-Science, e-Science 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798350365610
DOIs
Publication statusPublished - 2024
Externally publishedYes
Event20th IEEE International Conference on e-Science, e-Science 2024 - Osaka, Japan
Duration: 16 Sept 2024 → 20 Sept 2024

Publication series

NameProceedings - 2024 IEEE 20th International Conference on e-Science, e-Science 2024

Conference

Conference20th IEEE International Conference on e-Science, e-Science 2024
Country/TerritoryJapan
CityOsaka
Period16/09/24 → 20/09/24

!!!Keywords

  • Open-Source
  • Parallel Computing
  • Performance Evaluation
  • Python
  • Workflows

Fingerprint

Dive into the research topics of 'TaPS: A Performance Evaluation Suite for Task-based Execution Frameworks'. These topics are generated from the title and abstract of the publication. Together, they form a unique fingerprint.

Cite this