TY - GEN
T1 - TaPS
T2 - 20th IEEE International Conference on e-Science, e-Science 2024
AU - Gregory Pauloski, J.
AU - Hayot-Sasson, Valerie
AU - Gonthier, Maxime
AU - Hudson, Nathaniel
AU - Pan, Haochen
AU - Zhou, Sicheng
AU - Foster, Ian
AU - Chard, Kyle
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - Task-based execution frameworks, such as parallel programming libraries, computational workflow systems, and function-as-a-service platforms, enable the composition of distinct tasks into a single, unified application designed to achieve a computational goal and abstract the parallel and distributed execution of those tasks on arbitrary hardware. Research into these task executors has accelerated as computational sciences increasingly need to take advantage of parallel compute and/or heterogeneous hardware. However, the lack of evaluation standards makes it challenging to compare and contrast novel systems against existing implementations. Here, we introduce TaPS, the Task Performance Suite, to support continued research in distributed task executor frameworks. TaPS provides (1) a unified, modular interface for writing and evaluating applications using arbitrary execution frameworks and data management systems and (2) an initial set of reference synthetic and real-world science applications. We discuss how the design of TaPS supports the reliable evaluation of frameworks and demonstrate TaPS through a survey of benchmarks using the provided reference applications.
AB - Task-based execution frameworks, such as parallel programming libraries, computational workflow systems, and function-as-a-service platforms, enable the composition of distinct tasks into a single, unified application designed to achieve a computational goal and abstract the parallel and distributed execution of those tasks on arbitrary hardware. Research into these task executors has accelerated as computational sciences increasingly need to take advantage of parallel compute and/or heterogeneous hardware. However, the lack of evaluation standards makes it challenging to compare and contrast novel systems against existing implementations. Here, we introduce TaPS, the Task Performance Suite, to support continued research in distributed task executor frameworks. TaPS provides (1) a unified, modular interface for writing and evaluating applications using arbitrary execution frameworks and data management systems and (2) an initial set of reference synthetic and real-world science applications. We discuss how the design of TaPS supports the reliable evaluation of frameworks and demonstrate TaPS through a survey of benchmarks using the provided reference applications.
KW - Open-Source
KW - Parallel Computing
KW - Performance Evaluation
KW - Python
KW - Workflows
UR - https://www.scopus.com/pages/publications/85205980986
U2 - 10.1109/e-Science62913.2024.10678702
DO - 10.1109/e-Science62913.2024.10678702
M3 - Contribution to conference proceedings
AN - SCOPUS:85205980986
T3 - Proceedings - 2024 IEEE 20th International Conference on e-Science, e-Science 2024
BT - Proceedings - 2024 IEEE 20th International Conference on e-Science, e-Science 2024
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 16 September 2024 through 20 September 2024
ER -