Skip to main navigation Skip to search Skip to main content

Object Proxy Patterns for Accelerating Distributed Applications

  • J. Gregory Pauloski
  • , Valerie Hayot-Sasson
  • , Logan Ward
  • , Alexander Brace
  • , Andre Bauer
  • , Kyle Chard
  • , Ian Foster
  • The University of Chicago
  • Argonne National Laboratory
  • Illinois Institute of Technology

Research output: Contribution to journal › Journal Article › peer-review

1 Citation (Scopus)

Abstract

Workflow and serverless frameworks have empowered new approaches to distributed application design by abstracting compute resources. However, their typically limited or one-size-fits-all support for advanced data flow patterns leaves optimization to the application programmer - optimization that becomes more difficult as data become larger. The transparent object proxy, which provides wide-area references that can resolve to data regardless of location, has been demonstrated as an effective low-level building block in such situations. Here we propose three high-level proxy-based programming patterns - distributed futures, streaming, and ownership - that make the power of the proxy pattern usable for more complex and dynamic distributed program structures. We motivate these patterns via careful review of application requirements and describe implementations of each pattern. We evaluate our implementations through a suite of benchmarks and by applying them in three meaningful scientific applications, in which we demonstrate substantial improvements in runtime, throughput, and memory usage.

Original languageEnglish
Pages (from-to)253-265
Number of pages13
JournalIEEE Transactions on Parallel and Distributed Systems
Volume36
Issue number2
DOIs
Publication statusPublished - 2025
Externally publishedYes

Keywords

  • Distributed computing
  • futures
  • memory management
  • open-source software
  • streaming

ASJC Scopus subject areas

  • Signal Processing
  • Hardware and Architecture
  • Computational Theory and Mathematics

Fingerprint

Dive into the research topics of 'Object Proxy Patterns for Accelerating Distributed Applications'. These topics are generated from the title and abstract of the publication. Together, they form a unique fingerprint.

Cite this