Publication

Asymetric Flow Control for Data Transfer in Hybrid Computing Systems

AbstractHybrid computing systems that combine specialized accelerators with general-purpose processors are now being used to improve performance in many application areas. However, processing of network communications by the accelerators is often a significant bottleneck to the performance of the hybrid system. At the same time, the powerful yet underutilized general-purpose processors of the hybrid system are well suited to processing significant levels of network traffic. In this paper, we propose a novel asymmetric network data flow control system optimized for data stream processing. The system allows the general-purpose processors in a hybrid system to take complete control of network data movement. The system uses remote direct memory access to allow direct communication between the general-purpose processors and the main memories of the accelerators, with no network processing overhead on the accelerators. The accelerators only perform read and write operations with respect to the main memory. Our Cell Broadband Engine® implementation of the system returns a high throughput of up to 934 MB/s, directly communicating with multiple processor cores with full data flow control to multiple processor cores, while eliminating the network processing bottleneck on the accelerator system. Furthermore, our implementation demonstrates excellent performance scalability when targeting increasing numbers of processor cores on the accelerator system.PDF

Related Resources

See what’s new.

Publication

2014

On the Definition of a Computational Fluid Dynamic Solver using Cellular Discrete-Event Simulation

The Discrete Event System Specification (DEVS) has rarely been applied…

Project

2021

Mesh Processing

Computer representations of geometry are at the core of most problems…

Article

2022

General Electric Collaboration Targets Jet Engine Efficiency with Generative Design

How Autodesk technologies and researchers are helping General Electric…

Article

2022

How external communities enrich Autodesk Research

Outsight Network: An innovation hub that connects research globally…

Get in touch

Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.

Contact us