Publication
Asymetric Flow Control for Data Transfer in Hybrid Computing Systems
AbstractHybrid computing systems that combine specialized accelerators with general-purpose processors are now being used to improve performance in many application areas. However, processing of network communications by the accelerators is often a significant bottleneck to the performance of the hybrid system. At the same time, the powerful yet underutilized general-purpose processors of the hybrid system are well suited to processing significant levels of network traffic. In this paper, we propose a novel asymmetric network data flow control system optimized for data stream processing. The system allows the general-purpose processors in a hybrid system to take complete control of network data movement. The system uses remote direct memory access to allow direct communication between the general-purpose processors and the main memories of the accelerators, with no network processing overhead on the accelerators. The accelerators only perform read and write operations with respect to the main memory. Our Cell Broadband Engine® implementation of the system returns a high throughput of up to 934 MB/s, directly communicating with multiple processor cores with full data flow control to multiple processor cores, while eliminating the network processing bottleneck on the accelerator system. Furthermore, our implementation demonstrates excellent performance scalability when targeting increasing numbers of processor cores on the accelerator system.PDF
Related Resources
See what’s new.
2008
Staggered Poses: A Character Motion Representation for Detail–Preserving Editing of Pose and Coordinated Timing
We introduce staggered poses—a representation of character motion…
2015
Folding Angle Regulation by Curved Crease Design for Self-Assembling Origami Propellers
This paper describes a method for manufacturing complex three…
2015
Automatic Extraction of Function Knowledge from Text
This paper presents a method to automatically extract function…
2023
Is 2023 the Year AI and ML go Mainstream?
Kean Walmsley shares his thoughts on AI and ML potentially going…
Get in touch
Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.
Contact us