Publication
Asymetric Flow Control for Data Transfer in Hybrid Computing Systems
AbstractHybrid computing systems that combine specialized accelerators with general-purpose processors are now being used to improve performance in many application areas. However, processing of network communications by the accelerators is often a significant bottleneck to the performance of the hybrid system. At the same time, the powerful yet underutilized general-purpose processors of the hybrid system are well suited to processing significant levels of network traffic. In this paper, we propose a novel asymmetric network data flow control system optimized for data stream processing. The system allows the general-purpose processors in a hybrid system to take complete control of network data movement. The system uses remote direct memory access to allow direct communication between the general-purpose processors and the main memories of the accelerators, with no network processing overhead on the accelerators. The accelerators only perform read and write operations with respect to the main memory. Our Cell Broadband Engine® implementation of the system returns a high throughput of up to 934 MB/s, directly communicating with multiple processor cores with full data flow control to multiple processor cores, while eliminating the network processing bottleneck on the accelerator system. Furthermore, our implementation demonstrates excellent performance scalability when targeting increasing numbers of processor cores on the accelerator system.PDF
Related Resources
See what’s new.
2023
Generative design for COVID-19 and future pathogens using stochastic multi-agent simulationProposing a generative design workflow that integrates a stochastic…
2020
AuthAR: Concurrent Authoring of Tutorials for AR Assembly GuidanceAugmented Reality (AR) can assist with physical tasks such as object…
2016
Convolutional Neural Networks for Steady Flow ApproximationIn aerodynamics related design, analysis and optimization problems,…
2009
Gluing constructions amongst constant mean curvature hypersurfaces in the (n+1)-sphereFour constructions of constant mean curvature (CMC) hypersurfaces in…
Get in touch
Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.
Contact us