TY - CHAP A1 - Alonso, Gustavo A1 - Binnig, Carsten A1 - Pandis, Ippokratis A1 - Salem, Kenneth A1 - Skrzypczak, Jan A1 - Stutsman, Ryan A1 - Thostrup, Lasse A1 - Wang, Tianzheng A1 - Wang, Zeke A1 - Ziegler, Tobias T1 - DPI: The Data Processing Interface for Modern Networks T2 - 9th Biennial Conference on Innovative Data Systems Research N2 - As data processing evolves towards large scale, distributed platforms, the network will necessarily play a substantial role in achieving efficiency and performance. Increasingly, switches, network cards, and protocols are becoming more flexible while programmability at all levels (aka, software defined networks) opens up many possibilities to tailor the network to data processing applications and to push processing down to the network elements. In this paper, we propose DPI, an interface providing a set of simple yet powerful abstractions flexible enough to exploit features of modern networks (e.g., RDMA or in-network processing) suitable for data processing. Mirroring the concept behind the Message Passing Interface (MPI) used extensively in high-performance computing, DPI is an interface definition rather than an implementation so as to be able to bridge different networking technologies and to evolve with them. In the paper we motivate and discuss key primitives of the interface and present a number of use cases that show the potential of DPI for data-intensive applications, such as analytic engines and distributed database systems. Y1 - 2019 ER -