ScissionLite: accelerating distributed deep learning with lightweight data compression for IIoT
Abstract
Industrial Internet of Things (IIoT) applications can greatly benefit from leveraging edge computing. For instance, applications relying on deep neural network (DNN) models can be sliced and distributed across IIoT devices and the network edge to reduce inference latency. However, low network performance between IIoT devices and the edge often becomes a bottleneck. In this study, we propose ScissionLite, a holistic framework designed to accelerate distributed DNN inference using lightweight data compression. Our compression method features a novel lightweight down/upsampling network tailored for performance-limited IIoT devices, which is inserted at the slicing point of a DNN model to reduce outbound network traffic without causing a significant drop in accuracy. In addition, we have developed a benchmarking tool to accurately identify the optimal slicing point of the DNN for the best inference latency. ScissionLite improves inference latency by up to 15.7× with minimal accuracy degradation.
Citation
Ahn , H , Lee , M , Seong , S , Na , G-J , Chun , I-G , Varghese , B & Hong , C-H 2024 , ' ScissionLite: accelerating distributed deep learning with lightweight data compression for IIoT ' , IEEE Transactions on Industrial Informatics , vol. Early Access . https://doi.org/10.1109/TII.2024.3413340
Publication
IEEE Transactions on Industrial Informatics
Status
Peer reviewed
ISSN
1551-3203Type
Journal article
Description
Funding: This work was supported in part by the Electronics and Telecommunications Research Institute through the Korean government under Grant 23zs1300 (Research on High Performance Computing Technology to overcome limitations of AI processing) and in part by the Korea Institute for Advancement of Technology (KIAT) through the Korea Government (MOTIE) under Grant P0017011 (HRD Program for Industrial Innovation). Paper no. TII-23-4829.Collections
Items in the St Andrews Research Repository are protected by copyright, with all rights reserved, unless otherwise indicated.