Adaptive predictive modeling with online learning: addressing data drift challenges in historical data for distributed inferencing

Cleon Anderson; Scott Brown; David Harman; Matthew Dwyer

doi:10.1117/12.3013468

7 June 2024 Adaptive predictive modeling with online learning: addressing data drift challenges in historical data for distributed inferencing

Cleon Anderson, Scott Brown, David Harman, Matthew Dwyer

Author Affiliations +

Proceedings Volume 13051, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications VI; 130510W (2024) https://doi.org/10.1117/12.3013468
Event: SPIE Defense + Commercial Sensing, 2024, National Harbor, Maryland, United States

Abstract

In the era of data-intensive edge computing, the orchestration of Data Distributed Inferencing (DDI) tasks poses a formidable challenge, demanding real-time adaptability to varying network conditions and compute resources. This study introduces an innovative approach to address this challenge, leveraging Gradient Boosting Regression (GBR) as the core predictive modeling technique. The primary objective is to estimate inferencing time based on crucial factors, including bandwidth, compute device type, and the number of compute nodes, allowing for dynamic task placement and optimization in a DDI environment. Our model employs an online learning framework, continuously updating itself as new data streams in, enabling it to swiftly adapt to changing conditions and consistently deliver accurate inferencing time predictions. This research marks a significant step forward in enhancing the efficiency and performance of DDI systems, with implications for real-world applications across various domains, including IoT, edge computing, and distributed machine learning.

Conference Presentation

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Cleon Anderson, Scott Brown, David Harman, and Matthew Dwyer "Adaptive predictive modeling with online learning: addressing data drift challenges in historical data for distributed inferencing", Proc. SPIE 13051, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications VI, 130510W (7 June 2024); https://doi.org/10.1117/12.3013468

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available