Data Pipeline System Designs for In-network Learning - Séminaires Parisiens en Réseaux
Communication Dans Un Congrès Année : 2024

Data Pipeline System Designs for In-network Learning

Résumé

This paper introduces the design of a data pipeline system (DPS) integrated with artificial intelligence (AIF) functions to support real-time AI learning and operations for network automation in 5G/6G systems. To enhance the DPS for network learning, we design it as a chain of functions, namely ingress and egress Network Data Broker Function (iNDBF and eNDBF) and Network Data Preprocessing Function (NDPPF). To take into account the distributed nature of the network architecture of 5G and beyond, we design the DPS to be integrated seamlessly with a distributed learning system such as the federated learning. We implement a realistic evaluation framework, employing a real dataset from a national mobile operator to simulate the network architecture. Additionally, a federated learning framework for anomaly detection is integrated with the DPS to assess the effectiveness of our proposal. Evaluation results show that delays in end-to-end data transmission and preprocessing to the AIF locations can cause a distributed learning process to work with stale data. The results also highlight how these delays can lead to desynchronisation of the distributed learning process, and thus generate AI models with low accuracy.
Fichier principal
Vignette du fichier
PNtumba_et_al_CNSM_2024_v8.pdf (524.13 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04681121 , version 1 (14-09-2024)

Identifiants

  • HAL Id : hal-04681121 , version 1

Citer

Patient Ntumba, Nour-El-Houda Yellas, Salah Bin Ruba, Fehmi Ben Abdesslem, Stefano Secci. Data Pipeline System Designs for In-network Learning. 20th International Conference on Network and Service Management Prague, Czech Republic // 28 - 31 October 2024, Oct 2024, Prague, Czech Republic. ⟨hal-04681121⟩
21 Consultations
0 Téléchargements

Partager

More