SMART DATA PIPELINES FOR THE COGNITIVE COMPUTE CONTINUUM (SPICE)
Data processing applications have long been driving the development of cloud technologies. Assembling and maintaining well-designed complex data pipelines involves numerous challenges arising mainly from the growing numbers of edge/IoT devices whose data-processing capabilities have become vital to modern computing continuums in spite of their volatility and limited communication bandwidth.
These hurdles and the expertise and resource constraints act as a barrier to the wider adoption of data pipelines in industrial environments.
This proposal aims at
(1) efficient AI-assisted composition of smart data pipelines that will radically simplify the deployment and optimization of heterogeneous data processing
(2) automating it securely within the seamlessly integrated environment of modern compute continuums.
The results of our project will be made available as an innovation transformation incubator for other industrial partners and researchers to exploit and participate in.
