Deploying Containerized AI/ML Workloads Across Edge-Core-Cloud with openSUSE
Rudraksh Karpe
Rudraksh Karpe is an LLM Engineer at ZS Associates and a Google Summer of Code contributor for the openSUSE Project. Previously, he has worked with the KDE community to enhance the environmental sustainability of KDE applications. He is also a recipient of the Shubhra Kar Linux Foundation Training (LiFT) Scholarship Program.
Satyam Soni
Satyam is Google Summer of Code Mentee 2024 at OpenSUSE,Kubernetes Release Notes Lead and Shadow v.130 & v1.31, CNCF Ambassador, and Cloud Native Community Groups New Delhi Organizer. He focuses on developing and contributing to open-source software. He holds a good track record of contributions to various projects, communities, and he is currently an active contributor to the Kubernetes project.
No video of the event yet, sorry!
Deploying containerized AI/ML workloads across edge, core, and cloud infrastructures is crucial for optimizing data processing, enhancing performance, and managing complex computations efficiently. This talk highlights our practical experience from the Analytics Edge Ecosystem project during Google Summer of Code 2024, demonstrating how openSUSE Leap can be leveraged to achieve these goals. By utilizing Kubernetes and lightweight distributions like K3s on edge devices, we have reduced latency and minimized bandwidth usage, while hybrid and multi-cloud deployments offer scalability and flexibility.
In this session, we will explore the technical aspects of deploying various AI/ML workloads at the edge using openSUSE Leap.
Key topics:
- Using openSUSE Leap as base layer for deployment using KVM
- Containerization of workloads with Podman/Docker
- Kubernetes orchestration and cluster management with Rancher by SUSE
- Implementing a data pipeline that seamlessly transfers data from Edge devices
- Using AI/ML models deployed at the edge to provide real-time insights
- Cost optimization using edge devices for local processing
- Ensuring data security by processing sensitive information locally at the Edge
- Date:
- 2024 November 3 - 11:00
- Duration:
- 40 min
- Room:
- Room C
- Conference:
- openSUSE.Asia Summit 2024
- Language:
- en
- Track:
- openSUSE
- Difficulty:
- Medium
- Overview of Package Management in openSUSE MicroOS
- Start Time:
- 2024 November 3 11:00
- Room:
- Room A
- Status of CJK language support and activities in LibreOffice 2024
- Start Time:
- 2024 November 3 11:00
- Room:
- Room B