Building Edge Focused AI workloads using openSUSE Leap and SUSE Rancher Orchestration Management
A panel discussion by the AEEW openSUSE team
Rudraksh Karpe
Rudraksh Karpe is an LLM Engineer at ZS Associates and a Google Summer of Code contributor for the openSUSE Project. Previously, he has worked with the KDE community to enhance the environmental sustainability of KDE applications. He is also a recipient of the Shubhra Kar Linux Foundation Training (LiFT) Scholarship Program.
Bryan Gartner
Career Journey
Solution Architect - At SUSE, as a Sr. Technology Strategist, I've focused on major hardware and software partners plus embedded solution providers, providing designs and creating, installing and supporting proof-of-concept/production pilots, along with reference architectures, white papers and bench-marking deliverables. During this tenure I have been a steadfast user of openSUSE for my desktop/workstation/laptops.
IT Architect - Overlapping below and above, I have been a passionate, contributing member and advocate of the FOSS community. A core focus was Linux device-level enablement of the company's computing platforms and leading an IT Linux initiative to get production services moved onto the Linux platform, with one of the earliest was on SUSE 6.0.
Electrical Engineer - I used my formal education, along with mechanical and biomedical slants as a hardware designer, developing hybrid, thickfilm microcircuits, and started automation of design, process and test engineering tasks as well.
Terry Smith
No video of the event yet, sorry!
The openSUSE Project has been participating in the Google Summer of Code program for a while now, building its legacy in the open-source space. Analytics Edge Ecosystem Workloads (AEEW) with SUSE Rancher is one of the awesome projects under the openSUSE project umbrella, started back in 2022. Initially, the project began with motivation to process the data locally leveraging the Edge Ecosystem for real-time insights and improved privacy.
In 2024, it marked our third participation in the Google Summer of Code with the AEEW Project. In this panel discussion, we will share our journey and the experiences we gained, moving from Core ML to GenAI development. We will talk about building open AI/ML as well as GenAI-focused workloads and managing them at the Edge using openSUSE Leap, K3s, and SUSE Rancher.
Key Highlights:
- We would like to share the KVM-based openSUSE Leap setup that contributors start with.
- How to set up VMs on these machines.
- How to build pipelines to deploy Core-ML and GenAI-focused applications at the Edge using K3s.
- Setting up SUSE Rancher and monitoring workloads on it.
- The impact of processing data at the Edge and how you can reduce the risk of exposing your data to online LLM providers by simply using open-source LLMs.
- References to the Technical Reference Documentation from SUSE.
The audience of this talk will gain insights into processing data at the Edge, setting up AI/ML and GenAI pipelines using SUSE Rancher, and an overview of the KVM-based infrastructure setup using openSUSE Leap as the base layer operating system.
- Date:
- Duration:
- 45 min
- Room:
- Conference:
- Early Adopter Tech Summit 2025
- Language:
- Track:
- Open Source
- Difficulty:
- Medium