CentOS Connect

Bootable Containers in Action: Hands on with Deploying AI Workloads
2025-01-31 , Chestnut

There’s an exciting potential for bootable containers, which allow you to build and manage a full operating system just like a container image, and recently, Red Hat announced it’s intention to donate the tool to the Cloud Native Computing Foundation (CNCF). However, for AI/ML workloads which require a complicated stack of dependencies, this technology helps curate the delivery of a full stack for training and inferencing, for example with Red Hat Enterprise Linux AI. Join us as we put together an operating system for running an AI-enabled application with CentOS Stream, using an InstructLab fine-tuned model from our local developer workstation. With bootable containers, our deployment workflow is simplified, with flexibility for dynamic requirements and environments in building the next generation of Linux workloads.

See also: Session Slides (4.8 MB)

Carol Chen is a Community Architect at Red Hat, having led several upstream communities including InstructLab, Ansible and ManageIQ. She has been actively involved in open source communities while working for Jolla and Nokia previously. In addition, she also has experiences in software development/integration in her 12 years in the mobile industry. On a personal note, Carol plays the Timpani in an orchestra in Tampere, Finland, where she now calls home.

Cedric Clyburn (@cedricclyburn), Senior Developer Advocate at Red Hat, is an enthusiastic software technologist with a background in Kubernetes, DevOps, and container tools. He has experience speaking and organizing conferences including DevNexus, WeAreDevelopers, The Linux Foundation, KCD NYC, and more. Cedric loves all things open-source, and works to make developer's lives easier! Based out of New York.