Building Next-Gen AI Infrastructure: Scaling Enterprise LLM Serving and Training with RadixArk

Published on 14 May 2026, 16:53

Speaker: Banghua Zhu, Co-Founder & CTO, RadixArk
Talk Abstract: Deploying generative AI in production requires a robust, scalable, and highly optimized infrastructure. Join Banghua Zhu, co-founder and CTO of RadixArk, to discover how to build an efficient LLM inference and training stack with SGLang and Miles. This session will cover the open-source innovations in SGLang and Miles, and enterprise-ready inference and training services with RadixArk. We will demonstrate how our advanced inference and training engines maximize compute utilization, and scale AI applications seamlessly across diverse environments—ultimately building the foundations needed to bring the power of frontier AI to everyone.

Find the resources you need to develop using AMD products: amd.com/en/developer.html

Join the Developer Community: devcommunity.amd.com

Join the Developer Discord server: discord.gg/amd-dev

***

© 2026 Advanced Micro Devices, Inc. All rights reserved. AMD, the AMD Arrow logo, EPYC, ROCm, and AMD Instinct and combinations thereof are trademarks of Advanced Micro Devices, Inc.