Lemonade Server: Integrate Microsoft AI Toolkit in VS Code for Local LLM Execution on Ryzen™ AI PCs
310
7.4
Published on 24 Apr 2025, 21:00
In this video, we demonstrate how to install and run Lemonade Server, enabling users to deploy LLMs on Ryzen™ AI 300 series PCs. We also show how to integrate Lemonade Server with AI Toolkit, a VS Code extension that helps developers and AI engineers develop and test AI models. Lastly, we show some features of AI Toolkit running locally on the integrated GPU and NPU, including their playground, prompt builder, bulk run, and evaluation tools.
Links Referenced in the Video:
More info about Microsoft AI Toolkit: code.visualstudio.com/docs/int...
Lemonde integration with Continue Setup Instructions: github.com/onnx/turnkeyml/blob...
Lemonade Installation Link - github.com/onnx/turnkeyml/rele...
Lemonade Installation Instructions - github.com/onnx/turnkeyml/blob...
Lemonade Server Examples - github.com/onnx/turnkeyml/tree...
Additional Resources:
Ryzen AI Documentation - ryzenai.docs.amd.com/en/latest...
Lemonade SDK - github.com/onnx/turnkeyml/blob...
Find the resources you need to develop using AMD products: amd.com/en/developer.html
***
© 2025 Advanced Micro Devices, Inc. All rights reserved. AMD, the AMD Arrow logo, EPYC, ROCm, and AMD Instinct and combinations thereof are trademarks of Advanced Micro Devices, Inc.
YEMFLXLDR2D9UPYB
Links Referenced in the Video:
More info about Microsoft AI Toolkit: code.visualstudio.com/docs/int...
Lemonde integration with Continue Setup Instructions: github.com/onnx/turnkeyml/blob...
Lemonade Installation Link - github.com/onnx/turnkeyml/rele...
Lemonade Installation Instructions - github.com/onnx/turnkeyml/blob...
Lemonade Server Examples - github.com/onnx/turnkeyml/tree...
Additional Resources:
Ryzen AI Documentation - ryzenai.docs.amd.com/en/latest...
Lemonade SDK - github.com/onnx/turnkeyml/blob...
Find the resources you need to develop using AMD products: amd.com/en/developer.html
***
© 2025 Advanced Micro Devices, Inc. All rights reserved. AMD, the AMD Arrow logo, EPYC, ROCm, and AMD Instinct and combinations thereof are trademarks of Advanced Micro Devices, Inc.
YEMFLXLDR2D9UPYB
Fresh videos
Random videos