Text-to-Text-to-Image Generative AI on a CPU | Intel Software

Опубликовано 1 марта 2024, 15:00

See a generative AI demo running Llama 2 and Stable Diffusion on a single CPU. And learn how to ensure your software stack gets the most performance from your hardware.

Generative AI inference does not require as much compute power as training does. This demo shows an application that generates text using Llama 2, which is used as a prompt to generate an image using Stable Diffusion, all on a single CPU.

The key to getting the most performance from your hardware is to use the right software stack. In this case, it starts with open source PyTorch, which is powered by oneAPI and contains optimizations contributed by Intel. There are also a few environment variables that you can set to unlock the best performance from your hardware. Finally, Intel® Extension for PyTorch* plugs in with a couple of lines of code to further optimize and convert to bfloat16 data.

Learn how it all works together and how to get started for yourself.

PyTorch Optimizations from Intel: bit.ly/3SZCPXj

More details on this application: intel.ly/3wHji6s

Intel AI Software: intel.ly/3SONVOs

About Intel Software:
Intel® Developer Zone is committed to empowering and assisting software developers in creating applications for Intel hardware and software products. The Intel Software YouTube channel is an excellent resource for those seeking to enhance their knowledge. Our channel provides the latest news, helpful tips, and engaging product demos from Intel and our numerous industry partners. Our videos cover various topics; you can explore them further by following the links.

Connect with Intel Software:
INTEL SOFTWARE WEBSITE: intel.ly/2KeP1hD
INTEL SOFTWARE on FACEBOOK: bit.ly/2z8MPFF
INTEL SOFTWARE on TWITTER: bit.ly/2zahGSn
INTEL SOFTWARE GITHUB: bit.ly/2zaih6z
INTEL DEVELOPER ZONE LINKEDIN: bit.ly/2z979qs
INTEL DEVELOPER ZONE INSTAGRAM: bit.ly/2z9Xsby
INTEL GAME DEV TWITCH: bit.ly/2BkNshu

#IntelSoftware #AI #GenAI

Text-to-Text-to-Image Generative AI on a CPU | Intel Software