Empowering AI PC’s with Intel’s AI Software Stack | Tech Talk | Innovation Selects | Intel Software
326
8.4
Intel Software258 тыс
Следующее
Опубликовано 7 ноября 2024, 15:00
Intel's AI PC software stack simplifies AI development and deployment. It offers a comprehensive suite of tools and frameworks, including OpenVINO, ONNX Runtime, WebNN, and PyTorch, for seamless model integration. With the AI PC Development Kit and AI Playground, developers can easily experiment, prototype, and build AI applications, unlocking the potential of AI on PCs.
Discover how Intel's AI PC software stack is revolutionizing AI development and deployment, offering a suite of tools and frameworks that enable seamless model deployment and an out-of-the-box AI PC experience. Learn about the end-to-end model deployment flow, including runtimes and frameworks such as OpenVINO™, ONNX Runtime, WebNN, and PyTorch. Leverage tools and solutions like the AI PC Development Kit and AI Playground for experimentation, rapid prototyping, and building AI applications. This session empowers you to harness the full potential of AI on PCs, driving innovation for developers and customers.
Intel Innovation: intel.ly/46ixwbA
Intel Events: intel.ly/4dCbLWb
Intel AI PC intel.com/content/www/us/en/pr...
How to get started:docs.openvino.ai/2024/get-star...
OpenVINO Samples
github.com/openvinotoolkit/ope...
OpenVINO ecosystem framework support:
HuggingFace
• OpenVINO space in HuggingFace – FP16, INT8 and INT4 preconverted models ready for deployment! huggingface.co/OpenVINO
• Option 1: Use OpenVINO GenAI to run models from HuggingFace docs.openvino.ai/2024/learn-op...
• Option 2: Use Optimum-Cli to run models from HuggingFace docs.openvino.ai/2024/learn-op...
ONNX
• Option 1Conver ONNX model to OV format (IR) docs.openvino.ai/2024/openvino...
• Option 2: Use ONNX models thru OpenVINO ONNX Execution Provider onnxruntime.ai/docs/execution-...
Pytorch
• Option 1: Convert pytorch model to OpenVINO format (IR) (recommended for best performance) docs.openvino.ai/2024/openvino...
• Option 2: Use pytorch models with Torch.compile docs.openvino.ai/2024/openvino...
LangChain
• Example of LLMs inference with LangChain and OpenVINO python.langchain.com/docs/inte...
• Reference RAG implementation with OpenVINO and LangChain docs.openvino.ai/2024/notebook...
LlamaIndex
• Example of LLMs inference with LlamaIndex and OpenVINO docs.llamaindex.ai/en/stable/e...
• Reference RAG implementation with OpenVINO and LlamaIndex docs.openvino.ai/2024/notebook...
Pytorch 2.5 support for Intel GPUs
pytorch.org/blog/intel-gpu-sup...
AI PC Dev Kits
intel.com/content/www/us/en/de...
AI Playground
github.com/intel/AI-Playground
GIMP on Intel® Core™ Ultra Mobile Processors
intel.com/content/www/us/en/de...
About Intel Software:
Intel® Developer Zone is committed to empowering and assisting software developers in creating applications for Intel hardware and software products. The Intel Software YouTube channel is an excellent resource for those seeking to enhance their knowledge. Our channel provides the latest news, helpful tips, and engaging product demos from Intel and our numerous industry partners. Our videos cover various topics; you can explore them further by following the links.
Connect with Intel Software:
INTEL SOFTWARE WEBSITE: intel.ly/2KeP1hD
INTEL SOFTWARE on FACEBOOK: bit.ly/2z8MPFF
INTEL SOFTWARE on TWITTER: bit.ly/2zahGSn
INTEL SOFTWARE GITHUB: bit.ly/2zaih6z
INTEL DEVELOPER ZONE LINKEDIN: bit.ly/2z979qs
INTEL DEVELOPER ZONE INSTAGRAM: bit.ly/2z9Xsby
INTEL GAME DEV TWITCH: bit.ly/2BkNshu
#intelsoftware #innovation
Empowering AI PC’s with Intel’s AI Software Stack | Tech Talk | Innovation Selects | Intel Software
Discover how Intel's AI PC software stack is revolutionizing AI development and deployment, offering a suite of tools and frameworks that enable seamless model deployment and an out-of-the-box AI PC experience. Learn about the end-to-end model deployment flow, including runtimes and frameworks such as OpenVINO™, ONNX Runtime, WebNN, and PyTorch. Leverage tools and solutions like the AI PC Development Kit and AI Playground for experimentation, rapid prototyping, and building AI applications. This session empowers you to harness the full potential of AI on PCs, driving innovation for developers and customers.
Intel Innovation: intel.ly/46ixwbA
Intel Events: intel.ly/4dCbLWb
Intel AI PC intel.com/content/www/us/en/pr...
How to get started:docs.openvino.ai/2024/get-star...
OpenVINO Samples
github.com/openvinotoolkit/ope...
OpenVINO ecosystem framework support:
HuggingFace
• OpenVINO space in HuggingFace – FP16, INT8 and INT4 preconverted models ready for deployment! huggingface.co/OpenVINO
• Option 1: Use OpenVINO GenAI to run models from HuggingFace docs.openvino.ai/2024/learn-op...
• Option 2: Use Optimum-Cli to run models from HuggingFace docs.openvino.ai/2024/learn-op...
ONNX
• Option 1Conver ONNX model to OV format (IR) docs.openvino.ai/2024/openvino...
• Option 2: Use ONNX models thru OpenVINO ONNX Execution Provider onnxruntime.ai/docs/execution-...
Pytorch
• Option 1: Convert pytorch model to OpenVINO format (IR) (recommended for best performance) docs.openvino.ai/2024/openvino...
• Option 2: Use pytorch models with Torch.compile docs.openvino.ai/2024/openvino...
LangChain
• Example of LLMs inference with LangChain and OpenVINO python.langchain.com/docs/inte...
• Reference RAG implementation with OpenVINO and LangChain docs.openvino.ai/2024/notebook...
LlamaIndex
• Example of LLMs inference with LlamaIndex and OpenVINO docs.llamaindex.ai/en/stable/e...
• Reference RAG implementation with OpenVINO and LlamaIndex docs.openvino.ai/2024/notebook...
Pytorch 2.5 support for Intel GPUs
pytorch.org/blog/intel-gpu-sup...
AI PC Dev Kits
intel.com/content/www/us/en/de...
AI Playground
github.com/intel/AI-Playground
GIMP on Intel® Core™ Ultra Mobile Processors
intel.com/content/www/us/en/de...
About Intel Software:
Intel® Developer Zone is committed to empowering and assisting software developers in creating applications for Intel hardware and software products. The Intel Software YouTube channel is an excellent resource for those seeking to enhance their knowledge. Our channel provides the latest news, helpful tips, and engaging product demos from Intel and our numerous industry partners. Our videos cover various topics; you can explore them further by following the links.
Connect with Intel Software:
INTEL SOFTWARE WEBSITE: intel.ly/2KeP1hD
INTEL SOFTWARE on FACEBOOK: bit.ly/2z8MPFF
INTEL SOFTWARE on TWITTER: bit.ly/2zahGSn
INTEL SOFTWARE GITHUB: bit.ly/2zaih6z
INTEL DEVELOPER ZONE LINKEDIN: bit.ly/2z979qs
INTEL DEVELOPER ZONE INSTAGRAM: bit.ly/2z9Xsby
INTEL GAME DEV TWITCH: bit.ly/2BkNshu
#intelsoftware #innovation
Empowering AI PC’s with Intel’s AI Software Stack | Tech Talk | Innovation Selects | Intel Software
Свежие видео