Pre-training foundation models on Amazon SageMaker | Step 1: Prepare data | Amazon Web Services
564
23.5
Amazon Web Services764 тыс
Следующее
Опубликовано 24 июля 2024, 15:30
Amazon SageMaker helps you reduce the time and cost of training foundation models (FMs) at scale without managing infrastructure. In this video series, we will provide step-by-step guidance on training FMs from scratch on SageMaker.
To pre-train FMs, you first need to prepare massive amounts of data from sources such as social media, online forums, and company-specific data. In this video, you will learn how to create a framework to prepare large datasets, store processed data in a variety of sources such as S3 and FSx for Lustre, and use a file system that can offer GBs of throughput to pre-train an LLM.
Learn more at: go.aws/3Vgd31M
Subscribe:
More AWS videos: go.aws/3m5yEMW
More AWS events videos: go.aws/3ZHq4BK
Do you have technical AWS questions?
Ask the community of experts on AWS re:Post: go.aws/3lPaoPb
ABOUT AWS
Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform, offering over 200 fully featured services from data centers globally. Millions of customers — including the fastest-growing startups, largest enterprises, and leading government agencies — are using AWS to lower costs, become more agile, and innovate faster.
#AWS #AmazonWebServices #CloudComputing
To pre-train FMs, you first need to prepare massive amounts of data from sources such as social media, online forums, and company-specific data. In this video, you will learn how to create a framework to prepare large datasets, store processed data in a variety of sources such as S3 and FSx for Lustre, and use a file system that can offer GBs of throughput to pre-train an LLM.
Learn more at: go.aws/3Vgd31M
Subscribe:
More AWS videos: go.aws/3m5yEMW
More AWS events videos: go.aws/3ZHq4BK
Do you have technical AWS questions?
Ask the community of experts on AWS re:Post: go.aws/3lPaoPb
ABOUT AWS
Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform, offering over 200 fully featured services from data centers globally. Millions of customers — including the fastest-growing startups, largest enterprises, and leading government agencies — are using AWS to lower costs, become more agile, and innovate faster.
#AWS #AmazonWebServices #CloudComputing
Свежие видео
One person’s trash is another person’s accidentally deleted file. Here’s how to get it back. #Shorts