Pre-training foundation models on Amazon SageMaker | Step 1: Prepare data | Amazon Web Services

Опубликовано 24 июля 2024, 15:30

Amazon SageMaker helps you reduce the time and cost of training foundation models (FMs) at scale without managing infrastructure. In this video series, we will provide step-by-step guidance on training FMs from scratch on SageMaker.

To pre-train FMs, you first need to prepare massive amounts of data from sources such as social media, online forums, and company-specific data. In this video, you will learn how to create a framework to prepare large datasets, store processed data in a variety of sources such as S3 and FSx for Lustre, and use a file system that can offer GBs of throughput to pre-train an LLM.

Learn more at: go.aws/3Vgd31M

Subscribe:
More AWS videos: go.aws/3m5yEMW
More AWS events videos: go.aws/3ZHq4BK

Do you have technical AWS questions?
Ask the community of experts on AWS re:Post: go.aws/3lPaoPb

ABOUT AWS
Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform, offering over 200 fully featured services from data centers globally. Millions of customers — including the fastest-growing startups, largest enterprises, and leading government agencies — are using AWS to lower costs, become more agile, and innovate faster.

#AWS #AmazonWebServices #CloudComputing