65K node Kubernetes AI Platform - A Reality
1 218
8
Google Cloud Platform1.17 млн
Предыдущее
2 дня – 2 2544:50Популярные
36 дней – 9380:57
40 дней – 1 8893:31Опубликовано 13 ноября 2024, 16:00
The size of generative AI models is constantly increasing, with current models reaching hundreds of billions of parameters and the most advanced ones approaching 2 trillion. Training such large models on modern accelerators necessitates clusters exceeding 10,000 nodes. GKE, currently supporting the world's largest managed Kubernetes clusters with 15,000 nodes, has the capacity to handle these demanding training workloads. Anticipating further advancements and even larger models, we are introducing support for 65,000-node clusters. This expansion, combined with innovations in accelerator computing power, will enable the training of models with 10 trillion parameters or more.
Subscribe to Google Cloud Tech → goo.gle/GoogleCloudTech
Subscribe to Google Cloud Tech → goo.gle/GoogleCloudTech
Свежие видео
6 дней – 8 7600:53
6 дней – 3 27710:27
6 дней – 1 4167:41
7 дней – 113 94111:07
115 дней – 4 581 3377:42Случайные видео
283 дня – 1 367 4399:44
325 дней – 70 4549:25
11.04.21 – 83 8650:16
17.01.19 – 3 6731:58
37 дней – 45 92410:03
39 мин – 20:05
11 часов – 015:08
1 день – 6780:32
6 дней – 1921:02
15 дней – 34 8678:12
15 дней – 900:48
