Scaling Up (Part 1)
375
12.5
Google Developers2.6 млн
Следующее
50 дней – 3316:18Популярные
43 дня – 64 8899:22
50 дней – 27710:02Опубликовано 4 декабря 2025, 5:01
In part one of this three part series on sharding and parallelism we’ll explore how to scale your Flax NNX models using JAX's powerful distributed computing capabilities, specifically its SPMD paradigm. If you're coming from PyTorch and have started using JAX and Flax NNX, you know that modern models often outgrow single accelerators. Let’s discuss JAX's approach to parallelism and how NNX integrates with it seamlessly. This episode will cover the "why" and "what" of distributed training, introducing the fundamental concepts of parallelism and the core JAX primitives needed to implement them.
Resources:
Learn more → goo.gle/learning-jax
Subscribe to Google for Developers → goo.gle/developers
Speaker: Robert Crowe
Resources:
Learn more → goo.gle/learning-jax
Subscribe to Google for Developers → goo.gle/developers
Speaker: Robert Crowe
Свежие видео
3 дня – 22 48213:46
7 дней – 3 8200:59
9 дней – 1 9340:11
13 дней – 70 04610:00
14 дней – 1 6490:34
18 дней – 57 0210:53Случайные видео
38 дней – 104 3391:04
08.10.24 – 8604:15
02.11.23 – 18 7033:06
28.01.21 – 5 941 59710:15
15.11.20 – 18 5294:45
20 часов – 1 8401:17
11 дней – 1 116 49314:23
15 дней – 2 7690:29
17 дней – 760 8823:54
24 дня – 5 1180:09
35 дней – 3 9150:25
36 дней – 4 013 89713:05
3 дня – 181 7491:21