Scaling Up (Part 3)
132
Next
39 days – 2 22311:41Popular
63 days – 6 1480:18
66 days – 13 88510:02Published on 4 Dec 2025, 5:00
Welcome back to part three of our three part series on sharding and parallelism. In this episode we’ll put everything together, covering the training loop, data loading, checkpointing, and a complete, practical example with a Transformer block.
Resources:
Learn more → goo.gle/learning-jax
Subscribe to Google for Developers → goo.gle/developers
Speaker: Robert Crowe
Resources:
Learn more → goo.gle/learning-jax
Subscribe to Google for Developers → goo.gle/developers
Speaker: Robert Crowe
Fresh videos
7 hours – 19 95116:56
7 days – 17 45420:29
8 days – 6 2340:21
10 days – 34 69819:07Random videos
42 days – 3250:27
21.07.24 – 28 26320:25
29.04.24 – 101 7803:05
30.03.24 – 125 8880:57
17.11.23 – 8 8988:40
10.01.23 – 4002:04
2 days – 5274:37
3 days – 4 5661:32
4 days – 1 6040:18
4 days – 45 6461:12
6 days – 7 5871:27
12 days – 2301:22
17 days – 1 137 9691:01