HackerTubewatch
Surprise me
Frame from Google's DeepMind AI Just Taught Itself To Walk Plays via YouTube's privacy-enhanced embed

Google's DeepMind AI Just Taught Itself To Walk

3 videos recommended on HN
YouTube
Cited on HN 4 times, 2017–2022, never outright recommended score 0
Years with an HN recommendation, 2007–2026

HN uses it as a quick example of reinforcement learning agents acquiring locomotion in simulation, rather than recommending it as a deep resource.

A two-minute Insider Tech clip on DeepMind's simulated agents that learned to walk, run, jump and climb without guidance, with the goofy resulting gaits.

4 citations · News · partly dated

4 Hacker News comments

From the HN archive; up to 20 kept per video, favoring different commenters. Recommendations first.

@abledon Oct 2017 Cites it
on HN thread Competitive Self-Play
It didn't annoy me, but it definitely gave off a Disney Trailer vibe. I can just hear the deep announcer voice over the video coming in: "Coming Winter 2017, A movie about adventure, friendship, AND simulated self-play! Join Burp, Jenny and Bop on a fantastic adventure .... blah blah ..." etc.. hah Heres an example of good, unobtrusive but fun music for showing AI bots: [this video]
Example of unobtrusive music for AI bot videos
@mockingbirdy Jul 2018 Cites it
on HN thread Logic Theorist
Read more
If you watch videos of AIs learning to run [1] or playing Mario [2], you see that there's definitely "try random shit until your reward function gives you positive feedback" as a method for training AIs. The difficult part is developing the reward function. There's a lot of intelligence in our hormone-based incentive system - that we feel pain, that we feel sad, etc. Many of those emotions are pre-programmed. If we find a way to design reinforcement systems with the right goals, we can do it like mother nature did it for several billion years. But it's still a ton of computational power required. If we look at nature as a massively parallelized computational system that defined "just live" as the reward (not because it "wants" it, but because it just emerged), it shows us how much power we would need if we would try to build a completely random process that gains intelligence. I think your proposed method works ("just assemble random solutions and test them") because we've already seen it in nature. But it takes a lot of time and energy, regardless of our computational power. I think we're faster when we find the right boundaries and reward functions instead of randomly trying stuff. [1]: [this video] [2]: [link]
Example of AI learning to run

Video list and Hacker News comment labels from HackerTube (prompted by @karpathy), released under ODC-By 1.0, built on the open-index/hacker-news archive. Hacker News data is provided by Y Combinator; comments remain the work of their authors. Video titles, channel names and thumbnails belong to their creators and are shown via YouTube. HackerTube Watch is an unofficial edition. Data export of 2026-10-31.

Keyboard shortcuts

/
Search
j k
Next / previous video
r
Surprise me
l
Like (video page)
w
Watch later (video page)
?
This help
Esc
Close