Why Greatness Cannot Be Planned — Kenneth Stanley

What Hacker News said

Strong rec visarga · 2021-02 · on “Ask HN: Is the Brain a Computer or an Antenna?”

I think it's mainly a competitive & cooperative self replicator. The brain exists because previous generations did well. Do we need to infuse "antenna magic" into our brains, aren't they marvelous enough? I found this video about open endedness (contrasting evolution vs optimization) in the brain and AI very inspiring: [this video]

Strong rec ZephyrBlu · 2021-05 · on “NNCP: Lossless Data Compression with Neural Networks (2019)”

> The signal might be good but is it the signal you should be focusing on? There is an amazing amount of interesting stuff being discovered all the time. But is it helping you achieve concrete goals? My point is that putting everything through the filter of "does this directly help me achieve my goals?" isn't the best way to pursue your goals, assuming we're talking about big goals where the path to achieving them isn't clear. I recommend checking out this podcast episode called "Why Greatness Cannot be Planned". It really changed my perspective on achieving my long term goals: [this video] Also on Twitter, yeah some people don't only tweet things in their domain. But I've found that some people

Recommends visarga · 2021-02 · on “DeepMind achieves SOTA image recognition with 8.7x faster training”

> Anyways, my point is, none of this required math or genius or particularly demanding thought. It was basically let's tinker with this until we find a way that's better, using guess and check. No equations needed. I get that you'd like to have a clear theoretical basis for what works and we're far from there. But in the meantime we're stumbling in the dark, discovering tricks and forming intuitions, not knowing even where the road is going to lead us. This is an evolutionary process of ideas, similar to biological evolution that managed to make us. If you know where you're going you can optimise your actions but when you don't even know what might be useful later on, then all attempts are g

Recommends visarga · 2021-04 · on “Feynman: I am burned out and I'll never accomplish anything (1985)”

> Do things that don't matter. Aside from the doors it can unlock, it's just damn fun. I found this discussion about open-endedness being very illuminating about doing stuff that are just fun. A revolt against objectives. [this video]

Recommends bvsrinivasan · 2021-04 · on “Feynman: I am burned out and I'll never accomplish anything (1985)”

In all probability, Youtube's algorithm will already suggest this to anyone who watches the talk, but there is a (very) long, ML Street Talk interview on this idea here [this video] Stanley addresses some strong and subtle criticisms here but I actually preferred the book the most. The book is a bit repetitive but has some very good ideas in the appendix.

Recommends visarga · 2021-05 · on “Crazy New Ideas”

This video is relevant. They talk about "openendedness", serendipity, the tyranny of objectives, the evolution of ideas (and biology), inventing new problems not just solving problems. There are important implications in AI. Kenneth Stanley - Why Greatness Cannot Be Planned on Machine Learning Street Talk. [this video]

Recommends visarga · 2022-09 · on “Campus College of Letters and Science plans to limit high-demand majors”

You're right, the search space is deceptive and going directly towards the goal might lead to a dead end. Only in hindsight we can tell which stepping stones were essential. Immediate results are the best, but in the meantime we need to focus on novelty and interestingness. A great video about open-endedness (warning - very long) with Kenneth Stanley, author of the book "Why Greatness Cannot be Planned" [this video]

Recommends mikhailfranco · 2024-03 · on “Abandoning Objectives: Evolution with the Search for Novelty Alone (2011) [pdf]”

Lehman & Stanley concerning how explicit objectives encourage effort on exploit rather than explore. AI is progressing using objective functions that can be expressed in a concise form (energy minimization, gradient descent, etc.). A similar mechanism has been at work in industry since Ford and Winslow, from time-and-motion to jit-supply-chain, all under the short-term profit incentive. These are narrow known objectives with a desire to get relatively quick results. But perhaps the big leaps are not achieved by climbing local hills. The observation harks back to Thomas Kuhn, who described the activities of normal science and great leaps - scientific recolutions. Obviously there are further p