Deadly Truth of General AI? - Computerphile
Why Hacker News recommends it
Often pointed to as an accessible first introduction to AI safety and why a superintelligent AI could be dangerous.
What it is
A Computerphile video in which Rob Miles warns against assuming a general AI will think like a human. He uses the thought experiment of a stamp-collecting AI to show how a goal-driven system could pursue its aim with dangerous results.
Recommended by 3 HN commenters across 3 different months, 2016 to 2024.
What Hacker News said
Recommends pdkl95 · 2016-03 · on “Why AlphaGo Is Such a Big Deal”
> exponential leap forward A recent(-ish) Computerphile video has a good overview of the AI-self-improvement problem. [LINK] I recommend watching the previous video first, which introduces the problem of strong-AI rapidly finding solutions (especially with poorly-specified questions) that may not be in humanity's best interest. [this video] Before anybody jumps to overly-sensational conclusions, note that the last video in that series, Rob Miles explains how exponential self-improvement is an extreme point in the space of possible AI development. We don't know how to predict discoveries[1], so we need more research into AI, so we can hopefully make something that isn't exponentially growing beyon
Recommends johncs · 2022-12 · on “Perhaps It Is a Bad Thing That the Leading AI Companies Cannot Control Their AIs”
There's a great Computerphile video from 2015 that introduced me to the idea of AI safety awhile ago. It seems like some good context to this article: [this video]
Recommends circuit10 · 2023-04 · on “Stability AI Launches the First of Its StableLM Suite of Language Models”
But the concerns about AI taking over the world are valid and important; even if they sound silly at first, there is some very solid reasoning behind it. They’re big matrices, yes, but they’re Turing-complete which means they can theoretically do any computational task See [this video] for a really interesting video on why a theoretical superintelligent AI would be dangerous, and when you factor in that these models could self-improve and approach that level of intelligence it gets worrying…
Recommends circuit10 · 2023-04 · on “GitHub Copilot emits GPL code”
"those non-problems" Why is that a non-problem? It's a really important concern that we need to take more seriously I pasted this from another comment I wrote but: The concerns about AI taking over the world are valid and important; even if they sound silly at first, there is some very solid reasoning behind it. See [this video] for a really interesting video on why a theoretical superintelligent AI would be dangerous, and when you factor in that these models could self-improve and approach that level of intelligence it gets worrying…
Cites throwaway2048 · 2019-09 · on “Artificial intelligence is changing every aspect of war”
We understand how people work and think pretty well, their edgecases, and countermeasures to said edgecases. We don't understand edge cases of AI much at all, and the terrain-space of "possible minds" they might be is vastly broader than that of a human mind, and utterly outside our experience. An AI might work with absolute 100% flawless precision for 100 years, then decided one day to kill everyone. A lot harder to see that coming from a totally alien intelligence than a human one. AI does not think like humans, have human values, or care about what humans care about, that might make them extremely unpredictable and dangerous. There will be no time for iterative development, or learning fr
Cites ExtraE · 2021-03 · on “Moore's Law for Everything”
I don’t see the world this piece presents panning out. Either we make general intelligence (which then scales almost instantly to be way, way smarter than any human ever and then accidentally kills us [1]) or we don’t and humans still have a role to play in the workforce. [1] [this video]
Cites npoc · 2024-04 · on “Bitcoin Block 840000”
That's an issue with the concept of a "black budget", not the payment mechanism. The government corruption bitcoin stops is really bank corruption, but the central banks (including the fed) work hand in hand with the governments (control them in fact), so it's a kind of joint effort. The corruption works like this: When the Fed was formed in the early 20th century, it came to an agreement with the government to be able to print off unlimited amounts of money, providing it was in the form of loans and under the agreement that it would destroy the money when the loans were repaid. All under the Keynesian guise of "elasticity of money". The fly in the ointment is that the banks can charge inter