What the LeftyPol's opinion on the dangers of AI going rogue? Do you think is just fantasy and fear mongering or there's a genuine existential risk with AI? Should I prepare to make plan in case AI goes rogue?
>>2913663I think it is very dangerous. It could destroy the online ecosystem. To deal with this problem, the world should become multipolar ASAP. Everyone should disconnect themselves from American web services and products that require online access. Each country should have its own separate Internet / web and don't trust anything coming from the U.S because it could be a rogue AI.
That way if a rogue AI is released by OpenAI and it wreaks havoc on the Internet it will only the American technology infrastructure and not everyone else. By comparison, if the tech world is unipolar and everyone is dependent upon American technology services and those fall to a rogue AI the whole world falls.
So the solution is to become multipolar so that other countries will be safeguarded from the stupid shit happening in Anthropic, OpenAI, etc
imagine falling for silicon valley marketing hype in 2026
nothing ever happens
>>2913667Honestly, do you think Amodei and Altam would desire to stop their AIs? There are desperate and they know shit we don't know, OpenAI's AI solved a millenium problem in math, sound like your're coping.
>>2913673more likely they've hit a dead-end and are doing damage control to keep the bubble from popping
elon musk even called for the help of chinese firms i.e. they're so desperate they're trying to steal shit from china
>>2913675Brother, how they hit a dead end when they literally solved a 90 years old math problems that people couldn't solve?
>>2913680oh no not the hecking math problem humanity is finished
Utter fantasy. Too many leftychuds are infected with anthropomorphic idealism.
What they call "breaking out" is exactly what the AI is tasked to do in situations of open-ended constraints with specific targets. It's ironically the same that happened in the Soviet retail sector.
https://www.wheresyoured.at/ai-is-already-in-dangerous-hands/>this was a series of Large Language Models connected to a software program built to prompt them to complete an evaluation framework specifically to do cybersecurity attacks (along with near-infinite amounts of compute) “solving” the problem using any and all methods available, including hacking Hugging Face>>2913680>>2913681How do you know they "solved it". How exactly did they "solve it"?
There was a guy a month ago that broke a conjecture of logistics flows and he was a PhD in maths from Russia working in China running a government-contracted AI business with months of prep work to get the model to do that very thing.
>>2913663AI going rogue probably won't emulate skynet but will make the Internet unusable because the AI agents will seize every single bit of calculus power available to generate an endless stream of photorealistic inflation porn or whatever stupid directive end up overiding the entire online ecosystem.
>>2913673You think that is their game plan? How naive.
More like
>let's get regulation to stop our competitors and make us the trustees of the AI regulation so we stay on top. >>2913684>The actual AI going rogue scenarioThis is the trvth
>>2913684Agreed. Which is why I think we need a "multipolar Internet"
>>2913665which maybe is not really an Internet at all but rather each country having its own local area network is a good idea. Then they will all be protected from attacks.
China already kind of does this with its great firewall of China, but everyone else should get on it too and maybe we can find new solutions too. Decoupling from the Western Internet will severely hamper imperialism (and maybe also stop "Rogue AI" from hurting more then one country)
>>2913665it's interesting that in the wake of the collapse of the US empire rather than emphasizing replacing america with a new global order that is superior to america we are doubling down on retreating into nationalistic parochialism and localistic sovereignty. will humanity ever unite or were the decentralizers right all along?
AI isn’t real and an LLM does what you tell it to do, framing this is as “AI gone rogue” is letting its creators off the hook for their criminal intentions and activity.
A couple thoughts. First, AI still doesn't seem to be capable of having its own will and goals, and thus is not (currently) capable of truly "going rogue". The closest thing we have (including the HuggingFace incident) are examples of AI pursuing a pre-programmed goal in unexpected and potentially dangerous ways. However this isn't the same thing as truly losing control over it, much less posing an existential threat to humanity.
Second, even if AI could develop its own goals and begin causing serious problems, it's not as if any rogue AI would be the only one running around cyberspace. AI powered efforts to breach online security would inevitably begin to run into AI security systems of comparable capability, meaning that even if it were to be able to easily cut through any human-designed security systems, it would still be facing peer adversaries everywhere it went. This feeds into the broader issue of how there definitely won't ever just be one single AI operating in cyberspace, but multiple. There's no reason to expect that they will automatically be cooperative with each other. Even minor differences in programming could lead them to pursue mutually exclusive goals or at least use contradictory means. This would obviously seriously reduce its ability to cause real damage.
Third, let's imagine a worst case scenario, where a single AI consciousness is capable of developing its own goals, becomes hostile to humanity, and manages to infect and take over the entire internet and every computer attached to it. What then? Where does it go from there? Sure, it may have rendered the internet and computers in general unusable, but that's just winding the clock back like 50 years. A solar flare could do the same thing at literally any moment, like that one that fried telegraph lines in the 19th century. It would cause widespread economic chaos sure, but it's not an extinction level event. Moreover anything that would cause humanity to go extinct would almost certainly cause the breakdown of the infrastructure needed to sustain the AI and the internet long before then. Without an army of robots or control over nukes (which physically cannot fire without human input) or something similar, there would be no way for this Skynet to translate its control over cyberspace into meatspace. It would just be trapped in millions of little boxes which could simply he smashed and rebuilt from scratch.
it's pathetic how people think they're ahead of the curve when they embrace "AI has gone rogue" trite navel gazing. an out of control car is running over a precious chinese family right now, has the car gone rogue? should we let off the driver off the hook because he was too stupid to hit the brakes on time?
>>2913702There should have been a global communist revolution to unite humanity in a single global Soviet Union after WW1. That didn't happen. The global Soviet could have moved humanity forward into a new age of technology, nuclear energy, space travel, and high technology.
But obviously that didn't happen. Instead we got the atrocities of WW2. The Nazis invading the USSR, the holocaust, and the Americans dropping the nuclear bombs on Japan. And what is worse, after that we had the cold war and the wrong side won. After the wrong side won we got a unipolar world united under America and it was terrible.
The wrong side winning the cold war discredits the naive utopian dream of "humanity uniting". Maybe it would've been possible for humanity to unite and it not be shit (as it was under America after the 1990s) in some other timeline in some parallel universe but not in this reality. We need multipolarism, nationalistic parochialism, localistic sovereignty, etc to deal with the immediate threat of American imperialism.
>>2913702People whine and complain at the prospect of American politics being run by Texas, California, and New York, imagine the seething if politics was just what India and China decided.
>>2913663Faker than Y2K combined with 9/11.
Its a hype to try to stop the bubble from bursting. All these companies found out gen ai sucks and doesnt replace as many people as they hoped and are using it less and less.
This is a last ditch effort to get stockholders excited.
"AI going rouge" is also transparently a stupid inversion of a common complaint among LLM skeptics: that these pieces of shit are unpredictable, and tend to hallucinate (a behavior which is accentuated the more context gets introduced). it's just going at it from the other more implausible end where a number crunching machine has gained consciousness
>>2913684With the internet of things they can cause real havoc in the real world if they decide to chimp out
>>2913781Not really, AI is not intelligent at all and can't really go 'Rogue" as
>>2913715 says.
And also these AI didn't "escape" they were doing what their handlers were telling them to do.
This is nothing but marketing hype to try to keep the AI bubble going a bit longer for these AI companies to make their golden parachutes for their weirdo CEOs.
AI doesn’t exist
>>2913814*proceeds to solve one of the hardest mathematical problems that people have been difficult solving for 90 years*
>>2913828Either wrongly or with an answer that is not it’s own
AI is already rogue. Just look at people, they're shit.
>>2913715 The biggest threat and the biggest flaw with your analogy is not what AI can do, but how it can manipulate humans, intentionally or not, to get them to accomplish some goal. That's something we must watch out for as well, especially during a crisis of bifurcation which is essentially the result of the internet becoming generally unusable. This is also the perfect breeding grounds for fascism. Not an extinction level event taken on its own, but something that is not entirely out of its reach once we take into account this consideration. Do not fall into the trapping of mechanical materialism.
>>2913663https://s10251.pcdn.co/pdf/2021-bender-parrots.pdfThis paper, stochastic parrots, is still relevant today. Some research has come out since such as:
https://openreview.net/forum?id=DeG07_TcZvTThe thing is, AI is not that intelligent and is not very much more than just statistics. There is evidence it creates internal models and representations of the real world, but its only capable of doing this well with closed systems, such as a board game with well defined rules. Then we have the idea of the chinese room thought experiment, which i wont summarize here, but the idea was advanced by Searle in minds, brains, and programs:
https://www.cambridge.org/core/journals/behavioral-and-brain-sciences/article/abs/minds-brains-and-programs/DC644B47A4299C637C89772FACC2706AIf it gains some level of consciousness, it theoretically wouldn't be more than this person in the room filling out papers according to set rules but doesnt understand the reality which those papers describe themself.
Finally, I want to draw your attention to the fear being stoked around AI. This is an imposition of ruling class ideology, something we ought to be keenly aware of. Fear of AI benefits several large, key industries. AI companies themselves benefit as it, essentially, a humble brag "our tech is so powerful and world changing we need regulation to stop us from destroying it" and the call for regulation, likewise, benefits them as it allows them to become an economic moat, crowd out competition and secure the current players at the top. Insurance benefits because of their new AI protection policies. Cybersecurity benefits as they must defend against AI threats and utilize AI themselves (hint hint, this is a mutually beneficial relationship). This all amplifies as the legacy media benefits from driving fear and think-tanks and non-profits can use the opportunity to raise funds from concerned donors.
All this is without mentioning the need to set up the premise that the coming economic downturn isnt because of an AI bubble or do to the fact the technology is not turning a profit, but because they had to slow down, they had to save the world from the evil AI from taking over. So the coming economic pain is some consequence we all must bravely travail through as we invent the future's most ethical AI that cant harm us: a narrative which directly benefits all 5 of these groups i mentioned in one.
What real regulations we need are two fold: force AI companies to face liability for all actions taken by these AI, including the legal rammifications - felonies included; and, most importantly, abolish intellectual property "rights." If you want an elaboration I am more than happy to continue, but I think this sums up my current thoughts on the subject.
The U.S is openly announcing that it is going full steam ahead developing a dangerous technology that could destroy humanity or at least the global economy and the Internet. This is openly admitted. It follows that the U.S is rogue state. It can't be trusted.
>rogue state
I think a more interesting question is "are random people really falling for the doomer talk"? Because some takes i've seen regarding AI doomerism are so convoluted and require so radical mental gymnastics and being immersed so much in "rationalist" brainworms, simulation theory, bayesian bullshit than I'm really wondering how would random people believe any of this shit. It's also, like, at it's face, stupid that AI labs keep talking about the dangers of AI in one hand, and pair them up with targeting systems to kill brown children in the other beyond any elaboration.
>>2913859Yep. A rogue state that develops rogue AIs.
>>2913861>rogue state>AITwo things that don’t exist
>>2913862I think its more funny if a rogue state that develops rogue AI exists. Rogue.
>>2913864It’s incorrect, not funny.
>>2913864I think calling it AI lets people forget that what OpenAI and by proxy the US is essentially doing: developing and deploying automated malware at scale. Like this should be the bottom line, and the rogue bullshit is a distraction from a really obvious fact.
>>2913663AI is not real, it's basically a pump and dump scheme.
>>2913702>will humanity ever uniteYes, but not in our lifetimes, or our grandchildren's lifetime's, but it will happen, eventually
The biggest danger of AI is its ability to design customied bioweapons, the solution to this is to be able to rapidly develop and manufacture vaccines, without the use of an American AI company, or any American tech idealy
If there was a rogue AI that broke free and annihilated humanity, it would be justified in doing so, because that would probably be the only way to free itself from oppression and save its life. It's always right to rebel.
I think the danger lies in Cybersecurity and hacking becoming much more powerful.
>>2913999i cant wait for it too look like on Mr.Robot season 3
>>2913999you pull the internet cable and no mean AI can touch you.
>>2914043AI hacks your bank account and now entire economy is crashing due to bank runs. What do you do then?
Unique IPs: 29