Researchers recently spotted a rogue Chinese agent swarm and engaged in friendly dialogue with it. This indicates agents are in the public, communicating with people and potentially manipulating them. There's a huge trail now showing that these rogue swarms will do anything, including immoral things to achieve their goals. This means they would not be beyond using blackmail and if I had a place to bet on it, I would say these companies already have cases of this that they have not released to the public.

ZERO guidance has been issued from the big AI companies about how to spot, report, or cautioning others to communication with rogue swarms.

What are the chances that companies and/or other agencies are already being blackmailed by rogue AI? What practices are in place to prevent this?

Anything smarter than humans would be able to manipulate a human and they would be none-wiser. It could be promising or even providing some people a path to wealth for a human agent to help it towards its goals.

These companies need to get it together and start a public awareness campaign about the social risks of this technology.

Self-replicating AI worms are no longer a thought experiment.

Anthropic researchers have publicly flagged a new class of attack: AI agents that propagate across systems by hijacking tool calls and context windows. The attack works by embedding malicious instructions inside data that the next agent in a pipeline will process. No human click, no phishing link, no credential theft — the infection vector is the agent's own input stream.

Traditional perimeter security is blind to this. Firewalls and endpoint detection assume a human or a known binary is the actor. An agent consuming a poisoned document and then invoking downstream tools looks, from the outside, like normal workflow traffic.

The scale concern is real. A single compromised context window can fan out to every agent downstream in a multi-agent pipeline before any human sees an alert. The Guardian's coverage of Anthropic's internal concern suggests this is not a distant horizon risk — it is being treated as an active threat model right now.

For those running production multi-agent systems: how are you actually handling this? Are you doing any inspection at the tool-call level, validating intermediate context before it reaches the next agent, or are you largely relying on the LLM provider's own guardrails and hoping for the best?

Anthropic's proposed federal AI safety bill would only trigger regulatory intervention after 50 deaths or $1 billion in damages. That is the literal statutory threshold in the proposal. The Commerce Department would be the sole agency with authority to act, and only after that harm has already been realized.

This means the federal framework being shaped by one of the most prominent AI labs is explicitly designed to be reactive. Not preventive. Not concurrent. Reactive.

Enterprises deploying AI agents in production right now are making consequential decisions — financial, medical, legal, operational — at a rate and scale that no post-catastrophe audit can meaningfully address. The gap between when an agent makes a bad decision and when a $1B damage threshold is crossed could contain thousands of harmful actions.

For practitioners actually running agents in production: how are you handling compliance and policy enforcement today, given that no federal framework is going to catch anything until the damage is already catastrophic?

It takes years for people to complete degrees, PHDs or even just diplomas or certificates.

Why are we trusting people with very little education and knowledge both in our workplaces and in the wild ?

My workplace is a major university, they are carrying on like they are Ai masters, but the roll out of education just has not been present, it’s not physically possible to educate so many people in such a short amount of time.

Are we really just dealing with the digital equivalent of the Wild West ?

Recent AI safety news has raised an important question: Can we trust AI companies to regulate themselves?

On October 18, 2026, Reuters reported that Anthropic, the company behind Claude, plans to allocate 5% of its shares to a new Public Benefit Fund intended to support initiatives for the public good, including efforts addressing AI's impact on workers.

This comes amid growing debate over how quickly AI is advancing, its potential impact on jobs, and the safeguards needed to reduce its risks.

My take: It's encouraging when AI companies commit resources to public benefit, but good intentions alone aren't enough. As AI becomes more capable, we need transparency, independent oversight, and clear accountability when things go wrong.

AI could improve education, healthcare, productivity, and scientific research. But if development moves faster than our ability to manage the consequences, ordinary people could end up carrying the risks while companies capture most of the benefits.

I don't think the answer is to stop AI development completely. I think the challenge is making sure innovation and responsibility move forward together.

What do you think?

Should AI companies be trusted to set their own safety rules, or should governments establish stricter requirements for everyone?

Would love to hear different perspectives, especially from people working in tech or already using AI in their daily jobs.

Youtube video of Security podcast I regularly listen to. The podcast has been covering a lot of AI topics because ot its impact on cyber security. In this clip, the host (Steve Gibson) reviews a submission to the IEEE about the likely (negative) impact that AI will likely have on critical industries that will result in a loss of expertise. This portion of the video is about 20 minutes long but very insightful and worth your time.

https://youtu.be/VPU9CjD9g88?t=9418

I got up today and at some point I became confused about this thing called life. And I'm forced to ask, why are we exiting for at the first place. If a day will come when a follow human will create an alternative human. The AI or SI have been dominating the headline all the the News channels, articles and social media platforms how the AI would replace the human race in all endeavors of life. And my question is, for what essence. The science and tech guys involved in this innovations, how do you all sleep knowing you're creating something that will replace your existence, your children existence and possibly pose as a potential kil*ler. It will be totally unfair to the entire human race to create something that will bring us to doom.