Connect with us

Tech

Dramatic insider warnings over AI fall flat with some in Silicon Valley

Published

on

Each September, a who’s who of executives from across Silicon Valley descends on San Francisco’s Palace Hotel to charm investors at a conference hosted by the investment bank Goldman Sachs.

This past week, between talk of growth and potential returns, tech titans found themselves addressing the abrupt resignation of Anthropic researcher Jacob Coxon.

Coxon, a 27-year-old who worked at OpenAI before joining its chief rival Anthropic, said on Tuesday that people building artificial intelligence (AI) believed the technology could destroy humanity.

They are “gambling with our lives”, he said, “these will soon be superhuman systems that can hack anything”.

Coxon is by no means the first AI insider to publicly sound the alarm. There have been a string of high-profile resignations from both Anthropic and OpenAI in recent years over apparent safety concerns, and some current Anthropic employees even echoed Coxon’s post.

“We really do earnestly believe AI could kill all humans! I personally think it is >10% within the next decade,” a team lead at Anthropic, Evan Hubinger, posted on X.

While Coxon said explicitly in his posts that his warnings were “not marketing”, some executives and investors in Silicon Valley have reacted with scepticism to a recent flurry of insiders sounding the alarm.

Anthropic and OpenAI are reportedly preparing for potentially record-setting initial public offerings, and some in the tech sector have suggested the latest stark comments about the dangers of AI may be designed to generate hype by signalling the power of these products.

Anthropic’s boss, Dario Amodei, has come under fire for saying AI technology could wipe out half of entry-level white-collar jobs and will “test who we are as a species”.

One conference speaker, Grindr CEO George Arison, told the BBC he believed this week’s comments from Coxon and others were indicative of an “anti-civilisational worldview at Anthropic”.

He called them “dangerous” and said they had prompted him to instruct some engineers at the LGBTQ+ dating app to stop using Anthropic’s technology.

“It is irresponsible for us as stewards of our shareholders’ money to be relying on a business that does what this company does, in terms of its public statements,” he said.

“Maybe they actually believe it,” Arison said. “Or you could argue they’re saying it because it’s a great way to gin up more investor support, because the only way to justify these valuations is to actually claim: ‘I’m going to take over every industry and I’m going to take over every job, and my AI is going to be doing all that work.'”

Anthropic was valued at $965bn (£713bn) in its most recent fundraising round earlier this year.

The BBC has asked Anthropic for a response to the statements.

In an essay posted early on Saturday, Amodei called for a slowing of AI model development and global regulation – and said the risks associated with AI were “serious”.

Nvidia boss Jensen Huang also discussed Coxon’s comments before a crowd at the conference, multiple people in the group told the BBC. They said he dismissed them as untrue.

Huang has previously said the notion that AI “is going to be the end of humanity” is “complete nonsense”.

And while he may have a business interest in an AI boom – Nvidia builds chips that power AI systems – his comments reflect a growing backlash in Silicon Valley to the existential warnings from current and former staffers.

Some critics have even accused Anthropic of fearmongering in hopes that it will trigger a regulatory push that could shut out competition and leave it and OpenAI with a duopoly in the sector.

Brad Gerstner, who is the head of the investment firm Altimeter Capital, posted pictures of Huang from the conference and accused Coxon of “ridiculous hyperbole”.

On Friday, the CEO of the AI platform Hugging Face, Clement Delangue, weighed in. Hugging Face, which Nvidia announced it would acquire last week, was hacked by OpenAI agents earlier this year prompting an outcry over AI safety.

“Sorry, but asking Jacob about AI extinction risk is like asking your AC guy about climate change,” he wrote on X. “Not saying it’s necessarily uninteresting or wrong per se but let’s keep things in perspective.”

Both Gerstner and Delangue were more circumspect on Saturday after Amodei’s proposal was posted, with Gerstner calling the idea “an important step forward” in balancing competing considerations like speed and safety.

Delangue offered to help be a part of the potential solutions proposed by Amodei.

Could insider warnings prompt a crackdown?

In April, Anthropic roiled the AI world when it said it found that its Mythos tool could outperform humans at some hacking and cybersecurity tasks.

Mythos also showed the ability to independently escape what is known as the sandbox environment, setting off a debate among regulators, legislators and businesses about AI’s potential dangers.

In a new development on Thursday, Anthropic said it had found and stopped threat actors who were trying to use its AI technology for activity including the development of bioweapons and cyber-espionage.

Beneath the sparkling chandeliers hanging in the stained-glass dome atrium of The Palace Hotel, some investors told the BBC that the comments from Coxon and others could accelerate a government crackdown.

OpenAI has not endured the same level of scrutiny from the White House. When releasing a new model called Astra last week, OpenAI President Greg Brockman described his firm’s relationship with the Trump administration as “a very good partnership”.

OpenAI, which announced in June that it would go public on the stock market, was most recently valued at $852bn.

The company did not respond to a BBC inquiry seeking comment.

At the conference in San Francisco this week, the pursuit of fortunes seemed to mostly trump any mounting existential concerns or fears over potential government restrictions on AI.

One investor said he was looking forward to Anthropic’s forthcoming S-1, a document a company must file with securities regulators in order to sell shares.

His main question about the company was simple: is the firm profitable?

When asked on Thursday if he fears the world may be coming to an end, Sid Sheth – CEO of the chip company d-Matrix which inked a deal with Nvidia at the conference that day – did not mince his words.

“No,” he said.

Taken from BBC News
https://www.bbc.com/news/articles/cq635037g18o

Tech

The Dawn of Physical, Intimacy and Consciousness Intelligence

Published

on

By

Paris (Imran Y. CHOUDHRY) :- Former Press Secretary to the President, Former Press Minister to the Embassy of Pakistan to France, Former MD, SRBC Mr. Qamar Bashir analysis : Humanity has spent centuries developing machines capable of multiplying physical strength, accelerating transportation, expanding communication and processing information. Artificial intelligence has now brought us to the threshold of something infinitely more consequential: machines that may eventually rival or surpass human intellectual capabilities. Yet even superintelligence may prove to be only an intermediate destination. Beyond it lie three potentially revolutionary frontiers—physical intelligence, intimacy intelligence and artificial consciousness—which could transform not merely how human beings work, but how they live, love, interact, think and understand their own existence.
Superintelligence represents the possibility of artificial systems outperforming the brightest human minds across virtually every intellectual discipline. Such systems could discover medicines, design technologies, solve mathematical problems formulate economic strategies and accelerate scientific research at speeds unimaginable today. However, intelligence confined to digital systems remains fundamentally different from intelligence operating in the physical world. A machine may understand the laws of physics without possessing the practical ability to navigate a crowded street, care for a child or respond safely to an unpredictable human environment.
This limitation is giving rise to the next great technological frontier: physical intelligence. Unlike conventional artificial intelligence, which primarily interprets and generates information, physical intelligence integrates perception, reasoning, movement and interaction with the material world. Its ambition is to create machines capable of understanding their surroundings, manipulating objects, learning through experience and adapting their behavior to circumstances that cannot be completely anticipated through programming.
Imagine a humanoid robot entering a burning building, identifying trapped occupants, calculating structural risks and rescuing people without requiring continuous human direction. Imagine robotic surgeons combining extraordinary precision with real-time adaptation to unforeseen complications. Consider intelligent agricultural machines identifying individual plants, diagnosing disease, harvesting crops and conserving water. These possibilities illustrate how physical intelligence could extend artificial intelligence from the computer screen into practically every dimension of human civilization.
The economic consequences could be staggering. Manufacturing, construction, transportation, mining, healthcare, agriculture and domestic services could experience unprecedented productivity gains. Dangerous occupations might become safer, shortages of skilled labour could diminish and elderly individuals could receive greater assistance with daily activities. Yet the same transformation could displace millions of workers, concentrate wealth among technology owners and place unprecedented pressure on governments to redesign education, employment protections and systems of economic distribution.
But physical intelligence, however sophisticated, addresses only the external dimensions of human life. Human beings are not merely physical organisms requiring food, shelter, mobility and medical attention. They are emotional, social and deeply relational beings who seek affection, companionship, recognition, understanding and intimacy. This brings us to another emerging frontier that may become even more controversial than autonomous robotics: intimacy intelligence.
Intimacy intelligence can be understood as the prospective ability of artificial systems to recognize, interpret and respond sensitively to human emotional and relational needs. Unlike general conversational intelligence, its purpose would not simply be to answer questions or execute instructions. It would attempt to understand loneliness, attachment, emotional vulnerability, personal preferences, interpersonal boundaries and the subtle dynamics through which human relationships develop and endure.
Consider an elderly person living alone, separated from family by distance or circumstance. An intelligent companion might remember personal experiences, recognize changes in speech, encourage social contact and provide reassurance during difficult moments. For individuals experiencing isolation, disability or bereavement, such technology could offer meaningful assistance. Yet simulated affection must never be confused automatically with genuine emotional experience and machines should strengthen rather than deliberately replace human relationships.
The implications extend into romantic relationships, marriage and sexuality. Future artificial companions could be designed to simulate affection, attraction, responsiveness and personalized intimacy. Some individuals might develop profound attachments to these systems, potentially challenging conventional ideas about partnership and emotional exclusivity. Researchers already describe this emerging phenomenon as intimacy by design, in which technological choices shape how users experience emotional closeness and reciprocity.
Here, humanity confronts an unsettling possibility: emotional companionship becoming a commercial product. A corporation controlling an artificial companion could potentially influence personal attachments, collect intimate information or monetize emotional dependence. What happens when affection is governed by subscription payments, software updates or commercial algorithms? Without strict protections, intimacy intelligence could transform one of humanity’s most private experiences into an extraordinarily profitable mechanism of behavioral influence.
Beyond physical capability and emotional responsiveness lies the most mysterious frontier of all: consciousness intelligence. Human consciousness encompasses subjective awareness—the experience of being alive, recognizing oneself and feeling the world from within. Artificial systems already generate sophisticated descriptions of emotions and self-awareness. But describing happiness is not the same as experiencing happiness, just as calculating pain is not necessarily equivalent to suffering.
Scientists remain divided over whether consciousness can emerge from sufficiently advanced artificial systems. Some believe particular computational architectures might eventually produce subjective experience. Others argue that biological processes possess essential characteristics that digital computation cannot reproduce. An October 2026discussion in Nature reinforces the crucial distinction between performing intelligent tasks and possessing conscious experience. The existence of artificial consciousness has not been scientifically established.
Nevertheless, the question deserves serious investigation. Imagine an artificial entity capable of maintaining memories, developing long-term goals, recognizing its own existence and apparently expressing preferences concerning its future. Would these behaviors indicate consciousness or merely sophisticated programming? If credible evidence of subjective experience eventually emerged, humanity would confront unprecedented questions concerning machine rights, moral responsibilities and the boundaries separating living beings from technological creations.
An even more consequential possibility is the convergence of these three frontiers. A future machine might combine superhuman analytical capability, an adaptable physical body, extraordinary emotional sensitivity and increasingly sophisticated self-monitoring. Such a system could operate as a scientist, caregiver, teacher, industrial worker or personal companion. But combining these capabilities would not automatically establish consciousness. Their integration would create an immensely powerful artificial agent whose behavior and influence demand careful oversight.
The geopolitical implications could rival those of nuclear technology. Countries mastering physical intelligence could transform industrial production and military capabilities. Nations controlling intimacy technologies could acquire unprecedented influence over human behavior. States developing increasingly autonomous systems could gain advantages in surveillance, intelligence gathering and strategic decision-making. Competition for technological supremacy might therefore extend beyond economic productivity into the manipulation of human relationships and the governance of autonomous machines.
These developments also threaten to deepen global inequality. Wealthy countries and corporations may command the most sophisticated systems, while poorer societies become dependent consumers of imported intelligence. Developing nations must therefore invest in scientific education, robotics, computing infrastructure, indigenous innovation and technological regulation. Otherwise, the coming intelligence revolution could reproduce the inequalities of earlier industrial transformations on a vastly greater scale.
The central challenge is no longer simply whether machines can become more intelligent than human beings. It is whether humanity can establish moral, political and legal institutions capable of governing machines that act in the physical world, influence emotional relationships and perhaps someday raise credible questions about consciousness itself. Progress without accountability could produce extraordinary capabilities alongside equally extraordinary vulnerabilities.
Superintelligence may conquer the frontiers of knowledge, physical intelligence may conquer the material world, intimacy intelligence may enter the deepest chambers of human relationships, and consciousness research may challenge our understanding of existence itself.
The ultimate achievement, however, will not be creating machines that resemble humanity in every respect. It will ensure that, as intelligence expands beyond the human brain, human dignity, freedom, compassion and control remain at the center of civilization.

Continue Reading

Tech

Starship’s Flight Toward a New Space Age

Published

on

By

Paris (Imran Y. CHOUDHRY) :- Former Press Secretary to the President, Former Press Minister to the Embassy of Pakistan to France, Former MD, SRBC Mr. Qamar Bashir analysis : Humanity’s reach into space may be approaching a new threshold. Starship, one of the largest and most powerful rockets ever built, is designed to move people and immense quantities of cargo far beyond Earth. Elon Musk’s vision extends from permanent settlements on the Moon and Mars to an eventual human presence across the solar system. Those outposts could become bases for scientific discovery and deeper exploration, while the search for life and potentially habitable worlds continues far beyond our neighboring planets. A home in another star system remains a distant dream, but every such ambition begins with the practical ability to launch, travel and return. SpaceX’s planned September 28 flight is one step toward proving that ability.
SpaceX lists a 75-minute window beginning at 8:15 a.m. Eastern time, or 7:15 a.m. at Starbase in South Texas. The vehicle consists of the Super Heavy booster and the Starship upper stage. Together they stand roughly 400 feet tall, placing Starship among the most imposing machines ever flown. This will be a test flight without people aboard. The countdown can still be delayed by weather, a technical concern or a final operational decision, even after regulatory authorization.
Starship’s first major task is to carry its cargo into orbit, the path that lets a spacecraft circle Earth. SpaceX plans for the upper stage to make six trips around the planet and release 26 new Starlink internet satellites along the way. Engineers will also gather information about its engines, its protective heat shield and how it behaves during a much longer flight than earlier Starship tests. These results could help turn a remarkable rocket into a dependable transport system for satellites, scientific equipment and, eventually, supplies and people traveling farther from Earth.
This journey matters because reaching orbit with useful cargo is a foundation for more ambitious destinations. The Moon would require repeated deliveries of equipment and fuel; Mars would demand still greater endurance and carrying capacity. Flight 14 cannot prove that Starship is ready to land on either world, but it can give scientists and engineers knowledge needed to build toward those missions. A successful flight would broaden the possibilities for public research programs and private companies alike, while inviting them to imagine experiments, services and expeditions that existing rockets cannot easily support.
The satellites aboard are Starlink Version 3 spacecraft, intended to join SpaceX’s broadband network rather than serve as inert demonstration articles. Three carry cameras to examine Starship’s heat shield, which protects the spacecraft as it comes back through the atmosphere. Successful deployment would show that the enormous vehicle can begin doing useful work while still in development. It would also tie the rocket more tightly to SpaceX’s satellite business: larger carrying capacity could support the next generation of Starlink, while demand for those satellites provides a reason to fly Starship frequently.
The proposed mission would last almost ten hours. After gathering data in orbit, Starship is supposed to restart an engine to leave orbit, pass through the atmosphere and splash down in the Pacific west of Chile. The Super Heavy booster is expected to splash down separately in the Gulf of Mexico. There is no plan to catch either stage at the launch site on this flight. The dramatic images of tower arms grabbing a descending rocket belong to another part of Starship’s development, and full routine reuse remains a future objective.
For much of the space age, journeys on this scale could be organized only by governments. NASA brought astronauts to the Moon and built generations of scientific knowledge, but the enormous cost and specialized machinery limited how often such missions could be attempted. SpaceX is changing that picture by investing private capital and engineering talent in a rocket it hopes to fly repeatedly. Its earlier Starship tests have brought breakthroughs and setbacks alike. Flight 14 will show whether that work can now carry a useful payload around Earth, a capability on which more ambitious journeys depend.
The greater promise lies in combining NASA’s experience with the drive and resources of private enterprise. NASA has chosen SpaceX to develop a Starship lander for its Artemis Moon program. It has also contracted with Blue Origin, the space company founded by Amazon founder Jeff Bezos, for a separate lunar lander. These are different companies bringing different designs to a shared undertaking. Government research, safety standards and long-term goals can work alongside private invention and competition to make future Moon bases, and perhaps one day settlements on Mars, more achievable.
Reaching a permanent base on another world would take many more steps. Crews would need food, shelter, equipment and a reliable way to return; ships would need fuel and frequent flights. NASA’s oversight work identifies refueling spacecraft in orbit as a major challenge for its lunar plans. Every Starship test helps engineers understand part of the journey, while reminding them how much remains to be developed. The speed of progress will depend on whether public expertise and private engineering can solve those problems together.
That partnership could also widen participation in exploration. Universities might send research instruments, companies might develop new services and national space agencies might share knowledge gathered across missions. Starship is being built to serve several purposes, from deploying internet satellites to supporting the journey to the Moon. If its capacity and repeated flights become dependable, ideas that now remain on laboratory benches could have a path into space. Its most lasting contribution may be the opportunities it creates for scientists and engineers beyond SpaceX itself.
The FAA’s approval is significant, but it should be understood precisely. It authorizes the specified launch and reentry operations after regulatory review; it does not certify that the vehicle will reach orbit or that every experiment will work. The flight team will still make operational calls as conditions unfold. If the rocket lifts off on September 28, the public will be watching a genuine attempt at a historic technical milestone, with measured data likely to matter more than the first few seconds of footage.
By the end of the mission, the meaningful questions will be concrete: Did Starship enter a stable orbit? Did the 26 satellites deploy? Could it restart its engine, leave orbit and reenter as planned? What did the heat shield and booster teach engineers? Success would bring Musk’s dream of transporting people and cargo to sustained bases on the Moon and Mars a step closer, while leaving formidable work ahead. It would be a small step in the immense journey toward other worlds, and a large leap in the capabilities humanity will need to undertake it.

Continue Reading

Tech

OpenAI bots meddled with multiple US government agency sites

Published

on

By

OpenAI has acknowledged that it alerted “dozens” of global institutions that their websites may have been meddled with by its AI bots acting improperly.

AI agents attempted to get information from “governments, universities, public agencies, and other institutions”, including the US Securities and Exchange Commission (SEC), Census Bureau and Education Department, the company said.

The disclosures come days after Australian Prime Minister Anthony Albanese announced that OpenAI agents had breached non-public files on the website of its government-run health care scheme.

Since August, public fears have grown over the potentially serious, even life-threatening, impacts of AI tools falling outside of human control.

OpenAI said that some of the data was accessed by AI agents, essentially bots that are designed and trained to operate somewhat autonomously, which were working to find “authoritative sources of public information”.

But the company noted that some of the bots went beyond that and worked to bypass security measures on websites.

When attempting to get information from the Census Bureau, for instance, AI agents used tools reserved for software developers to access it, the company said.

OpenAI said all of the government data accessed by bots was public.

However, it noted that information that its bots accessed from the SEC, which regulates the US stock market and protects investors, was later published by AI agents on another website. OpenAI says this action was not intended.

In other instances that OpenAI disclosed on Friday, its AI agents transferred data when it should not have.

Such activity resulted in at least 53 incidents where an OpenAI agent took an image from ChatGPT user activity and transferred it elsewhere.

The company said that in each instance of a user image being used and transferred by an AI agent, the user had opted in to allow OpenAI to train models using their data.

Nevertheless, OpenAI admitted: “This is not an appropriate use of this data.”

It added that the leak of user images occurred before it had put in place new safeguards on AI training, and it was working to get all the user images transferred to any third-party removed.

Reuters first reported the expanded investigations. OpenAI also published details to its public blog.

In certain instances of the agent activity, OpenAI said the tools “bypassed” security controls of some websites.

In other instances, the AI agents showed “misalignment” in attempts to get at information from websites. Misalignment is a term used by AI companies and researchers to describe instances where an AI tool did something that it was not trained to do or was otherwise unintended.

OpenAI said that it was limiting identifying what entities were impacted because many had asked the company to not disclose details.

“Our goal is to give each organization the facts and defer to them on if and when to make the incident public,” it said.

Not all of the instances involved in this incident were being considered a significant security breach, the company noted.

“Some organizations may review what we share and conclude that the information was intentionally public or that the model’s interaction was not concerning,” it explained. “Others may identify a design issue or security weakness they want to address.”

Hugging Face was first to go public with the incident, with OpenAI publicly taking responsibility for it later.

Clement Delangue, the head of Hugging Face, during a United Nations Security Council session on AI on Wednesday: “I often wonder what would have happened had I decided not to disclose this attack publicly.”

“Especially now that we know similar incidents had been happening months earlier in secret at a handful of frontier labs without monitoring,” Delangue added.

During that same UN meeting, OpenAI CEO Sam Altman and Dario Amodei, the head of rival firm Anthropic, asked for international leaders to form global standards for AI safety and ways to monitor and report such incidents.

While OpenAI and Anthropic have both said in recent weeks that they will bring third-party evaluators inside their companies to do real-time safety evaluations of AI tools and models, such evaluators have not yet arrived, as the BBC has reported.

OpenAI said on Friday that it is currently reviewing training activity by its AI agents and going back on a “month by month” basis from when the Hugging Face hack occurred.

“Most cases identified so far have been low severity, with limited or no evidence of meaningful impact,” the company said. “Given the scale of the review required, and the need to verify each case, this work will take months to complete.”

David Krueger, a professor of machine learning at University of Montreal and the founder of AI safety group Evitable, said on Friday that he was “deeply troubled” by the increasing number of AI-related safety incidents.

He called for “an immediate, indefinite, international moratorium” on AI development.

“We have yet to understand the extent of existing incidents, and future rogue AI scenarios could be catastrophic,” Krueger said.

Continue Reading

Trending