OpenAI won’t launch its next-generation mannequin – GPT-6.1 Astra – because of security considerations, the ChatGPT-maker confirmed on Tuesday.
The AI system – which performs duties like looking the net and utilizing apps by itself – “did not fairly meet the bar” of the corporate’s requirements, Saachi Jain, head of security programs at OpenAI, mentioned.
In current weeks, high AI leaders together with OpenAI’s Sam Altman and Anthropic boss Dario Amodei have urged the business to sluggish the tempo of growth because of considerations about dangers related to the know-how.
The controversy round these dangers has intensified in current weeks after fashions developed by high AI corporations had been concerned in quite a lot of incidents.
OpenAI’s choice, first reported by the Wall Road Journal, is a uncommon occasion of a serious AI developer pulling a brand new launch over security considerations.
The most recent mannequin fell brief when it comes to “staying inside scope and authorisation, and the way it communicates again to the person about the kind of work it is finished,” Jain mentioned.
“We need to ensure our mannequin growth is secure irrespective of whether or not that is within the firm, or after we ship it to customers. However after we ship it to customers, we have now a particularly excessive bar when it comes to security and alignment,” she added.
The flagship GPT-6 Astra agentic mannequin was launched in September and specialises in advanced reasoning and executing duties autonomously. OpenAI mentioned it was the results of “years of analysis and massive bets”.
The corporate’s safety controls have come underneath intense scrutiny after a number of high-profile incidents involving its know-how.
Final week, Australian Prime Minister Anthony Albanese introduced that a rogue OpenAI agent had hacked into a government website in June and accessed personal information in what specialists mentioned was the primary recognized case of its sort on the planet.
In July, OpenAI mentioned its AI programs had accessed the web and hacked into open-source developer hub Hugging Face, prompting researchers and officers to name for tighter controls over the know-how.
On Monday, AI chip big Nvidia launched a set of software program security instruments for autonomous AI platforms – known as brokers – that it mentioned might have prevented the Hugging Face hack.
One of many new instruments makes use of {hardware} options in Nvidia’s chips to comprise brokers.
Nvidia boss Jensen Huang has largely dismissed requires tighter AI rules, arguing that rogue brokers are an engineering drawback that may be solved.
Nvidia agreed to purchase Hugging Face for $12.9bn (£9.74bn) earlier this month.
