Minister warns ‘inevitable’ breach of UK cyber defences by rogue AI

Please refresh the page or navigate to another page on the site to be automatically logged inPlease refresh your browser to be logged in

Want to bookmark your favourite articles and stories to read or reference later? Start your Independent Membership today.

Britain’s AI minister has warned that a compromise of the nation’s cyber defences is “likely, if not inevitable,” while setting out fresh initiatives aimed at preparing the country for major threats involving autonomous agents.

Kanishka Narayan urged tech developers to “build machines that leave us human beings in charge” as the world crosses the threshold into “the age of superintelligence”.

Delivering his first address since his post was elevated to Cabinet level, he confirmed that scientists at the UK’s AI Security Institute are evaluating advanced systems, including Google’s Gemini, to guarantee “robust safeguards”.

This follows successful lobbying by the minister to overturn a White House ban restricting UK access to cutting-edge models from major US firms, including Anthropic and OpenAI.

Google had previously limited access to Gemini to a vetted group of cybersecurity specialists to prevent misuse by hackers, but Mr Narayan confirmed it would be “rigorously” tested by British researchers.

The British government is also considering options to reinforce the Cyber Security and Resilience Bill and broader framework to ensure vital services like hospitals and utilities are shielded from emerging risks, he added.

At a press conference in west London, Mr Narayan pointed to an incident in Australia earlier this year, in which a rogue OpenAI agent hacked a government website and accessed private data.

“The Australian government has said that no personal medical records are known to have been accessed, and there is no evidence of wider compromise, but the incident should concern us,” he said.

The minister added: “It concerns me. It seems likely, if not inevitable, that our own cyber defences will be breached.”

He said the government must be prepared to put into “swift action” measures to ensure machines develop in the right way.

“As we cross the threshold into the age of superintelligence, the choices we make now matter… we must build machines that serve us,” Mr Narayan said.

“Machines that help scientists discover new medicines, machines that give care workers more time with the people who depend on them, machines that help British businesses become more productive.

“Above all, machines that leave us human beings in charge.

“But if that is our defining belief, we must be prepared to put it into swift action, and we must do so now, meeting this critical moment.”

Asked whether domestic safeguards were ultimately futile without closer alignment with the US, which has said it wants companies to self-regulate, and whether Britain would join calls for greater international coordination on AI security, Mr Narayan said the UK would continue to prioritise working with its allies.

He said the “big picture for me is of course we have to work internationally” but that government-level measures were “an important part of the toolkit”.

The government will focus on making sure “we’re keeping the British public safe… where aligned, good, but where we need to go further to keep the British public safe we will continue to do so,” Mr Narayan said.

Experts have warned AI could wipe out humanity within the near future if the technology if a race between companies to create self-improving superintelligence is allowed to progress unchecked.

Microsoft boss Brad Smith has said there need to be global safety rules in place, telling the BBC’s Big Boss Interview podcast that the technology is currently less regulated than milk and washing machines.

Leading frontier AI firms will appear before MPs on Tuesday in response to growing concerns about the safety of the technology.

In its submission to the Business, Innovation, Science and Trade Committee, OpenAI also said governments must develop rules and safeguards for “the new chapter” in AI capabilities.

“No company, industry, or government can meet this challenge alone,” the firm said.

“Democratic governments must ultimately determine the rules, safeguards, and accountability mechanisms.”

In its submission, Anthropic also said governments must step in to set the rules: “Frontier AI models … present new challenges and risks that warrant careful study and effective safeguards.

“While hundreds of people at Anthropic work to guard against these risks, a technology moving this fast, at this scale, should not be governed by the industry alone, and governments must set the rules.”

Meta told the committee the “opportunities and challenges” from “superintelligence” will be greater than “any we have seen in our lifetimes”.

“Every transformative advance has been accompanied by concern that people would be left behind, and on each occasion a greater number of people have come to share in increased prosperity, health and freedom,” the firm said.

Ahead of Tuesday’s hearing committee chairman Liam Byrne said: “Some of the richest firms on earth are now building software that could transform prosperity, progress and public services.

“But without big new safeguards we risk unleashing ‘super-criminal codes’ that pose immense dangers to our safety and security: hacking businesses and governments, transforming the power of cyber criminals and providing our enemies with dangerous new weapons.”

The Liberal Democrats said the government had “failed to rise to the occasion” as the UK faces a “dangerous crossroads” over the trajectory of AI and called for an immediate pause on the development of superintelligence.

The party’s technology spokeswoman Victoria Collins MP said: “Britain has a chance to step up to use our unique position to take a leading role to get world leaders around the table to co-ordinate on safety and co-operation.

“We didn’t leave the atomic bomb to a few billionaires to police themselves and AI cannot be the exception.

“Liberal Democrats are calling for an immediate pause on the development of superintelligent AI, so we can develop a nuclear-style non-proliferation treaty, alongside establishing a UK-headquartered global safety agency.

Join thought-provoking conversations, follow other Independent readers and see their replies

Please refresh the page or navigate to another page on the site to be automatically logged inPlease refresh your browser to be logged in