CISOs are nervous Gen AI use could lead to more security breaches

AI
(Image credit: Getty Images)

Chief Information Security Officers (CISO) are becomingly ever more concerned the increasing use of Generative AI tools could lead to more cybersecurity incidents.

A new pape by security experts Metomic surveying more than 400 CISOs in the UK and the US found security breaches linked to generative AI worry almost three-quarters (72%) of the respondents.

But that’s not the only thing CISOs are worried about, when it comes to generative AI, the report warns, as they also fear people will use sensitive company data to train the Large Language Models (LLM) used to power these tools. Sharing the data this way is a security risk, as there is a theoretical possibility that a malicious third party might extract this information somehow.

Spotting malware

CISOs have every right to be worried, though. Data breaches and similar cybersecurity incidents have been rising quarter into quarter, year after year. Since the introduction of generative AI tools, these attacks have gotten even more sophisticated, some researchers said.

For example, poor writing, as well as grammar and typing errors, were the best way to spot a phishing attack. Today, most hacking groups use AI to write convincing phishing emails for them, not only making them harder to spot, but also significantly lowering the barrier for entry. 

Another example is the writing of malicious code. Be it for a landing page, or for malware, hackers are constantly finding new ways to abuse the new tools. Generative AI developers are fighting back, putting limits in place that prevent the tools from being used this way, but threat actors have so far always managed to find a way around such roadblocks. 

Good news is that AI can also be used in defense, and many organizations have already deployed advanced, AI-powered solutions. 

More from TechRadar Pro

TOPICS

Sead is a seasoned freelance journalist based in Sarajevo, Bosnia and Herzegovina. He writes about IT (cloud, IoT, 5G, VPN) and cybersecurity (ransomware, data breaches, laws and regulations). In his career, spanning more than a decade, he’s written for numerous media outlets, including Al Jazeera Balkans. He’s also held several modules on content writing for Represent Communications.

Read more
Cartoon Phishing
Hackers use GenAI to attack more frequently and effectively
Half man, half AI.
Generative AI has a long way to go as siloed data and abuse of its capacity remain a downside – but it does change the game for security teams
Avast cybersecurity
Rise of AI is causing many firms to worry about their cybersecurity
Red padlock open on electric circuits network dark red background
AI-powered cyber threats are becoming the biggest worry for businesses everywhere
A profile of a human brain against a digital background.
Securely working with AI-generated code
An AI face in profile against a digital background.
The truth about GenAI security: your business can't afford to “wait and see”
Latest in Security
Hacker silhouette working on a laptop with North Korean flag on the background
North Korea unveils new military unit targeting AI attacks
An image of network security icons for a network encircling a digital blue earth.
US government warns agencies to make sure their backups are safe from NAKIVO security issue
Laptop computer displaying logo of WordPress, a free and open-source content management system (CMS)
This top WordPress plugin could be hiding a worrying security flaw, so be on your guard
Computer Hacked, System Error, Virus, Cyber attack, Malware Concept. Danger Symbol
Veeam urges users to patch security issues which could allow backup hacks
UK Prime Minister Sir Kier Starmer
The UK releases timeline for migration to post-quantum cryptography
Representational image depecting cybersecurity protection
Cisco smart licensing system sees critical security flaws exploited
Latest in News
L-mount alliance
Sirui joins L-Mount Alliance to deliver its superb budget lenses for Leica, DJI, Sigma and Panasonic cameras
Security padlock and circuit board to protect data
Trust in digital services around the world sees a massive drop as security worries continue
Samuel and Romy standing very close together in A24's Babygirl movie
Everything new on Max in April 2025, including A24's Babygirl and The Last of Us season 2
An AMD Radeon RX 9070 XT made by Sapphire on a table with its retail packaging
AMD’s secret weapon against Nvidia seems to be stock – way more RX 9070 GPUs are rumored to be hitting shelves than RTX 5000 models
Hacker silhouette working on a laptop with North Korean flag on the background
North Korea unveils new military unit targeting AI attacks
Seth Milchick and Kier Eagan's animatronic speaking in Severance season 2 episode 10
Apple TV+ announces Severance has been renewed for season 3 after that devastating finale