ChatGPT and other chatbots ‘can be tricked into making code for cyber attacks’
Artificial intelligence (AI) tools such as ChatGPT can be tricked into producing malicious code which could be used to launch cyber attacks, according to research. A study by researchers from the University of Sheffield’s Department of Computer Science found that it was possible to manipulate chatbots into creating code capable of breaching other systems. Generative AI tools such as ChatGPT can create content based on user commands or prompts and are expected to have a substantial impact on daily life as they become more widely used in industry, education and healthcare. But the researchers have warned that vulnerabilities exist, and said their research found they were able to trick the chatbots into helping steal sensitive personal information, tamper with or destroy databases, or bring down services using denial-of-service attacks. In reality many companies are simply not aware of these types of threats and due to the complexity of chatbots, even within the community, there are things that are not fully understood Xutan Peng, University of Sheffield PhD student In all, the university study found vulnerabilities in six commercial AI tools – of which ChatGPT was the most well-known. On Chinese platform Baidu-Unit, the scientists were able to use malicious code to obtain confidential Baidu server configurations and tampered with one server node. In response, the research has been recognised by Baidu, which addressed and fixed the reported vulnerabilities and financially rewarded the scientists, the university said. Xutan Peng, a PhD student at the University of Sheffield, who co-led the research, said: “In reality many companies are simply not aware of these types of threats and due to the complexity of chatbots, even within the community, there are things that are not fully understood. “At the moment, ChatGPT is receiving a lot of attention. It’s a standalone system, so the risks to the service itself are minimal, but what we found is that it can be tricked into producing malicious code that can do serious harm to other services.” The risk with AIs like ChatGPT is that more and more people are using them as productivity tools, rather than a conversational bot, and this is where our research shows the vulnerabilities are Xutan Peng, University of Sheffield PhD student The researchers also warned that people using AI to learn programming languages was a danger, as they could inadvertently create damaging code. “The risk with AIs like ChatGPT is that more and more people are using them as productivity tools, rather than a conversational bot, and this is where our research shows the vulnerabilities are,” Peng said. “For example, a nurse could ask ChatGPT to write an (programming language) SQL command so that they can interact with a database, such as one that stores clinical records. “As shown in our study, the SQL code produced by ChatGPT in many cases can be harmful to a database, so the nurse in this scenario may cause serious data management faults without even receiving a warning.” The UK will host an AI Safety Summit next week, with the Government inviting world leaders and industry giants to come together to discuss the opportunities and safety concerns around artificial intelligence. Read More Tinder adds Matchmaker feature to let friends recommend potential dates Google and Meta withdraw from upcoming Web Summit ‘Game-changing’ facial recognition technology catches prolific shoplifters Facial recognition firm Clearview AI overturns UK data privacy fine Sadiq Khan, Met Commissioner to ask phone companies to ‘design out’ theft Microsoft gets go-ahead to buy Call of Duty maker Activision
2023-10-24 23:00
Dream plays 'start, bench or cut' about Kai Cenat, xQc and Adin Ross: 'Reason why Kick is not kicking Twitch's a**'
Dream slammed Adin Ross while playing 'start, bench or cut' on the 'BFFs' podcast with Dave Portnoy, Josh Richards, and Brianna Chickenfry
2023-06-16 19:43
UK water crisis pollutes privatisation legacy
Britain's biggest water supplier staving off renationalisation, trains derailed by strikes and consumers suffering huge energy bills -- the nation's vital sectors are mired in...
2023-07-11 13:32
Fact check: Trump falsely claims Raffensperger said former president 'didn't do anything wrong' on their 2021 phone call
Georgia Secretary of State Brad Raffensperger has long been a pointed critic of former President Donald Trump's conduct on a January 2021 phone call in which Trump pressured Raffensperger to somehow "find" enough votes to overturn his defeat in Georgia in the 2020 election.
2023-09-19 03:32
Thaksin: Former Thai PM's prison sentence reduced to a year
After years in exile, Mr Thaksin returned home in August and was jailed for graft and abuse of power.
2023-09-01 18:31
Ilsong Educational Foundation Chairman Dai-Won Yoon Wins Linnaeus Medal as the First in Asia
SEOUL, South Korea--(BUSINESS WIRE)--Jun 2, 2023--
2023-06-02 17:00
This 14-course coding education bundle is on sale for 74% off
TL;DR: The 2023 Premium Learn to Code Certification Bundle is on sale for £32.32, saving
2023-09-25 12:00
Logan Paul reveals he's not receiving any ‘flat fee’ for Dillon Danis fight
Logan Paul claimed Dillon Danis knows how to sell a fight and that he's a 'good troll'
2023-10-02 12:18
Freedom Caucus member says hard-line group 'failed' with passage of 'Democratic' debt limit bill
House Freedom Caucus member Rep. Ken Buck criticized the bipartisan debt ceiling deal reached between House Republicans and the White House as a "Democratic bill," and said his hard-line, conservative group had "failed" in its efforts to influence legislation more to its liking.
2023-06-04 23:57
Arsenal defender Jurrien Timber to undergo surgery after ACL injury on competitive debut
Arsenal defender Jurrien Timber is set for a long spell out after damaging his anterior cruciate ligament in his right knee in his competitive debut for the Premier League club
2023-08-17 00:19
Singapore PM to Address Political Scandals in Parliament
Singapore’s Prime Minister Lee Hsien Loong will make a ministerial statement on the ongoing graft investigation involving Transport
2023-08-01 14:02
Wrexham to host former finalists Wigan on Carabao Cup return
Wrexham will host former finalists Wigan on their return to the Carabao Cup. The Welsh side, who will be participating in the competition for the first time since 2007-08 following their promotion to League Two, were paired with the 2006 runners-up in Thursday’s first-round draw. Notts County, who came up from the National League along with Wrexham, were handed a home tie against Lincoln. Leicester, Leeds and Southampton must play in the first round following their relegation from the Premier League. Leeds will host Shrewsbury, the Foxes will head across the midlands to Burton and Southampton will travel to Gillingham. The ties will be played in the week beginning August 7. The first-round draw, featuring sides from the Championship, League One and League Two, was split into northern and southern sections. The majority of top-flight sides will enter in the second round with those involved in European competitions going straight through to the third round. Read More Charity boss speaks out over ‘traumatic’ encounter with royal aide Ukraine war’s heaviest fight rages in east - follow live
2023-06-22 22:20
You Might Like...
Kaitlan Collins to anchor new 9 p.m. show on CNN
How tall is Courteney Cox? Iconic 'Friends' character Monica Geller was rightly known as 'Mother Hen' of the group
Mercenary Prigozhin warns Russia could face revolution unless elite gets serious about war
NASCAR slams Stewart-Haas Racing for cheating to make 2 consecutive days of massive penalties
Biden urges tougher gun restrictions, one year after Uvalde, Texas, school massacre
Rugby World Cup dreams for the girls of Romania
Giants rally past Guardians 5-4 in 10 innings to keep pace in NL wild-card chase
What is Savannah Chrisley's net worth? 'Chrisley Knows Best' alum spent 'money like it was never ever gonna go away' before parents went to prison
