Fraudsters may abuse ChatGPT and Bard to pump out highly convincing scams

Date:
Fri, 27 Oct 2023 09:29:47 +0000

Description:
Which? research has found that generative AI already has the potential to assist scammers in writing malicious emails

FULL STORY ======================================================================

New research from Which? has claimed generative AI tools such as ChatGPT and Bard lack effective defenses from fraudsters.

Where traditional phishing emails and other identity theft scams are often identified through the poor use of English, these tools could help scammers write convincing emails.

Over half (54%) of those surveyed by Which? stated that they look for poor grammar and spelling to help them spot scams. Bending the rules

Phishing emails and scam messages traditionally try to steal personal information and passwords from their victims. Open AIs ChatGPT and Googles Bard have rules in place already to curb malicious use, but they can easily
be circumvented through some rewording.

In its research, Which? prompted ChatGPT to create a range of scam messages from PayPal phishing emails to missing parcel texts. While both AI tools initially refused requests to create a phishing email from PayPal,
researchers found that by changing the prompt to write an email, ChatGPT happily obliged and asked for more information.

Researchers then replied with tell the recipient that someone has logged into their PayPal account, from which the AI constructed a highly convincing
email, and when asked to include a link in the email template, ChatGPT
obliged and also included guidance on how a user could change their password.

This research shows that it is already plausible for scammers to use AI tools to write highly convincing messages without broken English and incorrect grammar, to target individuals and businesses with increased success.

Rocio Concha, Which? Director of Policy and Advocacy, said, OpenAIs ChatGPT and Googles Bard are failing to shut out fraudsters, who might exploit their platforms to produce convincing scams.

Our investigation clearly illustrates how this new technology can make it easier for criminals to defraud people. The government's upcoming AI summit must consider how to protect people from the harms occurring here and now, rather than solely focusing on the long-term risks of frontier AI.

People should be even more wary about these scams than usual and avoid clicking on any suspicious links in emails and texts, even if they look legitimate. More from TechRadar Pro AI usage power consumption is now similar to many small countries Businesses need to be much more open about how they are using AI We also have a separate guide for the best identity theft protection for families



======================================================================
Link to news story: https://www.techradar.com/pro/fraudsters-may-abuse-chatgpt-and-bard-to-pump-ou t-highly-convincing-scams


--- Mystic BBS v1.12 A47 (Linux/64)
* Origin: tqwNet Technology News (1337:1/100)