As with any new technology, we have to take the good with the bad
But in the case of artificial intelligence (AI), the can of worms it threatens to open might be unlike anything we’ve ever seen.
Already, the technology is being used by cybercriminals to swindle people of their money, and the methods they’re using are getting increasingly difficult to detect.
Below are some of the ways AI is being deployed and what you can do to help keep your finances safe.
“Voice cloning” technology used in phone scams
Using just a short audio sample and some commercially-available programs, it’s now possible to clone someone’s voice and prompt it to say anything you want. Fraudsters have jumped at this opportunity, using AI-generated voices used to impersonate relatives of victims and leaving messages urgently requesting money to get out of a bind.
These scams can be surprisingly difficult to see through. A global survey by McAfee found that 70% of people had trouble distinguishing between a cloned voice and the real thing.1
Scammers are setting their sights on much larger targets too. In 2020, a manager in Hong Kong received a call from someone using deep fake technology to simulate his boss’s voice. The call was so convincing that he wound up transferring USD 35 million to fund a bogus acquisition deal.2
Similar tactics were used against the CEO of a UK-based energy firm, who was duped into sending $243,000 after speaking to a deep fake imposter.3
Generative AI used to gain victims’ trust
Malicious actors can now use language models like ChatGPT to polish up the messages they send to potential victims. All the usual giveaways — typos and missing punctuation — can be mended, giving things a more realistic (and potentially persuasive) sheen.
Romance scams are also bound to receive a shot in the arm. With AI, a scammer can generate original images to use on dating profiles and social media, potentially making it easier to win someone’s interest and trust.
Once a victim is invested in the ‘relationship,’ scammers will start asking for money, gifts and bank details. They might even get the victim to perform tasks that amount to money laundering on their behalf.
On the more extreme end, deepfake video technology can be used to recreate prominent figures’ likenesses against their will. A recent example involved CommBank CEO Matt Comyn, whose image was digitally replicated and used to shill an investing website.4
Ways to protect your finances
The reason so many of these scams work is because they succeed in creating a heightened emotional state in victims. Fraudsters assume that the more distressed or excited people are, the less guarded they’ll likely be with their money.
Fortunately, many of the usual methods for protecting your finances can still apply:
- Be wary of texts, emails or calls that seem crafted to create a sense of urgency. Keep a cool head and try to verify if the message has come from a legitimate source.
- If you receive a message from your bank asking for login details or other personal information, take it with a grain of salt.
- It’s common for scammers to request payment via channels that are hard to trace and difficult to recover money from, such as gift cards and cryptocurrency, so consider any mention of these a potential warning sign.
- Set up multi-factor authentication if you haven’t done so already.
- Exercise caution when discussing your finances over the phone, even if you believe it’s your child or grandchild on the other line. If at any point you become suspicious, put the call on hold and ring them yourself.
Australians lost a record $3.1 billion to scams in 2022,5 and that figure is poised to grow as AI use becomes more widespread. Scammers can target anyone, no matter how tech-savvy they are, but awareness of this new breed of scams can go a long way.
Contact Carrick Aland’s award-winning Wealth Planning team on 1300 466 998 or visit carrickaland.com.au/wealth-planning/ for specific advice.

This report is prepared by Bridges Financial Services Pty Limited ABN 60 003 474 977 AFSL 240837 (Bridges). Bridges is an ASX Market Participant and part of the IOOF group of companies. This report is prepared by the IOOF Research team for: Bridges Financial Services Pty Limited ABN 60 003 474 977 AFSL 240837, Consultum Financial Advisers Pty Ltd ABN 65 006 373 995 AFSL 230323, Elders Financial Planning ABN 48 007 997 186 AFSL 224645, Financial Services Partners ABN 15 089 512 587 AFSL 237 590, Millennium3 Financial Services Pty Ltd ABN 61 094 529 987 AFSL 244252, RI Advice Group Pty Ltd ABN 23 001 774 125 AFSL 238429, Shadforth Financial Group Ltd ABN 27 127 508 472 AFSL 318613 (‘Advice Licensees’). The Advice Licensees are part of the IOOF group comprising IOOF Holdings ABN 49 100 103 722 and its related bodies corporate (IOOF group). The Advice Licensees and/or their associated entities, directors and/or employees may have a material interest in, and may earn brokerage from, any securities or other financial products referred to in this document or may provide services to the company referred to in this report. The document is not available for distribution outside Australia and may not be passed on to any third person without the prior written consent of the Advice Licensees. The Advice Licensees and associated persons (including persons from whom information in this report is sourced) may do business or seek to do business with companies covered in its research reports. As a result, investors should be aware that the firms or other such persons may have a conflict of interest that could affect the objectivity of this report. Investors should consider this report as a single factor in making an investment decision. The document is current as at the date of issue but may be superseded by future publications. You can confirm the currency of this document by checking the intranet site (links below). The information contained in this report is for the sole use of advisers and clients of AFSL entities authorised by the Advice Licensees. This report may be used on the express condition that you have obtained a copy of the Advice Licensees Financial Services Guide (FSG) from their respective website. Disclaimer: The information in this report is general advice only and does not take into account the financial circumstances, needs and objectives of any particular investor. Before acting on the advice contained in this document, you should assess your own circumstances or seek advice from a financial adviser. Where applicable, you should obtain and consider a copy of the Product Disclosure Statement, prospectus or other disclosure material relevant to the financial product before making a decision to acquire a financial product. It is important to note that investments may go up and down and past performance is not an indicator of future performance. The contents of this report should not be disclosed, in whole or in part, to any other party without the prior consent of the IOOF Research Team and Advice Licensees. To the extent permitted by the law, the IOOF Research team and Advice Licensees and their associated entities are not liable for any loss or damage arising from, or in relation to, the contents of this report. For information regarding any potential conflicts of interest and analyst holdings; IOOF Research Team’s coverage criteria, methodology and spread of ratings; and summary information about the qualifications and experience of the IOOF Research Team please visit https://www.ioof.com.au/adviser/investment_funds/ioof_advice_research_process.






