Scammers are increasingly using artificial intelligence to clone voices, making fraudulent phone calls frighteningly realistic. Research indicates that people are not adept at distinguishing these AI-generated voices from genuine ones, raising significant concerns about personal and financial security. The sophistication of these voice deepfakes means that a familiar voice on the phone is no longer a reliable indicator of identity.
The Rise of AI Voice Scams
One alarming incident shared on social media involved a person receiving a call purportedly from their wife asking for a credit card number to pay for gas, claiming she had forgotten her wallet. The caller’s voice was described as sounding exactly like the wife’s, though with a slightly unusual cadence. The individual, who was with his actual wife at the time and knew she drove an electric car, was initially confused but suspected a voice deepfake or filter. This experience highlights how easily such scams can exploit trust based on vocal recognition.
Similar stories have surfaced, including one where a user reported being contacted by someone impersonating an attorney claiming a relative was in jail and needed bail money. These scams often leverage the ‘relative in distress’ scenario, a tactic that has proven effective even before the advent of advanced AI voice technology.
Vulnerability to ‘Relative in Distress’ Scams
A study involving 4,100 adults in the United States explored people’s susceptibility to AI-powered “relative in distress” scams. The research, published in a paper evaluating AI models’ capability to automate voice phishing attacks, found that a significant portion of participants—up to 36.1%—indicated they would comply with such a request or were uncertain about their response. It is important to note that this figure represents self-reported willingness to comply, not necessarily actual behavior or financial loss.
The study’s findings suggest that the persuasiveness of the scam, rather than just how human-like the voice sounds, plays a crucial role. Interestingly, individuals who frequently used AI were no more capable of identifying synthetic voices than those with no AI exposure. This indicates that familiarity with AI does not automatically confer immunity to these types of fraudulent calls.
Protecting Yourself and Your Family
Given the increasing realism of AI voice scams, establishing personal verification methods is essential. One effective strategy is to create a unique family code word or phrase. This should be something known only to close family members, making it highly unlikely for a scammer to guess or discover through public information.
A simpler, yet highly effective, precaution is to hang up the phone and call the person back directly using a known, trusted phone number. If an unexpected call comes from a family member urgently requesting money, do not rely solely on the voice’s authenticity. Ending the call and initiating contact yourself through a pre-established number can prevent falling victim to deception.
The Ferrari Deepfake Case Example
An incident involving Ferrari illustrates the value of personal verification. In 2024, an executive at the company received communications and a subsequent phone call that appeared to be from CEO Benedetto Vigna. Suspicious, the executive asked the purported CEO to identify a specific book the real CEO had recently recommended. The caller’s inability to answer this question exposed the deception. A family code word serves a similar purpose, acting as a quick and reliable verification tool.
The Broader Impact of AI on Trust
The implications of AI extend beyond individual scams, affecting societal trust. Mark Beare, Head of Consumer at Malwarebytes, stated that AI’s deepest impact is on human perception, eroding the ability to trust what is seen, heard, or who one is communicating with. This erosion of trust can have far-reaching consequences, undermining fundamental societal interactions.
Surveys indicate a growing difficulty in distinguishing genuine content from scams. A Malwarebytes survey revealed that 85% of respondents found it challenging to differentiate scams from legitimate interactions, a notable increase from the previous year. Furthermore, 88% reported increasing difficulty in discerning whether online content was created by humans or AI. This challenge is not limited to audio; AI-generated images and videos are also making it harder to rely on visual or auditory evidence.
Adapting to Evolving Threats
As AI voice technology continues to advance and become more convincing, adapting personal behaviors is crucial. Relying on familiar voices for identification is no longer a secure practice. Implementing strategies like establishing family code words and practicing direct, verified communication are vital steps.
In conclusion, the increasing sophistication of AI voice scams necessitates a proactive approach to security. By employing verification methods such as code words and direct callbacks, individuals can significantly reduce their vulnerability to these evolving threats and protect themselves and their loved ones from fraudulent activities.


