Infibeam partners with IISc Bengaluru to develop real-time deepfake detection systems

Fintech firm Infibeam Avenues Ltd. has announced a strategic partnership with the Indian Institute of Science (IISc) Bengaluru to develop advanced, real-time deepfake detection systems.

The move is aimed at bolstering digital security for government agencies, corporations, and other organizations, as deepfake technology continues to pose serious risks to individuals and businesses alike.

Rising threat of deepfakes

Deepfakes involve artificial intelligence creating hyper-realistic yet false images, audio clips, or videos. These deceptive materials have led to a surge in misinformation, cyberbullying, financial fraud, and identity theft.

In January 2024, a Hong Kong-based multinational company lost about $25 million (around Rs 207 crore) when scammers used deepfake technology during a live video call to impersonate company executives, a stark example of the technology’s dangerous potential.

Infibeam’s AI unit, Phronetic.AI, and IISc’s Vision and AI Lab (VAL) will jointly focus on building anti-deepfake solutions specifically for real-time video communication. Through this collaboration, researchers aim to develop an effective, cost-efficient detection platform that can operate at scale without compromising speed or accuracy.

“We are committed to staying ahead of malicious actors by developing innovative AI solutions that ensure digital authenticity,” said Vishal Mehta, chairman and managing director of Infibeam Avenues Ltd.

“This partnership is a crucial step toward enhancing cybersecurity and preventing the misuse of deepfake technology for fraudulent activities.”

How the real-time detection works

Deepfake detection tools exist in the market, but few are equipped to catch fakes in real-time. Phronetic.AI has created an advanced video AI agent that actively monitors ongoing video calls, alerting users if the other party is identified as a deepfake. 

Notably, the company has filed a patent for this breakthrough algorithm. Through continuous updates and research at IISc, these detection models will be refined to recognize increasingly sophisticated AI-generated content.

“As generative AI continues to advance at an unprecedented pace, the rise of deepfakes poses a significant challenge,” said Prof. Venkatesh Babu, professor and chair of the Department of Computational and Data Sciences (CDS) at IISc.

“Addressing this requires ongoing efforts from AI researchers to monitor emerging generative models and develop robust techniques to detect deepfakes effectively.”

User-friendly and versatile

The partnership also aims to develop an easy-to-use interface so that non-experts can quickly verify the authenticity of live visuals and audio. The adaptability is intended for a broad range of sectors, including banking, healthcare, finance, human resources, government organizations, and law enforcement. 

By offering a real-time deepfake detection agent, the project hopes to reinforce public trust in digital communication and protect the reputations of both institutions and individuals.

Infibeam Avenues Ltd. is a global financial technology company providing digital payment solutions and enterprise software platforms to businesses and governments across various industries. Its offerings range from payment gateways with more than 200 payment options to large-scale procurement platforms for government agencies.