" "

Infosys unveils small language models built using the Nvidia AI stack

author-image
ISN Team
New Update
Infosys 2024

Nvidia CEO Jensen Huang and Nandan Nilekani

Infosys, a global leader in IT and consulting, has unveiled two new small language models (SLMs) designed specifically for the banking and IT operations sectors.

Named Infosys Topaz BankingSLM and Infosys Topaz ITOpsSLM, these models are built using the advanced NVIDIA AI Stack.

Infosys intends for these models to provide industry-specific AI capabilities for enterprises, offering efficient, scalable solutions for companies looking to enhance their AI integration.

Leveraging NVIDIA’s AI stack for targeted applications

Advertisment

The Infosys Topaz BankingSLM and ITOpsSLM models are powered by NVIDIA’s AI Stack, bringing significant advantages to companies needing tailored AI solutions.

Developed within Infosys’s NVIDIA-focused centre of excellence, these SLMs incorporate general and specialized industry data, refined through NVIDIA AI Enterprise and NVIDIA AI Foundry in partnership with Sarvam AI.

The collaboration is intended to enable faster, more precise AI deployment in industries with complex data and operational needs.

According to Infosys, SLMs are trained on smaller, higher-quality datasets compared to large language models (LLMs).

By refining data specific to banking and IT operations, these models aim to improve accuracy and reduce response times, helping businesses implement focused AI applications more effectively.

Integration with existing Infosys solutions

The newly launched SLMs are designed to integrate seamlessly with Infosys’s established platforms, such as Infosys Finacle and Infosys Topaz.

These integrations allow businesses to use AI in specific operational areas, such as customer service and IT management, while keeping processes aligned with industry requirements.

Infosys also provides pretraining and fine-tuning services for companies wanting to develop custom AI models tailored to their own data and business needs, ensuring data security and compliance.

Executive Vice President of Infosys, Balakrishna D. R., explained the goal: “As we further our enterprise AI journey with NVIDIA, our focus is now on delivering foundational small language models as services for businesses to build on.

By integrating the NVIDIA AI stack with Infosys Topaz, we are taking advantage of advanced enterprise AI capabilities to tackle unique business challenges, enhance operational efficiency, and deliver bespoke solutions that drive business value for our clients.”

Enhanced features for industry-specific use cases

Infosys has expanded its work with NVIDIA to streamline AI application development by introducing features like the Digital Human blueprint for improved customer service and multimodal PDF data extraction for more efficient data handling.

These developments align with a broader push towards adopting AI-driven processes across multiple industries, including telecommunications, retail, and financial services. 

The Infosys-NVIDIA collaboration also covers digital solutions such as 3D workflows and digital twins through NVIDIA Omniverse Enterprise, which, combined with Infosys's Responsible AI suite and NVIDIA NeMo Guardrails, aims to foster safe, transparent AI implementation.

The Infosys AI Experience Zone, launched as part of this initiative, is intended to serve as a hub for exploring and developing co-innovated AI solutions.

A growing partnership between Infosys and NVIDIA

The development represents a significant step in the collaboration between Infosys and NVIDIA. Jay Puri, Executive Vice President of NVIDIA, noted, “Generative AI and the recent advancements in agentic and physical AI are ushering in a new era of innovation and productivity for enterprises worldwide. NVIDIA’s full-stack AI platform combined with Infosys Topaz empowers businesses to build and deploy custom AI applications that will transform industries, helping businesses unlock their full potential.”

Subscribe