iGenius Launches Nvidia-Powered AI Language Model for Highly Regulated Industries
3 Sources
3 Sources
[1]
Italy's iGenius launches Nvidia-powered AI language model for highly regulated industries
Tight legislation and compliance requirements hamper the use of artificial intelligence (AI) technology in regulated industries.Italian startup iGenius said on Thursday it was releasing Colosseum 355B, a large language model built with the latest Nvidia technology for customers in highly regulated industries with special data protection needs. Tight legislation and compliance requirements hamper the use of artificial intelligence (AI) technology in regulated industries. CEO Uljan Sharka told Reuters that iGenius was already in contact with potential users in the financial services sector as well as heavy industry companies and governments. Sharka flew to Brussels on Thursday to present the new model to the European Commission.
[2]
Italy's iGenius launches Nvidia-powered AI language model for highly regulated industries
MILAN (Reuters) - Italian startup iGenius said on Thursday it was releasing Colosseum 355B, a large language model built with the latest Nvidia technology for customers in highly regulated industries with special data protection needs. Tight legislation and compliance requirements hamper the use of artificial intelligence (AI) technology in regulated industries. CEO Uljan Sharka told Reuters that iGenius was already in contact with potential users in the financial services sector as well as heavy industry companies and governments. Sharka flew to Brussels on Thursday to present the new model to the European Commission. (Reporting by Elvira Pollina and Valentina Za, editing by Gianluca Semeraro)
[3]
AI firm iGenius introduces Nvidia-powered LLM for highly regulated industries - SiliconANGLE
AI firm iGenius introduces Nvidia-powered LLM for highly regulated industries Italian artificial intelligence startup iGenius Inc. announced today the launch of Colosseum 355B, its new state-of-the-art foundation large language model designed for highly regulated industries to provide businesses the confidence that their data won't be compromised. IGenius specializes in AI for enterprises working in highly regulated sectors, such as finance and public administration. The company develops LLMs to power its business intelligence agent, Crystal, an AI solution designed to work within these industries while providing high performance, customization and maintaining data privacy. To build Colosseum 355B, the company collaborated with Nvidia Corp. to accelerate the development of the model. It was built using the Nvidia AI Enterprise software platform and used the DGX Cloud AI platform to orchestrate more than 3,000 Nvidia H100 GPUs. According to Nvidia, the work was completed in two months and the result was a 355 billion parameter model that supports over 50 languages, excels at coding and is optimized to fit on a single H100 GPU node. IGenius said the model was pre-trained using a method known as FP8 precision, meaning it uses 8-bit floating point data, offering a significant reduction in memory usage. This size reduction allows the model to cut inference costs by 50% without having to convert the model, which could reduce accuracy or quality. Being small enough to run on a single H100 GPU also means that a regulated enterprise can run the model within its firewall on-premises without the need to host in the cloud. This provides the capability for an organization to host their own proprietary LLM and maintain complete control. "Colosseum is a powerful AI model poised to unlock new opportunities for sovereign nations across the most highly regulated industries," said Alexis Bjorlin, vice president of DGX Cloud at Nvidia. The model is specially designed for both continued pre-training and fine-tuning. CPT is a cost-effective alternative to pre-training, a way to further train a base pre-trained LLM using a large domain of text documents to augment the model's general knowledge with more specific information. This allows organizations to build their own specialized AI models that can adapt to long-term needs without losing general knowledge. Furthering the company's collaboration with Nvidia, Colosseum 355B is packaged as an Nvidia NIM microservice and available as an application programming interface via the company's Nvidia API catalog. Nvidia's NIM microservices provide secure containerized AI models that can be deployed across clouds, data centers and workstations.
Share
Share
Copy Link
Italian startup iGenius introduces Colosseum 355B, a large language model built with Nvidia technology, designed for highly regulated industries with special data protection needs.
Italian Startup iGenius Unveils Colosseum 355B for Regulated Industries
Italian artificial intelligence startup iGenius has announced the launch of Colosseum 355B, a large language model (LLM) designed specifically for highly regulated industries. This innovative AI model aims to provide businesses with high-performance capabilities while ensuring data protection and compliance with strict regulations
1
2
.Collaboration with Nvidia
The development of Colosseum 355B was accelerated through a collaboration with Nvidia. The model was built using the Nvidia AI Enterprise software platform and utilized the DGX Cloud AI platform, orchestrating more than 3,000 Nvidia H100 GPUs. This partnership enabled iGenius to complete the project in just two months, resulting in a 355 billion parameter model that supports over 50 languages and excels at coding
3
.Technical Specifications and Advantages
Colosseum 355B boasts several technical advancements that make it particularly suitable for regulated industries:
-
FP8 Precision: The model was pre-trained using 8-bit floating point data, significantly reducing memory usage and cutting inference costs by 50% without compromising accuracy
3
. -
On-Premises Deployment: The model's compact size allows it to run on a single H100 GPU, enabling organizations to host their proprietary LLM within their firewall and maintain complete control
3
. -
Continued Pre-training and Fine-tuning: Colosseum 355B is designed for both continued pre-training (CPT) and fine-tuning, allowing organizations to adapt the model to their specific needs while retaining general knowledge
3
.
Targeting Regulated Industries
iGenius CEO Uljan Sharka revealed that the company is already in contact with potential users in various sectors:
- Financial services
- Heavy industry
- Government agencies
1
2
The launch of Colosseum 355B addresses the challenges faced by regulated industries in adopting AI technology due to tight legislation and compliance requirements
1
2
.Integration with Nvidia Ecosystem
To further enhance its accessibility and deployment options, Colosseum 355B is packaged as an Nvidia NIM microservice and available as an API via the Nvidia API catalog. This integration allows for secure deployment across clouds, data centers, and workstations
3
.Related Stories
European Commission Presentation
Highlighting the model's potential impact on European AI initiatives, Sharka flew to Brussels to present Colosseum 355B to the European Commission
1
2
. This move underscores the importance of AI developments that align with regulatory requirements in the European context.Industry Perspective
Alexis Bjorlin, Vice President of DGX Cloud at Nvidia, expressed optimism about the model's potential, stating, "Colosseum is a powerful AI model poised to unlock new opportunities for sovereign nations across the most highly regulated industries"
3
.As AI continues to evolve, models like Colosseum 355B demonstrate the industry's commitment to developing solutions that balance innovation with regulatory compliance, potentially opening new avenues for AI adoption in sectors previously hesitant to embrace the technology.
References
Summarized by
Navi
[1]
[2]
Related Stories
Weekly Highlights
Weekly Highlights
Explore today's top stories
Your Daily Dose of Curated AI News
Don’t drown in AI news. We cut through the noise - filtering, ranking and summarizing the most important AI news, breakthroughs and research daily. Spend less time searching for the latest in AI and get straight to action.
