iGenius Launches Nvidia-Powered AI Language Model for Highly Regulated Industries

Italian Startup iGenius Unveils Colosseum 355B for Regulated Industries

Italian artificial intelligence startup iGenius has announced the launch of Colosseum 355B, a large language model (LLM) designed specifically for highly regulated industries. This innovative AI model aims to provide businesses with high-performance capabilities while ensuring data protection and compliance with strict regulations 1 2.

Collaboration with Nvidia

The development of Colosseum 355B was accelerated through a collaboration with Nvidia. The model was built using the Nvidia AI Enterprise software platform and utilized the DGX Cloud AI platform, orchestrating more than 3,000 Nvidia H100 GPUs. This partnership enabled iGenius to complete the project in just two months, resulting in a 355 billion parameter model that supports over 50 languages and excels at coding 3.

Technical Specifications and Advantages

Colosseum 355B boasts several technical advancements that make it particularly suitable for regulated industries:

FP8 Precision: The model was pre-trained using 8-bit floating point data, significantly reducing memory usage and cutting inference costs by 50% without compromising accuracy 3.
On-Premises Deployment: The model's compact size allows it to run on a single H100 GPU, enabling organizations to host their proprietary LLM within their firewall and maintain complete control 3.
Continued Pre-training and Fine-tuning: Colosseum 355B is designed for both continued pre-training (CPT) and fine-tuning, allowing organizations to adapt the model to their specific needs while retaining general knowledge 3.

Targeting Regulated Industries

iGenius CEO Uljan Sharka revealed that the company is already in contact with potential users in various sectors:

Financial services
Heavy industry
Government agencies 1 2

The launch of Colosseum 355B addresses the challenges faced by regulated industries in adopting AI technology due to tight legislation and compliance requirements 1 2.

Integration with Nvidia Ecosystem

To further enhance its accessibility and deployment options, Colosseum 355B is packaged as an Nvidia NIM microservice and available as an API via the Nvidia API catalog. This integration allows for secure deployment across clouds, data centers, and workstations 3.

European Commission Presentation

Highlighting the model's potential impact on European AI initiatives, Sharka flew to Brussels to present Colosseum 355B to the European Commission 1 2. This move underscores the importance of AI developments that align with regulatory requirements in the European context.

Industry Perspective

Alexis Bjorlin, Vice President of DGX Cloud at Nvidia, expressed optimism about the model's potential, stating, "Colosseum is a powerful AI model poised to unlock new opportunities for sovereign nations across the most highly regulated industries" 3.

As AI continues to evolve, models like Colosseum 355B demonstrate the industry's commitment to developing solutions that balance innovation with regulatory compliance, potentially opening new avenues for AI adoption in sectors previously hesitant to embrace the technology.