The Outpost is a comprehensive collection of curated artificial intelligence software tools that cater to the needs of small business owners, bloggers, artists, musicians, entrepreneurs, marketers, writers, and researchers.
© 2025 TheOutpost.AI All rights reserved
Curated by THEOUTPOST
On Fri, 17 Jan, 8:03 AM UTC
3 Sources
[1]
Italy's iGenius launches Nvidia-powered AI language model for highly regulated industries
Tight legislation and compliance requirements hamper the use of artificial intelligence (AI) technology in regulated industries.Italian startup iGenius said on Thursday it was releasing Colosseum 355B, a large language model built with the latest Nvidia technology for customers in highly regulated industries with special data protection needs. Tight legislation and compliance requirements hamper the use of artificial intelligence (AI) technology in regulated industries. CEO Uljan Sharka told Reuters that iGenius was already in contact with potential users in the financial services sector as well as heavy industry companies and governments. Sharka flew to Brussels on Thursday to present the new model to the European Commission.
[2]
Italy's iGenius launches Nvidia-powered AI language model for highly regulated industries
MILAN (Reuters) - Italian startup iGenius said on Thursday it was releasing Colosseum 355B, a large language model built with the latest Nvidia technology for customers in highly regulated industries with special data protection needs. Tight legislation and compliance requirements hamper the use of artificial intelligence (AI) technology in regulated industries. CEO Uljan Sharka told Reuters that iGenius was already in contact with potential users in the financial services sector as well as heavy industry companies and governments. Sharka flew to Brussels on Thursday to present the new model to the European Commission. (Reporting by Elvira Pollina and Valentina Za, editing by Gianluca Semeraro)
[3]
AI firm iGenius introduces Nvidia-powered LLM for highly regulated industries - SiliconANGLE
AI firm iGenius introduces Nvidia-powered LLM for highly regulated industries Italian artificial intelligence startup iGenius Inc. announced today the launch of Colosseum 355B, its new state-of-the-art foundation large language model designed for highly regulated industries to provide businesses the confidence that their data won't be compromised. IGenius specializes in AI for enterprises working in highly regulated sectors, such as finance and public administration. The company develops LLMs to power its business intelligence agent, Crystal, an AI solution designed to work within these industries while providing high performance, customization and maintaining data privacy. To build Colosseum 355B, the company collaborated with Nvidia Corp. to accelerate the development of the model. It was built using the Nvidia AI Enterprise software platform and used the DGX Cloud AI platform to orchestrate more than 3,000 Nvidia H100 GPUs. According to Nvidia, the work was completed in two months and the result was a 355 billion parameter model that supports over 50 languages, excels at coding and is optimized to fit on a single H100 GPU node. IGenius said the model was pre-trained using a method known as FP8 precision, meaning it uses 8-bit floating point data, offering a significant reduction in memory usage. This size reduction allows the model to cut inference costs by 50% without having to convert the model, which could reduce accuracy or quality. Being small enough to run on a single H100 GPU also means that a regulated enterprise can run the model within its firewall on-premises without the need to host in the cloud. This provides the capability for an organization to host their own proprietary LLM and maintain complete control. "Colosseum is a powerful AI model poised to unlock new opportunities for sovereign nations across the most highly regulated industries," said Alexis Bjorlin, vice president of DGX Cloud at Nvidia. The model is specially designed for both continued pre-training and fine-tuning. CPT is a cost-effective alternative to pre-training, a way to further train a base pre-trained LLM using a large domain of text documents to augment the model's general knowledge with more specific information. This allows organizations to build their own specialized AI models that can adapt to long-term needs without losing general knowledge. Furthering the company's collaboration with Nvidia, Colosseum 355B is packaged as an Nvidia NIM microservice and available as an application programming interface via the company's Nvidia API catalog. Nvidia's NIM microservices provide secure containerized AI models that can be deployed across clouds, data centers and workstations.
Share
Share
Copy Link
Italian startup iGenius introduces Colosseum 355B, a large language model built with Nvidia technology, designed for highly regulated industries with special data protection needs.
Italian artificial intelligence startup iGenius has announced the launch of Colosseum 355B, a large language model (LLM) designed specifically for highly regulated industries. This innovative AI model aims to provide businesses with high-performance capabilities while ensuring data protection and compliance with strict regulations 12.
The development of Colosseum 355B was accelerated through a collaboration with Nvidia. The model was built using the Nvidia AI Enterprise software platform and utilized the DGX Cloud AI platform, orchestrating more than 3,000 Nvidia H100 GPUs. This partnership enabled iGenius to complete the project in just two months, resulting in a 355 billion parameter model that supports over 50 languages and excels at coding 3.
Colosseum 355B boasts several technical advancements that make it particularly suitable for regulated industries:
FP8 Precision: The model was pre-trained using 8-bit floating point data, significantly reducing memory usage and cutting inference costs by 50% without compromising accuracy 3.
On-Premises Deployment: The model's compact size allows it to run on a single H100 GPU, enabling organizations to host their proprietary LLM within their firewall and maintain complete control 3.
Continued Pre-training and Fine-tuning: Colosseum 355B is designed for both continued pre-training (CPT) and fine-tuning, allowing organizations to adapt the model to their specific needs while retaining general knowledge 3.
iGenius CEO Uljan Sharka revealed that the company is already in contact with potential users in various sectors:
The launch of Colosseum 355B addresses the challenges faced by regulated industries in adopting AI technology due to tight legislation and compliance requirements 12.
To further enhance its accessibility and deployment options, Colosseum 355B is packaged as an Nvidia NIM microservice and available as an API via the Nvidia API catalog. This integration allows for secure deployment across clouds, data centers, and workstations 3.
Highlighting the model's potential impact on European AI initiatives, Sharka flew to Brussels to present Colosseum 355B to the European Commission 12. This move underscores the importance of AI developments that align with regulatory requirements in the European context.
Alexis Bjorlin, Vice President of DGX Cloud at Nvidia, expressed optimism about the model's potential, stating, "Colosseum is a powerful AI model poised to unlock new opportunities for sovereign nations across the most highly regulated industries" 3.
As AI continues to evolve, models like Colosseum 355B demonstrate the industry's commitment to developing solutions that balance innovation with regulatory compliance, potentially opening new avenues for AI adoption in sectors previously hesitant to embrace the technology.
Reference
[1]
[2]
Italian AI startup iGenius partners with Nvidia to construct one of the world's largest AI supercomputers, designed to serve highly regulated sectors like finance, healthcare, and government.
4 Sources
4 Sources
NVIDIA introduces AI Foundry, a comprehensive service designed to help enterprises create and deploy custom generative AI models. This new offering aims to revolutionize how businesses leverage AI technology.
3 Sources
3 Sources
NVIDIA launches NeMo Retriever microservices for multilingual generative AI, partnering with DataStax to dramatically improve data processing efficiency and language understanding across industries.
3 Sources
3 Sources
Nvidia introduces Nemotron-4-Mini-Hindi-4B, a lightweight Hindi-language AI model, during CEO Jensen Huang's visit to India. This move aims to tap into India's growing AI market and support localized AI development.
9 Sources
9 Sources
Nvidia introduces Llama Nemotron, a family of open-source AI models with enhanced reasoning capabilities, designed to provide a foundation for building advanced AI agents. The models offer improved accuracy and inference speed, targeting various deployment scenarios from edge devices to multi-GPU servers.
5 Sources
5 Sources