2 Sources
[1]
Hugging Face Teams Up With JFrog To Hunt Down Malicious AI Models
JFrog's scanner aims to perform a deeper analysis and parse the code in model weights to check for potential malicious usage. Hugging Face, one of the most sought-out platforms to host AI models, announced a partnership with software supply chain platform JFrog to improve security on the Hugging
[2]
JFrog advances AI security with Hugging Face partnership, Nvidia NIM and new MLOps platform - SiliconANGLE
JFrog advances AI security with Hugging Face partnership, Nvidia NIM and new MLOps platform Software supply chain company JFrog Ltd. today announced a number of new releases aimed at bringing greater trust, transparency and security to the world of artificial intelligence. The company announced
Share
Copy Link
JFrog teams up with Hugging Face to improve AI model security, launches new MLOps platform, and partners with Nvidia for streamlined AI deployment, addressing critical concerns in the AI supply chain.

In a significant move to address growing concerns over AI model security, software supply chain platform JFrog has announced a partnership with Hugging Face, the world's largest repository of open-source machine learning models. This collaboration aims to improve security on the Hugging Face Hub by integrating JFrog's advanced scanning technology
1
.The partnership comes in response to the discovery of malicious models on the platform in early 2024, highlighting the urgent need for enhanced security measures in the AI supply chain. JFrog's scanner will perform deep analysis of model weights, parsing embedded code to check for potential malicious usage
1
.JFrog's integration with Hugging Face introduces a "JFrog Certified" badge for models that pass verification, providing users with greater transparency and confidence in the models they choose to deploy. The scanning process, which will run continuously, supports various model types including pickle-based, TensorFlow, GPT-Generated Unified Format (GGUF), and Open Neural Network Exchange (ONNX) models
2
.Notably, JFrog's analysis has already identified 25 previously undetected malicious models, underscoring the importance of this security initiative. Users of the Hugging Face Hub will automatically benefit from this integration, with all public model repositories being scanned as soon as files are pushed to the Model Hub
1
.Beyond the Hugging Face partnership, JFrog has announced two additional initiatives to enhance AI security and deployment:
Collaboration with Nvidia: JFrog is integrating its platform with Nvidia Inference Microservices, part of the Nvidia AI Enterprise suite. This collaboration aims to provide a unified solution for securely deploying GPU-optimized machine learning models and large language models into production environments
2
.Launch of JFrog ML: This new MLOps solution is designed to unify machine learning development with traditional DevSecOps practices. JFrog ML offers an end-to-end framework for managing, deploying, and monitoring AI models alongside other software artifacts, applying consistent governance, traceability, and security controls across the entire software supply chain
2
.Related Stories
These initiatives by JFrog address critical challenges in the AI industry, particularly in terms of security and scalability. By integrating advanced security measures into popular platforms like Hugging Face and offering solutions for streamlined deployment, JFrog is contributing to a more secure and efficient AI development ecosystem.
Shlomi Ben Haim, JFrog's co-founder and CEO, emphasized the growing concerns around the use of open-source ML models and platforms, stating that JFrog ML offers "a superior, straightforward and hassle-free user experience for bringing models to production"
2
.As the demand for AI-powered applications continues to rise, these developments represent a significant step towards ensuring the safety and reliability of AI models in production environments, potentially accelerating the adoption of AI technologies across various industries.
Summarized by
Navi
10 Sept 2024

13 Nov 2025•Technology

04 Mar 2025•Technology

1
Technology

2
Technology

3
Policy and Regulation
