Pinecone Enhances Vector Database with Inference Capabilities and Cascading Retrieval, Boosting AI Accuracy by up to 48%

Pinecone Launches Innovative Vector Database with Inference Capabilities to Enhance AI Development

Pinecone, a leading knowledge platform for building accurate and scalable AI applications, has announced the integration of industry-first inference capabilities into its vector database. This new feature includes fully-managed embedding and reranking models and a unique approach to sparse embedding retrieval. By combining these capabilities with Pinecone's dense retrieval technology, the platform sets a new standard for AI-powered solutions with cascading retrieval. The company said these new advancements aim to improve the development of AI applications, making them up to 48% more accurate and enabling faster and easier creation of AI-driven tools. Pinecone has also introduced more granular role-based access controls (RBAC), allowing users to set API key roles for enhanced control over data plane operations. Customer-managed encryption keys (CMEK) provide users with greater control over their data encryption, improving tenant isolation. Additionally, audit logs for control plane activities and the general availability of AWS PrivateLink for serverless indexes further enhance security and performance. Pinecone's composable platform now includes pinecone-rerank-v0 proprietary reranking model, pinecone-sparse-english-v0 proprietary sparse embedding model, new sparse vector index type and includes new security features. Through its collaboration with Amazon Bedrock, Pinecone offers seamless integration that automates the ingestion, embedding, and querying of customer data as part of the large language model generation process. This integration allows customers to quickly generate more grounded and production-grade AI applications while running Retrieval-Augmented Generation (RAG) evaluations natively within Amazon Bedrock, eliminating the need for third-party tools. Pinecone's innovative approach combines inference, retrieval, and knowledge base management on a single platform, leading to significant performance improvements and new possibilities for AI application development. Customers can access Pinecone through the AWS Marketplace to accelerate deployment and optimise costs, further empowering developers to deliver better AI solutions. Pinecone, claims to have already helped over 5,000 customers build faster, more confident AI applications.

Pinecone expands vector database with cascading retrieval, boosting enterprise AI accuracy by up to 48%

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More Pinecone has made a name for itself in recent years as being one of the leading native vector database platforms. Pinecone is continuing to differentiate in an increasingly competitive market with new capabilities to help solve enterprise AI challenges Today Pinecone announced a series of updates to its namesake vector database platform. The updates include a new cascading retrieval approach that combines the benefits of dense and sparse vector retrieval. Pinecone is also deploying a new set of reranking technologies designed to help improve accuracy and efficiency for vector embeddings. The company claims the new innovations will help enterprises to build enterprise AI applications that are up to 48% more accurate. "We're trying to expand beyond our core vector database to solve basically the broader retrieval challenges," Gareth Jones, Staff Product Manager at Pinecone, told VentureBeat. Understanding the difference between dense and sparse vectors To date, Pinecone, like many other vector database technologies, has relied on dense vectors. Jones explained that dense text embedding models produce fixed-length vectors that capture semantic and contextual meaning. They are powerful for maintaining context, but not as effective for keyword search or entity lookup. He noted that dense models can sometimes struggle with concepts like phone numbers, part numbers and other specific entities, without significant fine-tuning. In contrast, sparse indexes allow for more flexible keyword search and entity lookup. Pinecone is adding sparse indexes to address the limitations of dense vector search alone. The overall goal is to provide a more comprehensive retrieval solution. The idea of combining keyword type searches with vectors is not new. It's a concept that is often lumped under the term - hybrid search. Jones referred to the new Pinecone approach as cascading retrieval. He argued that it is different from a generic hybrid search. Jones said that cascading retrieval goes beyond just a simple hybrid approach of running dense and sparse indexes in parallel. The approach involves adding a cascading set of improvements, such as re-ranking models, on top of the dense and sparse retrieval. The cascading approach combines the strengths of different techniques, rather than just doing a basic score-based fusion of the results. How reranking further improves Pinecone's vector database accuracy Pinecone is also improving the accuracy of results with the integration of a series of new reranker technologies. An AI reranker is a critical tool in the enterprise AI stack optimizing the order or 'rank' of results from a query. Pinecone's update includes multiple re-ranking options, including Cohere's new state-of-the-art Rerank 3.5 model and Pinecone's own high-performance re-rankers. By building its own reranker technology, Pinecone is aiming to further differentiate itself in the crowded vector database market. The new Pinecone rerankers are the first rerankers developed by the company and aim to deliver the best possible results, albeit with some latency impact. According to Pinecone's own analysis its new pinecone-rerank-v0 on its own can improve search accuracy by up to 60%, in an evaluation with the Benchmarking-IR (BEIR) benchmark. The new pinecone-sparse-english-v0 reranking model has the potential to specifically boost performance for keyword-based queries by up to 44%. The key benefit of these reranking components is that they allow Pinecone to deliver optimized retrieval results by combining the outputs of the dense and sparse indexes. This matters to enterprises because it allows them to consolidate their retrieval stack and get better performance without having to manage multiple vendors or models. Pinecone is aiming to provide a tightly integrated stack where users can simply send text and get back re-ranked results, without the overhead of managing the underlying components. On top of having more features inside the platform, Jones emphasized that it's a serverless offering that helps enterprises to optimize costs. The platform's serverless architecture automatically handles scaling based on actual usage patterns. "We maintain a serverless pay-go model," Jones states. "People's traffic to their application looks very different on a particular day, whether it be queries or writing documents to index... we handle all of that, so they're not over-provisioning at any given time."