2 Sources
2 Sources
[1]
Neo4j unifies real-time transactions and graph analytics at scale - SiliconANGLE
Neo4j unifies real-time transactions and graph analytics at scale Graph database maker Neo4j Inc. today launched Infinigraph, calling it a significant advancement in distributed graph technology. The company said the architecture allows users to run both operational and analytical workloads on a single graph database platform at over 100 terabytes in scale without fragmenting the graph, duplicating infrastructure or compromising performance. The product of more than two years of development, Infinigraph addresses the problem of harmonizing transactional systems and analytical workloads. Previous versions of Neo4j required running on a single physical computer, meaning that organizations had to use extract/transfer/load pipelines, synchronization, or multiple databases to handle high volumes. Infinigraph addresses this limitation by using sharding -- a database technique that splits large datasets into smaller, more manageable pieces -- to support billions of relationships and thousands of concurrent queries across multiple processors while maintaining the atomicity, consistency, isolation and durability, known as ACID, that's needed in transactional scenarios. The company can shard graph data across multiple machines while preserving its logical consistency, allowing for automatic distribution and scaling of data without the need for application rewrites or manual intervention. Neo4j said the new architecture lets customers embed tens of millions of documents as vectors directly into the graph. This enables use cases such as fraud detection, product knowledge graphs, long-term compliance monitoring and semantic search to be conducted on much larger and richer data volumes. "We're now able to support billions of vectors in the Neo4j database," said Sudhir Hasbe, president of technology at Neo4j. "This is particularly useful in life sciences, where companies are processing tens of millions of scientific documents for drug discovery. In the past, these documents would be orphaned. Now, they can be embedded directly into the graph." Neo4j laid the groundwork for the new architecture with the introduction of Fabric four years ago. That enabled federated graph queries across machines, but customers had to manage sharding themselves. Infinigraph automates this process while retaining full ACID compliance, a feature Hasbe said is critical for transactional reliability. "Graph sharding is a difficult problem due to traversal queries," which are a type of database query used to navigate relationships between connected data points in graph databases, Hasbe said. "We solved it by maintaining a global index in one environment for fast path queries, while distributing the actual data across machines for horizontal scalability. Even distributed transactions remain consistent and reliable." Neo4j quoted early-access customers Intuit Inc. and Dun & Bradstreet Corp. expressing their enthusiasm for the new features. "Running real-time queries while also analyzing broader patterns is critical," said Moheesh Raj, D&B's director of engineering. "That requires a graph to scale both." "Some of the biggest banks are now able to run fraud detection systems using Infinigraph, working with hundreds of terabytes of interconnected transactional data," Hasbe said. Neo4j also trumpeted the value of graphs as vector databases used in generative artificial intelligence. AI training requires both structured and unstructured data. The company first added vector support in 2023, allowing documents to be stored as vector embeddings. Infinigraph enables storage at a much larger scale. "Gen AI has made unstructured data more valuable than ever," Hasbe said. "We've seen customers go from using [Elasticsearch BV's] Elastic Store for vectors to managing everything within Neo4j. That's a huge simplification of their stack." Infinigraph is available on an early access basis now in Neo4j's self-managed Enterprise Edition, with broader availability set for October. The company said the feature will soon be available within its AuraDB cloud-native graph platform. Pricing for Infinigraph will follow a decoupled model, separating compute and storage to provide greater flexibility. "We're aligning our pricing model with how modern distributed systems operate," said Hasbe. "It allows customers to scale their workloads without unexpected costs." He said customers with smaller workloads will probably see costs decline from what they are currently paying.
[2]
Neo4j Launches Infinigraph for 100TB+ Unified Graph Workloads
Neo4j has launched a graph database built to unify workloads at 100TB+ scale for generative AI. Neo4j has launched Infinigraph, a new distributed graph database architecture designed to run both transactional and analytical workloads in one system at 100TB+ scale. The platform enables enterprises to store and analyse billions of relationships and run thousands of concurrent queries in real-time. It supports use cases such as embedding tens of millions of documents as vectors for context-aware assistants, global fraud detection, large product catalogues, and compliance analysis. By merging operational and analytical workloads, Infinigraph addresses the long-standing challenge of data silos. Enterprises often run separate transactional and analytical systems, leading to cost overheads and delays. Neo4j claims its approach removes ETL pipelines, sync delays, and redundancy.
Share
Share
Copy Link
Neo4j launches Infinigraph, a groundbreaking distributed graph database architecture that unifies transactional and analytical workloads at over 100TB scale, enabling real-time processing of billions of relationships and thousands of concurrent queries.
Neo4j, a leading graph database provider, has unveiled Infinigraph, a revolutionary distributed graph database architecture that promises to transform the landscape of data management and analysis
1
. This significant advancement allows organizations to run both operational and analytical workloads on a single graph database platform at an unprecedented scale of over 100 terabytes, without compromising performance or fragmenting data1
2
.Source: Analytics India Magazine
Infinigraph addresses a long-standing challenge in the database industry by harmonizing transactional systems and analytical workloads. Previously, Neo4j's solutions were limited to running on a single physical computer, necessitating complex workarounds for high-volume data processing
1
. The new architecture employs sharding techniques to support billions of relationships and thousands of concurrent queries across multiple processors while maintaining ACID (Atomicity, Consistency, Isolation, Durability) compliance crucial for transactional reliability1
.The innovative platform enables embedding of tens of millions of documents as vectors directly into the graph, opening up new possibilities for various use cases
1
:Source: SiliconANGLE
Sudhir Hasbe, President of Technology at Neo4j, highlighted the platform's ability to support billions of vectors, particularly beneficial in life sciences for processing vast amounts of scientific documents in drug discovery
1
.Infinigraph builds upon Neo4j's previous innovation, Fabric, introduced four years ago. While Fabric enabled federated graph queries across machines, it required manual sharding management. Infinigraph automates this process while maintaining full ACID compliance
1
. The architecture solves the complex problem of graph sharding by maintaining a global index for fast path queries while distributing actual data across machines for horizontal scalability1
.Early-access customers, including industry giants Intuit Inc. and Dun & Bradstreet Corp., have expressed enthusiasm for Infinigraph's capabilities
1
. Moheesh Raj, D&B's Director of Engineering, emphasized the critical nature of running real-time queries while analyzing broader patterns, which necessitates scalable graph technology1
.Related Stories
Neo4j is positioning Infinigraph as a powerful tool for generative AI applications. The platform's enhanced vector support allows for storage of documents as vector embeddings at a much larger scale, simplifying the technology stack for many customers
1
. This development is particularly timely as unstructured data becomes increasingly valuable in the era of generative AI1
.Infinigraph is currently available on an early access basis in Neo4j's self-managed Enterprise Edition, with broader availability scheduled for October
1
. The company plans to introduce a decoupled pricing model, separating compute and storage costs to provide greater flexibility and align with modern distributed systems operations1
. This new model is expected to potentially reduce costs for customers with smaller workloads1
.As the data landscape continues to evolve, Infinigraph represents a significant step forward in graph database technology, offering unprecedented scale, performance, and versatility for enterprises grappling with complex data challenges in the age of AI and big data.
Summarized by
Navi
[2]
1
Business and Economy
2
Business and Economy
3
Policy and Regulation