Zilliz Releases Milvus 2.4, Advances the Field of Vector Databases with GPUs

Zilliz, a trailblazer in vector database technology, is releasing Milvus 2.4, introducing a new standard in vector search capabilities with a groundbreaking GPU indexing feature powered by NVIDIA’s CUDA-Accelerated Graph Index for Vector Retrieval (CAGRA), part of the RAPIDS cuVS library.

Building on Zilliz’s commitment to innovation, Milvus 2.4 enhances GPU indexing capabilities since the introduction of GPU IVF-Flat and GPU IVF-PQ indexes last year.

"We are thrilled to introduce the next gen GPU indexing in Milvus 2.4, a release that underscores our commitment to advancing the field of vector database technology, with GPUs," said Charles Xie, CEO at Zilliz. "These features empower developers with unparalleled capabilities, enabling them to build highly efficient and scalable applications that leverage the combination of vector search and GPUs."

According to the company, GPU Indexing represents a significant milestone in vector database technology, propelling Milvus 2.4 further ahead of traditional CPU-based indexes like HNSW.

Leveraging the power of GPU acceleration, Milvus 2.4 delivers performance gains, particularly under large datasets, ensuring lightning-fast search responses and unparalleled efficiency for developers.

Accelerated vector search capabilities are key to improving retrieval-augmented generation workflows. Customers can use Milvus with NVIDIA NeMo Retriever microservices.

In addition to GPU Indexing, Milvus 2.4 introduces support for GPU-based brute force search, further enhancing recall performance without sacrificing speed. This combination of features empowers developers to build highly efficient and scalable applications that leverage the full potential of vector search technology, according to Zilliz.

“Vector databases play a pivotal role in powering AI models,” said John Zedlewski, senior director of accelerated data science, NVIDIA. “Bringing GPU acceleration to Milvus 2.4 with cuVS will improve a broad range of generative AI applications built on vector search, including NVIDIA NeMo Retriever.”

Milvus 2.4 is now available for download.

For more information about this news, visit