When [Bookshop.org](http://Bookshop.org)'s small engineering team struggled to push past a 14% search conversion rate, they faced a familiar dilemma. Despite having Elasticsearch—a powerful but complex search solution—their eight-person team was spending more time maintaining search infrastructure than improving their core platform. They needed something different: a solution that could deliver better results with less overhead.

Their challenge reflects a broader reality in modern software development. Every click, every search query, and every page load directly impact business metrics, yet the tools meant to optimize these experiences often become bottlenecks themselves. For engineering teams, especially smaller ones, the complexity of search infrastructure can become a _hidden tax_ on innovation and growth.

This is where Meilisearch comes in. Built to work seamlessly out of the box, it's the solution that lets developers focus on building rather than maintaining. Today, we're taking that mission further with [the launch of Meilisearch AI](https://www.meilisearch.com/launch-week)—our next step in making it radically easier for developers to build world-class search experiences.

In this article, we'll explore how modern search has evolved beyond simple queries, examine the technical challenges facing development teams, and introduce Meilisearch's innovative solutions—including our new AI capabilities. You'll learn how our approach to developer experience is transforming search implementation, and discover our roadmap for making advanced search features accessible to teams of all sizes.

## Redefining modern search

Modern search experiences extend far beyond the traditional search bar, encompassing two key facets: search and discovery. 

Search can take the appearance of inputs, menus, filters, or the trending UX of conversational search (i.e. chatbots). Discovery, on the other hand, plays a key role in navigating content and suggesting recommendations.

Across industries, we see search and discovery most prevalent as follows:

- **Traditional full-text search & semantic search:** standard in all industries ranging from SaaS to ecommerce, marketplaces, and content platforms
- **Conversational search:** prominent in RAG (Retrieval-Augmented Generation) and AI-enhanced search interfaces like Perplexity
- **Discovery for navigation:** common in social media and content platforms where a feed is the primary navigation
- **Recommendations:** tie in more critically with business value in ecommerce and content platforms

For early-stage startups and SMBs, implementing these search capabilities presents significant technical challenges. The complexity multiplies when adding AI integration and personalization layers. Addressing these pain points diverts the workforce from building core product value. Meilisearch is here to relieve you from this burden, allowing you to focus on what really matters. 

We want Meilisearch built-ins to handle modern use cases like [document embedding](https://www.meilisearch.com/docs/learn/ai_powered_search/document_template_best_practices). Complex setups—such as managing [heavyweight solutions like Elasticsearch](https://www.meilisearch.com/blog/meilisearch-vs-elasticsearch), [tweaking a Postgres instance](https://www.meilisearch.com/blog/postgres-full-text-search-limitations), or handling hybrid search—are additional integration burdens. This ignores the security consideration related to exposing front-end accessible APIs or the analytics necessary to collect business KPIs—things that don’t come packaged with custom-made solutions.

![bookshop_meilisearch.gif](https://unable-actionable-car.media.strapiapp.com/bookshop_meilisearch_9498082583.gif)

These DX considerations impact business metrics down the road as engineering bottlenecks lead to longer time-to-market, hindering growth for companies that want to move fast. In ecommerce, for example, search accuracy directly translates to conversion rate, as shown by how we helped [Bookshop increase search-based purchases by 43%](https://www.meilisearch.com/blog/bookshop-increases-search-based-purchases). On SaaS and content platforms, discovery enables engagement and adoption growth, both of which are key to keeping churn in check. 

## Leveraging DX to move mountains

Meilisearch is a no-configuration, plug-and-play solution that you can install and forget. At the heart of any search tool—and often the biggest challenge for developers—is ensuring relevant results. **CascadeRank** is our answer to [relevancy fine-tuning](https://www.meilisearch.com/docs/learn/relevancy/relevancy). Our algorithm uses human-readable ranking rules that enable configuration and easy customization. With Meilisearch, simplicity is key, allowing you to set up and focus on your core tasks. 

Though customization is easy, Meilisearch comes with strong defaults to handle common requirements out of the box—things like being typo-tolerant and prioritizing word proximity. Indeed, we’ve seen [Minipouce get better relevancy with Meilisearch’s default configuration than their previous Typesense setup](https://www.meilisearch.com/blog/minipouce-top-grade-customer-experience), leading to a 5x search volume increase. 

Scalability is a concern for small teams and enterprises alike. Performance is the name of the game for user-facing search—both for search latency and indexing time. As demonstrated by [Podscan.fm](http://Podscan.fm) [searching across 600GB of data](https://x.com/arvidkahl/status/1807889668748275802), search remains fast against large datasets. Our [next-generation indexer boasts 4x faster updates](https://www.meilisearch.com/blog/introducing-indexer-2024), making Meilisearch suitable at scale for write-intensive workflows, too.

[![arvid-kahl-tweet.png](https://unable-actionable-car.media.strapiapp.com/arvid_kahl_tweet_0c41da4824.png)
](https://x.com/arvidkahl/status/1807889668748275802)

When it comes to security, no compromise is possible. So Meilisearch provides fundamental security features to handle simple and complex use cases. Meilisearch facilitates [API key management](https://www.meilisearch.com/docs/learn/security/basic_security) to facilitate multi-environments. The built-in [multi-tenancy features](https://www.meilisearch.com/docs/learn/security/multitenancy_tenant_tokens) also enable more advanced security patterns, allowing developers to customize their access rules.

Using our expertise in search requirements across various customers, we built [Meilisearch Cloud](https://www.meilisearch.com/cloud). It’s the quickest way to get started. In addition to freeing teams from managing infrastructure, it integrates analytics and monitoring, making it [the preferred production platform for companies like HitPay](https://www.meilisearch.com/blog/hitpay-streamlines-search). Open-source Meilisearch can be self-hosted via Docker and a plethora of hosting platforms. 

This feature set positions Meilisearch well as a simple solution to get the best of modern search experience. This includes benefiting from an easy LLM integration to leverage AI-powered solutions.

## Future-proofing your search strategy

With native [hybrid and vector search](https://www.meilisearch.com/docs/learn/ai_powered_search/getting_started_with_ai_search) integration, Meilisearch makes it simple to implement AI-powered search capabilities. But we’re not stopping there—our 2025 roadmap is packed with features enabling businesses to uncover more value from AI while sustaining performance and scalability.

### Improved conversions with personalization

[Our research shows that personalization significantly improves conversion rates](https://www.meilisearch.com/blog/personalization-recommendations) across diverse business types. We aim to release a personalization framework enabling the collection of end-user context on each request. This comprehensive context management system allows developers to leverage user preferences, recent interactions, and behavioral patterns to further customize the relevancy of results on a per-user basis. 

### Retrieval augmented generation without overhead 

Although Meilisearch already enables [building retrieval-augmented generation (RAG)](https://www.meilisearch.com/blog/how-to-build-rag), we want to integrate built-in RAG capabilities in the engine, seamlessly combining full-text search, vector search, and LLM interaction. Then, we want to tackle inherent problems in state-of-the-art RAG applications by tackling the orchestration of filtering, ranking, and results merging in RAG scenarios. Of course, we want this to come with strong defaults, making it easy for developers to get started.

### Advanced ranking integrations

Our goal is to provide a native way for users to leverage AI reranking models to improve the relevancy of results. This provides a more flexible approach to configuring result relevancy by allowing real-time results reranking based on user context and behavior. We also want to enable organizations to integrate with their own custom ranking models to allow for further dynamic adjustment of results based on hand-picked factors.

### Reliability as you scale

We also plan to improve Meilisearch’s infrastructure to handle additional use cases better. In particular, we want to continue improving the distributed system capabilities for better scaling and high availability by building upon our sharding experiments with [federated remote search](https://www.meilisearch.com/docs/learn/multi_search/implement_sharding). Another layer of performance is integrating more sophisticated caching mechanisms to improve out-of-the-box performance. Monitoring and observability are also continuously improved based on user feedback.

## Meilisearch AI, refreshingly simple search DX

The release of Meilisearch AI marks a new age for Meilisearch users, fully integrating with the modern landscape of AI-powered applications. But it’s also a continuous fulfillment of our core value—making good search UX easy to build. We believe focusing on developer experience enables engineers to achieve faster time-to-value and maintain focus on their core business.

Meilisearch ships frequently to keep packaging built-in features, enabling fast-shipping companies to do what they do best. For more information on the Meilisearch AI release, consult our [launch week page](https://www.meilisearch.com/launch-week). 

Start with a [14-day free trial of Meilisearch Cloud](https://cloud.meilisearch.com/) or [request a demo](https://dub.sh/meili-sales) to discuss your needs with our search experts.

Building the future of search with Meilisearch AI

**[Rayon](https://rayon.so/) is a cloud-based design platform for architecture and interior design that enables teams to collaborate in real-time.**

With millions of monthly searches and users in over 100 countries, Rayon needed a fast, multilingual search solution to keep up with explosive data growth. They turned to Meilisearch to power their semantic search and scale seamlessly.

>“Meilisearch is very powerful for our needs, especially its semantic search, which effortlessly helps users find relevant objects - even without precise queries.” - said Bastien Dolla, CEO & Co-founder at Rayon.

**Challenge: delivering fast, intuitive, and scalable search experience, while accommodating rapid growth.**
-------------------------------------------------------------------------------

With a rapidly growing user base in over 100 countries, Rayon needed to address critical challenges, including improving search functionality and supporting the rapid expansion of its database and usage while enhancing the overall user experience.

**Challenge: Multilingual search for a global audience.**
Traditional keyword-based search systems usually require users to know the exact name of an asset, often in English. Rayon’s non-native English-speaking users make up a significant portion of its global audience, so the platform needed to support searches in multiple languages in order to eliminate friction.

**Challenge: Rapid data expansion.**
Rayon’s platform offers access to over 4,000 assets, which represent real-world objects like furniture or textures. Users can also create and publish their own libraries, which leads to the rapid growth of the repository. With approximately one terabyte of new data added weekly, conventional tools simply couldn’t keep pace.

**Challenge: Scaling demand.**
The platform handles 2 million searches monthly, and expects to hit 20 million by year’s end. This necessitated a high-performance, scalable solution.

**Solution: creating an AI-powered search experience for Rayon’s global user base.**
-------------------------------------------------------------------------------

Rayon turned to Meilisearch to address its challenges with multilingual search, scaling, and efficient data management. These were addressed by:

- Leveraging AI-powered [semantic search](https://www.meilisearch.com/blog/semantic-search) for intuitive discovery: rather than relying on exact keywords, Meilisearch understands intent. For example, whether a user searches for “Scandinavian style” or “modern sofa with clean lines,” relevant results are quickly delivered.
- Enabling multilingual search: In addition to understanding the natural meaning of a query, Meilisearch supports non-English language searches, leveraging OpenAI embeddings to eliminate language barriers. For example, a search for 'chaise' in French or 'silla' in Spanish will return relevant chair designs, regardless of the language used.
- Scalable architecture for rapid growth: By indexing only design asset libraries and using token-based access control, Meilisearch efficiently manages data growth while ensuring stable performance and secure, authorized access.
- Open-source flexibility and Rust compatibility: The open-source origins of Meilisearch ensures that Rayon retains control over its search infrastructure, which provides them the flexibility to deploy their own instance if needed. Compatibility with Rust, the programming language Rayon is built on, is an important commonality to Rayon as they have a strong Rust team, making it easier for them to integrate and work with Meilisearch

**Implementation**
-------------------------------------------------------------------------------

Rayon implemented an efficient indexing process to ensure users could quickly and accurately find the design assets they needed:
1. Library processing and SVG generation: When users publish a library of design assets, Rayon processes the files and generates SVG images for each element. These images serve as visual representations of the assets, making it easier for users to identify what they are searching for.
2. Embedding generation with OpenAI: Rayon uses OpenAI’s advanced AI models to generate embeddings for each design asset. These embeddings capture the semantic meaning of the asset, enabling Meilisearch to perform highly accurate searches based on natural language descriptions.
3. Token-based access control: Meilisearch’s token system allows Rayon to maintain strict control over data visibility while still providing a seamless search experience.

**Results**
-------------------------------------------------------------------------------
By solving key challenges, Meilisearch has become essential to Rayon’s mission, delivering faster searches, happier users, and a platform built for the future:
- **Multilingual search for a global audience.** Designers can now search for assets in their native language, eliminating the need for English-only queries.
- **Faster, more intuitive search:** Meilisearch’s high-performance engine enables users to find design assets in seconds using natural language, without needing exact names.
- **AI-powered discovery** – With [OpenAI embeddings](https://www.meilisearch.com/docs/learn/ai_powered_search/getting_started_with_ai_search#generate-embeddings-with-openai), Rayon's search goes beyond keywords, allowing users to find assets based on descriptions, even without precise terminology.
**Scalability for rapid growth** – Meilisearch indexes 250,000–350,000 searchable items, supporting both Rayon’s library and user-generated content. With 1TB of new data added weekly, it seamlessly handles growing search volumes—scaling from 2M to an expected 20M searches per month by year-end.

**Conclusion: Solidifying Rayon’s position as a leader in cloud-based design tools.**
-------------------------------------------------------------------------------
Meilisearch has become essential to Rayon's mission by solving multilingual access, scalability, and asset discovery challenges.
As Rayon continues to innovate, the team plans to explore new capabilities, such as visual search and deeper data and [RAG](https://www.meilisearch.com/blog/how-to-build-rag) integration, to evolve into a comprehensive platform for architects and designers.
Looking ahead, their vision goes beyond visual assets and drawings, aiming to integrate procurement details, material specifications, and other essential data into a **truly comprehensive design hub.**




How Rayon leverages AI semantic features for a seamless design UX 

**[MotionElements](https://www.motionelements.com/) is an AI-powered one-stop marketplace for video creators to access and customize creative assets. Time is money for MotionElements’ users, and search is essential in helping them quickly find what they need.** 

With a global user base speaking multiple languages, MotionElements relies on powerful multilingual search capabilities to deliver fast, accurate, and relevant results across diverse creative content.

![MotionElements_search.gif](https://unable-actionable-car.media.strapiapp.com/Motion_Elements_search_50cb3914a5.gif)
>“MotionElements’ federated hybrid search empowers creators to seamlessly explore diverse creative assets across our one-stop marketplace—all in their own language. By combining keyword search with zero-shot video search, visual & music similarity search, we deliver an intuitive, AI-enhanced discovery experience that fuels creative workflows.” - **Mark Sun, CTO at MotionElements**


**Challenge: Scaling search**
-------------------------------------------------------------------------------

Previously, MotionElements relied on Solr, which became increasingly difficult to maintain. With millions of new content pieces added each month, Solr consumed excessive RAM and struggled with scalability. MotionElements' search needs have also evolved, requiring support for keyword search, visual and music similarity vectors, and image embeddings—capabilities that are difficult to implement efficiently with Solr.


>_As our content grows, we need a search solution that can handle both traditional and AI-enhanced discovery while remaining scalable and performant,_ said Mark Sun, CTO of MotionElements.

![MotionElements_multimodal.gif](https://unable-actionable-car.media.strapiapp.com/Motion_Elements_multimodal_6cfa386d8d.gif)

**Solution: Choosing a superior price‑to‑performance ratio, scalability, and multilingual federated**
-------------------------------------------------------------------------------

- **Price‑to‑performance ratio:** MotionElements explored Elasticsearch, Algolia, and Typesense, and ultimately chose Meilisearch because of its price‑to‑performance ratio when handling large catalogs with millions of products.

- **Feature fit:** Meilisearch’s federated search capabilities and multilingual support were also key factors in MotionElements’ decision.

- **Addressing migration concerns**,  Mark Sun said:

>“Initially, we had concerns about migrating its image similarity vectors, but Quentin, the CEO of Meilisearch, provided invaluable support through a Proof of Concept (PoC), resolving all MotionElements’ migration challenges. Meilisearch offered the scalability, speed, and flexibility we needed while keeping infrastructure management minimal. Its federated search and hybrid search capabilities make it a powerful tool in MotionElements’ AI‑enhanced workflows. Federated search lets us retrieve results across multiple product types, making search in MotionElements’ one‑stop marketplace seamless. Hybrid search combines keyword search with external AI‑powered vector search, allowing us to enhance discovery across images and audio."

These features significantly improve search relevance, speed, and user experience, making it easier for the MotionElements team to deliver fast and intuitive search results.

**Implementation**
-------------------------------------------------------------------------------

Implementing Meilisearch was straightforward, thanks to its user‑friendly API. MotionElements wrote code to set up indexes based on its needs and pre‑generated NDJSON files of its products, which are stored in an S3 bucket. Meilisearch makes it easy to ingest data from NDJSON, dramatically improving MotionElements’ indexing workflow. 

Mark Sun said: _“Previously, re‑indexing on Solr took weeks, but with Meilisearch, it now takes just hours—saving us countless hours of engineering time. Since MotionElements uses the enterprise cloud version, the MotionElements developer team focuses on search optimization while Meilisearch handles the infrastructure.”_

**Results**
-------------------------------------------------------------------------------
The biggest impact has been faster search performance, improved accuracy, and higher engagement:

- **No more worrying about Solr and Zookeeper crashes**. _"Meilisearch is stable and scalable. Now, we can focus our efforts where they’re needed most, knowing our search infrastructure is stable and dependable._” — said Mark Sun.
- **Re-indexing time drastically reduced** – "what used to take weeks in Solr now takes just hours."_

- **Increased search-based conversions.** Faster, more relevant results lead to better engagement and retention.

**Conclusion: vision**
-------------------------------------------------------------------------------

Going forward, MotionElements expects further improvements in personalization, more efficient AI-powered product recommendations, and continued optimization of multilingual search, all of which are key drivers of its business growth.

As MotionElements continues investing in AI-powered search enhancements, Meilisearch remains a core search infrastructure component for the MotionElements platform. 
MotionElements’ vision includes:
- **Advancing hybrid search** – enabling seamless queries across keywords, text embeddings, image embeddings, and music similarity to deliver the best results across multiple vectors.
- **Enhancing language‑specific optimizations** – for example, in Japanese, when searching in kanji, results should also include matches in hiragana and katakana, while properly handling stop words for better accuracy.
- **Optimizing performance at scale** – indexing, updating, and searching must remain fast and efficient as MotionElements’ content library grows.
Meilisearch should continue to augment vector‑based search, rather than replace dedicated vector databases—providing a fast, flexible, and cost‑effective search infrastructure that evolves alongside MotionElements’ AI‑powered features.



AI-Powered discovery: how MotionElements elevates creators

Hybrid search combines keyword and semantic search, giving users the best of both worlds and control over the level of contextual depth they need. 

This type of information retrieval (IR) is especially critical in enterprise search, e-commerce, and knowledge management systems, where some inputs require deep contextual understanding while others demand precise keyword matching.

A clear advantage of hybrid search is its ability to handle data with less computational costs. 

This is thanks to the lexical matching system, which uses considerably less power than semantic algorithms that may rely on Large Language Models (LLMs), Convolutional Neural Networks (CNNs), and other energy-consuming models. 

Therefore, these systems can be tweaked for higher performance while being a cost-effective alternative to pure semantic search systems.

However, implementing hybrid search requires strategic planning. Users unfamiliar with semantic weighting may find it confusing, leading to frustration or disengagement. 

In the following piece, we will take a deep look into the importance of hybrid search, how to implement it, and in which situations it is the preferred solution.

## What is hybrid search?

Hybrid search systems combine keyword-based retrieval (sparse vector methodology) with semantic search systems ([dense vector embeddings](https://www.meilisearch.com/blog/what-are-vector-embeddings)) to optimize precision and contextual relevance.

For a visual explanation of the terms and technologies used in the hybrid search, let’s take a look at the schema below:

![What is hybrid search.png](https://unable-actionable-car.media.strapiapp.com/What_is_hybrid_search_111362249c.png)

Semantic search relies on dense vectors, requiring both the search query and target data to be embedded using Machine Learning (ML) models. Some methods, like neural search, leverage Deep Neural Networks (DNNs) to generate rich contextual insights for embedding, retrieval, and ranking. Vector search is another type of semantic search that uses embedding models to create dense vectors, ML algorithms such as Approximate Nearest Neighbors (ANN) for information retrieval, and cosine similarity search for ranking.

On the other hand, keyword search relies on sparse vectors generated through algorithms like BM25 that use Term Frequency-Inverse Document Frequency (TF-IDF). A sparse vector is focused on tokens, where each value corresponds to a specific keyword within a large vocabulary. When a search query is entered, the system preprocesses the input by extracting individual words and matching them against the sparse vector values of the documents. These are then ranked based on keyword relevance.

![Prepocessing.png](https://unable-actionable-car.media.strapiapp.com/Prepocessing_80a5f32b48.png)

### Dense vectors

The dense vectors are extensive and can have hundreds or thousands of floats (numerical representations) to identify a single document. They represent the similarity of objects in a vector space and can have the following shape:

```json
dense_vector = [0.8, 0.4, 0.2, 0.7, 0.9, 0.1, … ]
```

Dense vectors are usually multidimensional and don’t have zero values because they are created continuously to capture the complete information of the document or query.

### Sparse vectors

The sparse vectors are much shorter than dense vectors, and only a few numerical representations target specific keywords:

```json
sparse_vector = [{213: 0.3}, {543: 0.8}]
```

Unlike dense vectors, these mostly consist of zeros, with some float values used to map the keywords.
Hybrid search combines the strengths of dense and sparse vector retrieval to enhance search scores. It first gathers matches from both methods and then refines the final output using techniques like Reciprocal Rank Fusion (RRF). 

In the next chapter, we’ll explore each step of the hybrid search process.

## How does hybrid search work?

Hybrid search works by leveraging the semantic capabilities of dense vectors and the exact matching and accuracy of sparse vectors. The outputs retrieved from these vectors are re-ranked using techniques like RRF. 

![How does hybrid search work.png](https://unable-actionable-car.media.strapiapp.com/How_does_hybrid_search_work_3224ecf2f4.png)

By looking at the schematic above, we can structure the hybrid search workflow into distinct steps, allowing both semantic and keyword searches to operate in parallel:

### Data cleansing & preprocessing

- **Keyword Search**: Requires robust data cleaning (e.g., using NLP tools to remove stopwords) to ensure accurate term matching.
- **Semantic Search**: Benefits from noise reduction and strategic text segmentation (chunking) to improve the quality of document embeddings.

### Embedding: dense and sparse representations

- **Semantic Embeddings**: Models like Bidirectional Encoder Representations from Transformers (BERT) and Global Vectors (GloVe) transform documents into dense vectors, capturing nuanced contextual meanings.
- **Keyword Embeddings**: While BM25 functions primarily as a scoring algorithm based on term frequencies, SPLADE leverages neural networks to generate sparse embeddings.

### Retrieval mechanisms of dense and sparse vectors

- **Semantic Retrieval**: Utilizes algorithms like Approximate Nearest Neighbor (ANN) and K-Nearest Neighbor (KNN) to search within the dense vector space efficiently.
- **Keyword Retrieval**: Directly matches query terms with document vectors.

### Ensemble retrieval

- **Hybrid search re-ranking**: The final step involves re-ranking results from both retrieval methods using the Reciprocal Rank Fusion (RRF) algorithm.

The hybrid search process can be tweaked to assign importance to one type of result over another. If contextual meaning outweighs lexical matching, the system prioritizes outputs from the semantic search. Otherwise, it prioritizes keyword matching. This feature is available and easily controlled in Meilisearch’s [hybrid search setup](https://www.meilisearch.com/solutions/hybrid-search).

## What is a hybrid search engine example?

Companies have adopted hybrid search engines to improve the accuracy and relevance of search results. One of the most advanced hybrid search systems is Google Search, which combines multiple search techniques and algorithms to deliver precise and contextually relevant results.

Google integrates both keyword-based search and machine learning models to interpret user queries, rank web pages, and present the most relevant information. Currently, they utilize [Vertex AI Embedding](https://cloud.google.com/vertex-ai/docs/start/install-sdk) models to generate dense vectors that capture semantic meaning while simultaneously employing BM25 and SPLADE to create sparse vectors for keyword-based retrieval.

To configure search results, Google merges output from semantic and keyword-based searches using Reciprocal Rank Fusion (RRF), as detailed in their official [notebook](https://github.com/GoogleCloudPlatform/generative-ai/blob/main/embeddings/hybrid-search.ipynb).

As of January 2025, Google Search maintains an [89.79% market share](https://gs.statcounter.com/search-engine-market-share), continuing to dominate the search landscape. While AI-driven chatbot search features have begun gaining traction, they still fall short of Google's accuracy and real-time information retrieval capabilities.

## What are the benefits of hybrid search?

Hybrid search provides several advantages over standalone keyword-based or semantic search methods. Some of these benefits include:

1. **Enhanced search accuracy and relevance**: The re-ranking mechanism used in hybrid search produces the best outputs from exact matches and meaning. This level of accuracy ultimately retains users and reduces the bounce rate.
2. **Improved user experience**: The system can deliver meaningful content even if users enter inaccurate terms or vague keywords. This ease of retrieving information allows designers to create engaging search elements. Just ask [CarbonGraph](https://www.meilisearch.com/customers?usecase=Hybrid+search): "_We migrated to Meilisearch from Pinecone to consolidate our search service [...] The setup of the OpenAI embedder was very straightforward, and we love that embeddings are created automatically using the contents of a search document_."
3. **Cost-effective implementation**: Lexical matching in hybrid search reduces memory usage compared to pure semantic search engines. This is crucial for lowering cloud costs related to storage and computational demand, especially since keyword search algorithms do not depend on GPUs.
4. **Increased search speed**: [Opinly](https://opinly.ai/), a company that allows you to monitor your competitors' websites, was able to [increase the search speed](https://carbon.ai/customers/opinly) and the relevance of results by adopting hybrid search technologies.
5. **Personalization and adaptability**: Hybrid search systems can be configured to dynamically adjust the weight of keywords and semantic relevance or provide the user with control over it. The [NFSA collection](https://www.collection.nfsa.gov.au/) has this option available in their search engine. 

Hybrid search provides significant advantages across various business domains, offering speed, robustness, and efficiency. However, it is not always the optimal solution for every search application. The next chapter will explore its limitations and when alternative approaches may be more suitable.

## What are the drawbacks of hybrid search?

While hybrid search offers the best of both keyword-based and semantic search, it also comes with challenges that can impact implementation, performance, and user experience. Below are some key drawbacks to consider when adopting a hybrid search approach:

1. **Increased complexity in implementation**: Hybrid search requires integrating multiple search algorithms (e.g., keyword matching using BM25 and semantic search using dense embeddings). This integration can be technically complex and requires deep technical understanding.
2. **Difficulty in balancing keyword precision and context**: Over-relying on one method may diminish the benefits of the other (ex., more semantic power than keyword precision). If a good balance is not achieved, this could lead to a bad user experience and increased bounce rates.
3. **Bad user experience**: If users can adjust semantic weight, the interface should be intuitive or designed for an audience familiar with the terminology. Otherwise, it may lead to confusion and increase the risk of user drop-off. According to this [Toptotal report](https://www.collection.nfsa.gov.au/), 88% of users are less likely to return after a bad user experience.

Despite these challenges, hybrid search remains a powerful tool when applied correctly.

## When should you use hybrid search?

Hybrid search isn't the optimal solution in all scenarios. In cases where data is highly structured — such as product inventories or specific academic research — precision is key, and similar-sounding terms with distinct meanings must be strictly differentiated. Hybrid search truly excels in the following examples:

1. **E-commerce platforms**: Online retailers like Amazon implement hybrid search to enhance product discovery. When customers input vague queries, the system leverages keyword matching and semantic analysis to present relevant products. You can see it in action below; the user searched for “bottle that keeps drinks cold” and received results about thermoses.
 
![image9.png](https://unable-actionable-car.media.strapiapp.com/image9_3b6346806d.png)

2. **Enterprise knowledge bases**: Organizations often maintain extensive repositories of documents, manuals, and communications. Hybrid search enables employees to retrieve pertinent information efficiently and increase productivity.
3. **Streaming services**: Platforms such as Netflix utilize hybrid search to help users find content, whether they search by specific titles or describe themes.
4. **Marketplaces**: Hybrid search in e-commerce can improve search accuracy, handle complex queries, and increase product discovery, leading to increased sales. 

Now let’s see how you can seamlessly introduce hybrid search systems in your project or workflow with [Meilisearch](https://cloud.meilisearch.com/login?ref=navbar).

## How can you implement hybrid search?

Implementing a hybrid search requires a vector store solution. Several languages and AI frameworks can be used for implementation, but Python with Langchain is often a good stack to start building efficiently.

The AI-enhanced hybrid search from [Meilisearch](https://www.meilisearch.com/blog/introducing-hybrid-search) allows third-party embedding models and control over the semantic weight of the outputs, allowing a deeper semantic understanding of the user inputs.

To start using Meilisearch's hybrid search features, you must create an account and gain access to the API keys and [cloud platform](https://www.meilisearch.com/cloud). You can register for free and enjoy a 14-day trial.

![image6.png](https://unable-actionable-car.media.strapiapp.com/image6_9891a63d13.png)

After registering, you can create a new project and use the vector store to add and index documents, run queries, monitor analytics, and more.

In the settings tab, you'll find an option called Embedders, where you can enhance your hybrid search capabilities by integrating any embedding model of your choice. Below is an example of the OpenAI embedding model added to the list of embedders.

![image8.png](https://unable-actionable-car.media.strapiapp.com/image8_78aeaabd0b.png)

After adding a model, you can jump to the search preview tab and control the semantic weight directly there — you’re using hybrid search!

![image1.png](https://unable-actionable-car.media.strapiapp.com/image1_a6dc1af35b.png)

To integrate the search engine into your workflow, use Meilisearch’s API, available on the main page of the cloud dashboard. Here’s a Python script to query and retrieve results:

```json
import meilisearch


client = meilisearch.Client(
 '<meilisearch_server_url>',
 '<master_token>')
query = "Give me a book about a post-apocalyptic world"
results = client.index('books').search(query, opt_params={
 'hybrid': {
 'semanticRatio': 0.7,
 'embedder': 'openai'
 },
 'limit':4
})


for result in results['hits']:
 print(result['metadata']['text'])
```
To be able to run the code without issues, you first need to have the Meilisearch package installed:

```json
pip install meilisearch
```
Next, you need an index — a collection of documents you've added to Meilisearch Cloud ( 'books' in this example). Additionally, you’ll need an embedding model.

The results of the Python script are the following:

```json
{"id": 15, "title": "The Road", "description": "A father and his young son journey through post-apocalyptic America, fighting for survival while holding onto their humanity.", "genre": "Post-Apocalyptic"}
{"id": 6, "title": "1984", "description": "A dystopian social science fiction novel that follows Winston Smith and his rebellion against the totalitarian government that controls their society.", "genre": "Dystopian Fiction"}
{"id": 18, "title": "The Handmaid's Tale", "description": "In a dystopian future, a woman is forced to live as a concubine under a fundamentalist theocratic dictatorship.", "genre": "Dystopian Fiction"}
{"id": 19, "title": "Snow Crash", "description": "A pizza delivery driver and hacker investigates a dangerous computer virus that can affect human minds in both virtual and real worlds.", "genre": "Cyberpunk"}

```
Start building today by effortlessly uploading your documents to [Meilisearch Cloud](https://www.meilisearch.com/cloud). Seamlessly integrate the hybrid search capabilities into your infrastructure using [Python](https://www.meilisearch.com/docs/reference/api/search#example-22) and other supported languages, ensuring scalability and fast results.

## How does hybrid search compare to other search types?

Hybrid search combines two key approaches: semantic search and keyword search. However, semantic search is a broader term for methods that retrieve contextual or semantic meaning, including vector search and neural search. Let's explore the differences between all these search types:

| **Hybrid search** | **Vector search** | **Semantic search** | **Keyword search** | **Neural search** |
| --- | --- | --- | --- | --- |
| Combines dense and sparse vector representations to enhance search accuracy and contextual relevance. | Uses dense vector embeddings and algorithms like ANN to retrieve semantically relevant results. | A broader term for search technologies that use dense vectors to obtain contextual or semantic outputs. | Uses technologies like BM25 and SPLADE to create sparsed vectors that are used for accurate lexical matching. | This technology uses Deep Neural Networks (DNNs) for making dense vectors and supports different data types. |

Now, let's examine how hybrid search differs from each of the other search methods individually.

### What is the difference between hybrid search and vector search?

Hybrid search enhances vector search by incorporating keyword matching for improved accuracy. As a form of semantic search, vector search relies on an embedder to generate dense vectors and retrieval algorithms like ANN and KNN to identify relevant results. By merging these with sparse vector outputs, hybrid search optimizes retrieval using techniques such as RFF.

### What is the difference between semantic search and hybrid search?

Hybrid search is a combination of semantic and keyword searches. The quality of the hybrid search system response highly depends on the embedder used for the semantic search. The better the embedder and the retrieval algorithm applied on the dense vectors, the better the semantical or contextual response of the hybrid search. In addition, the hybrid search uses keyword matching for lexical accuracy.

### What is the difference between keyword search and hybrid search?

Hybrid search utilizes keyword search to deliver precise lexical results. Keyword search relies on algorithms like BM25 or SPLADE to generate sparse vectors from queries and documents, enabling fast and accurate retrieval. However, it lacks semantic understanding, so hybrid search integrates semantic search technologies to enhance search relevance and context.

### What is the difference between hybrid search and neural search?

Neural search, a type of semantic search, can be integrated into a hybrid search system. It leverages deep neural networks (DNNs) to deliver highly contextual results and supports various data input types. In a hybrid setup, neural search enhances typo tolerance while maintaining accuracy through lexical matching when users enter precise terms.

## Hybrid search gives you the best of both worlds

Hybrid search delivers exceptional accuracy and contextual relevance, but implementing it can be complex. It involves selecting the right vector database, choosing optimal embedding models, and fine-tuning outputs from both dense and sparse vectors.

[Meilisearch](https://www.meilisearch.com/cloud) simplifies this process by providing an intuitive platform backed by insightful tutorials. On this platform, you can effortlessly upload datasets, experiment with embeddings, fine-tune semantic relevance, and access advanced metrics like analytics and monetization.

Hybrid Search 101: how it works and why It's important

Neural search is redefining the future of information retrieval, pushing beyond traditional keyword and vector search approaches. While vector search applies machine learning (ML) to map semantic relationships between user queries and data embeddings, neural search leverages deep neural networks (DNNs) to optimize the entire search pipeline, from indexing and semantic analysis to ranking mechanisms.

This advancement enables neural search systems to continuously learn and refine results, outperforming conventional search methods in accuracy and adaptability. More importantly, they support multimodal data retrieval, allowing seamless search across text, images, audio, and even complex 3D datasets, critical for AI-driven applications and next-gen user experiences.

However, adoption comes with challenges. Neural search models often function as ‘black boxes,’ raising concerns about interpretability, and their high computational requirements can drive up infrastructure costs.

This guide explains the fundamentals of neural search, how it differs from existing search systems, and its strategic advantages. It also explores practical applications and potential trade-offs, helping you assess whether neural search aligns with your company’s AI roadmap.

## What is neural search?

Neural search, or neural information retrieval, leverages DNNs to interpret the contextual meaning behind search queries, enabling more accurate results than traditional keyword-matching systems and vector search. Instead of relying on exact terms, it transforms the user’s input and data into dense vector embeddings—numerical representations that capture semantic relationships. This process is similar to vector search systems, but instead of using ML models like approximate nearest neighbor (ANN) and a ranking algorithm, the neural search relies entirely on DNNs for the complete process.

A practical example involves querying a film database. A search like ‘Recommend a drama exploring modern parenting challenges’ would return a ranked list of movies aligned with the query’s intent, prioritizing contextual relevance over isolated keywords. The ranking is refined by the DNN itself, which needs to understand concepts like family dynamics and contemporary parenting struggles.

Here’s an example from Meilisearch: 

![image1.png](https://unable-actionable-car.media.strapiapp.com/image1_4431fc4739.png)

You can also try this for yourself by [checking out our demo](https://wheretowatch.meilisearch.com/). 

A commonly misunderstood term is often confused with neural search. In the next chapter, we’ll look into the key distinctions between neural search and neural architecture search (NAS).

## How does neural search differ from neural architecture search?

Neural search and NAS are often confused but serve different purposes. Neural search enhances information retrieval by understanding semantic meaning, while NAS focuses on automating the design of neural network architecture to optimize model performance for specific tasks.

NAS leverages techniques like recurrent neural networks and reinforcement learning (RL) to generate new language models, visual models, and overall neural architecture, eliminating manual experimentation and accelerating model development. In contrast, neural search applies deep learning to improve search relevance across text, images, sound, and other structured data types, transforming how systems retrieve and rank results.

Despite their differences, these technologies can intersect. For instance, you could use NAS to create a highly specialized artificial neural network tailored to your neural search. Let’s get a deeper understanding of how the latter works in the next chapter.

## How does neural search work?

Neural search enhances the search experience with DNNs using two main mechanisms: indexing and embedding. These are integrated in the following steps:

- **Data encoding and indexing**: The DNN analyzes documents (e.g., movie descriptions) to generate vector embeddings. These dense numerical representations capture semantic contexts, such as themes, relationships, and emotions, and are properly indexed in a vector database.
- **Query Encoding**: The user’s input (e.g., ‘Recommend a drama about modern parenting’) is converted into an embedding using the same DNN. This ensures the query and data share a unified semantic framework.
- **Semantic matching & ranking**: Unlike vector search systems that rely on external algorithms (ANN, cosine similarity) the DNN directly compares query and document embeddings. It evaluates learned relationships (e.g., linking ‘parenting challenges’ to films about complex family dynamics) to rank results by contextual alignment.

Neural searches can process various data inputs, depending on their types and activation functions, including text, images, audio, and 3D information. The embedding model adapts based on the input type. For instance, a convolutional neural network (CNN) is used for images, while large language models like BERT, are employed for text.

## What are some examples of neural search use?

Neural search can be applied to a wide range of use cases that require the processing of different types of data inputs and constant learning and optimization. Here are two simple examples of its potential applications:

1. **Optimize ranking results**: Jina AI offers a superior ranking solution based on neural search. It takes the initial outputs from a search query and reevaluates them to ensure they align more closely with the user's intent. [Jina’s AI Reranker](https://jina.ai/reranker) natural language processing model is available as open-source and can be accessed through Jina’s API.
2. **Search tools with images**: The German company [PROFISHOP](https://www.profishop.de/) uses a search engine powered by CNNs, allowing users to submit an image as input and fetch related content from a large industrial, durable, and consumer goods database.
3. **Retrieve ML models**: [Hugging Face](https://huggingface.co/chat/) has a large repository of models, including image-to-image, image-to-text, text-to-text, and more. Finding the appropriate model was initially challenging. However, the platform has since implemented a [hybrid search system](https://www.meilisearch.com/blog/hugging-face-democratizes-ai) that combines keyword matching with contextual understanding to enhance model discovery.
48. **Improve e-commerce**: [Google Shopping](https://shopping.google.com/) has integrated artificial intelligence (AI) to enhance its search capabilities, providing users with more relevant and personalized product recommendations. In addition, Google uses generative AI to summarize key factors during the search.

The neural search's ability to integrate RL for constant learning, accept different data types, and allow GenAI integration makes this technology extremely versatile and applicable to countless applications while ensuring accurate, personalized, and evolving results.

## What are the benefits of neural search?

Neural search systems offer several key benefits. Let’s take a look at some of them:

- **Increased engagement & reduced bounce rates**: Users expect almost real-time, precise, and relevant search results. When they don’t find what they need, [bounce rates surge](https://www.allaboutai.com/ai-seo/average-bounce-rate-guide/), and potential customers may never return. An optimal bounce rate is usually below 50%.
- **Enhanced productivity & efficiency**: Instead of manually searching through vast documentation or using inefficient keyword searches, neural search enables employees to find exact information instantly.
- **Multimodal search capabilities**: Neural search processes various data formats, including text, images, and audio. This versatility allows new use cases, particularly in e-commerce. According to [Think With Google](https://www.thinkwithgoogle.com/marketing-strategies/search/online-shopping-image-statistics/), 50% of online shoppers say images directly influence purchasing decisions.
- **Revenue growth**: Search is an important yet undervalued feature in e-commerce. [Bloomreach](https://www.bloomreach.com/) reports that while only 15% of B2C customers use site search, this small group drives 45% of online revenue.
- **Personalization & continuous learning**: Neural search systems can adapt by learning from user interactions and refining results based on behavior, clicks, and historical preferences. This dynamic personalization enhances user experience, improves retention, and drives long-term customer loyalty.

While the applications and benefits seem tempting, this is still a new field, so there is plenty of room for optimization. In the next section, we’ll explore some of this technology's challenges and limitations.

## What are the drawbacks of neural search?

The key drawbacks of neural search are listed below:

- **High computational cost and complexity**: DNNs require substantial computational resources for training and operation. This led to the development of GPUs with enhanced parallel processing power, which can be expensive. For instance, the newest model from NVIDIA (which has a [90% share](https://www.ft.com/content/03f66c13-3531-4ff2-b348-f17dac588c93) of the GPU market) is currently priced at [$2,529](https://www.tomshardware.com/news/lowest-gpu-prices).
- **Data dependency**: Neural search systems use high-quality, labeled training data to function properly. Without it, the system risks producing biased or skewed results. Designing the required metrics for the system before data ingestion is key to delivering better search functionality.
- **Lack of interpretability**: DNNs often function as 'black boxes,' learning complex patterns that can be difficult to understand. Due to this lack of transparency, debugging unexpected or odd results is challenging. This is why logs and [monitoring tools](https://www.meilisearch.com/blog/monitoring-metrics-release) are important once the search system is deployed. 
- **Model maintenance and engineering**: To stay effective, DNNs require frequent retraining to adapt to language and user behavior changes, increasing operational overhead. Additionally, the infrastructure and expertise required to maintain neural systems can be too expensive for smaller organizations. AI engineers are among the most in-demand jobs according to [LinkedIn’s 2025 report](https://www.linkedin.com/pulse/linkedin-jobs-rise-2025-25-fastest-growing-us-linkedin-news-gryie/) with an average annual salary of [$120,000 globally](https://artsmart.ai/blog/how-much-do-ai-engineers-make/), which is 30% higher than other engineering roles.

While technological advances are gradually reducing the computational demands of these models, these challenges must still be carefully considered when deciding whether to implement a neural search system.

## How does neural search compare to other types of search?

Neural search is a form of semantic search, similar to vector search, but it uses DNNs to handle indexing, encoding, and ranking. Other search types include keyword search and hybrid search. Here’s how they differ:

| **Neural search** | **Vector search** | **Keyword search** | **Hybrid search** |
| --- | --- | --- | --- |
| Leverages DNNs to embed and get the most relevant results based on semantic relationships. | Uses ML algorithms such as ANN to find semantic relationships. | Outputs content based on the keywords used in the query and doesn’t understand the context. | Combines both keyword search and neural search. |

### Neural search vs. vector search

Both [vector search](https://www.meilisearch.com/solutions/vector-search) and neural search retrieve data by matching query vectors to embeddings, making them forms of semantic search. Although neural search might be interpreted as a type of vector search, the latter typically refers to a method that leverages ML models like ANN for contextual retrieval and uses cosine similarity for ranking. In contrast, neural search bypasses these steps, relying entirely on DNNs throughout the search process.

### Neural search vs. keyword search

Keyword search relies solely on matching literal terms in search queries to those in a dataset, ignoring context or meaning. For example, a keyword search for 'best smartphone' won’t return results mentioning 'top mobile devices' unless those exact words are present, whereas neural search recognizes their semantic equivalence.

### Neural search vs. hybrid search

[Hybrid search](https://www.meilisearch.com/solutions/hybrid-search) combines the contextual intelligence of DNNs with the speed and simplicity of keyword matching, optimizing for precision and efficiency. It uses keyword search to rapidly filter exact term matches while leveraging neural techniques for semantic understanding, ensuring relevance even when queries or data require deeper interpretation. [Meilisearch](https://www.meilisearch.com/) gives you control over your hybrid search engine, enabling you to adjust the semantic context as needed.

## What is the future of neural search?

The fast evolution of AI, specifically in DNNs and NAS, will bring tremendous advances to neural search and its use-case scenarios. NAS, which automates the design of DNN architecture, enables the creation of highly specialized models that optimize accuracy, speed, and resource efficiency for specific tasks. These new and more powerful models have transformative applications in different industries:

- **Reshaping e-commerce**: Neural search engines can retrieve the most relevant products based on the context provided by the customer’s query. Already, giants like Google are using this technology to enhance searches — [Google Shopping](https://www.voguebusiness.com/story/technology/google-shakes-up-shopping-with-generative-ai) now includes an AI-generated brief containing what it thinks are the top three choices and why. The AI brief also includes tips on what to look for when shopping for a particular product, which is sourced from the web and summarized by AI. 
- **Education & skill development**: Learning platforms can use neural search to deliver materials tailored to an individual’s progress, learning style, and career goals. Imagine an AI tutor that dynamically assembles courses from videos, papers, and exercises. [Three in five](https://www.aiprm.com/ai-in-education-statistics/) (60%) teachers claim to have integrated AI into their teaching habits.
- **Healthcare transformation**: Neural search engines can potentially analyze patient histories, symptoms, and genomic data to identify personalized treatment options or clinical trials. This could significantly reduce the time patients wait for an accurate diagnosis and treatment. [Deep6 AI](https://deep6.ai/) is an example of this, as it uses neural search techniques to sift through massive amounts of data to match patients to clinical trials. 

Another emerging technology is Generative AI, which can go hand-in-hand with neural searches and be applied in different formats (text, image, sound, video):

- **Design & creativity**: Architects, for example, could use search engines by providing sketches and verbal descriptions (e.g., 'sustainable office building with natural light'), prompting the system to generate 3D models that integrate principles from existing designs and environmental data.
- **Dynamic content creation**: Media platforms could leverage generative AI to auto-generate videos, articles, or music playlists by retrieving and delivering content aligned with the user’s preferences, location, or mood.

These technologies will enhance information retrieval and actively influence human decision-making, creativity, and problem-solving as they evolve.

## Unlock next-generation neural search with Meilisearch

Neural search systems are state-of-the-art in delivering contextual results, but they may not be the ideal choice for every situation. This is why a hybrid search system can be handy, especially when it offers control over the semantic ratio and ranking outcomes. 



Neural search: Definition, how it works, benefits and more

_This blog post was originally published on kero's [personal blog](https://blog.kerollmops.com/meilisearch-indexes-embeddings-7x-faster-with-binary-quantization)._

<Callout intent="note">
This is one blog post in a series:
- [Spotify-Inspired: Elevating Meilisearch with Hybrid Search and Rust](https://blog.kerollmops.com/spotify-inspired-elevating-meilisearch-with-hybrid-search-and-rust)
- [Multithreading and Memory-Mapping: Refining ANN Performance with Arroy](https://blog.kerollmops.com/multithreading-and-memory-mapping-refining-ann-performance-with-arroy-in-rust)
- [Meilisearch Expands Search Power with Arroy's Filtered Disk ANN](https://blog.kerollmops.com/meilisearch-expands-search-power-with-arroy-s-filtered-disk-ann)
- [How Meilisearch Updates a Millions Vector Embeddings Database in Under a Minute](https://blog.kerollmops.com/how-meilisearch-updates-a-millions-vector-embeddings-database-in-under-a-minute)
- Meilisearch Indexes Embeddings 7x Faster with Binary Quantization.
</Callout>

For the past year at Meilisearch, [we’ve been working hard on hybrid search](https://github.com/meilisearch/meilisearch/issues/3838), which mixes keyword search with semantic search using [Arroy: our vector store, based on a Spotify technology](https://blog.kerollmops.com/spotify-inspired-elevating-meilisearch-with-hybrid-search-and-rust). A vector store is a data structure that efficiently stores embeddings (vectors) for fast and relevant retrieval, called Approximate Nearest Neighbors (ANN) search.

When our customers started to use arroy heavily, some of them started reaching the machine limits. For example, for a customer with a 768 dimensions model, we found out that we couldn’t index more than 15M of embeddings on a machine with 64GiB of RAM.

### Binary Quantization to the Rescue

The concept behind this elaborate term is that we are going to *quantize* the embeddings. Quantizing a number involves spreading it into a defined number of values; for *binary* quantization, two values can be represented on a single bit, e.g., 0.2561 becomes 1, and -0.568 becomes -1.

This implies that we could convert a 32-bit float number into a 1-bit number, which would divide the disk and RAM usage by 32. That would mean we could index up to 480M embeddings with 64GiB of RAM, instead of being limited to 15M embeddings.

An issue we faced is that bits cannot represent -1 and 1 but only 0 and 1. We had to use some tricks to make it work and fake 0s into -1s in our computations. For example, one of the functions that we had to optimize a lot was the function in charge of converting a binary quantized vector to 32-bit float vectors.

We do not publicly expose raw quantized embeddings and utilize this function to provide real 32-bit float embeddings to the users. However, the primary reason for converting 1-bit quantized embeddings to 32-bit floats is to ensure high precision when [generating hyperplanes to group embeddings together](https://blog.kerollmops.com/spotify-inspired-elevating-meilisearch-with-hybrid-search-and-rust#spotify-s-hyperplane-trees-for-efficient-anns) and maintaining relevant ANNs.

![Profiling backtrace showing slow 1-bit to 32-bit float conversion](https://unable-actionable-car.media.strapiapp.com/68747470733a2f2f692e696d6775722e636f6d2f497165713649562e706e67_596adc5fd5.png)

_Converting a quantized embedding back to 32-bit floating points takes up to 24.21s on a 1m53s run._

Below is the SIMD neon-specific version of this function. It processes raw bytes corresponding to a 1-bit quantized embedding, converting them into a properly aligned 32-bit float embedding. Using masks, the function separates the low and high bits, processing them in batches of four in 128-bit registers, which are then transformed into four 32-bit floats. These values are collectively written to the output vector.

```rust
unsafe fn to_vec_neon(bytes: &[u8]) -> Vec<f32> {
 let mut output: Vec<f32> = vec![0.0; bytes.len() / u32::BITS];
 let output_ptr = output.as_mut_ptr();
 let low_mask = [0b_0000_0001, 0b_0000_0010, 0b_0000_0100, 0b_0000_1000];
 let high_mask = [0b_0001_0000, 0b_0010_0000, 0b_0100_0000, 0b_1000_0000];
 let ones = unsafe { vld1q_dup_f32(&1.0) };
 let minus = unsafe { vld1q_dup_f32(&-1.0) };

 for (current_byte, base) in bytes.iter().enumerate() {
 unsafe {
 let base = *base as u32;
 let base = vld1q_dup_u32(&base);
 for (i, mask) in [low_mask, high_mask].iter().enumerate() {
 let mask = vld1q_u32(mask.as_ptr());
 let mask = vandq_u32(base, mask);
 // 0xffffffff if equal to zero and 0x00000000 otherwise
 let mask = vceqzq_u32(mask);
 let lane = vbslq_f32(mask, minus, ones);
 let offset = output_ptr.add(current_byte * 8 + i * 4);
 vst1q_f32(offset, lane);
 }
 }
 }

 output
}
```

_<a href="https://x.com/lemire/status/1835700368648323261">Daniel Lemire doesn't seem to have found a better algorithm</a>_ 🤭

### The Results

We chatted about the theoretical benefits of this approach earlier, but how does it work out in real life? Here are different tables summarizing the results for you.

<details>
 <summary>Open to see the original benchmarks</summary>
 <img src="https://unable-actionable-car.media.strapiapp.com/68747470733a2f2f692e696d6775722e636f6d2f67667765626b592e706e67_a96a995c7c.png" alt="Original arroy benchmark results"/>
</details>

#### Embeddings with 1024 Dimensions

When examining small embeddings, we can observe a significant impact on relevancy due to binary quantization. The primary advantages of this approach lie in faster insertion times and reduced storage requirements. It is not advisable to enable this feature for small embeddings, as they already occupy minimal disk space. Storing over four million 1024-dimensional embeddings requires just 8 GiB of disk space.

| Version | Recall @1 | Recall @20 | Recall @100 | Indexing time | Search time | On disk size |
|-------------------------|-----------|------------|-------------|---------------|-------------|--------------|
| Cosine | **1.00** | **0.72** | **0.84** | 491s | **23s** | 8 GiB |
| Binary Quantized Cosine | 0.87 | 0.50 | 0.52 | **147s** | 27s | **850 MiB** |

#### Embeddings with 1536 Dimensions

Binary quantization proves advantageous for managing larger embeddings. It significantly reduces search times, utilizing just 15% of the original disk space. Indexing about 500,000 1536-dimensional embeddings is achieved in a quarter of the time. Despite this, there remains a noticeable impact on relevancy...

| Version | Recall @1 | Recall @20 | Recall @100 | Indexing time | Search time | On disk size |
|-------------------------|-----------|------------|-------------|---------------|-------------|--------------|
| Cosine | **1.00** | **0.82** | **0.90** | 1219s | 50s | 13 GiB |
| Binary Quantized Cosine | **1.00** | 0.70 | 0.70 | **235s** | **47s** | **2 GiB** |

#### Embeddings with 3072 Dimensions

The impact of binary quantization on large embeddings is evident. While relevance may be slightly affected, the reduction in disk usage, search time, and indexing time is significant. Being able to store the same number of embeddings with just 15% of the space and index 6 times faster is a major achievement! It takes half as much disk space to store a million 3072-dimensional binary quantized embeddings than four million 1024-dimensional embeddings.

| Version | Recall @1 | Recall @20 | Recall @100 | Indexing time | Search time | On disk size |
|-------------------------|-----------|------------|-------------|---------------|-------------|--------------|
| Cosine | **1.00** | **0.86** | **0.92** | 4000s | 150s | 26 GiB |
| Binary Quantized Cosine | **1.00** | 0.77 | 0.77 | **560s** | **100s** | **4 GiB** |

### Conclusion

The impact of binary quantization on recall was expected to decrease, given the reduced information in the algorithm. However, for datasets with over 1500 dimensions, the impact on recall is relatively minor compared to the significant benefits in disk space and indexing speed.

In practice, we observed that space utilization decreased not by 32 times but by just 15% of the original space, a notable achievement. This is primarily due to arroy storing not only user vectors but also internal nodes for efficient searching. Split nodes (hyperplanes) are retained as full 32-bit floats to maintain precision.

- Indexing speed improves nearly 5 times with 1536 dimensions and about 7 times with 3072 dimensions.
- Disk size shrinks to around 6.5 times smaller.
- Search time shows slight improvements for embeddings starting at 1536 dimensions.

We recommend using Meilisearch/arroy's binary quantization feature for OpenAI users with large embeddings. In an upcoming article, we will compare Meilisearch/arroy with competitors, focusing on our Filtered DiskANN feature. Stay tuned!

Meilisearch indexes embeddings 7x faster with binary quantization

Meilisearch is too slow

## 🚀 Meilisearch 1.13

[![Meilisearch 1.13 release notes](https://unable-actionable-car.media.strapiapp.com/meilisearch_1_13_0d45bdb6ba.jpg)](https://www.meilisearch.com/blog/meilisearch-1-13)

Meilisearch 1.13 stabilizes AI-powered search, lays the groundwork for sharding and enables dumpless upgrades.

[Learn more](https://www.meilisearch.com/blog/meilisearch-1-13)

## ⚡ Next generation indexer

[![Introducing Meilisearch's next-generation indexer: 4x faster updates, 30% less storage](https://unable-actionable-car.media.strapiapp.com/indexer_edition_2024_541fd4389a.png)](https://www.meilisearch.com/blog/introducing-indexer-2024)

Learn how we improved the search performance of Meilisearch with parallel processing, optimized RAM usage, and enhanced observability.

[Learn more](https://www.meilisearch.com/blog/introducing-indexer-2024)

## 📰 In the news

### 🔌 Introducing Meilisearch MCP server

Making AI assistants integration using the Model Context Protocol.

[Read the blog](https://www.meilisearch.com/blog/introducing-mcp-server)

### 🔍 Symfony's search solution for 12 million words of documentation

Learn more about how Symfony uses Meilisearch to power its docs search.

[Read the case study](https://www.meilisearch.com/blog/symfonys-solution-for-documentation-search)

### 🧩 Implement sharding with remote federated search

Learn about our experimental approach to scaling Meilisearch horizontally.

[Read the docs](https://www.meilisearch.com/docs/learn/multi_search/implement_sharding)

### 🚀 What is latent semantic indexing?

Learn about the relevance of LSI in today's AI-driven search landscape.

[Read the blog](https://www.meilisearch.com/blog/latent-semantic-indexing)

### 📚 Choosing an embedder

How to choose the embedder best suited for your project.

[Read the guide](https://www.meilisearch.com/docs/learn/ai_powered_search/choose_an_embedder)

## 🤗 Made with Meilisearch

[Where To Watch](https://where2watch.meilisearch.com/?utm_campaign=blog&utm_medium=february-25-updates) is an open-source Meilisearch demo using hybrid search to find platforms to stream movies. It features movies recommendation based on the similar documents API.

![Searching for Epic Fantasy on WhereToWatch](https://unable-actionable-car.media.strapiapp.com/epic_fantasy_search_9813d60432.gif)

_We’re always looking to promote new projects from the community. Post yours in the [#built-with-meilisearch](https://dub.sh/meili-discord?utm_campaign=newsletter&utm_source=blog&utm_medium=february-25-updates) Discord channel!_

---

Stay in the loop of everything Meilisearch by subscribing to our [monthly newsletter](https://dub.sh/meili-newsletter?utm_campaign=newsletter&utm_source=blog&utm_medium=february-25-updates). To learn more about Meilisearch's future and help shape it, take a look at our [roadmap](https://roadmap.meilisearch.com/?utm_campaign=newsletter&utm_source=blog&utm_medium=february-25-updates) and participate in our [Product Discussions](https://github.com/orgs/meilisearch/discussions).

For anything else, join our developers community on [Discord](https://dub.sh/meili-discord?utm_campaign=newsletter&utm_source=blog&utm_medium=february-25-updates).

Meilisearch latest news and company updates