[Question]: Do you have plan to support other vector databases?

[shaoyie]

Describe your problem

Noticed now the backend is coupling with ElasticSearch.
Do you have plan to support some other vector stores, such as Pinecone, Milvus, etc.?

[KevinHuSh]

Do these support hybrid search like weighted vector similarity and keyword similarity?
I don't think they do.

[jlcbj]

Milvus 2.4 support hybrid search

[KevinHuSh]

Milvus 2.4 support hybrid search

Can Milvus support text similarity calculation such as BM25 and TFIDF?

[jlcbj]

https://milvus.io/docs/embed-with-bm25.md

[Nuclear6]

I feel that the latest vector database is better than the currently used hybrid retrieval. Everyone has updated and iterated to the ANN algorithm, and the ragflow project is still using the KNN algorithm.

[nadirvishun]

I have tested the pgvector vector store of fastgpt and the weaviate vector store of dify, both using bce-embedding-base. The retrieval effects of both are better than the es vector store of ragflow, but I am not very sure if it is due to the vector store.

[taowang1993]

I have tested the pgvector vector store of fastgpt and the weaviate vector store of dify, both using bce-embedding-base. The retrieval effects of both are better than the es vector store of ragflow, but I am not very sure if it is due to the vector store.

how do you compare Dify vs Ragflow?

I am using Dify with Milvus to build a RAG application.

But I am not sure if ragflow is a better option than Dify.

seems like Dify is going to update to RAG2.0 at the end of this year.