Trouble Connecting to Local Server with LangChain Wrapper / Python Client

[hodgesz]

I just installed Qdrant with docker and can access the web console with no issues.

However, when I try to connect with the Python client with LangChain wrapper with the following code, I receive the following error.

doc_db = Qdrant.from_documents(
        docs_split,
        embeddings,
        url='http://localhost:6333',
        collection_name='userpiliot_knowledge_base',
        prefer_grpc=True
    )

File "/Users/hodgesz/PycharmProjects/ai/generative_ai/chatbot_old.py", line 64, in setup
    doc_db = Qdrant.from_documents(
             ^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Caskroom/miniforge/base/envs/langchain_dev/lib/python3.11/site-packages/langchain/vectorstores/base.py", line 332, in from_documents
    return cls.from_texts(texts, embedding, metadatas=metadatas, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Caskroom/miniforge/base/envs/langchain_dev/lib/python3.11/site-packages/langchain/vectorstores/qdrant.py", line 641, in from_texts
    client.recreate_collection(
  File "/opt/homebrew/Caskroom/miniforge/base/envs/langchain_dev/lib/python3.11/site-packages/qdrant_client/qdrant_client.py", line 1386, in recreate_collection
    return self._client.recreate_collection(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Caskroom/miniforge/base/envs/langchain_dev/lib/python3.11/site-packages/qdrant_client/qdrant_remote.py", line 1786, in recreate_collection
    self.delete_collection(collection_name, timeout=timeout)
  File "/opt/homebrew/Caskroom/miniforge/base/envs/langchain_dev/lib/python3.11/site-packages/qdrant_client/qdrant_remote.py", line 1674, in delete_collection
    return self.grpc_collections.Delete(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Caskroom/miniforge/base/envs/langchain_dev/lib/python3.11/site-packages/grpc/_channel.py", line 1030, in __call__
    return _end_unary_response_blocking(state, call, False, None)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Caskroom/miniforge/base/envs/langchain_dev/lib/python3.11/site-packages/grpc/_channel.py", line 910, in _end_unary_response_blocking
    raise _InactiveRpcError(state)  # pytype: disable=not-instantiable
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:6334: Failed to connect to remote host: Connection refused"
	debug_error_string = "UNKNOWN:failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:6334: Failed to connect to remote host: Connection refused {grpc_status:14, created_time:"2023-07-03T12:17:04.288939-06:00"}"
>

Seems odd it is trying to connect on port 6334 when 6333 is what was passed in 'url' parameter. Any ideas?

[timvisee]

Seems odd it is trying to connect on port 6334 when 6333 is what was passed in 'url' parameter. Any ideas?

Qdrant has a REST (HTTP) and gRPC server. The web console uses REST on 6333, the Python client uses gRPC on 6334 because prefer_grpc=True.

If running the Qdrant Docker image, are you sure port 6334 is exposed as well?

docker run -p 6333:6333 -p 6334:6334 \
    -v $(pwd)/qdrant_storage:/qdrant/storage \
    qdrant/qdrant

You could set prefer_grpc=False to only use the REST API but that is not recommended.

[hodgesz]

Appreciate the reply. Following the installation directions, I only exposed 6333, but following your guidance worked. Thanks!