You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
My database service is running in another docker container, I tried to create a separate GPTCache server, but couldn't find the documentation. Here is the code without the GPTCache server:
Could you please let me know how to move them in config.yaml to start a GPTCache server?
Anything else?
Here is a sample of config.yaml:
embedding:
onnx
embedding_config:
# Set embedding model params here
storage_config:
data_dir:
gptcache_data
manager:
postgresql,pgvector
vector_params:
# Set vector storage related params here
evaluation:
distance
evaluation_config:
# Set evaluation metric kws here
pre_function:
get_prompt
post_function:
first
config:
similarity_threshold: 0.8
# Set other config here
The text was updated successfully, but these errors were encountered:
echosun1996
changed the title
[DOCS]: Add support for remote databases in GPTCache server config yaml
[DOCS]: Add support for remote databases in GPTCache server config
Oct 15, 2023
You can add the scalar parmas under storage config:
embedding:
onnxembedding_config:
# Set embedding model params herestorage_config:
data_dir:
gptcache_datamanager:
postgresql,pgvectorvector_params:
# Set vector storage related params herescalar_params:
sql_url: <URL> table_name: <TABLE_NAME> evaluation:
distanceevaluation_config:
# Set evaluation metric kws herepre_function:
get_promptpost_function:
firstconfig:
similarity_threshold: 0.8# Set other config here
Documentation Link
https://github.com/zilliztech/GPTCache/blob/main/examples/README.md#How-to-use-GPTCache-server
Describe the problem
My database service is running in another docker container, I tried to create a separate GPTCache server, but couldn't find the documentation. Here is the code without the GPTCache server:
Could you please let me know how to move them in config.yaml to start a GPTCache server?
Anything else?
Here is a sample of config.yaml:
The text was updated successfully, but these errors were encountered: