Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: Add support for async connection and operations for PostgreSQL as Cache Storage provider #463

Open
andre-meneses-fivestars opened this issue Jul 3, 2023 · 1 comment
Labels
planned It has been planned and will be implemented in the future

Comments

@andre-meneses-fivestars
Copy link

Is your feature request related to a problem? Please describe.

I already use a PostgreSQL database with an async connection in the project where I'm also using GPTCache and would like the connection to that DB for the GPT Cache Storage also to be async.

Describe the solution you'd like.

Cache Base would accept a connection string for PostgreSQL in the format postgresql+asyncpg://{DATABASE_URI} and those connections to the DB would be async.

Describe an alternate solution.

No response

Anything else? (Additional Context)

No response

@SimFG
Copy link
Collaborator

SimFG commented Jul 3, 2023

Thank you for submitting your proposal. We appreciate your suggestion, which is already part of our plan. However, based on our latest research findings, we have identified that the majority of the time consumption occurs during the model's runtime. Additionally, we must also consider the importance of the storage access time.

@SimFG SimFG added the planned It has been planned and will be implemented in the future label Jul 7, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
planned It has been planned and will be implemented in the future
Projects
None yet
Development

No branches or pull requests

2 participants