We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
CUDA Version: 12.0 , with A10 GPU CentOS: 7.9
I run the text-embedding-inference program by the following script
volume=/data/pretrain_model model=/data/pretrain_model/bge-small-zh-v1.5 revision=refs/pr/5 docker run -d --restart=always --gpus all\ -p 8070:80 \ -v $volume:/data --pull always ghcr.io/huggingface/text-embeddings-inference:86-1.2 \ --model-id $model \ --tokenization-workers 2
and the docker has successfully run, however, when i try the following command for caculate embedding:
curl 127.0.0.1:8070/embed_sparse \ -X POST \ -d '{"inputs":"I like you."}' \ -H 'Content-Type: application/json'
the error ocurred: curl: (56) Recv failure: Connection reset by peer, how can i solve it?
docker logs
return the embedding
The text was updated successfully, but these errors were encountered:
You can refer to #207
Sorry, something went wrong.
No branches or pull requests
System Info
CUDA Version: 12.0 , with A10 GPU
CentOS: 7.9
Information
Tasks
Reproduction
I run the text-embedding-inference program by the following script
and the docker has successfully run, however, when i try the following command for caculate embedding:
the error ocurred:
![image](https://private-user-images.githubusercontent.com/43194221/316308672-c963ef77-d98e-4867-bbfc-7acdfec9d764.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjA1NzI3MTEsIm5iZiI6MTcyMDU3MjQxMSwicGF0aCI6Ii80MzE5NDIyMS8zMTYzMDg2NzItYzk2M2VmNzctZDk4ZS00ODY3LWJiZmMtN2FjZGZlYzlkNzY0LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MTAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzEwVDAwNDY1MVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTgzMTY2MmUxYmYwZGM0MmI3ZmE1OWQ3N2Q0NGY3NGQ1ODA3ODllYThkMTEwZTRhMzNhNzA3NjIyY2I1NGI2MWEmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.UsUTSp3a6cgjkIlZjw3I9d_p0kwACrmRQHgi3zLAI-Q)
curl: (56) Recv failure: Connection reset by peer, how can i solve it?
docker logs
![image](https://private-user-images.githubusercontent.com/43194221/316567890-808683b7-ea5b-45ab-b142-3096aafd66c3.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjA1NzI3MTEsIm5iZiI6MTcyMDU3MjQxMSwicGF0aCI6Ii80MzE5NDIyMS8zMTY1Njc4OTAtODA4NjgzYjctZWE1Yi00NWFiLWIxNDItMzA5NmFhZmQ2NmMzLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MTAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzEwVDAwNDY1MVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWFlMGFjMDYzNzZiOWRkZjA3NDdlNTI2Mzc1ZjI0NWNkZTE3OGY5Y2QxYjIyNWVjMTIwNWY0NTFiZDgzYmU0MzkmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.wNKMyRQP3VH5Sd_PfSDnCFfDLOumLEI7hcKo3jjUlIU)
Expected behavior
return the embedding
The text was updated successfully, but these errors were encountered: