From 0711073979f0c126bb9de688f64097b140a81282 Mon Sep 17 00:00:00 2001 From: FMXExpress Date: Fri, 7 Jul 2023 08:07:20 -0700 Subject: [PATCH] Update README.md --- README.md | 16 +++++++++++++++- 1 file changed, 15 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index 10f9532..0bb78a2 100644 --- a/README.md +++ b/README.md @@ -20,7 +20,21 @@ Built in functionality includes: Built with [Delphi](https://www.embarcadero.com/products/delphi/) using the FireMonkey framework this client works on Windows, macOS, and Linux (and maybe Android+iOS) with a single codebase and single UI. At the moment it is specifically set up for Windows. -It features a REST integration with OpenAI.com (ChatGPT) and Replicate.com for providing source code generation functionality within the client. You need to sign up for API keys to access that functionality. +It features a REST integration with OpenAI.com (ChatGPT) and Replicate.com for providing source code generation functionality within the client. You need to sign up for API keys to access that functionality. Replicate models can be run in the cloud or locally via docker. + +``` +docker run -d -p 5000:5000 --gpus=all r8.im/replicate/vicuna-13b@sha256:6282abe6a492de4145d7bb601023762212f9ddbbe78278bd6771c8b3b2f2a13b +curl http://localhost:5000/predictions -X POST -H "Content-Type: application/json" \ + -d '{"input": { + "prompt": "...", + "max_length": "...", + "temperature": "...", + "top_p": "...", + "repetition_penalty": "...", + "seed": "...", + "debug": "..." + }}' +``` # CodeDroidAI Desktop client Screenshot on Windows ![CodeDroidAI Desktop client on Windows](/screenshot.png)