Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Portkey Integration #3227

Open
wants to merge 251 commits into
base: main
Choose a base branch
from

Conversation

siddharthsambharia-portkey

Solve (#3226)
Closes (#3226)

Description

Adds Portkey as a model provider in Continue.dev, enabling LLM request routing, caching, and observability through Portkey's AI Gateway.

Added:

  • Portkey adapter with OpenAI-compatible API
  • Configuration for Portkey API key and Config ID
  • Documentation and UI integration
  • Support for custom headers and Portkey-specific features

Testing

  1. Get API key from app.portkey.ai
  2. Create config ID in Portkey dashboard
  3. Update Continue config:
{
  "models": [
    {
      "provider": "portkey",
      "model": "AUTODETECT",
      "apiKey": "YOUR_PORTKEY_API_KEY",
      "portkeyConfigId": "YOUR_PORTKEY_CONFIG_ID"
    }
  ]
}
  1. Verify requests work and appear in Portkey dashboard

Checklist

  • Provider implementation
  • Documentation updated
  • UI support added
  • Dependencies updated

obeone and others added 30 commits November 26, 2024 00:02
…omization examples

Updated the getDiff function calls in multiple documentation files to exclude unstaged changes by passing 'false'. Added comments to explain the parameter purpose. Introduced the AbortController signal in the streamComplete function to enhance handling of async operations. Changes apply to English and Chinese documentation.
…on to work simultaneously.

2.PendingCompletion may be cleared by the accept thread after renderCompletion is executed, causing the finalTextToInsert variable not to be written into pendingCompletion.
tomasz-stefaniak and others added 26 commits December 10, 2024 11:29
…model

* Adding Cohere's `rerank-v3.5` model to the list of acceptable options.
bugfix: remove unused `node_modules` in binary
…lable-attributes

Fix: Check for MCP Available Attributes
@siddharthsambharia-portkey
Copy link
Author

hey @sestinj can you merge this now?

@sestinj
Copy link
Contributor

sestinj commented Dec 11, 2024

@siddharthsambharia-portkey yeah I'm sorry I started to and totally broke the commit history. I will handle it from here, though I might end up just starting a fresh PR and copying over your changes to make it easier for myself

@siddharthsambharia-portkey
Copy link
Author

Yes that sounds good, let me know if I can be of any help!

@siddharthsambharia-portkey
Copy link
Author

hey @sestinj any updates on when you are planning to merge this? do you need any help?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.