Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feature] Add gpt-4o-2024-08-06 with strict: true in response_format #579

Open
JasonZhu1313 opened this issue Aug 12, 2024 · 0 comments
Open
Labels
BFCL-General General BFCL Issue enhancement New feature or request

Comments

@JasonZhu1313
Copy link
Contributor

Is the feature request related to a problem?
No, OpenAI recently released new feature to support structured output with constrained decoding, would love to see the standing on the leaderboard compared to OS model, in blog it mentioned impressive capability on format following, now sure how this mode works semantically in function calling domain. https://openai.com/index/introducing-structured-outputs-in-the-api/

Describe the solution you'd like
Add this model to leaderboard https://openai.com/index/introducing-structured-outputs-in-the-api/

Additional context
Add any other context or screenshots about the feature request here.
https://openai.com/index/introducing-structured-outputs-in-the-api/

@JasonZhu1313 JasonZhu1313 added the enhancement New feature or request label Aug 12, 2024
@HuanzhiMao HuanzhiMao added the BFCL-General General BFCL Issue label Aug 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
BFCL-General General BFCL Issue enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants