New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Updates on existing evals; readmes; solvers #1483

Merged

JunShern merged 1 commit into openai:main from ojaffe:ollie/updates-20240313

Mar 13, 2024

Contributor

ojaffe commented Mar 13, 2024

Miscellaneous updates:

Updates existing evals with
- Better READMEs
- Previously missed reproducibility code
- Minor bugfixes / improvements
Improvements to solvers
- Update default solvers to use latest models
- Improved features and robustness for OAI solvers
- Features for applying postprocessors to solver outputs
- Fixed "completion_fn not found" warning from registry


          Updates on existing evals; readmes; solvers. Minor registry changes. …

b0e13df

…Missed commit for base prompt prefixes

ojaffe requested review from andrew-openai, etr2460 and katyhshi as code owners

March 13, 2024 09:45

JunShern self-requested a review

March 13, 2024 10:18

JunShern approved these changes

View reviewed changes

Collaborator

JunShern left a comment

Thanks @ojaffe ! Noting that these changes have all been tested in our private fork and are ready to go.

JunShern merged commit 11c30b2 into openai:main

2 checks passed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

JunShern JunShern approved these changes

andrew-openai Awaiting requested review from andrew-openai andrew-openai is a code owner

etr2460 Awaiting requested review from etr2460 etr2460 is a code owner

katyhshi Awaiting requested review from katyhshi katyhshi is a code owner

Labels

None yet