New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Can phidata integrate vLLM model? #1626

Open

364378743 opened this issue Dec 23, 2024 · 1 comment

364378743 commented Dec 23, 2024

VLLM is also the openai specification interface, and my test case for phidata is a toolkit that does not call phidata.

Contributor

manthanguptaa commented Dec 25, 2024

Hey @364378743, we currently don't support vLLM but I will take that as a feature request!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment