-
Notifications
You must be signed in to change notification settings - Fork 28
♻️ use defaults for all params for full_model marker #526
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
Signed-off-by: Prashant Gupta <[email protected]>
|
👋 Hi! Thank you for contributing to vLLM support on Spyre. Or this can be done with Now you are good to go 🚀 |
|
bot:test |
1 similar comment
|
bot:test |
|
@waleedqk I think we'd need to run the |
|
@joerunde I was using an active PR to test the build and test process |
|
bot:test |
3 similar comments
|
bot:test |
|
bot:test |
|
bot:test |
|
bot:test |
|
Converting to a draft because we want to reimagine this with the vdpp marker that we are thinking about right now |
|
bot:test |
|
bot:test |
Description
Use defaults for all params for full_model marker. This enables us to use
full_modelmarker which defaults to TP 4 and CB along with usingsendnnand the full modelRelated Issues