Add hf-xet to requirements #2292
Open
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
add the hf_xet package to avoid the warning when downloading models from HuggingFace.
I checked the repo and would need some opinion of developers where to put the fix: there are 2 places:
requirements.txt contains the base dependencies that are always installed olive/olive_config.json contains extra_dependencies for optional features that users can install as needed (like pip install olive-ai[gpu], pip install olive-ai[lora], etc.) Since the warning occurs during the getting started example (a basic use case), and hf_xet improves download performance from HuggingFace for models with Xet Storage, it makes sense to add it as a base dependency in requirements.txt.
Proposed change:
Add hf_xet to the requirements.txt
Describe your changes
changes do not require unit test or doc update nor is it user-facing (there is no change, just avoiding a current warning
Checklist before requesting a review
lintrunner -a(Optional) Issue link
fix for #2288