Skip to content

[docs] Optimize and scale pt. 2 - #14909

Open
stevhliu wants to merge 3 commits into
huggingface:mainfrom
stevhliu:optimize-memory
Open

stevhliu wants to merge 3 commits into
huggingface:mainfrom
stevhliu:optimize-memory

Conversation

@stevhliu

Copy link
Copy Markdown
Member

Finishes updating the Optimize and scale section in #14867:

  • adds a table to "Reduce memory usage" to help users select a strategy based on their use case
  • fix the docs to match the code (default shard size is 10GB, skip_modules_pattern in the layerwise casting example, removed a loaded text encoder in Wan example that was never used, etc.)

@github-actions github-actions Bot added size/L PR with diff > 200 LOC documentation Improvements or additions to documentation and removed size/L PR with diff > 200 LOC labels Sep 29, 2026
@HuggingFaceDocBuilderDev

Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@sayakpaul

Copy link
Copy Markdown
Member

Will review after #14867 is merged to keep things manageable.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants