fix: avoid writable mmap for read-only weights#1698

Merged

leejet merged 1 commit into

fix/mmap-readonly-offload-weights

Jun 22, 2026

leejet commented Jun 22, 2026

Owner

Summary

Defer model file mmap setup until LoRA application mode determines whether writable mmap is required.
Propagate the writable mmap choice into ModelManager so CPU/offloaded read-only weights can use read-only file mappings instead of always using writable private mappings.

Related Issue / Discussion

Additional Information

N/A

Checklist

I have read and confirmed this PR follows the contribution guidelines.


          fix: avoid writable mmap for read-only weights

2666e2a

leejet merged commit f440ad9 into master

14 checks passed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet