v0.15.1
Fixed 1
- Fix handling of modules_to_save when used in conjunction with DeepSpeed ZeRO stage 3 to prevent those modules from being placeholder values in saved checkpoints
This patch includes a fix for #2450. In this bug modules_to_save was not handled correctly when used in conjunction with DeepSpeed ZeRO stage 3 which resulted in those modules being placeholder values in the saved checkpoints.
Full Changelog: https://github.com/huggingface/peft/compare/v0.15.0...v0.15.1