PEFT v0.17.1

v0.17.1

0.17.1

Changed 1
  • PEFT now raises an error when attempting to add multiple adapters to prevent incorrect behavior
Fixed 1
  • PEFT no longer removes existing parametrizations from the parameter when using the target_parameters feature

This patch release contains a few fixes (via #2710) for the newly introduced target_parameters feature, which allows LoRA to target nn.Parameters directly (useful for mixture of expert layers). Most notably:

  • PEFT no longer removes possibly existing parametrizations from the parameter.
  • Adding multiple adapters (via model.add_adapter or model.load_adapter) did not work correctly. Since a solution is not trivial, PEFT now raises an error to prevent this situation.
View original

Upgraded? How did it go?

Discussion