Polars 1.11.0

1.11.0

Python Polars 1.11.0

Added 4
  • AssumeRole support for AWS Credential Provider
  • Added escape_regex operation to the str namespace and as a global function
  • Expose group_by_dynamic in pyir
  • Add AlignedBytes types
Changed 6
  • Improve var/cov/corr performance
  • Reduce memcopy in parquet
  • Optimize array and list gather
  • Various Schema improvements for equality and init dtype checks
  • Improve read_database_uri typing
  • Improve error message for Zero-Field Structs with Parquet
Fixed 8
  • Allow .get(null) in groupby context
  • Fix include_file_paths and with_row_index for streaming CSV scan
  • Release GIL in gather_with_series() and friend
  • Raise on data mismatch in str.json_decode
  • Ensure Python version matches version used to serialize credential provider
  • Capture groups should be ignored in replace_all when literal=True
  • Ignore Parquet is_min_max_value_exact when set to true
  • Projection pushdown was ignored by include_file_paths
🚀 Performance improvements
  • Improve var/cov/corr performance (#19381)
  • Reduce memcopy in parquet (#19350)
  • Optimize array and list gather (#19327)
✨ Enhancements
  • Various Schema improvements (equality/init dtype checks) (#19379)
  • AssumeRole support for AWS Credential Provider (#19346)
  • Added escape_regex operation to the str namespace and as a global function (#19257)
  • Improve read_database_uri typing (#19334)
🐞 Bug fixes
  • Allow .get(null) in groupby context (#19401)
  • Fix include_file_paths and with_row_index for streaming CSV scan (#19394)
  • Flaky parametric parquet test (#19393)
  • Release GIL in gather_with_series() and friend (#19383)
  • Raise on data mismatch in str.json_decode (#19347)
  • Ensure Python version matches version used to serialize credential provider (#19375)
  • Capture groups should be ignored in replace_all when literal=True (#19366)
  • Ignore Parquet is_{min,max}_value_exact when set to true (#19344)
  • Projection pushdown was ignored by include_file_paths (#19341)
📖 Documentation
  • Spurious import in example (#19398)
  • Tiny correction post dask-expr (#19354)
📦 Build system
  • Revert PyO3 version back to 0.21 (#19376)
🛠️ Other improvements
  • Expose group_by_dynamic in pyir (#19385)
  • Add AlignedBytes types (#19308)
  • Remove unsued bytes->BytesIO conversion (#19369)
  • Improve error message for Zero-Field Structs with Parquet (#19370)
  • Reduce memcopy in parquet (#19350)

Thank you to all our contributors for making this release possible! @alexander-beedie, @barak1412, @benrutter, @coastalwhite, @corwinjoy, @itamarst, @max-muoto, @nameexhaustion, @orlp, @ritchie46, @stinodego, @wence- and @wolfgang-noichl

View original

Upgraded? How did it go?

Discussion