v0.4.9
Release v0.4.9
Added
- Added a --version flag to the CLI
Changed
- Updated all browsers and fingerprints
- Mixing a session-level proxy with a per-request proxies argument now raises an error instead of one being silently dropped
Fixed
- Fixed the session-level proxy argument being silently ignored in HTTP sessions
- Fixed browser navigations failing when combining init_script with user_data_dir
- Fixed encoding detection when websites quote the charset value in the Content-Type header
- Fixed an IndexError in adaptive element relocation when auto_save is enabled
- Fixed spiders' checkpoint and cache saving crashing on Windows
- Fixed incorrect similarity scoring in find_similar for elements with mismatched attribute counts
A maintenance update packed with community-reported fixes 🛠️
🚀 New Stuff and quality of life changes
- Updated all browsers and fingerprints. Run
scrapling install --forceafter updating to refresh them. - Added a
--versionflag to the CLI by @ETM-Code in #303 (Solves #299)
🐛 Bug Fixes
- Fixed the session-level
proxyargument being silently ignored in HTTP sessions, which could leak your real IP (Solves #295). Note that mixing a session-levelproxywith a per-requestproxiesargument (or vice versa) now raises an error instead of one being silently dropped. - Fixed browser navigations failing when combining
init_scriptwithuser_data_dir(Solves #294). - Fixed encoding detection when websites quote the charset value in the
Content-Typeheader by @Bortlesboat in #323. - Fixed an
IndexErrorin adaptive element relocation whenauto_saveis enabled by @Mubashirrrr in #340. - Fixed spiders' checkpoint and cache saving crashing on Windows by @MrStarkEG in #344.
- Fixed incorrect similarity scoring in
find_similarfor elements with mismatched attribute counts (Solves #322).
Docs
- Clarified that the default installation includes the parser engine only, and the fetchers/spiders need the extras (Solves #343).
- Fixed the Docker image name in the remaining examples by @evanclan in #315.
- Fixed a broken link in the contribution guide by @Bortlesboat in #320.
🙏 Special thanks to the community for all the continuous testing and feedback