v0.1.8b1Pre-release
Version 0.1.8b1
Added 1
- Support MARKITDOWN_CU_ENDPOINT and MARKITDOWN_DOCINTEL_ENDPOINT environment variables
Fixed 19
- Mitigate UnicodeDecodeError due to wrong ASCII charset guess for long files
- Support extended content-disposition filenames
- Fall back to plain text when RSS item content triggers RecursionError
- Allow Content Understanding conversion from stdin
- Correct \underleftarrow macro and map math italic h in equation conversion
- Strip the UTF-8 BOM and skip blank rows before building CSV tables
- Preserve strikethrough from <strike> and CSS line-through
- Fix percent-encoded Windows drive paths in file URIs
- Escape pipes and newlines in CSV values
- Safely extract EPUB metadata text without crashing on None nodeValue or nested elements
- Handle math run with no text child in OMML to LaTeX conversion
- Catch UnicodeDecodeError in IpynbConverter.accepts() on non-decodable content
- Ignore malformed DOCX styles missing type
- Preserve percent-encoded octets in href paths
- Remove extra closing brace from caron and ring-above accent templates
- Buffer CLI stdin before format detection on Windows
- Preserve Atom XHTML content in RSS
- Initialize md_text in _parse_rss_type to prevent UnboundLocalError
- ZipConverter renders literal output instead of 'None' when stream has no source info
From markitdown
This prerelease includes numerous small bug fixes. None adds new features or is expected to change output in typical cases. Nevertheless, the volume of changes warrants a cautious rollout.
Please report any issues or regressions.
What's Changed
- Pin GitHub Actions to full-length commit SHAs by @danfiedler-msft in https://github.com/microsoft/markitdown/pull/2316
- Mitigate UnicodeDecodeError due to wrong ASCII charset guess for long files by @fcatalan92 in https://github.com/microsoft/markitdown/pull/2360
- fix: support extended content-disposition filenames by @cat0825 in https://github.com/microsoft/markitdown/pull/2045
- fix: fall back to plain text when RSS item content triggers RecursionError by @shoemoney in https://github.com/microsoft/markitdown/pull/2333
- fix(cli): allow Content Understanding conversion from stdin by @uczltw6 in https://github.com/microsoft/markitdown/pull/2318
- fix: correct \underleftarrow macro and map math italic h in equation conversion by @gdols in https://github.com/microsoft/markitdown/pull/2293
- feat(cli): support MARKITDOWN_CU_ENDPOINT / MARKITDOWN_DOCINTEL_ENDPOINT by @seenws in https://github.com/microsoft/markitdown/pull/2358
- fix(csv): strip the UTF-8 BOM and skip blank rows before building the table by @uuzzrm in https://github.com/microsoft/markitdown/pull/2303
- Preserve strikethrough from <strike> and CSS line-through by @gyanu2507 in https://github.com/microsoft/markitdown/pull/2342
- Fix percent-encoded Windows drive paths in file URIs by @tandede in https://github.com/microsoft/markitdown/pull/2315
- fix: escape pipes and newlines in CSV values by @asjad3 in https://github.com/microsoft/markitdown/pull/2266
- fix(epub): safely extract metadata text without crashing on None nodeValue or nested elements by @hsusul in https://github.com/microsoft/markitdown/pull/2247
- fix: handle math run with no text child in OMML->LaTeX conversion by @S1MS4 in https://github.com/microsoft/markitdown/pull/2189
- fix: IpynbConverter.accepts() catches UnicodeDecodeError on non-decodable content (fixes #1894) by @hanhan761 in https://github.com/microsoft/markitdown/pull/1929
- fix(docx): ignore malformed styles missing type by @gingerninja85 in https://github.com/microsoft/markitdown/pull/2190
- Preserve percent-encoded octets in href paths by @Sonai124 in https://github.com/microsoft/markitdown/pull/2173
- fix: remove extra closing brace from caron and ring-above accent templates by @AndrewAvery7 in https://github.com/microsoft/markitdown/pull/2279
- fix: preserve strikethrough semantics for <strike>, line-through CSS, and w:dstrike by @wasim-builds in https://github.com/microsoft/markitdown/pull/2356
- fix: buffer CLI stdin before format detection on Windows by @mohui666 in https://github.com/microsoft/markitdown/pull/2351
- fix(rss): preserve Atom XHTML content by @weivwang in https://github.com/microsoft/markitdown/pull/2297
- fix: initialize md_text in _parse_rss_type to prevent UnboundLocalError by @smedavarapu1 in https://github.com/microsoft/markitdown/pull/2164
- fix: ZipConverter renders '(unknown)' instead of literal 'None' when stream has no source info by @JSap0914 in https://github.com/microsoft/markitdown/pull/2134
- fix: truncate uppercase data image URIs by @pony-maggie in https://github.com/microsoft/markitdown/pull/2122
- fix(doc-intel): default api_version to None in DocumentIntelligenceConverter by @MeiSiristhebest in https://github.com/microsoft/markitdown/pull/2267
- fix(outlook): read .msg string properties saved in the non-Unicode format by @gdols in https://github.com/microsoft/markitdown/pull/2295
- fix: handle URI schemes case-insensitively by @pony-maggie in https://github.com/microsoft/markitdown/pull/2121
- fix: normalize data URI parameter case by @pony-maggie in https://github.com/microsoft/markitdown/pull/2120
- fix(xlsx): tolerate legacy showZeroes sheet views by @he-yufeng in https://github.com/microsoft/markitdown/pull/2064
- docs: use canonical markdown result property by @CooperSheroy in https://github.com/microsoft/markitdown/pull/2259
- fix(youtube): handle missing title metadata without raising AssertionError by @hsusul in https://github.com/microsoft/markitdown/pull/2238
- Bump actions/checkout from 5.1.0 to 7.0.1 by @dependabot[bot] in https://github.com/microsoft/markitdown/pull/2320
- Bump actions/setup-python from 5.6.0 to 7.0.0 by @dependabot[bot] in https://github.com/microsoft/markitdown/pull/2321
- fix(ipynb): preserve leading # in notebook heading titles by @Alphaxiaoteng in https://github.com/microsoft/markitdown/pull/2371
- fix(docx): preserve underlined text by @he-yufeng in https://github.com/microsoft/markitdown/pull/2017
- fix(pptx): ignore empty llm captions by @Lubrsy706 in https://github.com/microsoft/markitdown/pull/1886
- fix: PptxConverter tolerates None shape.text and notes text by @alvinttang in https://github.com/microsoft/markitdown/pull/2059
- fix(pptx): prevent crash in PptxConverter when chart title lacks a text frame by @aoright in https://github.com/microsoft/markitdown/pull/2194
- fix: catch OSError when exiftool binary is missing (#1960) by @doitgo in https://github.com/microsoft/markitdown/pull/2082
- Fix exiftool JSON decoding to use UTF-8 by @Vedant43hh in https://github.com/microsoft/markitdown/pull/2067
- fix: WikipediaConverter renders hash None heading when page has no title by @hanhan761 in https://github.com/microsoft/markitdown/pull/1990
- fix: guard against missing oMath element in DOCX math converter (#1979) by @hanhan761 in https://github.com/microsoft/markitdown/pull/1995
- fix: handle DOCX files with inconsistent ZIP filename casing (#1812) by @lyydsheep in https://github.com/microsoft/markitdown/pull/2016
- Support short YouTube URLs by @MukundaKatta in https://github.com/microsoft/markitdown/pull/1882
- fix: suppress pydub RuntimeWarning when ffmpeg is missing (fixes #1685) by @hanhan761 in https://github.com/microsoft/markitdown/pull/1985
- chore: remove unused mammoth import from PlainTextConverter (#1951) by @hanhan761 in https://github.com/microsoft/markitdown/pull/1953
- fix(rss): treat Atom text content and summary as plain text by @lazerg in https://github.com/microsoft/markitdown/pull/2374
- fix: ImageConverter gracefully handles LLM API failures (fixes #1942) by @hanhan761 in https://github.com/microsoft/markitdown/pull/1948
- fix(docx): handle unknown math functions in OMML converter without crashing by @MeiSiristhebest in https://github.com/microsoft/markitdown/pull/2268
- Update README to help scope PRs. by @afourney in https://github.com/microsoft/markitdown/pull/2376
New Contributors
- @danfiedler-msft made their first contribution in https://github.com/microsoft/markitdown/pull/2316
- @fcatalan92 made their first contribution in https://github.com/microsoft/markitdown/pull/2360
- @cat0825 made their first contribution in https://github.com/microsoft/markitdown/pull/2045
- @shoemoney made their first contribution in https://github.com/microsoft/markitdown/pull/2333
- @uczltw6 made their first contribution in https://github.com/microsoft/markitdown/pull/2318
- @gdols made their first contribution in https://github.com/microsoft/markitdown/pull/2293
- @seenws made their first contribution in https://github.com/microsoft/markitdown/pull/2358
- @uuzzrm made their first contribution in https://github.com/microsoft/markitdown/pull/2303
- @gyanu2507 made their first contribution in https://github.com/microsoft/markitdown/pull/2342
- @tandede made their first contribution in https://github.com/microsoft/markitdown/pull/2315
- @asjad3 made their first contribution in https://github.com/microsoft/markitdown/pull/2266
- @hsusul made their first contribution in https://github.com/microsoft/markitdown/pull/2247
- @S1MS4 made their first contribution in https://github.com/microsoft/markitdown/pull/2189
- @hanhan761 made their first contribution in https://github.com/microsoft/markitdown/pull/1929
- @gingerninja85 made their first contribution in https://github.com/microsoft/markitdown/pull/2190
- @Sonai124 made their first contribution in https://github.com/microsoft/markitdown/pull/2173
- @AndrewAvery7 made their first contribution in https://github.com/microsoft/markitdown/pull/2279
- @wasim-builds made their first contribution in https://github.com/microsoft/markitdown/pull/2356
- @mohui666 made their first contribution in https://github.com/microsoft/markitdown/pull/2351
- @weivwang made their first contribution in https://github.com/microsoft/markitdown/pull/2297
- @smedavarapu1 made their first contribution in https://github.com/microsoft/markitdown/pull/2164
- @JSap0914 made their first contribution in https://github.com/microsoft/markitdown/pull/2134
- @pony-maggie made their first contribution in https://github.com/microsoft/markitdown/pull/2122
- @MeiSiristhebest made their first contribution in https://github.com/microsoft/markitdown/pull/2267
- @he-yufeng made their first contribution in https://github.com/microsoft/markitdown/pull/2064
- @CooperSheroy made their first contribution in https://github.com/microsoft/markitdown/pull/2259
- @Alphaxiaoteng made their first contribution in https://github.com/microsoft/markitdown/pull/2371
- @Lubrsy706 made their first contribution in https://github.com/microsoft/markitdown/pull/1886
- @alvinttang made their first contribution in https://github.com/microsoft/markitdown/pull/2059
- @aoright made their first contribution in https://github.com/microsoft/markitdown/pull/2194
- @doitgo made their first contribution in https://github.com/microsoft/markitdown/pull/2082
- @Vedant43hh made their first contribution in https://github.com/microsoft/markitdown/pull/2067
- @lyydsheep made their first contribution in https://github.com/microsoft/markitdown/pull/2016
- @MukundaKatta made their first contribution in https://github.com/microsoft/markitdown/pull/1882
- @lazerg made their first contribution in https://github.com/microsoft/markitdown/pull/2374
Full Changelog: https://github.com/microsoft/markitdown/compare/v0.1.7...v0.1.8a1