WeKnora/docreader/parser
Lukas e7aaf8ae02
fix(docreader): keep the space held by a whitespace-only inline element (#3978)
markdownify renders an emphasis, code or link element whose text is only
whitespace as "", and the whitespace goes with it. HTML and MHTML
uploads therefore lost word boundaries: `further<strong> </strong>
reference` became `furtherreference`, and `<b>First</b><b> </b><b>Last</b>`
became `**First****Last**`. Editors produce that markup whenever a single
space between two words carries different formatting.

Before conversion, unwrap such elements so their whitespace stays as plain
text. Only elements with no child elements are touched, innermost first,
so a linked image keeps its link and nested wrappers come off completely.
2026-10-08 01:31:48 +08:00
..
__init__.py fix(knowledge): support local HTML uploads 2026-07-29 20:11:17 +08:00
base_parser.py feat: introduce WeKnora Lite edition with lightweight configuration and deployment 2026-03-02 21:21:49 +08:00
chain_parser.py feat(metadata): enhance document processing to include metadata extraction and handling 2026-04-01 15:49:47 +08:00
concurrency.py fix(docreader): throttle heavy parser concurrency 2026-05-07 17:36:09 +08:00
doc_parser.py fix(docreader): kill timed-out converter process groups (#2990) 2026-09-23 12:02:53 +08:00
docx2_parser.py feat: 新增文档模型类,调整配置与解析逻辑,优化日志及导入 2025-11-18 22:37:01 +08:00
docx_merge.py fix(docreader): preserve vertically merged table cells (#2657) 2026-08-12 10:59:49 +08:00
docx_parser.py fix(docreader): keep DOCX table content in parsed text (#2898) 2026-08-31 17:56:17 +08:00
epub_parser.py fix(docreader): read EPUB chapters in spine order (#3977) 2026-10-08 01:21:50 +08:00
excel_convert.py feat(parser): add OpenDataLoader, PaddleOCR-VL engines, and parser improvements 2026-06-03 12:29:13 +08:00
excel_parser.py fix(docreader): drop data validation ranges openpyxl cannot parse instead of failing the sheet (#3599) (#3608) 2026-09-25 22:29:27 +08:00
html_parser.py fix(knowledge): support local HTML uploads 2026-07-29 20:11:17 +08:00
image_parser.py feat: introduce WeKnora Lite edition with lightweight configuration and deployment 2026-03-02 21:21:49 +08:00
markdown_parser.py fix: stop markdown table regex catastrophic backtracking (#2770) 2026-08-24 18:08:07 +08:00
markitdown_parser.py fix(docreader): drop data validation ranges openpyxl cannot parse instead of failing the sheet (#3599) (#3608) 2026-09-25 22:29:27 +08:00
mhtml_parser.py fix(docreader): keep the space held by a whitespace-only inline element (#3978) 2026-10-08 01:31:48 +08:00
opendataloader_parser.py fix(security): harden outbound URL SSRF protection (#2626) 2026-08-10 13:24:14 +08:00
parser.py fix(docreader): detect legacy doc payloads 2026-07-11 12:21:56 +08:00
pdf_parser.py fix(citations): 修复原文定位、高亮范围与 DocReader 启动失败 (#3794) 2026-09-27 20:32:26 +08:00
ppt_convert.py feat(parser): add OpenDataLoader, PaddleOCR-VL engines, and parser improvements 2026-06-03 12:29:13 +08:00
pptx_media.py feat(parser): add OpenDataLoader, PaddleOCR-VL engines, and parser improvements 2026-06-03 12:29:13 +08:00
registry.py fix(parser): default ppt/pptx to markitdown when no engine rules (#2882) 2026-08-31 14:58:15 +08:00
source_locator.py fix(citations): 修复原文定位、高亮范围与 DocReader 启动失败 (#3794) 2026-09-27 20:32:26 +08:00
web_parser.py fix: align client sessions and integration request handling (#3305) 2026-09-16 16:20:57 +08:00
xlsx_merge.py fix(docreader): avoid chart serialization during xlsx preprocessing 2026-08-12 13:26:19 +08:00
xlsx_repair.py fix(docreader): drop data validation ranges openpyxl cannot parse instead of failing the sheet (#3599) (#3608) 2026-09-25 22:29:27 +08:00
xmind_parser.py feat(docreader): add XMind outline parsing (#2713) 2026-08-20 19:49:48 +08:00