ProSA
2026Structural Robustness Auditing for Document Parsing
- Led the development of ProSA, an auditing framework requiring no access to parser internals. To address Footprint Bias in measuring parsing damage by perturbation area, designed the block-level structural loss rate B-SLR to jointly assess block locations and text preservation.
- Led the research direction, experimental design and core validation; evaluated MinerU and PP-StructureV3 and analyzed how structural errors propagate to downstream question answering and retrieval.
- Across 1,000 document pages and 29 fixed perturbation configurations, B-SLR achieved fitted R² values of 0.727 / 0.916 against changes in OCR character error rate, exceeding 0.384 / 0.110 for the area-based metric.
