Add PAS Hub SAP-accuracy regression harness (Guinness 205 cohort)

Foundation for PRD #1555: runs each PAS Hub site-note PDF through the extractor -> EpcPropertyData -> Sap10Calculator and gauges the computed SAP against pashub's own SAP-10.2 `pre_sap` (from hubspot_deal_data). - test_pashub_sap_accuracy.py: hybrid gate. Per-fixture "must compute" (xfail on the known in-progress mapper gaps MissingMainFuelType / UnmappedSapCode / UnmappedPasHubLabel) + aggregate within-0.5 ratchet floor, mirroring test_sap_accuracy_corpus.py. - 205 image-stripped site-note PDFs + manifest.json. Images stripped so the repo footprint stays ~52MB while the text layer the extractor reads is byte-identical. - build_pashub_accuracy_fixtures.py: provenance/rebuild from S3 + hubspot_deal_data. All 206 currently xfail on the known heating-string mapper gaps; each fix (#1556-1568) flips its fixtures to computing and ratchets the floor. Refs #1555 #1568 Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-27 23:35:01 +00:00 · 2026-07-14 15:32:18 +00:00 · 2026-07-14 15:32:18 +00:00 · e5fee3896a
commit e5fee3896a
parent 2f0d5a25f1
208 changed files with 12055 additions and 0 deletions
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499516101837.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499516101837.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499516101839.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499516101839.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499516101841.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499516101841.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499521277114.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499521277114.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499521277115.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499521277115.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499525433550.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499525433550.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499525433551.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499525433551.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499525433552.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499525433552.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499527236803.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499527236803.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499527236805.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499527236805.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499529160906.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499529160906.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499529160907.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499529160907.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499529160908.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499529160908.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499529160909.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499529160909.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499529160910.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499529160910.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499529160911.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499529160911.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499529160912.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499529160912.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499530733767.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499530733767.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499532465358.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499532465358.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499532465359.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499532465359.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499532465360.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499532465360.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499532465361.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499532465361.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499534268613.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499534268613.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499534268615.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499534268615.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499534268616.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499534268616.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499536091330.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499536091330.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499536091332.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499536091332.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499536091333.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499536091333.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499538003156.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499538003156.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499538003157.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499538003157.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499538003158.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499538003158.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499539910905.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499539910905.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499541546213.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499541546213.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499541546214.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499541546214.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499541546215.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499541546215.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499541546216.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499541546216.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499541546217.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499541546217.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499541546218.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499541546218.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499543223503.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499543223503.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499543223504.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499543223504.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499543223505.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499543223505.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499559510256.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499559510256.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499559510258.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499559510258.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499561092294.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499561092294.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499561092295.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499561092295.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499561092296.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499561092296.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499562940629.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499562940629.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499562940630.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499562940630.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499562940631.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499562940631.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499562940636.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499562940636.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499564834027.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499564834027.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499564834028.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499564834028.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499564834029.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499564834029.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499564834030.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499564834030.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499564834031.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499564834031.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499566627044.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499566627044.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499566627045.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499566627045.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499568413915.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499568413915.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499568413916.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499568413916.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499568413918.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499568413918.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499570197710.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499570197710.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499572113604.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499572113604.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499572113606.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499572113606.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499573717207.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499573717207.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499573717208.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499573717208.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499573717209.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499573717209.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499573717210.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499573717210.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499575623906.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499575623906.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499575623907.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499575623907.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499577477357.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499577477357.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499577477358.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499577477358.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499577477359.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499577477359.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499579565295.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499579565295.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499579565296.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499579565296.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499581328608.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499581328608.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499581328611.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499581328611.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499581328612.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499581328612.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499583068383.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499583068383.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499583068384.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499583068384.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499584755918.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499584755918.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499584755919.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499584755919.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499584755920.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499584755920.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499584755921.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499584755921.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499584755922.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499584755922.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499586692333.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499586692333.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499586692336.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499586692336.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499590032588.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499590032588.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499592219845.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499592219845.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499592219846.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499592219846.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499592219848.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499592219848.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499592219850.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499592219850.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499594029285.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499594029285.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499594029286.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499594029286.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499594029287.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499594029287.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499594881228.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499594881228.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499596874956.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499596874956.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499596874957.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499596874957.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499598474450.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499598474450.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499598474451.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499598474451.pdf
--- a/backend/documents_parser/tests/fixtures/pashub_accuracy/499598474452.pdf
+++ b/backend/documents_parser/tests/fixtures/pashub_accuracy/499598474452.pdf
--- a/Show more
+++ b/Show more