Proof-of-Concept Debt: Measuring the Timeliness and Noise of Public Exploit Disclosure as Exploitation Intelligence

Authors

Keywords:

proof-of-concept, exploit intelligence, Exploit-DB, GitHub PoCs, corpus quality, exploitation evidence, digital trust

Abstract

Background: Public proof-of-concept (PoC) exploits — on GitHub, in Exploit-DB, in security blogs — are consumed as exploitation intelligence: a working PoC is treated as evidence that a vulnerability is exploitable now . The published record supports the timeliness claim: CMU SEI's measurement of 75,807 CVEs found that, given a public exploit eventually appears, its median time-to-publication is just 2 days after patch release (mean 91 days) — and modern reporting (e.g., LLM-CVX, 2025) reaffirms the 2-day median against patched vulnerabilities. Objective: We analyze the PoC corpus as an intelligence source and expose its structural weakness: the corpus is not a signal but a debt — an accumulating body of artifacts whose quality, attribution accuracy, and safety properties vary without any verification standard. Methods: Synthesis of the published exploitation-timing measurements; construction of a PoC-corpus noise taxonomy; and a six-risk-versus-six-verification-mechanism assessment. Results: The corpus's value is real (2-day median timeliness for the exploited minority) but its consumption failure modes are severe and unmeasured: stale PoCs that no longer reproduce inflate "exploit exists" counts; malicious PoCs weaponize the verification step itself; PoC-CVE mislabeling corrupts attribution; and per-PoC verification cost is the reason none of this is routinely checked. We specify the verification harness — sandboxed reproduction with attestation, provenance scoring, and CVE/product binding validation — whose absence defines the debt. Conclusions: "Public exploit exists" should be treated as an unverified hypothesis, not a signal. The intelligence layer needs PoC verification as an infrastructure service, with attested reproduction results — and consumers should budget verification cost explicitly rather than treating corpus membership as evidence.

References

1. Cybersecurity and Infrastructure Security Agency, "Known Exploited Vulnerabilities (KEV) Catalog," updated continuously. [Online]. Available: https://www.cisa.gov/known-exploited-vulnerabilities-catalog

2. FIRST, "Exploit Prediction Scoring System (EPSS)," updated daily. [Online]. Available: https://www.first.org/epss/

3. National Institute of Standards and Technology, "NIST Updates NVD Operations to Address Record CVE Growth," Apr. 2026. [Online]. Available: https://www.nist.gov/news-events/news/2026/04/nist-updates-nvd-operations-address-record-cve-growth

4. Cybersecurity and Infrastructure Security Agency, "Vulnerability Exploitability eXchange (VEX)" guidance. [Online]. Available: https://www.cisa.gov/sbom

5. J. Zhang et al., "Exploit Prediction Scoring System (EPSS) — model documentation," FIRST, 2023-2025. [Online]. Available: https://www.first.org/epss/

6. "LLM-CVX: A Benchmarking Framework for Assessing the Offensive Potential of LLMs in Exploiting CVEs," in Proc. 18th ACM Workshop on Artificial Intelligence and Security (AISec '25), 2025. [Online]. Available: https://dl.acm.org/doi/10.1145/3733799.3762978

7. J. Beerman, L. Allodi, and J. M. Spring, "Historical Analysis of Exploit Availability Timelines," in Proc. USENIX Workshop on Cyber Security Experimentation and Test (CSET '20), 2020. [Online]. Available: https://www.sei.cmu.edu/library/historical-analysis-of-exploit-availability-timelines/

8. Practitioner documentation on malicious proof-of-concept artifacts, including honeypot/backdoored PoC reports in public repositories, 2020-2025 (multiple independent sources). [Online]. Available: https://github.com/topics/poc-exploit

9. Cybersecurity and Infrastructure Security Agency, "Known Exploited Vulnerabilities Catalog" — binding operational directive remediation requirements. [Online]. Available: https://www.cisa.gov/known-exploited-vulnerabilities-catalog

Downloads

Published

2026-10-30