Datasetpublic

Lelonthecodeur/web-research-coding-5m

Web Research + GitHub + Website Coding Dataset Version: 1.1.0 Total examples: 5,000,000 Splits train: 4,750,000 validation: 125,000 test: 125,000 Core capabilities Web search Web research Evidence extraction Fact verification Multi-hop research Multi-layer technical analysis Architecture analysis Root-cause analysis Security analysis Performance analysis UX analysis Design analysis Refactoring Code review Debugging Website coding Design systems… See the full description on the dataset page: https://huggingface.co/datasets/Lelonthecodeur/web-research-coding-5m.

sourceHugging Faceupdated 22d agoView on Hugging Face

2likes1.1kdownloads

rootREADME.md

README.md78 linesDownload Raw Back to root

1# Web Research + GitHub + Website Coding Dataset2 3Version: 1.1.04 5Total examples: 5,000,0006 7## Splits8 9- train: 4,750,00010- validation: 125,00011- test: 125,00012 13## Core capabilities14 15- Web search16- Web research17- Evidence extraction18- Fact verification19- Multi-hop research20- Multi-layer technical analysis21- Architecture analysis22- Root-cause analysis23- Security analysis24- Performance analysis25- UX analysis26- Design analysis27- Refactoring28- Code review29- Debugging30- Website coding31- Design systems32- Developer experience33- Developer onboarding34- API developer experience35- Documentation experience36 37## Source diversity38 39- Hugging Face: 20%40- GitLab: 10%41- Codeberg: 5%42- Stack Exchange: 15%43- MDN: 15%44- PyPI: 10%45- npm: 10%46- Official web documentation: 10%47- GitHub: 5%48 49## Multi-layer reasoning structure50 51Each deep analysis can cover:52 531. Problem542. Context553. Evidence564. Architecture575. Implementation586. Quality597. Security608. Performance619. UX6210. Design6311. Developer Experience6412. Validation6513. Trade-offs6614. Final synthesis67 68## Rate limits69 70GitHub is intentionally limited to a small anchor pool.71The 5,000,000 examples are generated locally from the collected72source anchors and therefore do not require 5,000,000 API requests.73 74## Data note75 76The dataset consists primarily of generated examples grounded77in public technical source metadata and URLs. It is not intended78to be a bulk reproduction of third-party website contents.