heitorrosa/cvm-corpus
CVM Filings Corpus (PT-BR) Brazilian CVM regulatory filings in Portuguese, cleaned and chunked for language-model pretraining. Built for DAPT on financial Portuguese. Contents Path What output/corpus.jsonl Full corpus (7.2 GB). Chunk schema: text, company, cnpj, category, subject, date, year, document_id, chunk_id, extraction_quality. output/corpus-250M.jsonl DSIR-selected 250M-token subset (token count by chars÷4 proxy ≈ 150M whitespace tokens): 187… See the full description on the dataset page: https://huggingface.co/datasets/heitorrosa/cvm-corpus.
Update README.md
Update README.md
Update README.md
Update README.md
Update README.md
Update README.md
Update README.md
remove 1017 duplicated root pdfs in 2020/pdfs (kept in part-/)
remove 847 duplicated root pdfs in 2019/pdfs (kept in part-/)
remove 6247 duplicated root pdfs in 2018/pdfs (kept in part-/)
remove 8797 duplicated root pdfs in 2017/pdfs (kept in part-/)
remove 9997 duplicated root pdfs in 2016/pdfs (kept in part-/)
remove 9997 duplicated root pdfs in 2015/pdfs (kept in part-/)
remove 9997 duplicated root pdfs in 2014/pdfs (kept in part-/)
remove 9997 duplicated root pdfs in 2013/pdfs (kept in part-/)
remove 3022 duplicated root pdfs in 2012/pdfs (kept in part-/)
remove 9997 duplicated root pdfs in 2007/pdfs (kept in part-/)
upload 2020/pdfs/part-2-9 (part 14)
upload 2020/pdfs/part-2-9 (part 13)
upload 2020/pdfs/part-2-9 (part 12)
upload 2020/pdfs/part-2-9 (part 11)
upload 2020/pdfs/part-2-9 (part 10)
upload 2020/pdfs/part-0-1 (part 15)
upload 2020/pdfs/part-0-1 (part 14)
upload 2020/pdfs/part-0-1 (part 13)
upload 2020/pdfs/part-2-9 (part 9)
upload 2020/pdfs/part-0-1 (part 12)
upload 2020/pdfs/part-2-9 (part 8)
upload 2020/pdfs/part-2-9 (part 7)
upload 2020/pdfs/part-0-1 (part 11)
upload 2020/pdfs/part-2-9 (part 6)
upload 2020/pdfs/part-2-9 (part 5)
upload 2020/pdfs/part-2-9 (part 4)
upload 2020/pdfs/part-0-1 (part 10)
upload 2020/pdfs/part-2-9 (part 3)
upload 2020/pdfs/part-2-9 (part 2)
upload 2020/pdfs/part-2-9
upload 2019/pdfs/part-3-9 (part 13)
upload 2019/pdfs/part-3-9 (part 12)
upload 2019/pdfs/part-3-9 (part 11)
upload 2020/pdfs/part-0-1 (part 9)
upload 2019/pdfs/part-3-9 (part 10)
upload 2020/pdfs/part-0-1 (part 8)
upload 2019/pdfs/part-3-9 (part 9)
upload 2020/pdfs/part-0-1 (part 7)
upload 2019/pdfs/part-3-9 (part 8)
upload 2020/pdfs/part-0-1 (part 6)
upload 2020/pdfs/part-0-1 (part 5)
upload 2020/pdfs/part-0-1 (part 4)
upload 2019/pdfs/part-3-9 (part 7)