web-graph
web-graph-embeddings
Web Graph Embedings from Common Crawl's Host-level Hyperlink Graph
Dense 128-dimensional embeddings for 52,913,544 web hosts, learned by link prediction on the
Common Crawl host-level hyperlink graph release cc-main-2025-26-nov-dec-jan. Vectors are L2-normalized and served in float16;
similarity is cosine (a dot product on the unit vectors).
The dataset contains hosts with link degree >= 8 (total in+out degree), a 52.9 M / ~19 % induced subgraph that carries ~97 % of the edges.… See the full description on the dataset page: https://huggingface.co/datasets/commoncrawl/web-graph-embeddings.pl-web-graph-2026-09-14
Polish Web Domain Observations 2026-09-14
A curated snapshot of a .pl-focused domain crawler: DNS observations, host availability metadata, discovered URL references, and the crawl frontier. No HTML, page text, or website classifications are included. Observations accumulated over months, so September 14 dates the export itself while each row carries its own observation time. Coverage is whatever one crawler reached, and liveness holds as of the recorded timestamp.
Rendered… See the full description on the dataset page: https://huggingface.co/datasets/AsciiMAster/pl-web-graph-2026-09-14.cc-webgraph-domain-2026-junweb-graph-testing-v1
Common Crawl neo4j Web Graph (Crawl from October, November and December 2025)
This dataset contains one of the Common Crawl Foundation's Web Graphs, stored in a neo4j graph database dump.
We have been computing these web graphs since 2018, and currently every crawl has a web graph covering the previous 3 crawls.
This dataset is a test and contains the web graph computed over the crawls of October, November and December 2025.
More information here.
Status
This… See the full description on the dataset page: https://huggingface.co/datasets/commoncrawl/web-graph-testing-v1.web-agent-graph-dataset
Web Agent Grouped Graph Dataset
This dataset contains web navigation tasks in grouped graph format with full history and candidate actions for training reward models.
Data Format
Each line in graph_dataset.jsonl represents a single step with all candidate actions grouped together:
{
"task_id": "...",
"goal": "Find product X and add to cart",
"domain": "shopping",
"step_index": 3,
"history": [
{"state_id": "S0", "screenshot": "...", "url": "...", "obs":… See the full description on the dataset page: https://huggingface.co/datasets/Anish13/web-agent-graph-dataset.