commoncrawl/web-graph-embeddings

Web Graph Embedings from Common Crawl's Host-level Hyperlink Graph Dense 128-dimensional embeddings for 52,913,544 web hosts, learned by link prediction on the Common Crawl host-level hyperlink graph release cc-main-2025-26-nov-dec-jan. Vectors are L2-normalized and served in float16; similarity is cosine (a dot product on the unit vectors). The dataset contains hosts with link degree >= 8 (total in+out degree), a 52.9 M / ~19 % induced subgraph that carries ~97 % of the edges.… See the full description on the dataset page: https://huggingface.co/datasets/commoncrawl/web-graph-embeddings.