Team Ai
Datasetpublic

CyberMax-tools/open-domain-ranks

Linkheft Open Domain Ranks: free domain authority data for 10.3 million domains Score your own domain list on the latest release, by API: $5 for 25,000 lookups. Buy now → · API key on screen the moment checkout ends · no subscription · 14-day refund if it doesn't work as described · help: cybermax.tools@gmail.com Need it fresh, filtered or via API? This free file is a snapshot (the latest Common Crawl + Majestic release for 10.3M domains), last updated 2026-10-10. Linkheft… See the full description on the dataset page: https://huggingface.co/datasets/CyberMax-tools/open-domain-ranks.

sourceHugging Faceotherupdated 5h agoView on Hugging Face
0likes6.3kdownloads
Dataset Card

Linkheft Open Domain Ranks: free domain authority data for 10.3 million domains

<!-- cybermax-bridge:start -->

Score your own domain list on the latest release, by API: $5 for 25,000 lookups. [Buy now →](https://data.cybermaxtools.com/buy/linkheft-api-pack?s=hf-open-domain-ranks-top) · API key on screen the moment checkout ends · no subscription · 14-day refund if it doesn't work as described · help: cybermax.tools@gmail.com Need it fresh, filtered or via API? This free file is a snapshot (the latest Common Crawl + Majestic release for 10.3M domains), last updated 2026-10-10. - [Linkheft domain authority API](https://data.cybermaxtools.com/buy/linkheft-api?s=hf-open-domain-ranks) (1,000 free domain lookups a day, $5 for 25,000 (no expiry, no subscription), or $19/month for 100,000): returns the authority score, web rank, trend and Majestic links for up to 50 domains per call from this same data, always the latest release, by REST API or MCP. - [Linkheft on Apify](https://data.cybermaxtools.com/buy/linkheft?s=hf-open-domain-ranks) ($0.002 per domain ranked): scores any list of domains on demand (authority 0-100, rank, 4-month trend), via API, schedule or MCP. - [DomainDNA API $5 pack](https://data.cybermaxtools.com/buy/domaindna-api-pack?s=hf-open-domain-ranks) ($5 for 1,000 domain checks, never expires): tech stack, email provider, SPF, DMARC and domain age for your own domains, by REST API or MCP. Pay by card, your API key is on screen the moment checkout ends; no account, no subscription. - [DomainDNA domain intel API (card checkout)](https://data.cybermaxtools.com/buy/domaindna?s=hf-open-domain-ranks) (25 free domains a day, $5 for 1,000 (no expiry, no subscription), or $19/month for 5,000): checks tech stack (with evidence), email provider, SPF/DMARC and domain age for your own domains by REST API or MCP; pay by card in one click, key shown instantly, no Apify account needed (the DomainDNA Apify tool for bulk lists, TLS and monitor mode is linked from the same page). - [DomainDNA on Apify](https://data.cybermaxtools.com/buy/domaindna-apify?s=hf-open-domain-ranks) ($0.004 per domain analyzed): checks tech stack, TLS, SPF/DMARC and domain age for your own domain lists, with a monitor mode that returns only changes. - Using it at work? [Commercial license + support](https://data.cybermaxtools.com/buy/dataset-license?s=hf-open-domain-ranks) (from $49/year): invoice, PDF licence certificate, named support, freshness and availability commitments and an SLA; the data stays free and open for everyone. - [Get an email when this dataset updates](https://data.cybermaxtools.com/notify?ds=open-domain-ranks&s=hf-open-domain-ranks): free, double opt-in, unsubscribe any time. - [CyberMax Store](https://cybermaxtools.com/store/?utm_source=huggingface&utm_medium=dataset&utm_campaign=open-domain-ranks): every CyberMax data product, API plan and weekly brief in one place.

<!-- cybermax-bridge:end -->

<!-- cm:banner --> Linkheft: Know how big any website is, in bulk <!-- /cm:banner -->

<!-- cybermax-use:start -->

Use this dataset

python
from datasets import load_dataset

ds = load_dataset("CyberMax-tools/open-domain-ranks", split="train", streaming=True)
for row in ds.take(5):
    print(row)

Need it fresh, filtered or via API? [Linkheft domain authority API](https://data.cybermaxtools.com/buy/linkheft-api?s=hf-use-open-domain-ranks) (1,000 free domain lookups a day, $5 for 25,000 (no expiry, no subscription), or $19/month for 100,000). <!-- cybermax-use:end -->

An open alternative to proprietary "domain authority" scores. For each of the top 10 million domains on the web (plus every Majestic Million domain) this dataset gives:

columnmeaning
domainregistrable domain, lowercase (stripe.com)
cc_rankharmonic-centrality rank in the Common Crawl web graph (1 = most central), latest release
cc_pr_rankPageRank rank in the same graph
cc_hostsnumber of hosts (subdomains) of the domain seen in the crawl
cc_prev_rankharmonic-centrality rank in the release ~4 months earlier (trend)
mj_rankMajestic Million global rank
mj_refsubnetsreferring IP subnets (Majestic), a backlink-diversity signal
mj_refipsreferring IP addresses (Majestic)

Empty cell = the domain is not in that list. See meta.json for release names and totals.

Layout

shards/<xx>.tsv.gz, where xx is the first two hex characters of md5(domain). To look up one domain you download one ~800 KB file:

python
import gzip, hashlib, urllib.request
d = "stripe.com"
k = hashlib.md5(d.encode()).hexdigest()[:2]
url = f"https://huggingface.co/datasets/CyberMax-tools/open-domain-ranks/resolve/main/shards/{k}.tsv.gz"
for line in gzip.decompress(urllib.request.urlopen(url).read()).decode().splitlines():
    if line.split("\t")[0] == d: print(line)

Try it in your browser: Linkheft free domain authority checker.

Bulk lookups, a 0–100 authority score, rank-trend verdicts and an MCP tool for AI agents: Linkheft on the Apify Store.

<!-- cybermax-production:start -->

Use it in production

This snapshot is free. For pipelines that need it current every day, the Deltawren Open Domain Ranks feed serves the same files with the same columns, refreshed daily (Majestic Million columns refresh every day; Common Crawl columns change when Common Crawl publishes a new web graph, every 1-3 months), plus daily history and a "what changed since yesterday" diff. Daily diffs of rank changes from the feed start date; a full snapshot on the 1st of each month.

Switching is one line: change the base URL and add your key.

python
import pandas as pd

# free snapshot
# BASE = "https://huggingface.co/datasets/CyberMax-tools/open-domain-ranks/resolve/main/"
BASE = "https://deltawren.cybermaxtools.com/v1/domain-ranks/latest/"  # Deltawren daily feed
KEY = {"headers": {"x-api-key": "YOUR_KEY"}}  # or add ?key=YOUR_KEY to the URL

df = pd.read_csv(BASE + "shards/00.tsv.gz", sep="\t", header=None, compression="gzip", storage_options=KEY)

# what changed since yesterday (free summary; the changed rows need the key)
import requests
print(requests.get("https://deltawren.cybermaxtools.com/api/changes?feed=domain-ranks").json())

Get a feed key (from $19/month, or every feed in one key) · Docs · Manifest

Licence: Attribution required: Majestic Million (CC BY 3.0) and the Common Crawl web graph (Common Crawl terms of use). Using it at work? The Commercial License + Support adds an invoice, a licence certificate, named support and an SLA.

<!-- cybermax-production:end -->

Sources and attribution

  • —Common Crawl Web Graph, domain-level ranks (commoncrawl.org/web-graphs), used under the Common Crawl Terms of Use.
  • —Majestic Million by Majestic-12 Ltd, licensed CC BY 3.0 (https://majestic.com/reports/majestic-million).

This is a derived work of both; please keep the attribution. Not affiliated with Common Crawl, Majestic, Moz, Ahrefs or Semrush. Scores are not Moz DA or Ahrefs DR.

Built by CyberMax.

<!-- cybermax-xlinks:start -->

More free from CyberMax

<!-- cybermax-notebook:start -->

Quickstart notebook

Load this dataset with pandas and see real outputs in the quickstart notebook. Need it refreshed for your own list? Linkheft — Bulk Domain Authority Checker & Website Rank API. <!-- cybermax-notebook:end -->

<!-- cybermax-web:start -->

Browse it on the web

Free, no sign-up: one page per top-5,000 domain: https://data.cybermax-tools.workers.dev/domain/, plus a free rank badge. AI agents can query it through the remote MCP server https://data.cybermax-tools.workers.dev/mcp (no key). <!-- cybermax-web:end -->

CyberMax-tools/open-domain-ranks · Team Ai