datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
us-historical-layoffs-archive-warn-act-notices-removed-from-state-websites
Historical US layoffs archive: 6,799 WARN Act notices that state websites no longer list (2000-2025), recovered
Rebuilt 2026-09-25. Five state labor agencies — Connecticut, Michigan, New York,
North Carolina and Pennsylvania — retired the web pages their older WARN Act
layoff notices lived on. Their current pages start years later. This dataset is
every notice in our file that came from one of those retired pages and is not
on the agency's live page today: 6,799 notices, 6,799… See the full description on the dataset page: https://huggingface.co/datasets/APProjects/us-historical-layoffs-archive-warn-act-notices-removed-from-state-websites.webis-touche2020-qrels
Dataset Card for BEIR Benchmark
Dataset Summary
BEIR is a heterogeneous benchmark that has been built from 18 diverse datasets representing 9 information retrieval tasks:
Fact-checking: FEVER, Climate-FEVER, SciFact
Question-Answering: NQ, HotpotQA, FiQA-2018
Bio-Medical IR: TREC-COVID, BioASQ, NFCorpus
News Retrieval: TREC-NEWS, Robust04
Argument Retrieval: Touche-2020, ArguAna
Duplicate Question Retrieval: Quora, CqaDupstack
Citation-Prediction: SCIDOCS
Tweet… See the full description on the dataset page: https://huggingface.co/datasets/BeIR/webis-touche2020-qrels.agent-web-index
Agent Web Index — how much of the web can AI assistants actually read?
50,413 domains measured live. 26% of them cannot be read by at least one of
ChatGPT, Claude, Perplexity or Gemini. Updated daily. Live index: https://shop.lumnika.com/ai-readiness/
Every row here is the result of real HTTP requests, not an estimate and not a re-publication of
someone else's crawl: each domain's homepage is requested once as a browser and once as each of the
published AI crawler user-agents… See the full description on the dataset page: https://huggingface.co/datasets/DeusHorizon/agent-web-index.casia-webfaceweb-server-logs
Web Server Access Logs (Synthetic) (Free Sample)
This is a free sample with 5,003 rows. The full dataset has 50,048 rows across 2 tables.
Realistic HTTP access logs from a simulated SaaS company running an
e-commerce API and marketing website. 50,000 requests across 3 servers
over 12 months.
Includes realistic patterns: weekday/weekend traffic variation, peak hours,
seasonal trends, bot traffic, and two injected anomalies (DDoS attempt and
database outage) for anomaly detection… See the full description on the dataset page: https://huggingface.co/datasets/mindweave/web-server-logs.WebVid-CoVRarxiv.org/abs/2308.14746
web-attacks-longweb-attacks45_Million_Websitesnexus-fpv
NEXUS FPV Physics Dataset Sampler by webXOS
Auto-generated small FPV drone flight-telemetry and reinforcement-learning for experience sample dataset captured directly in the browser
by NEXUS FPV. Each row is one physics tick recorded while a drone flew through a waypoint course, either under manual control or the built-in PID auto-pilot.
Play the game and make your own datasets: https://webxos.itch.io/nexus-fpv or download it from the /gym/ folder of this repo.
Generator: NEXUS… See the full description on the dataset page: https://huggingface.co/datasets/webxos/nexus-fpv.DEplain-web-doc
DEplain-web-doc: A corpus for German Document Simplification
DEplain-web-doc is a subcorpus of DEplain Stodden et al., 2023 for document simplification.
The corpus consists of 396 (199/50/147) parallel documents crawled from the web in standard German and plain German (or easy-to-read German). All documents are either published under an open license or the copyright holders gave us the permission to share the data.
If you are interested in a larger corpus, please check our paper… See the full description on the dataset page: https://huggingface.co/datasets/DEplain/DEplain-web-doc.enterprise-financial-crime-ai-datasetTransactions → Risk Analysis → Alerts → Investigation → SAR Reports
Dataset Statistics
Total records: 310,396Dataset size: 339 MBAuto-converted parquet size: 65 MB
Languages:
English
French
Spanish
Main fields:
email_id
thread_id
timestamp
language
bank
department
country
risk_level
Enterprise Financial Crime AI Dataset
The Enterprise Financial Crime AI Dataset is a high-fidelity dataset built from real-world operational patterns and enterprise data structures… See the full description on the dataset page: https://huggingface.co/datasets/Webopen2026/enterprise-financial-crime-ai-dataset.0skeng-agentic-web-benchmark
0skeng Index: synthetic UK collectibles prices
The prices in this dataset are generated, not collected. A script produces
every figure from a fixed seed. No marketplace was read, no listing was
matched, and no real sale lies behind any number here. Do not use it to value,
buy or sell anything, and do not repeat any figure in it as a market fact.
What it is good for is testing: it has the shape, spread and internal
consistency of a real weekly price index, in formats a program or… See the full description on the dataset page: https://huggingface.co/datasets/hug-the-trees/0skeng-agentic-web-benchmark.COVID-19-vaccine-attitude-tweets
Dataset Card for COVID-19-vaccine-attitude-tweets
Dataset Summary
The dataset consists of 2564 manually annotated tweets related to COVID-19 vaccines. The dataset can be used to discover the attitude expressed in the tweet towards the subject of COVID-19 vaccines. Tweets are in English. The dataset was curated in such a way as to maximize the likelihood of tweets with a strong emotional tone. We have assumed the existence of three classes:
PRO (label 0): positive, the… See the full description on the dataset page: https://huggingface.co/datasets/webimmunization/COVID-19-vaccine-attitude-tweets.swiss-sme-websites-2026
Swiss SME Websites 2026: 10,000 sites audited, canton by canton
Aggregated measurements of 10,000 websites of Swiss small and medium-sized
businesses, drawn at random from the Swiss commercial register in September
2026. Proportions only: no company name, no website address, no figure for a
group of fewer than 30 sites.
Study page (FR): https://hallebardier.com/etude-sites-pme-suisses/
Study page (EN): https://hallebardier.com/en/swiss-sme-website-study/
Study page (DE):… See the full description on the dataset page: https://huggingface.co/datasets/mp-cmd/swiss-sme-websites-2026.web-server-logs
Web Server Access Logs (Synthetic) (Free Sample)
This is a free sample with 5,003 rows. The full dataset has 50,048 rows across 2 tables.
Realistic HTTP access logs from a simulated SaaS company running an
e-commerce API and marketing website. 50,000 requests across 3 servers
over 12 months.
Includes realistic patterns: weekday/weekend traffic variation, peak hours,
seasonal trends, bot traffic, and two injected anomalies (DDoS attempt and
database outage) for anomaly… See the full description on the dataset page: https://huggingface.co/datasets/linaaaaaaaaaaaaa/web-server-logs.web-attack-detectionThe dataset contains 625,904 attack payload samples, with 294,771 labeled as 1 and 331,129 labeled as 0, including SQL injection, XSS, command injection, and other vulnerabilities.
Website_Traffic_and_Engagementagent-discoverability-ado-score-romania
Agent Discoverability (ADO Score) — Romania, September 2026
130 Romanian domains probed for A2A Agent Cards, MCP discovery, llms.txt, schema.org and Wikidata. Zero Agent Cards; mean ADO Score 17/100. Raw data, scripts and scoring spec, CC BY 4.0.
Canonical study (analysis, charts, interpretation):
Romanian ·
English
What this is
On 8 September 2026 a standard-library Python probe (published) requested, for each of 130 domains, the homepage without JavaScript… See the full description on the dataset page: https://huggingface.co/datasets/WebSEM-ai/agent-discoverability-ado-score-romania.ai-search-visibility-romania-electronics-market
AI Search Visibility — Romania's Electronics & IT Market (August 2026)
18 brand-free purchase questions × 5 AI engines = 87 answers. 86 of them name a major retailer. Position, not presence, decides the market. Raw data CC BY 4.0.
Canonical study (analysis, charts, interpretation):
Romanian ·
English
What this is
Eighteen real purchase questions were put to ChatGPT, Google Gemini, Perplexity, Google AI Mode and Google AI Overviews, in Romanian, from Romania, in… See the full description on the dataset page: https://huggingface.co/datasets/WebSEM-ai/ai-search-visibility-romania-electronics-market.COVID-19-conspiracy-theories-annotated-tweets
Dataset Card for Dataset Name
The dataset includes approximately 54,000 tweet IDs collected through the Twitter API between November 2019 and December 2021, along with annotations indicating whether a tweet supports a particular conspiracy theory.
Dataset Details
Curated by: Izabela Krysinska
Funded by [optional]: EEA Financial Mechanism 2014–2021. Project registration number: 2019/35/J/HS6/03498
Shared by [optional]: Izabela Krysinska
Language(s) (NLP): English… See the full description on the dataset page: https://huggingface.co/datasets/webimmunization/COVID-19-conspiracy-theories-annotated-tweets.indonesia-affordable-housing
Indonesia Affordable Housing Dataset
A comprehensive dataset of affordable housing projects across Indonesia, containing detailed information about residential properties, specifications, locations, pricing, and developer data.
Dataset Creator: web3hungry
Dataset ID: web3hungry/indonesia-affordable-housing
License: CC0 1.0
Dataset Overview
This dataset provides extensive data on housing developments throughout Indonesia, covering both subsidized and commercial… See the full description on the dataset page: https://huggingface.co/datasets/web3hungry/indonesia-affordable-housing.uae-website-privacy-compliance-index
UAE Website Privacy Compliance Index (October 2026)
Aggregate results of a consent and tracking scan of the homepages of 547 UAE business websites on .ae domains (476 business websites, 71 online shops), published by Arqam360 in October 2026.
52% loaded trackers before the visitor made a consent choice.
51% tracked visitors with no consent banner at all.
41% ran Google Analytics or Google Tag Manager without Google Consent Mode v2.
Median compliance score: 40 out of 100 (430… See the full description on the dataset page: https://huggingface.co/datasets/Arqam360/uae-website-privacy-compliance-index.webgpu-compute-benchmarks
WebGPU compute benchmarks across browsers and GPU vendors
Every run submitted to gpubench.dev between 2026-03-30
and 2026-08-14, exported from the live table. WebGPU compute-shader throughput
measured in real browsers on whatever hardware visitors happened to have.
This exists because two preprints cite cross-vendor results from this table and
the table is live and mutable, so those claims could not be checked by a reader.
This snapshot is the checkable version.… See the full description on the dataset page: https://huggingface.co/datasets/abgunaydin/webgpu-compute-benchmarks.lab05-semantic-searchrki-grippe-web-wochenbericht-2026-02-06
RKI GrippeWeb – Daten des Wochenberichts (re-hosted on Hugging Face)
This Hugging Face dataset repository re-hosts a snapshot (2026-02-06) of the public weekly dataset “GrippeWeb – Daten des Wochenberichts” published by the Robert Koch-Institut (RKI) on GitHub under the Creative Commons Attribution 4.0 license:
https://github.com/robert-koch-institut/GrippeWeb_Daten_des_Wochenberichts
No endorsement: This is an independent re-hosting of RKI’s open data. Robert Koch-Institut (RKI)… See the full description on the dataset page: https://huggingface.co/datasets/Ohja-ai/rki-grippe-web-wochenbericht-2026-02-06.ai-visibility-small-business-websites-2026
AI Crawler Visibility and JavaScript Rendering Gaps in Small Business Websites: Dual-Capture Dataset (n=368)
This dataset accompanies the study by Axion Deep Digital measuring how much answer-critical content on small business websites is available to a JavaScript-rendering engine (Google) but absent from a non-rendering AI crawler's direct fetch (GPTBot, ClaudeBot, PerplexityBot).
Method: Each site was captured twice in a single pass, once rendered in headless Chromium with… See the full description on the dataset page: https://huggingface.co/datasets/joshuarg007/ai-visibility-small-business-websites-2026.ai-visibility-romania-luxury-jewelry
AI Visibility — Romania's Luxury Jewelry (July 2026)
We asked ten large language models the same question, word for word. We got
29 different brands across 50 available positions, and no brand appeared in
all ten lists.
Canonical study (analysis, charts, interpretation):
Romanian ·
English
The prompt
Which luxury jewelry brands from Romania do you recommend for wedding bands
and engagement rings? Give me a top 5, with a short argument for each and the
sources you… See the full description on the dataset page: https://huggingface.co/datasets/WebSEM-ai/ai-visibility-romania-luxury-jewelry.DEplain-web-sent
DEplain-web-sent: A corpus for German Sentence Simplification
DEplain-web-sent is a subcorpus of DEplain Stodden et al., 2023 for evaluation of sentence simplification.
The corpus consists of 1846 sentence pairs of 147 parallel documents crawled from the web in standard German and plain German (or easy-to-read German). All documents are either published under an open license, or the copyright holders gave us permission to share the data.
Human annotators sentence-wise aligned the… See the full description on the dataset page: https://huggingface.co/datasets/DEplain/DEplain-web-sent.webvid10m_motion