Team Ai
Datasetpublic

24jihoward/filesystem-g0

filesystem-g0 — full disk backup Backup of /mnt/filesystem-g0 (Dual Dynamics Models research disk). Phase 1: 2026-09-14/15 (1,424 GB). Phase 2: 2026-10-05/06 (+295 GB, incl. JAM_real_world). 350 units, 1718.6 GB as chunked tar archives under archives/. Naming Archive name = unit path with every / replaced by a single _: Dual-Dynamics-Models/data/task_data -> archives/Dual-Dynamics-Models_data_task_data.tar.part000 MANIFEST.tsv is the authoritative map (unit… See the full description on the dataset page: https://huggingface.co/datasets/24jihoward/filesystem-g0.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes251downloads
Dataset Card

filesystem-g0 — full disk backup

Backup of /mnt/filesystem-g0 (Dual Dynamics Models research disk). Phase 1: 2026-09-14/15 (1,424 GB). Phase 2: 2026-10-05/06 (+295 GB, incl. JAM_real_world).

350 units, 1718.6 GB as chunked tar archives under archives/.

Naming

Archive name = unit path with every / replaced by a single _:

Dual-Dynamics-Models/data/task_data  ->  archives/Dual-Dynamics-Models_data_task_data.tar.part000

MANIFEST.tsv is the authoritative map (unit path, bytes, archive prefix, part count).

Restore

Archive paths inside the tars are relative to /mnt/filesystem-g0.

bash
UNIT=Dual-Dynamics-Models_data_task_data
hf download 24jihoward/filesystem-g0 --repo-type dataset \
   --include "archives/$UNIT.tar.part*" --local-dir /tmp/restore
cd /mnt/filesystem-g0
cat /tmp/restore/archives/$UNIT.tar.part* | tar -xf -

18 of 350 units are multi-part: parts are raw 40 GiB byte slices, so concatenate before extracting (cat …part*). Never extract a part on its own.

Verified

  • —Single-part restore: MD5 of an extracted .mp4 matches the original byte-for-byte.
  • —cat parts | tar -xf roundtrip verified on a multi-part archive.
  • —All non-final parts are exactly 40 GiB; 0 malformed parts across 350 units.

NOT included

  • —miniconda3/ (110 GB) and all .venv/conda-env/site-packages — machine-specific (3,071 files hardcode the conda prefix); rebuild from env/specs/ + requirements.
  • —.git.bak/ (132 GB) — stale git-LFS objects, hash-verified identical to live files.
  • —hf_cache/ (92 GB) — re-downloadable from the Hub.
  • —Duplicate trees: vlac/VLAC_pipeline/Ctrl-World/, VLAC-8b-1epoch/, redundant SVD copies.
  • —Already on HF: libero_tracks_mesh_uniform_rlds, task_data_atm_224_square_center_crop.