Team Ai
Datasetpublic

Shanmuk4622/E2AM_EfficientNetV2_S

E2AM Ablation Results: EfficientNetV2-S Energy-aware training ablation study for EfficientNetV2-S across three image-classification datasets: CIFAR-10, CIFAR-100, and Tiny-ImageNet. Each dataset has 15 training variants (8 individual-method M0..M7, 7 cumulative ablation C0..C6) at 50 epochs, plus a 5-variant deployment pipeline (FP32 baseline, structured pruning, pruning+finetune, INT8 quantization, pruned+INT8). Status: 45 completed variants, 0 partial. Quick links… See the full description on the dataset page: https://huggingface.co/datasets/Shanmuk4622/E2AM_EfficientNetV2_S.

sourceHugging Faceapache-2.0updated 4mo agoView on Hugging Face
0likes176downloads
Dataset Card

E2AM Ablation Results: EfficientNetV2-S

Energy-aware training ablation study for EfficientNetV2-S across three image-classification datasets: CIFAR-10, CIFAR-100, and Tiny-ImageNet.

Each dataset has 15 training variants (8 individual-method M0..M7, 7 cumulative ablation C0..C6) at 50 epochs, plus a 5-variant deployment pipeline (FP32 baseline, structured pruning, pruning+finetune, INT8 quantization, pruned+INT8).

Status: 45 completed variants, 0 partial.

Quick links

Headline results

DatasetBest variantTop-1Top-5Energy (kWh)CO₂ (kg)Time (sec)
CIFAR-10C5cacheampgradaccumadaptivelr_l10.90400.99770.10060.04784909
CIFAR-100C4cacheampgradaccumadaptivelr0.70960.92510.09540.04534587
Tiny-ImageNetM7fulle2am0.58050.81620.20050.09529683

Cross-dataset comparison

How the same training variants behave across CIFAR-10, CIFAR-100, and Tiny-ImageNet.

Accuracy By Variant Across Datasets

[image]

Energy By Variant Across Datasets

[image]

Per-dataset results

CIFAR-10

M-matrix (individual methods)

VariantEpochsTop-1Top-5Energy (kWh)CO₂ (kg)Time (s)Status
M0baselinefp32500.75650.98390.20800.09889714completed
M1cacheonly500.75820.98510.19630.09329440completed
M2amponly500.80130.99090.09860.04694775completed
M3gradaccum_only500.80360.99030.19550.09289403completed
M4l1sparsity_only500.73940.98370.20970.09969834completed
M5adaptivelr_only500.88410.99690.19630.09339454completed
M6eagonly500.75900.98540.20800.09889713completed
M7fulle2am500.89740.99670.10050.04774847completed

C-matrix (cumulative ablation)

VariantEpochsTop-1Top-5Energy (kWh)CO₂ (kg)Time (s)Status
C0_baseline500.75690.98650.19880.09449591completed
C1_cache500.74720.98620.19850.09439556completed
C2cacheamp500.80680.99130.09880.04694824completed
C3cacheamp_gradaccum500.83450.99370.09880.04694810completed
C4cacheampgradaccumadaptivelr500.89730.99710.09890.04704825completed
C5cacheampgradaccumadaptivelr_l1500.90400.99770.10060.04784909completed
C6fulle2am500.90400.99770.10070.04784915completed

[image]

[image]

[image]

[image]

CIFAR-100

M-matrix (individual methods)

VariantEpochsTop-1Top-5Energy (kWh)CO₂ (kg)Time (s)Status
M0baselinefp32500.39000.71040.19900.09459332completed
M1cacheonly500.41900.74650.19920.09469689completed
M2amponly500.52400.82380.09560.04544608completed
M3gradaccum_only500.54080.83650.19840.09439629completed
M4l1sparsity_only500.43780.76710.20190.09599629completed
M5adaptivelr_only500.59750.86410.19950.09489678completed
M6eagonly500.40100.72810.19990.09509520completed
M7fulle2am500.70900.92540.10250.04874970completed

C-matrix (cumulative ablation)

VariantEpochsTop-1Top-5Energy (kWh)CO₂ (kg)Time (s)Status
C0_baseline500.40750.73590.19990.09509529completed
C1_cache500.45020.77000.19980.09499533completed
C2cacheamp500.54110.84010.09820.04664756completed
C3cacheamp_gradaccum500.61110.87750.09530.04534578completed
C4cacheampgradaccumadaptivelr500.70960.92510.09540.04534587completed
C5cacheampgradaccumadaptivelr_l1500.70160.92050.09680.04604672completed
C6fulle2am500.70170.91910.09990.04754812completed

[image]

[image]

[image]

[image]

Tiny-ImageNet

M-matrix (individual methods)

VariantEpochsTop-1Top-5Energy (kWh)CO₂ (kg)Time (s)Status
M0baselinefp32500.24620.51700.39520.187718949completed
M1cacheonly500.24510.51280.39440.187319008completed
M2amponly500.35410.63050.19370.09209387completed
M3gradaccum_only500.34670.64010.39210.186318791completed
M4l1sparsity_only500.24400.51720.40540.192619502completed
M5adaptivelr_only500.46110.74190.39790.189019208completed
M6eagonly500.26060.54160.39920.189619319completed
M7fulle2am500.58050.81620.20050.09529683completed

C-matrix (cumulative ablation)

VariantEpochsTop-1Top-5Energy (kWh)CO₂ (kg)Time (s)Status
C0_baseline500.24750.51990.41190.195719800completed
C1_cache500.25020.51860.40140.190719312completed
C2cacheamp500.34650.63000.19800.09409633completed
C3cacheamp_gradaccum500.44360.72420.20120.09569766completed
C4cacheampgradaccumadaptivelr500.57380.81620.20260.09639831completed
C5cacheampgradaccumadaptivelr_l1500.57080.81250.20530.09759943completed
C6fulle2am500.57080.81250.20530.09759939completed

[image]

[image]

[image]

[image]

Deployment results

No deployment results in this repo yet.

Methodology

Model: EfficientNetV2-S (~20.2M params).

Training protocol: from scratch, SGD with momentum 0.9, weight decay 5e-4, initial LR 0.1, 50 epochs, 1 warmup epoch. All variants share the same protocol so ablation comparison stays apples-to-apples across the matrix.

Input: native dataset resolution upsampled to 128x128 in-model via nn.Upsample (FX-traceable to keep D3/D4 INT8 quantization possible).

Optimization toggles (the 5 individual methods and their cumulative combinations):

MethodMechanism
Tensor cacheTraining images held in RAM as a normalized float tensor
AMPtorch.cuda.amp.autocast + GradScaler
Grad accum (x2)Accumulate gradients across 2 mini-batches
L1 sparsityLambda * sum(w_i) added to loss with lambda=1e-8
Cosine LRlr(t) = lr_max 0.5 (1 + cos(pi*t/T))
EAG early-stopEnergy-Aware Gain: stop when accuracy gain per joule plateaus

Energy measurement: GPU power sampled at 1 Hz via nvidia-smi --query-gpu=power.draw. Energy = trapezoidal integration over power-vs-time. CO₂ = energy_kWh * 0.475 (global average grid intensity).

Hardware: Single NVIDIA T4 (14.5 GB) on Kaggle.

Repository structure

runs/
  cifar10/
  cifar100/
  tiny_imagenet/
    individual_methods/M0..M7/   (history.csv, metrics_summary.json,
                                  best_model.pt, last_model.pt, config.yaml)
    cumulative_ablation/C0..C6/  (same)
paper_tables/                     (6 unified CSV tables)
comparison_plots/<dataset>/       (per-dataset plots)
comparison_plots/cross_dataset/   (cross-dataset plots)
README.md                         (this file)

Reproducibility

Each variant directory has a config.yaml with the exact configuration used. To reproduce:

  1. 1.huggingface-cli download Shanmuk4622/E2AM_EfficientNetV2_S --repo-type dataset
  2. 2.Load the e2am.py library and call the appropriate config factory
  3. 3.Run e2am.train_one_run(cfg)

Limitations

  • —Energy measurement is GPU-only (via nvidia-smi); CPU/memory power not included
  • —Pruning is mask-based; no wall-clock speedup without sparsity-aware runtime
  • —INT8 (D3/D4) is CPU FX static quantization (fbgemm); may fail on transformer blocks. Failures logged in metrics.json rather than crashing.
  • —Single-T4 reproduction; multi-GPU not validated
  • —SGD@0.1 is suboptimal for some architectures; the paper compares variant-to-variant deltas which remain meaningful regardless

Citation

bibtex
@misc{e2am_ablation_effnetv2s,
  title  = {E2AM: Energy-Aware Adaptive Model Training Ablation Study (EfficientNetV2-S)},
  author = {Shanmuk},
  year   = {2026},
  howpublished = {\url{https://huggingface.co/datasets/Shanmuk4622/E2AM_EfficientNetV2_S}},
}

This README was auto-generated on 2026-06-06 12:40 UTC. Source repo: Shanmuk4622/E2AMEfficientNetV2S