kmfoda/bittensor_lmeh_evaluations

Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference

HF LLM Leaderboard Evluation Scripts for Bittensor Validatos

Install LM-Eval

git clone https://github.com/EleutherAI/lm-evaluation-harness
cd lm-evaluation-harness
pip install -e .

Running Evaluations on Bittensor's Validator

python3 eval_bittensor.py --validator opentensor_foundation

Running Evaluations on Bittensor's Validator

export BITAPAI_KEY = XXXX
python3 eval_bittensor.py --validator tasostats