Team Ai
20 results

imatrix

eaddario /imatrix-calibration Importance Matrix Calibration Datasets This repository provides calibration datasets used to generate importance matrices (imatrix), which are required to minimize errors when quantizing models with LLaMA C++. The llama-imatrix program cannot handle parquet files directly and thus requires them to be converted into text format first. There are many ways to do this but a simple approach is to use DuckDB with the following command: duckdb -noheader -ascii -c "SELECT content FROM… See the full description on the dataset page: https://huggingface.co/datasets/eaddario/imatrix-calibration.texttext-generationn<1K68 likes7.5k downloads5mo agoHugging Facegabriellarson /imatrix-storage1 likes2.8k downloads1y agoHugging FaceThireus /imatrix0 likes1.7k downloads2mo agoHugging Facefroggeric /imatrix Input files for generating the Importance Matrix Which file to use for generating the importance matrix Not all importance matrices are equal. The best results are obtained when using a source file similar to the training data. Size also matters: the bigger the model (eg: 70b vs 13b) and the higher the quant (eg: q6k_ vs iq3_xs), the bigger the source file needs to be to make an impact. Multiple input files can be combined if needed; for example: cat multilingual.txt… See the full description on the dataset page: https://huggingface.co/datasets/froggeric/imatrix.text10K<n<100K17 likes271 downloads2y agoHugging Facemagiccodingman /QwQ-32B-abliterated-131k-GGUF-Yarn-Imatrix QwQ-32B-Abliterated-131k-GGUF-Yarn-Imatrix High-Fidelity Semantic Simulation & Orchestration AI Model Will this pass the random stupid benchmarks that exist today? I don't know, nor care. I don't need my local AI model to know some random city capital of a foreign country. I need a local AI model that can simulate with high semantic fidelity. Why? Because your AI may be able to spit random facts. I want an AI that knows when to Google facts. I want an AI that tracks hundreds of… See the full description on the dataset page: https://huggingface.co/datasets/magiccodingman/QwQ-32B-abliterated-131k-GGUF-Yarn-Imatrix.10M<n<100M17 likes236 downloads1y agoHugging Facelemon07r /bartowski-imatrix-v5-semantic Bartowski iMatrix Calibration v5 (Semantic Chunking) A processed version of bartowski's v5 imatrix calibration data using semantic boundary detection optimized for the v5 data structure. Dataset Summary Metric Value Total samples 2,075 Chunking method V5-optimized semantic boundary detection Chunk size 200+ characters (no upper limit, preserves document integrity) Languages English, German, Spanish, French, Italian, Swedish, Russian, Arabic, Chinese… See the full description on the dataset page: https://huggingface.co/datasets/lemon07r/bartowski-imatrix-v5-semantic.texttext-generation1K<n<10K9 likes129 downloads8mo agoHugging Face