Team Ai
Modelpublic

jason1966/CoPaw-Flash-9B-DataAnalyst-LoRA

sourceHugging Faceapache-2.0updated 6mo agoView on Hugging Face
88likes30downloads
Model Card

CoPaw-Flash-9B-DataAnalyst-LoRA

![Demo Video](https://youtu.be/A0WBHV-DzIE?si=sHpjOUuhzjmN43p) [![Showcase](https://img.shields.io/badge/Showcase-29Datasets-blue?style=for-the-badge&logo=google-chrome&logoColor=white)](https://dataanalyst.locoremind.com/) ![Framework](https://github.com/IIIIQIIII/data-analyst) ![vLLM](https://docs.vllm.ai/)

Agentic Data Analyst that autonomously explores, analyzes, and visualizes your datasets.

<p align="center"> <img src="dataanalyst-demo.gif" alt="Data Analyst Demo" width="800"> </p>

What It Does

This model functions as an autonomous data analyst:

  • β€”πŸ“‚ Loads and explores datasets (CSV, Excel, JSON)
  • β€”πŸ” Performs statistical analysis and data profiling
  • β€”πŸ“Š Creates visualizations (matplotlib, seaborn, plotly)
  • β€”πŸ Writes and executes Python analysis scripts
  • β€”πŸ“ Generates summary reports and insights
  • β€”πŸ”„ Iterates through multi-step analysis workflows
  • β€”πŸŽ― Completes 90% of tasks autonomously (no human intervention)

Model Details

PropertyValue
Base Modelagentscope-ai/CoPaw-Flash-9B (Qwen3.5-9B architecture)
Task TypeData Analysis Agent
LoRA Rank64
LoRA Alpha128
Precisionbfloat16
PEFT Version0.18.1

Performance Benchmark

Tested on 29 real Kaggle datasets with Data Analyst framework (max_turns=50, context=128K):

MetricQwen3.5-9B BaseDataAnalyst-LoRAImprovement
Avg iterations1.226.021.7x
Python files0100+∞
Charts generated0290+∞
Total tokens~5K18.5M3700x
Natural completion rate*0%89.7%+89.7pp
Hit turn limitN/A10.3%-
Usable output0/29 (0%)26/29 (90%)+90pp
User interventionRequired every stepAutonomousAutonomous

*Natural completion = Model autonomously outputs final summary report within 50 turns

<p align="center"> <img src="benchmark-chart.png" alt="Performance Benchmark: Base Model vs DataAnalyst-LoRA" width="800"> </p>

Key Findings

Base Model (Qwen3.5-9B):

  • β€”βŒ Understands tool call format but cannot execute autonomously
  • β€”βŒ Stops after 1-2 iterations
  • β€”βŒ Requires continuous user "continue" prompts
  • β€”βŒ Produces zero analysis output
  • β€”βŒ Not usable for real data analysis tasks

CoPaw-Flash-9B-DataAnalyst-LoRA:

  • β€”βœ… Fully autonomous execution (26 iterations average)
  • β€”βœ… Generates complete analysis pipelines
  • β€”βœ… Creates visualizations and reports
  • β€”βœ… 90% success rate on real-world datasets
  • β€”βœ… Production-ready for data analysis workflows

Conclusion: LoRA training is essential, not optional. Base model lacks autonomous data analyst capabilities despite understanding the tool calling format. This LoRA transforms the base model into a production-ready AI data analyst that can handle real-world datasets independently.

Quick Start

Step 1: Deploy with vLLM

bash
export HF_TOKEN=your_huggingface_token

CUDA_VISIBLE_DEVICES=0,1 vllm serve agentscope-ai/QwenPaw-Flash-9B \
  --enable-lora \
  --lora-modules agent-lora=jason1966/CoPaw-Flash-9B-DataAnalyst-LoRA \
  --max-lora-rank 64 \
  --tensor-parallel-size 2 \
  --gpu-memory-utilization 0.85 \
  --max-model-len 131072 \
  --gdn-prefill-backend triton \
  --trust-remote-code \
  --reasoning-parser qwen3 \
  --enable-auto-tool-choice \
  --tool-call-parser qwen3_xml \
  --port 8000

Step 2: Setup Data Analyst Framework

bash
git clone https://github.com/IIIIQIIII/data-analyst.git
cd data-analyst
bun install

Configure .env:

bash
CLAUDE_CODE_USE_OPENAI=1
OPENAI_BASE_URL=http://localhost:8000/v1
OPENAI_API_KEY=unused
OPENAI_MODEL=agent-lora

Step 3: Start Analyzing

bash
bun run start

Then input your analysis task:

Analyze sales_2024.csv and identify trends

The model will autonomously load data, perform analysis, create visualizations, and generate reportsβ€”all without requiring manual "continue" prompts.

vLLM Parameters

ParameterDescription
--enable-loraEnable LoRA adapter support
--lora-modules agent-lora=...Load DataAnalyst-LoRA adapter
--max-lora-rank 64LoRA rank (must match adapter)
--reasoning-parser qwen3Enable reasoning process visibility
--enable-auto-tool-choiceAutomatic tool selection
--tool-call-parser qwen3_xmlParse XML-format tool calls
--gdn-prefill-backend tritonOptimize prefill with Triton

Hardware Requirements

ConfigurationVRAM Required
Dual GPU (bf16, TP=2)~11GB per GPU
Single GPU (bf16)~22GB
8-bit quantized~12GB
4-bit quantized~6GB

Tested: 2x NVIDIA H200, vLLM 0.19.1, CUDA 13.0, Python 3.12

Troubleshooting

IssueSolution
FlashInfer errorsAdd --gdn-prefill-backend triton
Out of memoryReduce --max-model-len or --gpu-memory-utilization
Connection refusedCheck `netstat -tlnp \grep 8000`

Acknowledgments

License

Apache 2.0