Tuhin20/CodeLlama-7b-Instruct-FineTuned-JavaPython
0102
๐ง CodeLlama-7B-Instruct Fine-Tuned on Java + Python
This model is a fine-tuned version of codellama/CodeLlama-7b-Instruct-hf, trained using Unsloth on a curated dataset of 85k Python and Java programming tasks.
โ๏ธ Technical Details
- Framework: Unsloth + TRL SFTTrainer
- Quantization: QLoRA (4-bit, merged into Q4KM GGUF)
- Context length: 2048 tokens
- Base model:
CodeLlama-7b-Instruct-hf
๐งฉ Files
config.jsontokenizer.modelCodeLlama-7b-Instruct-hf.Q4_K_M.gguf
๐ช Example Usage
from unsloth import FastLanguageModel
model, tokenizer = FastLanguageModel.from_pretrained(
"Tuhin20/CodeLlama-7b-Instruct-FineTuned-JavaPython",
load_in_4bit=True,
device_map="auto",
)
prompt = "Write a Java function to reverse a linked list."
inputs = tokenizer(prompt, return_tensors="pt").to("cuda")
outputs = model.generate(**inputs, max_new_tokens=300)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))Trained and uploaded by Tuhin20
