Team Ai
Modelpublic

OEvortex/HelpingAI-Lite-1.5T

sourceHugging Faceotherupdated 3y agoView on Hugging Face
2likes69downloads
Model Card

๐ŸŒŸ HelpingAI-Lite-1.5T Model Card ๐ŸŒŸ

๐Ÿ“Š Datasets used:

  • โ€”cerebras/SlimPajama-627B
  • โ€”HuggingFaceH4/ultrachat_200k
  • โ€”bigcode/starcoderdata
  • โ€”HuggingFaceH4/ultrafeedback_binarized
  • โ€”OEvortex/vortex-mini
  • โ€”Open-Orca/OpenOrca

๐Ÿ—ฃ๏ธ Language:

  • โ€”English (en)

๐Ÿ”’ License:

HelpingAI Simplified Universal License (HSUL)

๐Ÿง  Model Overview: HelpingAI-Lite-1.5T is an advanced version of the HelpingAI-Lite model, trained on a vast corpus of 1.5 trillion tokens. This extensive training data enables the model to provide precise and insightful responses, particularly for coding tasks.

๐Ÿ”ง Usage Example:

python
from transformers import pipeline
from accelerate import Accelerator

# Initialize the accelerator
accelerator = Accelerator()

# Initialize the pipeline
pipe = pipeline("text-generation", model="OEvortex/HelpingAI-Lite-1.5T", device=accelerator.device)

# Define the messages
messages = [
    {
        "role": "system",
        "content": "You are a chatbot who can be a teacher",
    },
    {
        "role": "user",
        "content": "Explain me working of AI.",
    },
]

# Prepare the prompt
prompt = pipe.tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)

# Generate predictions
outputs = pipe(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)

# Print the generated text
print(outputs[0]["generated_text"])