Modelpublic

bralynn/pydevmini1

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face

50likes40downloads

Model Card

🚀 Try It Yourself (for free)

Don't just take my word for it. Test the model right now under the exact conditions shown in the video demonstration.

![Open In Colab](https://colab.research.google.com/drive/1c8WCvsVovCjIyqPcwORX4c_wQ7NyIrTP?usp=sharing)

Model Details

—Model Type: Causal Language Model
—Number of Parameters: 4.0B
—Number of Parameters (Non-Embedding): 3.6B
—Number of Layers: 36
—Number of Attention Heads (GQA): 32 for Q, 8 for KV
—Context Length: 262,144 tokens (native)

Recommended Inference Parameters

For best results, I suggest using the following generation parameters:

—Temperature: 0.7
—Top P: 0.8
—Top K: 20
—Min P: 0.0

How to Contribute & Provide Feedback For any and all feedback, please open a Community discussion tab on this model repository or join our Discord! Discord: https://discord.gg/RqwqMGhqaC