alantcoding/TranscriptAnalyzer-Open-7B

1---2base_model:3- NousResearch/Hermes-2-Pro-Mistral-7B4- teknium/OpenHermes-2.5-Mistral-7B5tags:6- merge7- mergekit8- lazymergekit9- NousResearch/Hermes-2-Pro-Mistral-7B10- teknium/OpenHermes-2.5-Mistral-7B11---12 13# TranscriptAnalyzer-Open-7B14 15TranscriptAnalyzer-Open-7B is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):16* [NousResearch/Hermes-2-Pro-Mistral-7B](https://huggingface.co/NousResearch/Hermes-2-Pro-Mistral-7B)17* [teknium/OpenHermes-2.5-Mistral-7B](https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B)18 19## 🧩 Configuration20 21```yaml22base_model: teknium/OpenHermes-2.5-Mistral-7B23dtype: float1624merge_method: dare_ties25parameters:26  density: 0.627 28slices:29  - sources:30    - model: NousResearch/Hermes-2-Pro-Mistral-7B31      layer_range: [0, 32]32      parameters:33        weight: 0.6534        density: 0.735    - model: teknium/OpenHermes-2.5-Mistral-7B36      layer_range: [0, 32]  37      parameters:38        weight: 0.3539        density: 0.640```41 42## 💻 Usage43 44```python45!pip install -qU transformers accelerate46 47from transformers import AutoTokenizer48import transformers49import torch50 51model = "alantcoding/TranscriptAnalyzer-Open-7B"52messages = [{"role": "user", "content": "What is a large language model?"}]53 54tokenizer = AutoTokenizer.from_pretrained(model)55prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)56pipeline = transformers.pipeline(57    "text-generation",58    model=model,59    torch_dtype=torch.float16,60    device_map="auto",61)62 63outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)64print(outputs[0]["generated_text"])65```