Shuu12121/CodeSearch-ModernBERT-Owl-Plus

🦉 CodeSearch-ModernBERT-Owl-Plus: High-Performance Sentence-BERT for Code Search

CodeSearch-ModernBERT-Owl-Plus is a high-performance code search model fine-tuned in a Sentence-BERT architecture, based on the pretrained CodeModernBERT-Owl v1.0.

This model is optimized for function-level search within codebases and natural language queries, achieving state-of-the-art results on the MTEB benchmark.

🛠 Features

• —✅ Fine-tuned in Sentence-BERT format from CodeModernBERT-Owl
• —✅ Supports multiple languages (Python, Java, JavaScript, etc.)
• —✅ Specialized encoder for high-accuracy code search
• —✅ Ideal for multi-stage (dual encoder) retrieval setups
• —✅ Generates rich semantic embeddings for code and queries

📊 Evaluation on MTEB Benchmark

🏆 Main Scores in MTEB

This model achieved the following main scores (based on NDCG\@10):

• —CodeSearchNetRetrieval: main_score = 0.8918
• —COIR-CodeSearchNetRetrieval: main_score = 0.8013

🧪 CodeSearchNetRetrieval (MTEB)

This model achieves strong performance across all ranking metrics and demonstrates balanced retrieval capability.

🧪 COIR-CodeSearchNetRetrieval (MTEB)

Robust and consistent performance is also maintained on the COIR dataset, demonstrating strong generalization.

📥 Usage Example

from sentence_transformers import SentenceTransformer

model = SentenceTransformer("Shuu12121/CodeSearch-ModernBERT-Owl-Plus")
embeddings = model.encode(["binary search function", "def binary_search(arr, target): ..."])

📝 Conclusion

• —✅ An optimized Sentence-BERT model based on CodeModernBERT-Owl
• —✅ Achieves MRR\@10 > 0.87 on MTEB CodeSearchNetRetrieval
• —✅ Ready for integration in production-level code search systems

📜 License

📄 Apache-2.0

📧 Contact

For questions or inquiries, feel free to reach out: 📧 [shun0212114@outlook.jp](mailto:shun0212114@outlook.jp)