Base Model - SOLAR-10.7B

This model is the base model implementation of SOLAR-10.7B. The architecture of base model is Llama2 architecture and initialized with weights of Mistral.

Please check specific details in the GitHub Repository.

GitHub Repository: https://github.com/gauss5930/iDUS

🏆 HuggingFace Open LLM Leaderboard

Model	ARC	HellaSwag	MMLU	TruthfulQA	Winogrande	GSM8K	Average
Llama2_init_Mistral	60.07	83.3	64.09	42.15	78.37	37.91	60.98

Downloads last month: 713

Safetensors

Model size

7.24B params

Tensor type

FP16

Inference Examples

Text Generation

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Spaces using Cartinoe5930/Llama2_init_Mistral 5

Collection including Cartinoe5930/Llama2_init_Mistral

iDUS

Collection

4 items • Updated Jan 19