legraphista
/

RoLlama2-7b-Chat-GGUF

Text Generation

Model card Files Files and versions Community

Edit model card

RoLlama2-7b-Chat-GGUF

This is GGUF quantized version of OpenLLM-Ro/RoLlama2-7b-Chat created using llama.cpp

Downloads last month: 68

GGUF

Model size

6.74B params

Architecture

llama

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Examples

Text Generation

Inference API (serverless) has been turned off for this model.

Model tree for legraphista/RoLlama2-7b-Chat-GGUF

Base model

meta-llama/Llama-2-7b-hf

Finetuned

OpenLLM-Ro/RoLlama2-7b-Base

Finetuned

OpenLLM-Ro/RoLlama2-7b-Chat

Quantized

(3)

this model

Collection including legraphista/RoLlama2-7b-Chat-GGUF

RoLlama2 GGUF

GGUF variants of https://huggingface.co/collections/OpenLLM-Ro/rollama2-664722bbf536ec14701ec81d • 6 items • Updated Aug 5