GGUF
Vietnamese
How to use from the
Use from the
llama-cpp-python library
# !pip install llama-cpp-python

from llama_cpp import Llama

llm = Llama.from_pretrained(
	repo_id="vilm/vinallama-2.7b-chat-GGUF",
	filename="vinallama-2.7b-chat_q5_0.gguf",
)
output = llm(
	"Once upon a time,",
	max_tokens=512,
	echo=True
)
print(output)

VinaLLaMA - State-of-the-art Vietnamese LLMs

image

Read our Paper

Prompt Format (ChatML):

<|im_start|>system
Bạn là một trợ lí AI hữu ích. Hãy trả lời người dùng một cách chính xác.
<|im_end|>
<|im_start|>user
Hello world!<|im_end|>
<|im_start|>assistant
Downloads last month
21
GGUF
Model size
3B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

5-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Space using vilm/vinallama-2.7b-chat-GGUF 1

Collection including vilm/vinallama-2.7b-chat-GGUF

Paper for vilm/vinallama-2.7b-chat-GGUF