Text Generation
GGUF
Inference Endpoints

GGUF version of uproai/ros-7b-v1

Usage

  1. Install llama.cpp
  2. Run model locally
!./llama-cpp -m ../ros-7b-v1.gguf -n 300 -p 'Continue this where it left off, follow the pattern:\nAfter a long day of work, Kanye West goes to his Kanye Nest to take his Kanye Rest. He wakes up feeling his Kanye Best. Then he’ll get Kanye Dressed on his Kanye Vest to go on a Kanye Quest. He goes to church and becomes Kanye Blessed, then to a hotel room to be a Kanye Guest. Then to school to take his Kanye Test. He forgot to brush his teeth. Did he run out of Kanye Crest? His neighbor stole it, what a Kanye Pest.\n' -ngl 32
Downloads last month
6
GGUF
Model size
7.24B params
Architecture
llama
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.

Datasets used to train uproai/ros-7b-v1-gguf