Hugging Face's logo

ruwan
/
open-llama-sharded-1GB-7B-alpaca-vmware

Text Generation
Transformers
PyTorch
llama
text-generation-inference
Inference Endpoints
Model card Files Community

note : use original open llama tokenizer

model_path = 'ruwan/open-llama-sharded-1GB-7B-alpaca-vmware'

tokenizer = LlamaTokenizer.from_pretrained("openlm-research/open_llama_7b") model = LlamaForCausalLM.from_pretrained( model_path, torch_dtype=torch.float16, device_map='auto' )

Downloads last month
1
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.