AdamLucek
/

llama3-8b-code-sql-slerp

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

AdamLucek commited on Aug 8

Commit

cbd50d3

•

1 Parent(s): 3d4fc34

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -50,9 +50,9 @@ Loading in 8-bit Quantization
 ```python
 from transformers import AutoTokenizer, AutoModelForCausalLM, BitsAndBytesConfig
-tokenizer = AutoTokenizer.from_pretrained("AdamLucek/sql-expert")
 model = AutoModelForCausalLM.from_pretrained(
-    "AdamLucek/sql-expert",
     device_map="cuda",
     quantization_config=BitsAndBytesConfig(load_in_8bit=True)
 )

 ```python
 from transformers import AutoTokenizer, AutoModelForCausalLM, BitsAndBytesConfig
+tokenizer = AutoTokenizer.from_pretrained("AdamLucek/llama3-8b-code-sql-slerp")
 model = AutoModelForCausalLM.from_pretrained(
+    "AdamLucek/llama3-8b-code-sql-slerp",
     device_map="cuda",
     quantization_config=BitsAndBytesConfig(load_in_8bit=True)
 )