mrm8488 commited on
Commit
443db7b
1 Parent(s): 7b1c219

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -2
README.md CHANGED
@@ -136,5 +136,10 @@ instruction = "Dame una lista de lugares a visitar en España."
136
  print(generate(instruction))
137
  ```
138
 
139
- ### Benchmark
140
- Running the model on a *Nvidia T4 with 16GB VRAM*, it takes aprox **0.091 seconds** to generate a token
 
 
 
 
 
 
136
  print(generate(instruction))
137
  ```
138
 
139
+ ### Performance Test
140
+
141
+ After several executions on a *Nvidia T4 with 16GB VRAM*, we got: it takes aprox **0.091 seconds** to generate a token
142
+
143
+ | Latency | GPU Mem |
144
+ ----------|---------|
145
+ |43.36ms/token | 3.83 GB |