adding in venv creation for gpu tutorial
Browse files
README.md
CHANGED
@@ -92,6 +92,14 @@ The inference code to run the model can be found our [github repo](https://githu
|
|
92 |
|
93 |
[This tutorial](https://github.com/huggingface/transformers-bloom-inference) from Huggingface will be the base layer for running our model. The tutorial is intended for BLOOM; however, since our model is based off of BLOOM we can repurpose it.
|
94 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
95 |
For setup instructions follow the Huggingface tutorial.
|
96 |
|
97 |
NOTE: Things that we had to modify in order for BLOOMChat to work:
|
|
|
92 |
|
93 |
[This tutorial](https://github.com/huggingface/transformers-bloom-inference) from Huggingface will be the base layer for running our model. The tutorial is intended for BLOOM; however, since our model is based off of BLOOM we can repurpose it.
|
94 |
|
95 |
+
First create a python virtual environment for these packages
|
96 |
+
|
97 |
+
```
|
98 |
+
python3 -m venv bloomchat_venv
|
99 |
+
source bloomchat_venv/bin/activate
|
100 |
+
pip install --upgrade pip
|
101 |
+
```
|
102 |
+
|
103 |
For setup instructions follow the Huggingface tutorial.
|
104 |
|
105 |
NOTE: Things that we had to modify in order for BLOOMChat to work:
|