Spaces:
Sleeping
Sleeping
File size: 3,517 Bytes
bca5262 dbc802e bca5262 dbc802e bca5262 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 |
# TensorLM - webui for LLM models
*This is Fooocus from the world of Stable Difusion in the world of Text Generation, the same ease of use and the same convenience.*
This is simple and modern [Gradio](https://gradio.app) webui for LLM models GGML format (.bin) based on LLaMA.
---
Navigation: \
[**Installing**](#installing) \
[**Presets**](#presets) \
[**Model downloading**](#model-downloading) \
[**Args**](#args)
---
## Fast use
You can use this webui in cloud service Colab: <a target="_blank" href="https://colab.research.google.com/github/ehristoforu/TensorLM-webui/blob/dev/assets/TensorLM_colab.ipynb">
<img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"/>
</a>
## Features
- Simple to use
- Comfy to work
- Not demanding on resources
- Beautiful and pleasant interface
## Installing
### In Windows
[**>>> Portable one-click packege <<<**](https://github.com/ehristoforu/TensorLM-webui/releases/download/latest/latest_TensorLM_portable_win64.7z)
Step-by-step installation:
1. Install [Python 3.10.6](https://www.python.org/ftp/python/3.10.6/python-3.10.6-amd64.exe) and [Git](https://github.com/git-for-windows/git/releases/download/v2.44.0.windows.1/Git-2.44.0-64-bit.exe)
2. Run ```git clone https://github.com/ehristoforu/TensorLM-webui.git```
3. Run ```cd TensorLM-webui```
4. Run ```update_mode.bat``` && enter 1 and 2
5. Run ```start.bat```
### In MacOS
Step-by-step installation:
1. Install [Python 3.10.6](https://www.python.org/ftp/python/3.10.6/python-3.10.6-macos11.pkg) and [Git](https://git-scm.com/download/mac)
2. Run ```git clone https://github.com/ehristoforu/TensorLM-webui.git```
3. Run ```cd TensorLM-webui```
4. Run ```python pip install -r requirements.txt```
5. Run ```python webui.py```
### In Linux
Step-by-step installation:
1. Install [Python 3.10.6](https://www.python.org/downloads/release/python-3106/) and [Git](https://git-scm.com/download/linux)
2. Run ```git clone https://github.com/ehristoforu/TensorLM-webui.git```
3. Run ```cd TensorLM-webui```
4. Run ```python pip install -r requirements.txt```
5. Run ```python webui.py```
## Presets
In this app there is 23 default presets. \
*Thanks, [@mustvlad](https://github.com/mustvlad/ChatGPT-System-Prompts) for system prompts!*
You can create your custom presets, instruction in ```presets``` folder (it is .md-file).
## Model downloading
With this interface you don't need to scour the Internet looking for a compatible model; in the "Tabs" checkbox and in the "ModelGet" tab you can choose which model to download from our verified repository on HuggingFace.
## Args
*To use args*:
- In Windows: edit start.bat with Notepad and edit line with ```python webui.py``` to ```python webui.py [Your args]```, for ex. ```python webui.py --inbrowser```
- In MacOS & Linux: run ```python webui.py``` with args - ```python webui.py {Your args}```, for ex. ```python webui.py --inbrowser```
### Args list
`--inbrowser --share --lowvram --debug --quiet`
## Forks
While there are no forks 😔, perhaps you will be the first who can significantly improve this application!
## 
## Citation
```bibtex
@software{ehristoforu_TensorLM-webui_2024,
author = {ehristoforu},
month = apr,
title = {{TensorLM-webui}},
url = {https://github.com/ehristoforu/TensorLM-webui},
year = {2024}
}
```
|