|
--- |
|
base_model: STEM-AI-mtl/phi-2-electrical-engineering |
|
datasets: |
|
- STEM-AI-mtl/Electrical-engineering |
|
- garage-bAInd/Open-Platypus |
|
inference: false |
|
language: |
|
- en |
|
license: other |
|
license_link: LICENSE |
|
license_name: stem.ai.mtl |
|
model_creator: mod |
|
model_name: Phi 2 Electrical Engineering |
|
model_type: phi-msft |
|
prompt_template: '{prompt} |
|
' |
|
quantized_by: TheBloke |
|
llamafile coverted by : Shaikat |
|
tags: |
|
- phi-2 |
|
- electrical engineering |
|
- Microsoft |
|
--- |
|
This repo contains llamafile version for Phi 2 Electrical Engineering model. This llamafile is created from gguf format of original model's quantized version. |
|
|
|
# About llamafile |
|
|
|
llamafile is the new framework that collapses all the complexity of (large language models) LLMs down to a single-file executable (called a "llamafile") that runs locally on most computers, with no installation. The first release of llamafile is a product of Mozilla’s innovation group and developed by [Justine Tunney](https://justine.lol/), about llamafile in short as per [introductory post](https://hacks.mozilla.org/2023/11/introducing-llamafile/) |
|
|
|
**llamafile lets you turn large language model (LLM) weights into executables.** |
|
|
|
**Say you have a set of LLM weights in the form of a 4GB file (in the commonly-used GGUF format). With llamafile you can transform that 4GB file into a binary that runs on six OSes without needing to be installed.** |
|
|
|
Basically, llamafile lets anyone distribute and run LLMs with a single file. |
|
|
|
Here in [github](https://github.com/Mozilla-Ocho/llamafile/issues/242#issuecomment-1930700064) you can find how I created llamafile version from gguf version for other model. |
|
|
|
# Model Description |
|
|
|
## [From the original model card ](https://huggingface.co/STEM-AI-mtl/phi-2-electrical-engineering) |
|
|
|
This is the adapters from the LoRa fine-tuning of the phi-2 model from Microsoft. It was trained on the STEM-AI-mtl/Electrical-engineering dataset combined with garage-bAInd/Open-Platypus.** |
|
|
|
**Developed by: STEM.AI** |
|
|
|
Model type: **Q&A and code generation** |
|
|
|
Language(s) (NLP): **English** |
|
|
|
Finetuned from model [optional]: **microsoft/phi-2** |
|
|
|
Direct Use: **Q&A related to electrical engineering, and Kicad software. Creation of Python code in general, and for Kicad's scripting console.** |
|
|
|
**Refer to microsoft/phi-2 model card for recommended prompt format.** |
|
|
|
## GGUF version |
|
|
|
The original model was quantized by the [ Great Mr. Bloke](https://huggingface.co/TheBloke/phi-2-electrical-engineering-GGUF). |
|
|
|
|
|
As per TheBloke's model card the recommended model phi-2-electrical-engineering.Q5_K_M.gguf quantized with Q5_K_M method this gguf file can take maximum 4.50 GB of RAM. |
|
|
|
# How to run |
|
|
|
To run llamafile version in windows just rename the file by adding .exe at the last and run it as you run any other exe file. |
|
|
|
For running in linux run like any binary in linux, just make sure the llamafile is executable by running chmod. |
|
|
|
Thats it. |
|
|
|
# Prompt format |
|
|
|
``` |
|
Instruction: <prompt> (without the <>) |
|
|
|
Response: |
|
``` |
|
|
|
Thank you for using this model. |
|
|
|
|
