File size: 1,141 Bytes
4c47348 56d37a4 4c47348 56d37a4 4c47348 56d37a4 4c47348 56d37a4 4c47348 56d37a4 4c47348 82e0513 4c47348 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 |
---
license: apache-2.0
datasets:
- projectlosangeles/Monster-MIDI-Dataset
language:
- en
base_model:
- skytnt/midi-model
tags:
- music
- llama
- music llama
- midi
- music ai
---
# Music Llama Medium
## Llama for MIDI music generation
***
## Model Details
### Model Description
- **Developed by:** SkyTNT
- **Trained by:** asigalov61
- **Model type:** Llama Transformer
- **License:** apache-2.0
### Model Sources
- **Code Repository:** https://github.com/SkyTNT/midi-model
- **Demo:** https://huggingface.co/spaces/skytnt/midi-composer
## Training Details
### Training Data
- [projectlosangeles/Monster-MIDI-Dataset](https://huggingface.co/datasets/projectlosangeles/Monster-MIDI-Dataset)
- [SymphonyNet MIDI Dataset](https://symphonynet.github.io/)
#### Training Hyperparameters
- config: tv2o-medium
- max-len: 4096
- layers: 12
- acc-grad: 8
- lr: 1e-4
- weight-decay: 0.01
- batch: 8x2x8
- bf16 mixed precision
#### Loss
- train loss: 0.2
***
### Project Los Angeles
### Tegridy Code 2024 |