File size: 1,444 Bytes
bd1d714 187d2b7 bd1d714 187d2b7 bd1d714 187d2b7 bd1d714 187d2b7 bd1d714 187d2b7 bd1d714 187d2b7 bd1d714 187d2b7 bd1d714 187d2b7 bd1d714 187d2b7 bd1d714 187d2b7 bd1d714 187d2b7 bd1d714 187d2b7 bd1d714 187d2b7 bd1d714 187d2b7 bd1d714 187d2b7 bd1d714 187d2b7 bd1d714 187d2b7 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 |
---
license: cc-by-nc-4.0
base_model: jaigouk/tachikoma-v1
tags:
- generated_from_trainer
model-index:
- name: tachikoma-v1
results: []
---
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
# tachikoma-v1
<img src="https://s3.eu-central-1.amazonaws.com/files.jaigouk.com/tachikoma2.png"/>
This model is a fine-tuned version of [jaigouk/tachikoma-v1](https://huggingface.co/jaigouk/tachikoma-v1) on an unknown dataset.
## Model description
- intention is to use this with system message for generating ruby codes
## Intended uses & limitations
- writing rspec / ruby codes
- https://ollama.ai/jaigouk/tachikoma
## Training and evaluation data
- https://huggingface.co/datasets/jaigouk/coding-dataset
- https://huggingface.co/datasets/Nan-Do/instructional_code-search-net-ruby
## Training procedure
### Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 16
- eval_batch_size: 16
- seed: 42
- gradient_accumulation_steps: 4
- total_train_batch_size: 64
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: constant
- lr_scheduler_warmup_steps: 1
- num_epochs: 1
### Training results
### Framework versions
- Transformers 4.35.0
- Pytorch 2.1.0+cu118
- Datasets 2.14.5
- Tokenizers 0.14.1
|