Fine tuning this model with Proprietary Code

by vtraghu - opened Apr 17

Apr 17

Hi, I am practically new to fine tuning of LLM models.
I would like to fine tune a code generator model with proprietary code mostly C++ for for embedded system . Can some one confirm

Whether I can use Qwen/CodeQwen1.5-7B-Chat as a base a do PEFT ( LORA) with my custom data set
Does this licencing term of the model allow me to use for commercial purpose.
Any specific data format I have to follow while fine tuning?

Thanks

huybery

Qwen org Apr 19

https://qwen.readthedocs.io/en/latest/training/SFT/llama_factory.html

Hi, you can reference this tutorial.

JustinLin610 changed discussion status to closed Apr 24

gknerr

Jul 3

@vtraghu , Did you make any progress in your tuning of Qwen/CodeQwen1.5-7B-Chat ?

Did you use https://qwen.readthedocs.io/en/latest/training/SFT/llama_factory.html ?

Thanks

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment