PEFT
Safetensors

Model Card for Model ID

Model Details

Model Description

  • Developed by: Shinoji Research
  • Funded by [optional]: Shinoji Research
  • Shared by [optional]: [More Information Needed]
  • Model type: [More Information Needed]
  • Language(s) (NLP): [More Information Needed]
  • License: Purely machine generated works are not eligilble for copyright protection. Out of respect for the license of Phi-4, we will only distribute the adapter file (for now).
  • *Finetuned from model NyxKrage/Microsoft_Phi-4:

Model Sources [optional]

Uses

This is a super undertrained preview of Phi-4 trained on PowerInfer/QWQ-LONGCOT-500K dataset , heavily inspired by: https://huggingface.co/PowerInfer/SmallThinker-3B-Preview. It does produce slightly different responses than Phi-base but needs more training.

Assuming nothing goes wrong with the training process, in about 2 weeks we should have a completed version.

Training Details

Training Data

Trained on https://huggingface.co/datasets/PowerInfer/QWQ-LONGCOT-500K

Downloads last month
4
Inference API
Unable to determine this model’s pipeline type. Check the docs .

Model tree for ShinojiResearch/Amadeus-Preview

Adapter
(1)
this model