Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
RLHF-And-Friends
/
RM-sentiment-trl-style-Llama-3.2-1B-Instruct-Q4-LoRA8-Batch-16-Tok-1024
like
0
Follow
RLHF-And-Friends
4
Transformers
Safetensors
trl-internal-testing/sentiment-trl-style
Generated from Trainer
trl
reward-trainer
Inference Endpoints
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
RM-sentiment-trl-style-Llama-3.2-1B-Instruct-Q4-LoRA8-Batch-16-Tok-1024
1 contributor
History:
2 commits
evgurov
End of training
5b9dc1c
verified
14 days ago
.gitattributes
Safe
1.57 kB
End of training
14 days ago
README.md
Safe
2.07 kB
End of training
14 days ago
adapter_config.json
Safe
784 Bytes
End of training
14 days ago
adapter_model.safetensors
Safe
6.84 MB
LFS
End of training
14 days ago
special_tokens_map.json
Safe
322 Bytes
End of training
14 days ago
tokenizer.json
Safe
17.2 MB
LFS
End of training
14 days ago
tokenizer_config.json
Safe
54.8 kB
End of training
14 days ago
training_args.bin
pickle
Detected Pickle imports (10)
"transformers.trainer_utils.IntervalStrategy"
,
"transformers.trainer_utils.HubStrategy"
,
"transformers.trainer_pt_utils.AcceleratorConfig"
,
"accelerate.state.PartialState"
,
"transformers.trainer_utils.SaveStrategy"
,
"accelerate.utils.dataclasses.DistributedType"
,
"trl.trainer.reward_config.RewardConfig"
,
"transformers.trainer_utils.SchedulerType"
,
"transformers.training_args.OptimizerNames"
,
"torch.device"
How to fix it?
5.69 kB
LFS
End of training
14 days ago
