Model Card for Model ID
Model Details
Model Description
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
- Developed by: [More Information Needed]
- Funded by [optional]: [More Information Needed]
- Shared by [optional]: [More Information Needed]
- Model type: [More Information Needed]
- Language(s) (NLP): [More Information Needed]
- License: [More Information Needed]
- Finetuned from model [optional]: [More Information Needed]
hf-causal-experimental (pretrained=T3Q-LLM/T3Q-LLM-TE-NLI-Dora4-v1.0,use_accelerate=true,trust_remote_code=true), limit: None, provide_description: False, num_fewshot: 0, batch_size: 8
Task | Version | Metric | Value | Stderr | |
---|---|---|---|---|---|
kobest_boolq | 0 | acc | 0.9544 | ± | 0.0056 |
macro_f1 | 0.9544 | ± | 0.0056 | ||
kobest_copa | 0 | acc | 0.7860 | ± | 0.0130 |
macro_f1 | 0.7856 | ± | 0.0130 | ||
kobest_hellaswag | 0 | acc | 0.5300 | ± | 0.0223 |
acc_norm | 0.5480 | ± | 0.0223 | ||
macro_f1 | 0.5276 | ± | 0.0223 | ||
kobest_sentineg | 0 | acc | 0.8917 | ± | 0.0156 |
macro_f1 | 0.8915 | ± | 0.0157 |
- Downloads last month
- 8
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.