rubra-ai
/

Phi-3-mini-128k-instruct

Text Generation

function-calling

text-generation-inference

Inference Endpoints

Model card Files Files and versions Metrics Training metrics Community

sanjay920 commited on Jul 9

Commit

522b416

•

1 Parent(s): 193932f

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -67,7 +67,7 @@ The model is the result of further post-training [microsoft/Phi-3-mini-128k-inst
 | Model                              | Function Calling | MMLU  | GPQA  | GSM-8K | MATH  | MT-bench | Win | Loss | Tie | Win Rate | Loss Rate | Adjusted Win Rate |
 |------------------------------------|------------------|-------|-------|--------|-------|----------|-----|------|-----|----------|-----------|-------------------|
-| Phi-3 Mini 128k Instruct  (June)         | -                | - | - | -  | - | -     | -  | -   | -  | -  | -  | -       |
 | Rubra Enhanced Phi-3 Mini 128k Instruct (June) | -           | 67.87 | 29.69 | 79.45  | 30.80 | -     | -  | -   | -  | -  | -   | -           |
 | Phi-3 Mini 128k Instruct  (April)         | -                | 68.17 | 25.90 | 80.44  | 28.12 | 7.92     | 51  | 45   | 64  | 0.31875  | 0.28125   | **0.51875**       |
 | Rubra Enhanced Phi-3 Mini 128k Instruct (April) | 65.71%           | 66.66 | 29.24 | 74.09  | 26.84 | 7.45     | 45  | 51   | 64  | 0.28125  | 0.31875   | 0.48125           |

 | Model                              | Function Calling | MMLU  | GPQA  | GSM-8K | MATH  | MT-bench | Win | Loss | Tie | Win Rate | Loss Rate | Adjusted Win Rate |
 |------------------------------------|------------------|-------|-------|--------|-------|----------|-----|------|-----|----------|-----------|-------------------|
+| Phi-3 Mini 128k Instruct  (June)         | -                | - | 27.01 | -  | 32.92 | -     | -  | -   | -  | -  | -  | -       |
 | Rubra Enhanced Phi-3 Mini 128k Instruct (June) | -           | 67.87 | 29.69 | 79.45  | 30.80 | -     | -  | -   | -  | -  | -   | -           |
 | Phi-3 Mini 128k Instruct  (April)         | -                | 68.17 | 25.90 | 80.44  | 28.12 | 7.92     | 51  | 45   | 64  | 0.31875  | 0.28125   | **0.51875**       |
 | Rubra Enhanced Phi-3 Mini 128k Instruct (April) | 65.71%           | 66.66 | 29.24 | 74.09  | 26.84 | 7.45     | 45  | 51   | 64  | 0.28125  | 0.31875   | 0.48125           |