sigridjineth
commited on
Commit
•
5ef3b2e
1
Parent(s):
2eebe7b
Update README.md
Browse files
README.md
CHANGED
@@ -91,62 +91,6 @@ SentenceTransformer(
|
|
91 |
)
|
92 |
```
|
93 |
|
94 |
-
## Usage
|
95 |
-
|
96 |
-
### Direct Usage (Sentence Transformers)
|
97 |
-
|
98 |
-
First install the Sentence Transformers library:
|
99 |
-
|
100 |
-
```bash
|
101 |
-
pip install -U sentence-transformers
|
102 |
-
```
|
103 |
-
|
104 |
-
Then you can load this model and run inference.
|
105 |
-
```python
|
106 |
-
from sentence_transformers import SentenceTransformer
|
107 |
-
|
108 |
-
# Download from the 🤗 Hub
|
109 |
-
model = SentenceTransformer("sentence_transformers_model_id")
|
110 |
-
# Run inference
|
111 |
-
sentences = [
|
112 |
-
'한 소녀가 자전거를 타고 있고 모든 사람들이 도시에서 그녀에게 달려들고 있다.',
|
113 |
-
'소녀가 자전거를 타고 있다.',
|
114 |
-
'소녀는 자전거를 탄다',
|
115 |
-
]
|
116 |
-
embeddings = model.encode(sentences)
|
117 |
-
print(embeddings.shape)
|
118 |
-
# [3, 1024]
|
119 |
-
|
120 |
-
# Get the similarity scores for the embeddings
|
121 |
-
similarities = model.similarity(embeddings, embeddings)
|
122 |
-
print(similarities.shape)
|
123 |
-
# [3, 3]
|
124 |
-
```
|
125 |
-
|
126 |
-
<!--
|
127 |
-
### Direct Usage (Transformers)
|
128 |
-
|
129 |
-
<details><summary>Click to see the direct usage in Transformers</summary>
|
130 |
-
|
131 |
-
</details>
|
132 |
-
-->
|
133 |
-
|
134 |
-
<!--
|
135 |
-
### Downstream Usage (Sentence Transformers)
|
136 |
-
|
137 |
-
You can finetune this model on your own dataset.
|
138 |
-
|
139 |
-
<details><summary>Click to expand</summary>
|
140 |
-
|
141 |
-
</details>
|
142 |
-
-->
|
143 |
-
|
144 |
-
<!--
|
145 |
-
### Out-of-Scope Use
|
146 |
-
|
147 |
-
*List how the model may foreseeably be misused and address what users ought not to do with the model.*
|
148 |
-
-->
|
149 |
-
|
150 |
## Evaluation
|
151 |
|
152 |
### Metrics
|
@@ -155,13 +99,12 @@ You can finetune this model on your own dataset.
|
|
155 |
|
156 |
| Metrics | sigridjineth/ModernBERT-korean-large-preview | Alibaba-NLP/gte-multilingual-base | answerdotai/ModernBERT-large |
|
157 |
|------|----------------------------------------------|-----------------------------------|------------------------------|
|
158 |
-
|
|
159 |
| **Recall@10** | 0.87719 | 0.93860 | 0.0 |
|
160 |
| **Precision@1** | 0.57018 | 0.59649 | 0.0 |
|
161 |
| **NDCG@100** | 0.74543 | 0.78411 | 0.01565 |
|
162 |
| **Recall@100** | 0.98246 | 1.0 | 0.09649 |
|
163 |
| **Recall@1000** | 1.0 | 1.0 | 1.0 |
|
164 |
-
| **실행 시간 (초)** | 47.7 | 9.6 | 46.7 |
|
165 |
|
166 |
#### Triplet
|
167 |
|
|
|
91 |
)
|
92 |
```
|
93 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
94 |
## Evaluation
|
95 |
|
96 |
### Metrics
|
|
|
99 |
|
100 |
| Metrics | sigridjineth/ModernBERT-korean-large-preview | Alibaba-NLP/gte-multilingual-base | answerdotai/ModernBERT-large |
|
101 |
|------|----------------------------------------------|-----------------------------------|------------------------------|
|
102 |
+
| **NDCG@10** | 0.72503 | 0.77108 | 0.0 |
|
103 |
| **Recall@10** | 0.87719 | 0.93860 | 0.0 |
|
104 |
| **Precision@1** | 0.57018 | 0.59649 | 0.0 |
|
105 |
| **NDCG@100** | 0.74543 | 0.78411 | 0.01565 |
|
106 |
| **Recall@100** | 0.98246 | 1.0 | 0.09649 |
|
107 |
| **Recall@1000** | 1.0 | 1.0 | 1.0 |
|
|
|
108 |
|
109 |
#### Triplet
|
110 |
|