|
--- |
|
base_model: sentence-transformers/multi-qa-MiniLM-L6-cos-v1 |
|
datasets: [] |
|
language: [] |
|
library_name: sentence-transformers |
|
pipeline_tag: sentence-similarity |
|
tags: |
|
- sentence-transformers |
|
- sentence-similarity |
|
- feature-extraction |
|
- generated_from_trainer |
|
- dataset_size:211 |
|
- loss:MultipleNegativesRankingLoss |
|
widget: |
|
- source_sentence: How long is the initial period of extra time in the drop-off procedure? |
|
sentences: |
|
- required in drawn matches, the following drop - off procedure is used to determine |
|
a winner. 24. 1. 1 each team will reduce their on - field team to four ( 4 ) players |
|
and within 60 seconds take up a position to restart play from the halfway line, |
|
defending the same end of the field as at the end of play. 24. 1. 2 the drop - |
|
off commences with a tap from the centre of the halfway line by the team that |
|
did not commence the match with possession. 24. 1. 3 the drop - off will commence |
|
with a two ( 2 ) minute period of extra time. 24. 1. 4 should a team be leading |
|
at the expiration of the two ( 2 ) minute period of extra time then that team |
|
will be declared the winner and match complete. 24. 1. 5 should neither team be |
|
leading at the expiration of two ( 2 ) minutes, a signal is given and the match |
|
will pause at the next touch or dead ball. each team will then remove another |
|
player from the field of play. 24. 1. 6 the match will recommence immediately |
|
after the players have left the field at the same place where it paused ( i. e. |
|
the team retains possession at the |
|
- made but must be included in relevant competition, event or tournament conditions |
|
1. 2 line markings should be 4cm in width but must be no less than 2. 5cm. line |
|
markings are to be laid out as shown in appendix 1 - the field of play. sidelines |
|
extend seven ( 7 ) metres beyond the try lines to join the dead ball lines and |
|
define the in - goal areas which measure fifty ( 50 ) metres wide by seven ( 7 |
|
) metres in length. 1. 3 the interchange areas are located no closer than one |
|
( 1 ) metre from each sideline. 1. 4 suitably sized markers, cones or corner posts |
|
of a distinguishing colour and made from safe and pliable material should be positioned |
|
at the intersections of the sideline and halfway line and the sideline and the |
|
try line. 1. 4. 1 markers, cones or corner posts placed on the junction of the |
|
sideline and try line are deemed to be in the field of play. 1. 4. 2 all other |
|
markers or cones are deemed to be out of the field of play. 1. 5 the standard |
|
playing surface is grass. other surfaces including synthetic grass may be used |
|
but shall be subject to nta approved standards. 1. 6 the field of play |
|
- required in drawn matches, the following drop - off procedure is used to determine |
|
a winner. 24. 1. 1 each team will reduce their on - field team to four ( 4 ) players |
|
and within 60 seconds take up a position to restart play from the halfway line, |
|
defending the same end of the field as at the end of play. 24. 1. 2 the drop - |
|
off commences with a tap from the centre of the halfway line by the team that |
|
did not commence the match with possession. 24. 1. 3 the drop - off will commence |
|
with a two ( 2 ) minute period of extra time. 24. 1. 4 should a team be leading |
|
at the expiration of the two ( 2 ) minute period of extra time then that team |
|
will be declared the winner and match complete. 24. 1. 5 should neither team be |
|
leading at the expiration of two ( 2 ) minutes, a signal is given and the match |
|
will pause at the next touch or dead ball. each team will then remove another |
|
player from the field of play. 24. 1. 6 the match will recommence immediately |
|
after the players have left the field at the same place where it paused ( i. e. |
|
the team retains possession at the |
|
- source_sentence: What happens to the touch count if a player from the defending |
|
team deliberately makes contact with the ball in flight, propelling it towards |
|
the defending team's dead ball line and an attacking player drops the ball? |
|
sentences: |
|
- '##s as zero ( 0 ) touch. 12. 2 if a player from the defending team deliberately |
|
makes contact with the ball in flight and the ball is retrieved by an attacking |
|
player, without touching the ground, play continues and the next touch is zero |
|
( 0 ) touch. 12. 3 if a player from the defending team deliberately makes contact |
|
with the ball in flight, propelling it forward and an attacking player, in an |
|
attempt to regain possession, drops the ball, the attacking team retains possession |
|
and the fit playing rules - 5th edition 10 copyright © touch football australia |
|
2020 touch count restarts as zero ( 0 ) touch. 12. 4 if a player from the defending |
|
team deliberately makes contact with the ball in flight, propelling it towards |
|
the defending team ’ s dead ball line and an attacking player, in an attempt to |
|
regain possession drops the ball, a change of possession occurs. 12. 5 if a player |
|
from the defending team unintentionally makes contact with the ball in flight |
|
and the ball goes to ground, a change of possession occurs. 12. 6 if a player |
|
from the defending team unintentionally makes contact with the ball in flight |
|
and the ball is retrieved by an attacking player, play and the touch count continues.' |
|
- made but must be included in relevant competition, event or tournament conditions |
|
1. 2 line markings should be 4cm in width but must be no less than 2. 5cm. line |
|
markings are to be laid out as shown in appendix 1 - the field of play. sidelines |
|
extend seven ( 7 ) metres beyond the try lines to join the dead ball lines and |
|
define the in - goal areas which measure fifty ( 50 ) metres wide by seven ( 7 |
|
) metres in length. 1. 3 the interchange areas are located no closer than one |
|
( 1 ) metre from each sideline. 1. 4 suitably sized markers, cones or corner posts |
|
of a distinguishing colour and made from safe and pliable material should be positioned |
|
at the intersections of the sideline and halfway line and the sideline and the |
|
try line. 1. 4. 1 markers, cones or corner posts placed on the junction of the |
|
sideline and try line are deemed to be in the field of play. 1. 4. 2 all other |
|
markers or cones are deemed to be out of the field of play. 1. 5 the standard |
|
playing surface is grass. other surfaces including synthetic grass may be used |
|
but shall be subject to nta approved standards. 1. 6 the field of play |
|
- ( 4 ) defending players are in an onside position or unless directed to so by |
|
the referee. where the number of players on the field from the defending team |
|
falls below four ( 4 ), all players must be in an onside position for a tap to |
|
be taken unless directed to do so by the referee. ruling = the player will be |
|
directed to return to the mark and to take the tap again. 7. 7 the tap to commence |
|
or recommence play must be performed without delay. ruling = a penalty to the |
|
non - offending team at the centre of the halfway line. 8 match duration 8. 1 |
|
a match is 40 minutes in duration, consisting of two ( 2 ) x 20 minute halves |
|
with a half time break. 8. 1. 1 there is no time off for injury during a match. |
|
8. 2 local competition and tournament conditions may vary the duration of a match. |
|
8. 3 when time expires, play is to continue until the next touch or dead ball |
|
and end of play is signaled by the referee. 8. 3. 1 should a penalty be awarded |
|
during this period, the penalty is to be taken. 8. 4 if a match is abandoned in |
|
any circumstances other than those referred to in |
|
- source_sentence: What happens if an attacking player fails to perform a rollball |
|
on the mark? |
|
sentences: |
|
- 'ball goes to ground, a change of possession occurs. 12. 6 if a player from the |
|
defending team unintentionally makes contact with the ball in flight and the ball |
|
is retrieved by an attacking player, play and the touch count continues. 12. 7 |
|
a player from the attacking team cannot pass the ball into a defending player |
|
intentionally seeking a rebound or a restart of the touch count. ruling = a penalty |
|
to the defending team at the point of the pass. 13 the rollball 13. 1 the attacking |
|
player is to position on the mark, face the opponent ’ s try line, make a genuine |
|
attempt to stand parallel to the sidelines, place the ball on the ground between |
|
the feet in a controlled manner and : 13. 1. 1 step forward over the ball ; or |
|
13. 1. 2 roll the ball back between the feet no more than one ( 1 ) metre ; or |
|
13. 1. 3 pass a foot over the ball. ruling = a change of possession to the defending |
|
team at the point of the infringement. 13. 2 a player must perform the rollball |
|
on the mark. ruling = a penalty to the defending team at the point of the infringement. |
|
13. 3 a player must not perform a voluntary rollball' |
|
- dead ball and end of play is signaled by the referee. 8. 3. 1 should a penalty |
|
be awarded during this period, the penalty is to be taken. 8. 4 if a match is |
|
abandoned in any circumstances other than those referred to in clause 24. 1. 6 |
|
the nta or nta competition provider in its sole discretion shall determine the |
|
result of the match. 9 possession 9. 1 the team with the ball is entitled to six |
|
( 6 ) touches prior to a change of possession. 9. 2 on the change of possession |
|
due to an intercept, the first touch will be zero ( 0 ) touch. 9. 3 following |
|
the sixth touch or a loss of possession due to any other means, the ball must |
|
be returned to the mark without delay. ruling = a deliberate delay in the changeover |
|
procedure will result in a penalty awarded to the non - offending team ten ( 10 |
|
) metres forward of the mark for the change of possession. 9. 4 if the ball is |
|
dropped or passed and goes to ground during play, a change of possession results. |
|
ruling = the mark for the change of possession is where the ball makes initial |
|
contact with the ground. 9. 5 if the ball, while still under the control of the |
|
half |
|
- ( 7 ) metre line. 10. 7 the half may pass or run with the ball but cannot get |
|
touched while in possession of the ball. ruling = a change of possession occurs |
|
at the point of the touch, or if in - goal the nearest point on the seven ( 7 |
|
) metre line. 10. 8 if a touch is made in the in - goal area before the ball is |
|
grounded, the player in possession is to perform a rollball seven ( 7 ) metres |
|
from the team ’ s attacking try line, provided it is not the sixth touch and the |
|
player is not half. 10. 9 if a player in possession is touched while on or behind |
|
their defending try line, the touch counts and once the referee sets the mark |
|
seven ( 7 ) metres directly forward of the contact point from the defending team |
|
’ s try line, a rollball is performed. 10. 10 if a player in possession intentionally |
|
makes a touch on an offside defender who is making every effort to retire and |
|
remain out of play, the touch counts. fit playing rules - 5th edition copyright |
|
© touch football australia 2020 9 10. 11 if a touch is made on a player in possession |
|
while the player is juggling the ball in an attempt to maintain control of it, |
|
- source_sentence: What is the result of a match if it is abandoned in circumstances |
|
other than those specified in clause 24.1.6? |
|
sentences: |
|
- 'touch football australia 2020 11 13. 5. 5 when possession changes after the half |
|
is touched or when the half places the ball on or over the try line ; or 13. 5. |
|
6 in replacement of a penalty tap ; or 13. 5. 7 when so directed by the referee. |
|
13. 6 a player is to perform a rollball seven ( 7 ) metres in - field under the |
|
following circumstances : 13. 6. 1 when a change of possession takes place due |
|
to a player in possession making contact with the sideline or any ground outside |
|
the field of play, prior to a touch being made ; or 13. 6. 2 when the ball not |
|
in possession of a player makes contact with the sideline or any ground outside |
|
the field of play. 13. 7 a player may not perform a tap in replacement of a rollball. |
|
ruling = the offending team must return to the mark and perform the rollball. |
|
13. 8 an attacking player, other than the player performing the rollball, may |
|
receive the ball at the rollball and shall do so without delay. that player is |
|
referred to as the half. 13. 9 the half may control the ball with a foot prior |
|
to picking up the ball. 13. 10 a player' |
|
- a rollball. half time the break in play between the two halves of a match. imminent |
|
about to occur, it is almost certain to occur. infringement the action of a player |
|
contrary to the rules of the game. in - goal area the area in the field of play |
|
bounded by the sidelines, the try lines and the dead ball lines. there are two |
|
( 2 ), one ( 1 ) at each end of the field of play. see appendix 1. interchange |
|
the act of an on - field player leaving the field of play to be replaced by an |
|
off - field player entering the field of play. interchange area a marked rectangle |
|
for each team on opposite sides of the field of play usually measuring 20 metres |
|
long by no more than five ( 5 ) metres wide, extending ten ( 10 ) metres either |
|
side of the halfway line and not less than one ( 1 ) metre from the sideline. |
|
it is the area in which all off - field players must remain until an interchange |
|
is initiated. see appendix 1. kick strike or propel forcibly with the foot, a |
|
blow or forceful thrust with the foot to the ball. a tap to commence or recommence |
|
play or a penalty tap is not defined as a kick. line markings |
|
- dead ball and end of play is signaled by the referee. 8. 3. 1 should a penalty |
|
be awarded during this period, the penalty is to be taken. 8. 4 if a match is |
|
abandoned in any circumstances other than those referred to in clause 24. 1. 6 |
|
the nta or nta competition provider in its sole discretion shall determine the |
|
result of the match. 9 possession 9. 1 the team with the ball is entitled to six |
|
( 6 ) touches prior to a change of possession. 9. 2 on the change of possession |
|
due to an intercept, the first touch will be zero ( 0 ) touch. 9. 3 following |
|
the sixth touch or a loss of possession due to any other means, the ball must |
|
be returned to the mark without delay. ruling = a deliberate delay in the changeover |
|
procedure will result in a penalty awarded to the non - offending team ten ( 10 |
|
) metres forward of the mark for the change of possession. 9. 4 if the ball is |
|
dropped or passed and goes to ground during play, a change of possession results. |
|
ruling = the mark for the change of possession is where the ball makes initial |
|
contact with the ground. 9. 5 if the ball, while still under the control of the |
|
half |
|
- source_sentence: What is the ruling if an attacking player intentionally passes |
|
the ball to a defending player seeking a rebound or restart of the touch count? |
|
sentences: |
|
- 'ball goes to ground, a change of possession occurs. 12. 6 if a player from the |
|
defending team unintentionally makes contact with the ball in flight and the ball |
|
is retrieved by an attacking player, play and the touch count continues. 12. 7 |
|
a player from the attacking team cannot pass the ball into a defending player |
|
intentionally seeking a rebound or a restart of the touch count. ruling = a penalty |
|
to the defending team at the point of the pass. 13 the rollball 13. 1 the attacking |
|
player is to position on the mark, face the opponent ’ s try line, make a genuine |
|
attempt to stand parallel to the sidelines, place the ball on the ground between |
|
the feet in a controlled manner and : 13. 1. 1 step forward over the ball ; or |
|
13. 1. 2 roll the ball back between the feet no more than one ( 1 ) metre ; or |
|
13. 1. 3 pass a foot over the ball. ruling = a change of possession to the defending |
|
team at the point of the infringement. 13. 2 a player must perform the rollball |
|
on the mark. ruling = a penalty to the defending team at the point of the infringement. |
|
13. 3 a player must not perform a voluntary rollball' |
|
- . see appendix 1. kick strike or propel forcibly with the foot, a blow or forceful |
|
thrust with the foot to the ball. a tap to commence or recommence play or a penalty |
|
tap is not defined as a kick. line markings markings of the field of play. see |
|
appendix 1. link the player beside the wing player. mark ( for a tap ) the centre |
|
of the halfway line for the commencement or recommencement of play, or the position |
|
where a penalty tap is awarded as a result of an infringement. mark ( for a touch |
|
) the position in the field of play where the player in possession was at the |
|
time the touch was made. fit playing rules - 5th edition 2 copyright © touch football |
|
australia 2020 middle the player inside the link player. nta national touch association |
|
as defined in the fit constitution. obstruction a deliberate attempt by either |
|
an attacking or defending player to gain an unfair advantage by interfering with |
|
the opposition to prevent them from gaining a rightful advantage. offside ( attacker |
|
) an attacking player in a position forward of the ball. offside ( defender ) |
|
a defending player in a position closer than seven ( 7 ) metres from the mark |
|
of the rollball ; or ten ( 10 ) metres from the mark |
|
- or passed and goes to ground during play, a change of possession results. ruling |
|
= the mark for the change of possession is where the ball makes initial contact |
|
with the ground. 9. 5 if the ball, while still under the control of the half, |
|
contacts the ground in the in - goal area, possession is lost. ruling = play will |
|
restart with a rollball at the nearest point on the seven ( 7 ) metre line. fit |
|
playing rules - 5th edition 8 copyright © touch football australia 2020 9. 6 if |
|
a player mishandles the ball and even if in an effort to gain control, the ball |
|
is accidentally knocked forward into any other player, a change of possession |
|
results. 10 the touch 10. 1 a touch may be made by either a defending player or |
|
a player in possession. 10. 2 a defending player may not claim a touch if contact |
|
has not been made. if a player claims a touch has been made, but the referee is |
|
unsure the touch will count. ruling = a penalty to the attacking team at the point |
|
of the infringement and the offending player sent to the sin bin. 10. 3 players |
|
of both defending and attacking teams are to use the minimum force necessary to |
|
make a touch. players must ensure that the |
|
--- |
|
|
|
# SentenceTransformer based on sentence-transformers/multi-qa-MiniLM-L6-cos-v1 |
|
|
|
This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [sentence-transformers/multi-qa-MiniLM-L6-cos-v1](https://huggingface.co/sentence-transformers/multi-qa-MiniLM-L6-cos-v1). It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more. |
|
|
|
## Model Details |
|
|
|
### Model Description |
|
- **Model Type:** Sentence Transformer |
|
- **Base model:** [sentence-transformers/multi-qa-MiniLM-L6-cos-v1](https://huggingface.co/sentence-transformers/multi-qa-MiniLM-L6-cos-v1) <!-- at revision 2430568290bb832d22ad5064f44dd86cf0240142 --> |
|
- **Maximum Sequence Length:** 512 tokens |
|
- **Output Dimensionality:** 384 tokens |
|
- **Similarity Function:** Cosine Similarity |
|
<!-- - **Training Dataset:** Unknown --> |
|
<!-- - **Language:** Unknown --> |
|
<!-- - **License:** Unknown --> |
|
|
|
### Model Sources |
|
|
|
- **Documentation:** [Sentence Transformers Documentation](https://sbert.net) |
|
- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers) |
|
- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers) |
|
|
|
### Full Model Architecture |
|
|
|
``` |
|
SentenceTransformer( |
|
(0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel |
|
(1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True}) |
|
(2): Normalize() |
|
) |
|
``` |
|
|
|
## Usage |
|
|
|
### Direct Usage (Sentence Transformers) |
|
|
|
First install the Sentence Transformers library: |
|
|
|
```bash |
|
pip install -U sentence-transformers |
|
``` |
|
|
|
Then you can load this model and run inference. |
|
```python |
|
from sentence_transformers import SentenceTransformer |
|
|
|
# Download from the 🤗 Hub |
|
model = SentenceTransformer("Trelis/multi-qa-MiniLM-L6-cos-v1-ft-pairs-1-epoch") |
|
# Run inference |
|
sentences = [ |
|
'What is the ruling if an attacking player intentionally passes the ball to a defending player seeking a rebound or restart of the touch count?', |
|
'ball goes to ground, a change of possession occurs. 12. 6 if a player from the defending team unintentionally makes contact with the ball in flight and the ball is retrieved by an attacking player, play and the touch count continues. 12. 7 a player from the attacking team cannot pass the ball into a defending player intentionally seeking a rebound or a restart of the touch count. ruling = a penalty to the defending team at the point of the pass. 13 the rollball 13. 1 the attacking player is to position on the mark, face the opponent ’ s try line, make a genuine attempt to stand parallel to the sidelines, place the ball on the ground between the feet in a controlled manner and : 13. 1. 1 step forward over the ball ; or 13. 1. 2 roll the ball back between the feet no more than one ( 1 ) metre ; or 13. 1. 3 pass a foot over the ball. ruling = a change of possession to the defending team at the point of the infringement. 13. 2 a player must perform the rollball on the mark. ruling = a penalty to the defending team at the point of the infringement. 13. 3 a player must not perform a voluntary rollball', |
|
'. see appendix 1. kick strike or propel forcibly with the foot, a blow or forceful thrust with the foot to the ball. a tap to commence or recommence play or a penalty tap is not defined as a kick. line markings markings of the field of play. see appendix 1. link the player beside the wing player. mark ( for a tap ) the centre of the halfway line for the commencement or recommencement of play, or the position where a penalty tap is awarded as a result of an infringement. mark ( for a touch ) the position in the field of play where the player in possession was at the time the touch was made. fit playing rules - 5th edition 2 copyright © touch football australia 2020 middle the player inside the link player. nta national touch association as defined in the fit constitution. obstruction a deliberate attempt by either an attacking or defending player to gain an unfair advantage by interfering with the opposition to prevent them from gaining a rightful advantage. offside ( attacker ) an attacking player in a position forward of the ball. offside ( defender ) a defending player in a position closer than seven ( 7 ) metres from the mark of the rollball ; or ten ( 10 ) metres from the mark', |
|
] |
|
embeddings = model.encode(sentences) |
|
print(embeddings.shape) |
|
# [3, 384] |
|
|
|
# Get the similarity scores for the embeddings |
|
similarities = model.similarity(embeddings, embeddings) |
|
print(similarities.shape) |
|
# [3, 3] |
|
``` |
|
|
|
<!-- |
|
### Direct Usage (Transformers) |
|
|
|
<details><summary>Click to see the direct usage in Transformers</summary> |
|
|
|
</details> |
|
--> |
|
|
|
<!-- |
|
### Downstream Usage (Sentence Transformers) |
|
|
|
You can finetune this model on your own dataset. |
|
|
|
<details><summary>Click to expand</summary> |
|
|
|
</details> |
|
--> |
|
|
|
<!-- |
|
### Out-of-Scope Use |
|
|
|
*List how the model may foreseeably be misused and address what users ought not to do with the model.* |
|
--> |
|
|
|
<!-- |
|
## Bias, Risks and Limitations |
|
|
|
*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.* |
|
--> |
|
|
|
<!-- |
|
### Recommendations |
|
|
|
*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.* |
|
--> |
|
|
|
## Training Details |
|
|
|
### Training Hyperparameters |
|
#### Non-Default Hyperparameters |
|
|
|
- `eval_strategy`: steps |
|
- `per_device_train_batch_size`: 16 |
|
- `per_device_eval_batch_size`: 16 |
|
- `learning_rate`: 0.0001 |
|
- `num_train_epochs`: 1 |
|
- `lr_scheduler_type`: cosine |
|
- `warmup_ratio`: 0.3 |
|
|
|
#### All Hyperparameters |
|
<details><summary>Click to expand</summary> |
|
|
|
- `overwrite_output_dir`: False |
|
- `do_predict`: False |
|
- `eval_strategy`: steps |
|
- `prediction_loss_only`: True |
|
- `per_device_train_batch_size`: 16 |
|
- `per_device_eval_batch_size`: 16 |
|
- `per_gpu_train_batch_size`: None |
|
- `per_gpu_eval_batch_size`: None |
|
- `gradient_accumulation_steps`: 1 |
|
- `eval_accumulation_steps`: None |
|
- `learning_rate`: 0.0001 |
|
- `weight_decay`: 0.0 |
|
- `adam_beta1`: 0.9 |
|
- `adam_beta2`: 0.999 |
|
- `adam_epsilon`: 1e-08 |
|
- `max_grad_norm`: 1.0 |
|
- `num_train_epochs`: 1 |
|
- `max_steps`: -1 |
|
- `lr_scheduler_type`: cosine |
|
- `lr_scheduler_kwargs`: {} |
|
- `warmup_ratio`: 0.3 |
|
- `warmup_steps`: 0 |
|
- `log_level`: passive |
|
- `log_level_replica`: warning |
|
- `log_on_each_node`: True |
|
- `logging_nan_inf_filter`: True |
|
- `save_safetensors`: True |
|
- `save_on_each_node`: False |
|
- `save_only_model`: False |
|
- `restore_callback_states_from_checkpoint`: False |
|
- `no_cuda`: False |
|
- `use_cpu`: False |
|
- `use_mps_device`: False |
|
- `seed`: 42 |
|
- `data_seed`: None |
|
- `jit_mode_eval`: False |
|
- `use_ipex`: False |
|
- `bf16`: False |
|
- `fp16`: False |
|
- `fp16_opt_level`: O1 |
|
- `half_precision_backend`: auto |
|
- `bf16_full_eval`: False |
|
- `fp16_full_eval`: False |
|
- `tf32`: None |
|
- `local_rank`: 0 |
|
- `ddp_backend`: None |
|
- `tpu_num_cores`: None |
|
- `tpu_metrics_debug`: False |
|
- `debug`: [] |
|
- `dataloader_drop_last`: False |
|
- `dataloader_num_workers`: 0 |
|
- `dataloader_prefetch_factor`: None |
|
- `past_index`: -1 |
|
- `disable_tqdm`: False |
|
- `remove_unused_columns`: True |
|
- `label_names`: None |
|
- `load_best_model_at_end`: False |
|
- `ignore_data_skip`: False |
|
- `fsdp`: [] |
|
- `fsdp_min_num_params`: 0 |
|
- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False} |
|
- `fsdp_transformer_layer_cls_to_wrap`: None |
|
- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None} |
|
- `deepspeed`: None |
|
- `label_smoothing_factor`: 0.0 |
|
- `optim`: adamw_torch |
|
- `optim_args`: None |
|
- `adafactor`: False |
|
- `group_by_length`: False |
|
- `length_column_name`: length |
|
- `ddp_find_unused_parameters`: None |
|
- `ddp_bucket_cap_mb`: None |
|
- `ddp_broadcast_buffers`: False |
|
- `dataloader_pin_memory`: True |
|
- `dataloader_persistent_workers`: False |
|
- `skip_memory_metrics`: True |
|
- `use_legacy_prediction_loop`: False |
|
- `push_to_hub`: False |
|
- `resume_from_checkpoint`: None |
|
- `hub_model_id`: None |
|
- `hub_strategy`: every_save |
|
- `hub_private_repo`: False |
|
- `hub_always_push`: False |
|
- `gradient_checkpointing`: False |
|
- `gradient_checkpointing_kwargs`: None |
|
- `include_inputs_for_metrics`: False |
|
- `eval_do_concat_batches`: True |
|
- `fp16_backend`: auto |
|
- `push_to_hub_model_id`: None |
|
- `push_to_hub_organization`: None |
|
- `mp_parameters`: |
|
- `auto_find_batch_size`: False |
|
- `full_determinism`: False |
|
- `torchdynamo`: None |
|
- `ray_scope`: last |
|
- `ddp_timeout`: 1800 |
|
- `torch_compile`: False |
|
- `torch_compile_backend`: None |
|
- `torch_compile_mode`: None |
|
- `dispatch_batches`: None |
|
- `split_batches`: None |
|
- `include_tokens_per_second`: False |
|
- `include_num_input_tokens_seen`: False |
|
- `neftune_noise_alpha`: None |
|
- `optim_target_modules`: None |
|
- `batch_eval_metrics`: False |
|
- `eval_on_start`: False |
|
- `batch_sampler`: batch_sampler |
|
- `multi_dataset_batch_sampler`: proportional |
|
|
|
</details> |
|
|
|
### Training Logs |
|
| Epoch | Step | Training Loss | loss | |
|
|:------:|:----:|:-------------:|:------:| |
|
| 0.1429 | 2 | 1.0897 | 1.2121 | |
|
| 0.2857 | 4 | 1.2773 | 1.0726 | |
|
| 0.4286 | 6 | 1.1082 | 1.0932 | |
|
| 0.5714 | 8 | 1.4353 | 1.0729 | |
|
| 0.7143 | 10 | 1.4442 | 1.0426 | |
|
| 0.8571 | 12 | 1.0593 | 1.0475 | |
|
| 1.0 | 14 | 1.5769 | 1.0494 | |
|
|
|
|
|
### Framework Versions |
|
- Python: 3.10.12 |
|
- Sentence Transformers: 3.0.1 |
|
- Transformers: 4.42.3 |
|
- PyTorch: 2.1.1+cu121 |
|
- Accelerate: 0.31.0 |
|
- Datasets: 2.17.1 |
|
- Tokenizers: 0.19.1 |
|
|
|
## Citation |
|
|
|
### BibTeX |
|
|
|
#### Sentence Transformers |
|
```bibtex |
|
@inproceedings{reimers-2019-sentence-bert, |
|
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks", |
|
author = "Reimers, Nils and Gurevych, Iryna", |
|
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing", |
|
month = "11", |
|
year = "2019", |
|
publisher = "Association for Computational Linguistics", |
|
url = "https://arxiv.org/abs/1908.10084", |
|
} |
|
``` |
|
|
|
#### MultipleNegativesRankingLoss |
|
```bibtex |
|
@misc{henderson2017efficient, |
|
title={Efficient Natural Language Response Suggestion for Smart Reply}, |
|
author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil}, |
|
year={2017}, |
|
eprint={1705.00652}, |
|
archivePrefix={arXiv}, |
|
primaryClass={cs.CL} |
|
} |
|
``` |
|
|
|
<!-- |
|
## Glossary |
|
|
|
*Clearly define terms in order to be accessible across audiences.* |
|
--> |
|
|
|
<!-- |
|
## Model Card Authors |
|
|
|
*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.* |
|
--> |
|
|
|
<!-- |
|
## Model Card Contact |
|
|
|
*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.* |
|
--> |