---
base_model: cross-encoder/ms-marco-MiniLM-L-6-v2
datasets: []
language: []
library_name: sentence-transformers
pipeline_tag: sentence-similarity
tags:
- sentence-transformers
- sentence-similarity
- feature-extraction
- generated_from_trainer
- dataset_size:9729
- loss:MultipleNegativesRankingLoss
widget:
- source_sentence: Does the clock stop during the drop-off in Touch Rugby?
sentences:
- 12. 2 if a player from the defending team deliberately makes contact with the
ball in flight and the ball is retrieved by an attacking player, without touching
the ground, play continues and the next touch is zero ( 0 ) touch. 12. 3 if a
player from the defending team deliberately makes contact with the ball in flight,
propelling it forward and an attacking player, in an attempt to regain possession,
drops the ball, the attacking team retains possession and the fit playing rules
- 5th edition 10 copyright © touch football australia 2020 touch count restarts
as zero ( 0 ) touch. 12. 4 if a player from the defending team deliberately makes
contact with the ball in flight, propelling it towards the defending team ’ s
dead ball line and an attacking player, in an attempt to regain possession drops
the ball, a change of possession occurs. 12. 5 if a player from the defending
team unintentionally makes contact with the ball in flight and the ball goes to
ground, a change of possession occurs. 12. 6 if a player from the defending team
unintentionally makes contact with the ball in flight and the ball is retrieved
by an attacking player, play and the touch count continues.
- fit playing rules - 5th edition copyright © touch football australia 2020 9 10.
11 if a touch is made on a player in possession while the player is juggling the
ball in an attempt to maintain control of it, the touch counts if the attacking
player following the touch retains possession. 10. 12 if a player in possession
is touched and subsequently makes contact with either the sideline, a field marker
or the ground outside the field of play, the touch counts and play continues with
a rollball at the mark where the touch occurred. 10. 13 when a player from the
defending team enters its defensive seven metre zone, the defending team must
move forward at a reasonable pace until a touch is imminent or made. ruling =
a penalty to the attacking team at the point of the infringement. 10. 14 when
a player in possession enters the defending teams ’ seven metre zone the defending
team is not obliged to move forward but cannot retire back towards their try line
until a touch is imminent or made. ruling = a penalty to the attacking team at
the seven ( 7 ) metre line in line with the point of the infringement.
- 24. 1. 2 the drop - off commences with a tap from the centre of the halfway line
by the team that did not commence the match with possession. 24. 1. 3 the drop
- off will commence with a two ( 2 ) minute period of extra time. 24. 1. 4 should
a team be leading at the expiration of the two ( 2 ) minute period of extra time
then that team will be declared the winner and match complete. 24. 1. 5 should
neither team be leading at the expiration of two ( 2 ) minutes, a signal is given
and the match will pause at the next touch or dead ball. each team will then remove
another player from the field of play. 24. 1. 6 the match will recommence immediately
after the players have left the field at the same place where it paused ( i. e.
the team retains possession at the designated number of touches, or at change
of possession due to some infringement or the sixth touch ) and the match will
continue until a try is scored. 24. 1. 7 there is no time off during the drop
- off and the clock does not stop at the two ( 2 ) minute interval.
- source_sentence: What happens to the possession of the ball when a player is sent
to the sin bin?
sentences:
- 'fit playing rules - 5th edition copyright © touch football australia 2020 appendix
1 – field of play contents 01 i the field of play 5 02 i player registration 5
03 i the ball 6 04 i playing uniform 6 05 i team composition 6 06 i team coach
and team officials 7 07 i commencement and recommencement of play 7 08 i match
duration 8 09 i possession 8 10 i the touch 9 11 i passing 10 12 i ball touched
in flight 10 13 i the rollball 11 14 i scoring 13 15 i offside 13 16 i obstruction
14 17 i interchange 14 18 i penalty 15 19 i advantage 16 20 i misconduct 16 21
i forced interchange 16 22 i sin bin 16 23 i dismissal 17 24 i drop - off 17 25
i match officials 18 fit playing rules - 5th edition copyright © touch football
australia 2020 fit playing rules - 5th edition copyright © touch football australia
2020 definitions and terminology unless the contrary intention appears, the following
definitions and terminology apply to the game of touch : term / phrase definition
/ description advantage the period of time after an infringement in which the
non - offending side has the opportunity to gain advantage either territorial,
tactical or in the form of a try. attacking try line the line on or over which
a player has to place the ball to score a try.'
- 21 forced interchange 21. 1 where the referee deems it necessary to implement
a forced interchange following an infringement, the referee is to stop the match,
direct the ball to be placed on the mark, advise the offending player of the reason
for the forced interchange, direct that player to return to the interchange area,
display the relevant signal and award a penalty to the non - offending team. 22
sin bin 22. 1 the on - field referee is required to indicate the commencement
and the end of the sin bin time. 22. 2 any player sent to the sin bin must stand
in the sin bin area at the opposition ’ s end of the field of play and on the
same side as their interchange area. 22. 3 any player sent to the sin bin must
return to the interchange area prior to re - entering the field of play. 22. 4
any action that causes the touch count to restart will result in a continuation
of that possession. for the avoidance of doubt, should a defender knock the ball
down or give away a penalty, this does not mean that the possession has been completed,
but rather the possession continues.
- 10. 8 if a touch is made in the in - goal area before the ball is grounded, the
player in possession is to perform a rollball seven ( 7 ) metres from the team
’ s attacking try line, provided it is not the sixth touch and the player is not
half. 10. 9 if a player in possession is touched while on or behind their defending
try line, the touch counts and once the referee sets the mark seven ( 7 ) metres
directly forward of the contact point from the defending team ’ s try line, a
rollball is performed. 10. 10 if a player in possession intentionally makes a
touch on an offside defender who is making every effort to retire and remain out
of play, the touch counts. fit playing rules - 5th edition copyright © touch football
australia 2020 9 10. 11 if a touch is made on a player in possession while the
player is juggling the ball in an attempt to maintain control of it, the touch
counts if the attacking player following the touch retains possession.
- source_sentence: Under what circumstances is a penalty try awarded in Touch Rugby?
sentences:
- 13. 14 after a touch is made between the dead ball line and the seven ( 7 ) metre
line, an attacking team is permitted to rollball on the seven ( 7 ) metre line
at a point directly in line with where the touch was made. fit playing rules -
5th edition 12 copyright © touch football australia 2020 14 scoring 14. 1 a try
is worth one ( 1 ) point. 14. 2 a try is awarded when a player, other than the
half, places the ball on or over the try line without being touched. 14. 3 in
attempting to score a try, a player must have control of the ball prior to placing
it on or over the try line. 14. 4 if a player places the ball on the ground and
releases it short of the try line while attempting to score a try, the player
is required to perform a rollball to restart play and a touch is counted. if a
player does not release the ball from their hands, the match continues and no
touch is counted. 14. 5 at the end of play the team that has scored the most tries
is declared the winner.
- fit playing rules - 5th edition 8 copyright © touch football australia 2020 9.
6 if a player mishandles the ball and even if in an effort to gain control, the
ball is accidentally knocked forward into any other player, a change of possession
results. 10 the touch 10. 1 a touch may be made by either a defending player or
a player in possession. 10. 2 a defending player may not claim a touch if contact
has not been made. if a player claims a touch has been made, but the referee is
unsure the touch will count. ruling = a penalty to the attacking team at the point
of the infringement and the offending player sent to the sin bin. 10. 3 players
of both defending and attacking teams are to use the minimum force necessary to
make a touch. players must ensure that the method employed in making a touch does
not pose an unnecessary risk to player safety. ruling = a penalty to the non -
offending team at the point of the infringement. 10. 4 if the ball is accidentally
knocked from the hands of a player in possession during a touch, the touch counts
and the attacking team retains possession.
- 18. 7 a player may perform a rollball instead of a penalty tap and the player
who receives the ball does not become the half. 18. 8 if the defending team is
penalised three ( 3 ) times upon entering their seven metre zone during a single
possession, the last offending player will be given an exclusion until the end
of that possession. 18. 9 a penalty try is awarded if any action by a player,
team official or spectator, deemed by the referee to be contrary to the rules
or spirit of the game clearly prevents the attacking team from scoring a try.
fit playing rules - 5th edition copyright © touch football australia 2020 15 19
advantage 19. 1 where a defending team player is offside at a tap or rollball
and attempts to interfere with play, the referee will allow advantage or award
a penalty, whichever is of greater advantage to the attacking team. 19. 2 should
the attacking team in the act of taking the advantage subsequently infringe, the
ruling on the initial infringement will apply.
- source_sentence: What is the maximum distance the ball can move after a tap in Touch
Rugby?
sentences:
- tap and tap penalty the method of commencing the match, recommencing the match
after half time and after a try has been scored. the tap is also the method of
recommencing play when a penalty is awarded. the tap is taken by placing the ball
on the ground at or behind the mark, releasing both hands from the ball, tapping
the ball gently with either foot or touching the foot on the ball. the ball must
not roll or move more than one ( 1 ) metre in any direction and must be retrieved
cleanly, without touching the ground again. the player may face any direction
and use either foot. provided it is at the mark, the ball does not have to be
lifted from the ground prior to a tap being taken. team a group of players constituting
one ( 1 ) side in a competition match. tfa touch football australia limited touch
any contact between the player in possession and a defending player. a touch includes
contact on the ball, hair or clothing and may be made by a defending player or
by the player in possession. touch count the progressive number of touches that
each team has before a change of possession, from zero ( 0 ) to six ( 6 ).
- a player with both feet on or behind their defending try line. pass the act of
changing possession between individual attacking players by propelling the ball
laterally and / or backwards and may include a flick, knock or throw. perimeter
a border not less than five ( 5 ) metres from the boundary of the field of play.
see appendix 1. penalty the ruling by a referee to award a tap when a player or
team infringes the rules of the game. possession refers to the player or team
that has control of the ball. providing other rules do not apply, the team with
the ball is entitled to six ( 6 ) touches. referee the match official ( s ) appointed
to make rulings during the conduct of a match. rollball the act of bringing the
ball into play following a touch or a change of possession. ruck / rollball area
the area, not exceeding one ( 1 ) metre in distance, between the player performing
a rollball and the half. ruling the decision made by a referee as a result of
particular circumstance and may result in a play on, a tap penalty, a discipline
option, change of possession or a try. seven metre zone the area between the seven
( 7 ) metre line and the try line.
- 5th edition rules touch football tion rules touch football touch football australia
( tfa ) undertook an extensive internal review of their domestic playing rules
throughout 2018 and 2019. the review was led by an vastly experienced group of
current and past players, coaches, referees and administrators of the sport from
community competitions to the elite international game. this group consulted broadly
within the australian community to develop a set of playing rules that could be
applied across all levels of the sport. the result was the tfa 8th edition playing
rules. at the federation of international touch paris convention held in october
2019 touch football australia presented the tfa 8th edition playing rules and
subsequently offered fit and all national touch associations ( ntas ) royalty
free rights to use the newly developed rules. consequently, the fit board resolved
to adopt the tfa 8th edition playing rules as the 5th edition fit playing rules
to be used across all levels of the game internationally. fit and its members
acknowledge and thank touch football australia for the rights to use these rules.
whilst consistency in the application of the rules of the game is important, fit
encourages its members to offer features in local competition rules to ensure
that all participants enjoy a high quality experience.
- source_sentence: What is the minimum number of digits allowed for identifying numbers
according to clause 4.3.1?
sentences:
- 9. 2 on the change of possession due to an intercept, the first touch will be
zero ( 0 ) touch. 9. 3 following the sixth touch or a loss of possession due to
any other means, the ball must be returned to the mark without delay. ruling =
a deliberate delay in the changeover procedure will result in a penalty awarded
to the non - offending team ten ( 10 ) metres forward of the mark for the change
of possession. 9. 4 if the ball is dropped or passed and goes to ground during
play, a change of possession results. ruling = the mark for the change of possession
is where the ball makes initial contact with the ground. 9. 5 if the ball, while
still under the control of the half, contacts the ground in the in - goal area,
possession is lost. ruling = play will restart with a rollball at the nearest
point on the seven ( 7 ) metre line. fit playing rules - 5th edition 8 copyright
© touch football australia 2020 9. 6 if a player mishandles the ball and even
if in an effort to gain control, the ball is accidentally knocked forward into
any other player, a change of possession results.
- 2. 2 teams playing unregistered players are liable to forfeit any match in which
unregistered players have competed. fit playing rules - 5th edition copyright
© touch football australia 2020 5 3 the ball 3. 1 the game is played with an oval,
inflated ball of a shape, colour and size approved by fit or the nta. 3. 2 the
ball shall be inflated to the manufacturers ’ recommended air pressure. 3. 3 the
referee shall immediately pause the match if the size and shape of the ball no
longer complies with clauses 3. 1 or 3. 2 to allow for the ball to replaced or
the issue rectified. 3. 4 the ball must not be hidden under player attire. 4 playing
uniform 4. 1 participating players are to be correctly attired in matching team
uniforms 4. 2 playing uniforms consist of shirt, singlet or other item as approved
by the nta or nta competition provider, shorts and / or tights and socks. 4. 3
all players are to wear a unique identifying number not less than 16cm in height,
clearly displayed on the rear of the playing top. 4. 3. 1 identifying numbers
must feature no more than two ( 2 ) digits.
- '24. 5 for the avoidance of doubt for clauses 24. 3 and 24. 4 the non - offending
team will retain a numerical advantage on the field of play during the drop -
off. 25 match officials 25. 1 the referee is the sole judge on all match related
matters inside the perimeter for the duration of a match, has jurisdiction over
all players, coaches and officials and is required to : 25. 1. 1 inspect the field
of play, line markings and markers prior to the commencement of the match to ensure
the safety of all participants. 25. 1. 2 adjudicate on the rules of the game ;
25. 1. 3 impose any sanction necessary to control the match ; 25. 1. 4 award tries
and record the progressive score ; 25. 1. 5 maintain a count of touches during
each possession ; 25. 1. 6 award penalties for infringements against the rules
; and 25. 1. 7 report to the relevant competition administration any sin bins,
dismissals or injuries to any participant sustained during a match. 25. 2 only
team captains are permitted to seek clarification of a decision directly from
the referee. an approach may only be made during a break in play or at the discretion
of the referee.'
---
# SentenceTransformer based on cross-encoder/ms-marco-MiniLM-L-6-v2
This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [cross-encoder/ms-marco-MiniLM-L-6-v2](https://huggingface.co/cross-encoder/ms-marco-MiniLM-L-6-v2). It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
## Model Details
### Model Description
- **Model Type:** Sentence Transformer
- **Base model:** [cross-encoder/ms-marco-MiniLM-L-6-v2](https://huggingface.co/cross-encoder/ms-marco-MiniLM-L-6-v2)
- **Maximum Sequence Length:** 512 tokens
- **Output Dimensionality:** 384 tokens
- **Similarity Function:** Cosine Similarity
### Model Sources
- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
### Full Model Architecture
```
SentenceTransformer(
(0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel
(1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)
```
## Usage
### Direct Usage (Sentence Transformers)
First install the Sentence Transformers library:
```bash
pip install -U sentence-transformers
```
Then you can load this model and run inference.
```python
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("Trelis/ms-marco-MiniLM-L-6-v2-2-cst-ep-MNRLtriplets-2e-5-batch32-gpu-overlap")
# Run inference
sentences = [
'What is the minimum number of digits allowed for identifying numbers according to clause 4.3.1?',
'2. 2 teams playing unregistered players are liable to forfeit any match in which unregistered players have competed. fit playing rules - 5th edition copyright © touch football australia 2020 5 3 the ball 3. 1 the game is played with an oval, inflated ball of a shape, colour and size approved by fit or the nta. 3. 2 the ball shall be inflated to the manufacturers ’ recommended air pressure. 3. 3 the referee shall immediately pause the match if the size and shape of the ball no longer complies with clauses 3. 1 or 3. 2 to allow for the ball to replaced or the issue rectified. 3. 4 the ball must not be hidden under player attire. 4 playing uniform 4. 1 participating players are to be correctly attired in matching team uniforms 4. 2 playing uniforms consist of shirt, singlet or other item as approved by the nta or nta competition provider, shorts and / or tights and socks. 4. 3 all players are to wear a unique identifying number not less than 16cm in height, clearly displayed on the rear of the playing top. 4. 3. 1 identifying numbers must feature no more than two ( 2 ) digits.',
'24. 5 for the avoidance of doubt for clauses 24. 3 and 24. 4 the non - offending team will retain a numerical advantage on the field of play during the drop - off. 25 match officials 25. 1 the referee is the sole judge on all match related matters inside the perimeter for the duration of a match, has jurisdiction over all players, coaches and officials and is required to : 25. 1. 1 inspect the field of play, line markings and markers prior to the commencement of the match to ensure the safety of all participants. 25. 1. 2 adjudicate on the rules of the game ; 25. 1. 3 impose any sanction necessary to control the match ; 25. 1. 4 award tries and record the progressive score ; 25. 1. 5 maintain a count of touches during each possession ; 25. 1. 6 award penalties for infringements against the rules ; and 25. 1. 7 report to the relevant competition administration any sin bins, dismissals or injuries to any participant sustained during a match. 25. 2 only team captains are permitted to seek clarification of a decision directly from the referee. an approach may only be made during a break in play or at the discretion of the referee.',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 384]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]
```
## Training Details
### Training Hyperparameters
#### Non-Default Hyperparameters
- `eval_strategy`: steps
- `per_device_train_batch_size`: 32
- `per_device_eval_batch_size`: 32
- `learning_rate`: 2e-05
- `num_train_epochs`: 2
- `lr_scheduler_type`: constant
- `warmup_ratio`: 0.3
- `bf16`: True
#### All Hyperparameters
Click to expand
- `overwrite_output_dir`: False
- `do_predict`: False
- `eval_strategy`: steps
- `prediction_loss_only`: True
- `per_device_train_batch_size`: 32
- `per_device_eval_batch_size`: 32
- `per_gpu_train_batch_size`: None
- `per_gpu_eval_batch_size`: None
- `gradient_accumulation_steps`: 1
- `eval_accumulation_steps`: None
- `learning_rate`: 2e-05
- `weight_decay`: 0.0
- `adam_beta1`: 0.9
- `adam_beta2`: 0.999
- `adam_epsilon`: 1e-08
- `max_grad_norm`: 1.0
- `num_train_epochs`: 2
- `max_steps`: -1
- `lr_scheduler_type`: constant
- `lr_scheduler_kwargs`: {}
- `warmup_ratio`: 0.3
- `warmup_steps`: 0
- `log_level`: passive
- `log_level_replica`: warning
- `log_on_each_node`: True
- `logging_nan_inf_filter`: True
- `save_safetensors`: True
- `save_on_each_node`: False
- `save_only_model`: False
- `restore_callback_states_from_checkpoint`: False
- `no_cuda`: False
- `use_cpu`: False
- `use_mps_device`: False
- `seed`: 42
- `data_seed`: None
- `jit_mode_eval`: False
- `use_ipex`: False
- `bf16`: True
- `fp16`: False
- `fp16_opt_level`: O1
- `half_precision_backend`: auto
- `bf16_full_eval`: False
- `fp16_full_eval`: False
- `tf32`: None
- `local_rank`: 0
- `ddp_backend`: None
- `tpu_num_cores`: None
- `tpu_metrics_debug`: False
- `debug`: []
- `dataloader_drop_last`: False
- `dataloader_num_workers`: 0
- `dataloader_prefetch_factor`: None
- `past_index`: -1
- `disable_tqdm`: False
- `remove_unused_columns`: True
- `label_names`: None
- `load_best_model_at_end`: False
- `ignore_data_skip`: False
- `fsdp`: []
- `fsdp_min_num_params`: 0
- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
- `fsdp_transformer_layer_cls_to_wrap`: None
- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
- `deepspeed`: None
- `label_smoothing_factor`: 0.0
- `optim`: adamw_torch
- `optim_args`: None
- `adafactor`: False
- `group_by_length`: False
- `length_column_name`: length
- `ddp_find_unused_parameters`: None
- `ddp_bucket_cap_mb`: None
- `ddp_broadcast_buffers`: False
- `dataloader_pin_memory`: True
- `dataloader_persistent_workers`: False
- `skip_memory_metrics`: True
- `use_legacy_prediction_loop`: False
- `push_to_hub`: False
- `resume_from_checkpoint`: None
- `hub_model_id`: None
- `hub_strategy`: every_save
- `hub_private_repo`: False
- `hub_always_push`: False
- `gradient_checkpointing`: False
- `gradient_checkpointing_kwargs`: None
- `include_inputs_for_metrics`: False
- `eval_do_concat_batches`: True
- `fp16_backend`: auto
- `push_to_hub_model_id`: None
- `push_to_hub_organization`: None
- `mp_parameters`:
- `auto_find_batch_size`: False
- `full_determinism`: False
- `torchdynamo`: None
- `ray_scope`: last
- `ddp_timeout`: 1800
- `torch_compile`: False
- `torch_compile_backend`: None
- `torch_compile_mode`: None
- `dispatch_batches`: None
- `split_batches`: None
- `include_tokens_per_second`: False
- `include_num_input_tokens_seen`: False
- `neftune_noise_alpha`: None
- `optim_target_modules`: None
- `batch_eval_metrics`: False
- `eval_on_start`: False
- `batch_sampler`: batch_sampler
- `multi_dataset_batch_sampler`: proportional
### Training Logs
Click to expand
| Epoch | Step | Training Loss | loss |
|:------:|:----:|:-------------:|:------:|
| 0.0066 | 2 | 4.4256 | - |
| 0.0131 | 4 | 4.1504 | - |
| 0.0197 | 6 | 4.0494 | - |
| 0.0262 | 8 | 4.0447 | - |
| 0.0328 | 10 | 3.9851 | - |
| 0.0393 | 12 | 3.9284 | - |
| 0.0459 | 14 | 3.9155 | - |
| 0.0525 | 16 | 3.8791 | - |
| 0.0590 | 18 | 3.8663 | - |
| 0.0656 | 20 | 3.9012 | - |
| 0.0721 | 22 | 3.8999 | - |
| 0.0787 | 24 | 3.7895 | - |
| 0.0852 | 26 | 3.7235 | - |
| 0.0918 | 28 | 3.7938 | - |
| 0.0984 | 30 | 3.5057 | - |
| 0.1049 | 32 | 3.5776 | - |
| 0.1115 | 34 | 3.5092 | - |
| 0.1180 | 36 | 3.7226 | - |
| 0.1246 | 38 | 3.5426 | - |
| 0.1311 | 40 | 3.7318 | - |
| 0.1377 | 42 | 3.529 | - |
| 0.1443 | 44 | 3.5977 | - |
| 0.1508 | 46 | 3.6484 | - |
| 0.1574 | 48 | 3.5026 | - |
| 0.1639 | 50 | 3.4568 | - |
| 0.1705 | 52 | 3.6119 | - |
| 0.1770 | 54 | 3.4206 | - |
| 0.1836 | 56 | 3.3701 | - |
| 0.1902 | 58 | 3.3232 | - |
| 0.1967 | 60 | 3.3398 | - |
| 0.2033 | 62 | 3.333 | - |
| 0.2098 | 64 | 3.3587 | - |
| 0.2164 | 66 | 3.1304 | - |
| 0.2230 | 68 | 3.0618 | - |
| 0.2295 | 70 | 3.145 | - |
| 0.2361 | 72 | 3.2074 | - |
| 0.2426 | 74 | 3.0436 | - |
| 0.2492 | 76 | 3.0572 | - |
| 0.2525 | 77 | - | 3.0810 |
| 0.2557 | 78 | 3.1225 | - |
| 0.2623 | 80 | 2.8197 | - |
| 0.2689 | 82 | 2.8979 | - |
| 0.2754 | 84 | 2.7827 | - |
| 0.2820 | 86 | 2.9472 | - |
| 0.2885 | 88 | 2.918 | - |
| 0.2951 | 90 | 2.7035 | - |
| 0.3016 | 92 | 2.6876 | - |
| 0.3082 | 94 | 2.8322 | - |
| 0.3148 | 96 | 2.6335 | - |
| 0.3213 | 98 | 2.3754 | - |
| 0.3279 | 100 | 3.0978 | - |
| 0.3344 | 102 | 2.4946 | - |
| 0.3410 | 104 | 2.5085 | - |
| 0.3475 | 106 | 2.7456 | - |
| 0.3541 | 108 | 2.3934 | - |
| 0.3607 | 110 | 2.3222 | - |
| 0.3672 | 112 | 2.4773 | - |
| 0.3738 | 114 | 2.6684 | - |
| 0.3803 | 116 | 2.2435 | - |
| 0.3869 | 118 | 2.243 | - |
| 0.3934 | 120 | 2.228 | - |
| 0.4 | 122 | 2.4652 | - |
| 0.4066 | 124 | 2.2113 | - |
| 0.4131 | 126 | 2.0805 | - |
| 0.4197 | 128 | 2.5041 | - |
| 0.4262 | 130 | 2.4489 | - |
| 0.4328 | 132 | 2.2474 | - |
| 0.4393 | 134 | 2.0252 | - |
| 0.4459 | 136 | 2.257 | - |
| 0.4525 | 138 | 1.9381 | - |
| 0.4590 | 140 | 2.0183 | - |
| 0.4656 | 142 | 2.1021 | - |
| 0.4721 | 144 | 2.1508 | - |
| 0.4787 | 146 | 1.9669 | - |
| 0.4852 | 148 | 1.7468 | - |
| 0.4918 | 150 | 1.8776 | - |
| 0.4984 | 152 | 1.8081 | - |
| 0.5049 | 154 | 1.6799 | 1.6088 |
| 0.5115 | 156 | 1.9628 | - |
| 0.5180 | 158 | 1.8253 | - |
| 0.5246 | 160 | 1.7791 | - |
| 0.5311 | 162 | 1.8463 | - |
| 0.5377 | 164 | 1.6357 | - |
| 0.5443 | 166 | 1.6531 | - |
| 0.5508 | 168 | 1.6747 | - |
| 0.5574 | 170 | 1.5666 | - |
| 0.5639 | 172 | 1.7272 | - |
| 0.5705 | 174 | 1.6045 | - |
| 0.5770 | 176 | 1.3786 | - |
| 0.5836 | 178 | 1.6547 | - |
| 0.5902 | 180 | 1.6416 | - |
| 0.5967 | 182 | 1.4796 | - |
| 0.6033 | 184 | 1.4595 | - |
| 0.6098 | 186 | 1.4106 | - |
| 0.6164 | 188 | 1.4844 | - |
| 0.6230 | 190 | 1.4581 | - |
| 0.6295 | 192 | 1.4922 | - |
| 0.6361 | 194 | 1.2978 | - |
| 0.6426 | 196 | 1.2612 | - |
| 0.6492 | 198 | 1.4725 | - |
| 0.6557 | 200 | 1.3162 | - |
| 0.6623 | 202 | 1.3736 | - |
| 0.6689 | 204 | 1.4553 | - |
| 0.6754 | 206 | 1.4011 | - |
| 0.6820 | 208 | 1.2523 | - |
| 0.6885 | 210 | 1.3732 | - |
| 0.6951 | 212 | 1.3721 | - |
| 0.7016 | 214 | 1.5262 | - |
| 0.7082 | 216 | 1.2631 | - |
| 0.7148 | 218 | 1.6174 | - |
| 0.7213 | 220 | 1.4252 | - |
| 0.7279 | 222 | 1.3527 | - |
| 0.7344 | 224 | 1.1969 | - |
| 0.7410 | 226 | 1.2901 | - |
| 0.7475 | 228 | 1.4379 | - |
| 0.7541 | 230 | 1.1332 | - |
| 0.7574 | 231 | - | 1.0046 |
| 0.7607 | 232 | 1.3693 | - |
| 0.7672 | 234 | 1.3097 | - |
| 0.7738 | 236 | 1.2314 | - |
| 0.7803 | 238 | 1.0873 | - |
| 0.7869 | 240 | 1.2882 | - |
| 0.7934 | 242 | 1.1723 | - |
| 0.8 | 244 | 1.1748 | - |
| 0.8066 | 246 | 1.2916 | - |
| 0.8131 | 248 | 1.0894 | - |
| 0.8197 | 250 | 1.2299 | - |
| 0.8262 | 252 | 1.207 | - |
| 0.8328 | 254 | 1.1361 | - |
| 0.8393 | 256 | 1.1323 | - |
| 0.8459 | 258 | 1.0927 | - |
| 0.8525 | 260 | 1.1433 | - |
| 0.8590 | 262 | 1.1088 | - |
| 0.8656 | 264 | 1.1384 | - |
| 0.8721 | 266 | 1.0962 | - |
| 0.8787 | 268 | 1.1878 | - |
| 0.8852 | 270 | 1.0113 | - |
| 0.8918 | 272 | 1.1411 | - |
| 0.8984 | 274 | 1.0289 | - |
| 0.9049 | 276 | 1.0163 | - |
| 0.9115 | 278 | 1.2859 | - |
| 0.9180 | 280 | 0.9449 | - |
| 0.9246 | 282 | 1.0941 | - |
| 0.9311 | 284 | 1.0908 | - |
| 0.9377 | 286 | 1.1028 | - |
| 0.9443 | 288 | 1.0633 | - |
| 0.9508 | 290 | 1.1004 | - |
| 0.9574 | 292 | 1.0483 | - |
| 0.9639 | 294 | 1.0064 | - |
| 0.9705 | 296 | 1.0088 | - |
| 0.9770 | 298 | 1.0068 | - |
| 0.9836 | 300 | 1.1903 | - |
| 0.9902 | 302 | 0.9401 | - |
| 0.9967 | 304 | 0.8369 | - |
| 1.0033 | 306 | 0.5046 | - |
| 1.0098 | 308 | 1.0626 | 0.8660 |
| 1.0164 | 310 | 0.9587 | - |
| 1.0230 | 312 | 1.0565 | - |
| 1.0295 | 314 | 1.1329 | - |
| 1.0361 | 316 | 1.1857 | - |
| 1.0426 | 318 | 0.9777 | - |
| 1.0492 | 320 | 0.9883 | - |
| 1.0557 | 322 | 0.9076 | - |
| 1.0623 | 324 | 0.7942 | - |
| 1.0689 | 326 | 1.1952 | - |
| 1.0754 | 328 | 0.9726 | - |
| 1.0820 | 330 | 1.0663 | - |
| 1.0885 | 332 | 1.0337 | - |
| 1.0951 | 334 | 0.9522 | - |
| 1.1016 | 336 | 0.9813 | - |
| 1.1082 | 338 | 0.9057 | - |
| 1.1148 | 340 | 1.0076 | - |
| 1.1213 | 342 | 0.8557 | - |
| 1.1279 | 344 | 0.9341 | - |
| 1.1344 | 346 | 0.9188 | - |
| 1.1410 | 348 | 1.091 | - |
| 1.1475 | 350 | 0.8205 | - |
| 1.1541 | 352 | 1.0509 | - |
| 1.1607 | 354 | 0.9201 | - |
| 1.1672 | 356 | 1.0741 | - |
| 1.1738 | 358 | 0.8662 | - |
| 1.1803 | 360 | 0.9468 | - |
| 1.1869 | 362 | 0.8604 | - |
| 1.1934 | 364 | 0.8141 | - |
| 1.2 | 366 | 0.9475 | - |
| 1.2066 | 368 | 0.8407 | - |
| 1.2131 | 370 | 0.764 | - |
| 1.2197 | 372 | 0.798 | - |
| 1.2262 | 374 | 0.8205 | - |
| 1.2328 | 376 | 0.7995 | - |
| 1.2393 | 378 | 0.9305 | - |
| 1.2459 | 380 | 0.858 | - |
| 1.2525 | 382 | 0.8465 | - |
| 1.2590 | 384 | 0.7691 | - |
| 1.2623 | 385 | - | 0.7879 |
| 1.2656 | 386 | 1.0073 | - |
| 1.2721 | 388 | 0.8026 | - |
| 1.2787 | 390 | 0.8108 | - |
| 1.2852 | 392 | 0.7783 | - |
| 1.2918 | 394 | 0.8766 | - |
| 1.2984 | 396 | 0.8576 | - |
| 1.3049 | 398 | 0.884 | - |
| 1.3115 | 400 | 0.9547 | - |
| 1.3180 | 402 | 0.9231 | - |
| 1.3246 | 404 | 0.8027 | - |
| 1.3311 | 406 | 0.9117 | - |
| 1.3377 | 408 | 0.7743 | - |
| 1.3443 | 410 | 0.8257 | - |
| 1.3508 | 412 | 0.8738 | - |
| 1.3574 | 414 | 0.972 | - |
| 1.3639 | 416 | 0.8297 | - |
| 1.3705 | 418 | 0.8941 | - |
| 1.3770 | 420 | 0.8513 | - |
| 1.3836 | 422 | 0.7588 | - |
| 1.3902 | 424 | 0.8332 | - |
| 1.3967 | 426 | 0.7682 | - |
| 1.4033 | 428 | 0.7916 | - |
| 1.4098 | 430 | 0.9519 | - |
| 1.4164 | 432 | 1.0526 | - |
| 1.4230 | 434 | 0.8724 | - |
| 1.4295 | 436 | 0.8267 | - |
| 1.4361 | 438 | 0.7672 | - |
| 1.4426 | 440 | 0.7977 | - |
| 1.4492 | 442 | 0.6947 | - |
| 1.4557 | 444 | 0.9042 | - |
| 1.4623 | 446 | 0.8971 | - |
| 1.4689 | 448 | 0.9655 | - |
| 1.4754 | 450 | 0.8512 | - |
| 1.4820 | 452 | 0.9421 | - |
| 1.4885 | 454 | 0.9501 | - |
| 1.4951 | 456 | 0.8214 | - |
| 1.5016 | 458 | 0.9335 | - |
| 1.5082 | 460 | 0.7617 | - |
| 1.5148 | 462 | 0.8601 | 0.7855 |
| 1.5213 | 464 | 0.757 | - |
| 1.5279 | 466 | 0.7389 | - |
| 1.5344 | 468 | 0.8146 | - |
| 1.5410 | 470 | 0.9235 | - |
| 1.5475 | 472 | 0.9901 | - |
| 1.5541 | 474 | 0.9624 | - |
| 1.5607 | 476 | 0.8909 | - |
| 1.5672 | 478 | 0.7276 | - |
| 1.5738 | 480 | 0.9444 | - |
| 1.5803 | 482 | 0.874 | - |
| 1.5869 | 484 | 0.7985 | - |
| 1.5934 | 486 | 0.9335 | - |
| 1.6 | 488 | 0.8108 | - |
| 1.6066 | 490 | 0.7779 | - |
| 1.6131 | 492 | 0.8807 | - |
| 1.6197 | 494 | 0.8146 | - |
| 1.6262 | 496 | 0.9218 | - |
| 1.6328 | 498 | 0.8439 | - |
| 1.6393 | 500 | 0.7348 | - |
| 1.6459 | 502 | 0.8533 | - |
| 1.6525 | 504 | 0.7695 | - |
| 1.6590 | 506 | 0.7911 | - |
| 1.6656 | 508 | 0.837 | - |
| 1.6721 | 510 | 0.731 | - |
| 1.6787 | 512 | 0.911 | - |
| 1.6852 | 514 | 0.7963 | - |
| 1.6918 | 516 | 0.7719 | - |
| 1.6984 | 518 | 0.8011 | - |
| 1.7049 | 520 | 0.7428 | - |
| 1.7115 | 522 | 0.8159 | - |
| 1.7180 | 524 | 0.7833 | - |
| 1.7246 | 526 | 0.7934 | - |
| 1.7311 | 528 | 0.7854 | - |
| 1.7377 | 530 | 0.8398 | - |
| 1.7443 | 532 | 0.7875 | - |
| 1.7508 | 534 | 0.7282 | - |
| 1.7574 | 536 | 0.8269 | - |
| 1.7639 | 538 | 0.8033 | - |
| 1.7672 | 539 | - | 0.7595 |
| 1.7705 | 540 | 0.9471 | - |
| 1.7770 | 542 | 0.941 | - |
| 1.7836 | 544 | 0.725 | - |
| 1.7902 | 546 | 0.8978 | - |
| 1.7967 | 548 | 0.8361 | - |
| 1.8033 | 550 | 0.7092 | - |
| 1.8098 | 552 | 0.809 | - |
| 1.8164 | 554 | 0.9399 | - |
| 1.8230 | 556 | 0.769 | - |
| 1.8295 | 558 | 0.7381 | - |
| 1.8361 | 560 | 0.7554 | - |
| 1.8426 | 562 | 0.8553 | - |
| 1.8492 | 564 | 0.919 | - |
| 1.8557 | 566 | 0.7479 | - |
| 1.8623 | 568 | 0.8381 | - |
| 1.8689 | 570 | 0.7911 | - |
| 1.8754 | 572 | 0.8076 | - |
| 1.8820 | 574 | 0.7868 | - |
| 1.8885 | 576 | 0.9147 | - |
| 1.8951 | 578 | 0.7271 | - |
| 1.9016 | 580 | 0.7201 | - |
| 1.9082 | 582 | 0.7538 | - |
| 1.9148 | 584 | 0.7522 | - |
| 1.9213 | 586 | 0.7737 | - |
| 1.9279 | 588 | 0.7187 | - |
| 1.9344 | 590 | 0.8713 | - |
| 1.9410 | 592 | 0.7971 | - |
| 1.9475 | 594 | 0.8226 | - |
| 1.9541 | 596 | 0.7074 | - |
| 1.9607 | 598 | 0.804 | - |
| 1.9672 | 600 | 0.7259 | - |
| 1.9738 | 602 | 0.7758 | - |
| 1.9803 | 604 | 0.8209 | - |
| 1.9869 | 606 | 0.7918 | - |
| 1.9934 | 608 | 0.7467 | - |
| 2.0 | 610 | 0.4324 | - |
### Framework Versions
- Python: 3.10.12
- Sentence Transformers: 3.0.1
- Transformers: 4.42.3
- PyTorch: 2.1.1+cu121
- Accelerate: 0.31.0
- Datasets: 2.17.1
- Tokenizers: 0.19.1
## Citation
### BibTeX
#### Sentence Transformers
```bibtex
@inproceedings{reimers-2019-sentence-bert,
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
author = "Reimers, Nils and Gurevych, Iryna",
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
month = "11",
year = "2019",
publisher = "Association for Computational Linguistics",
url = "https://arxiv.org/abs/1908.10084",
}
```
#### MultipleNegativesRankingLoss
```bibtex
@misc{henderson2017efficient,
title={Efficient Natural Language Response Suggestion for Smart Reply},
author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
year={2017},
eprint={1705.00652},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
```