SetFit with sentence-transformers/paraphrase-mpnet-base-v2 on data/raw/15239678.jsonl

This is a SetFit model that can be used for Text Classification. This SetFit model uses sentence-transformers/paraphrase-mpnet-base-v2 as the Sentence Transformer embedding model. A LogisticRegression instance is used for classification.

The model has been trained using an efficient few-shot learning technique that involves:

Fine-tuning a Sentence Transformer with contrastive learning.
Training a classification head with features from the fine-tuned Sentence Transformer.

Model Details

Model Description

Model Type: SetFit
Sentence Transformer body: sentence-transformers/paraphrase-mpnet-base-v2
Classification head: a LogisticRegression instance
Maximum Sequence Length: 512 tokens
Number of Classes: 2 classes
Language: en
License: apache-2.0

Model Sources

Repository: SetFit on GitHub
Paper: Efficient Few-Shot Learning Without Prompts
Blogpost: SetFit: Efficient Few-Shot Learning Without Prompts

Model Labels

Label	Examples
negative	'slow, uninspiring, borng i think the second film just confirmed that dune isn't for me.i found the first one rather long and a bit boring. this second part didn't do much to change my mind. i gave it a try through.some things didn't make sense.1. why, if there are rifles/laser weapons are the majority of the battles found hand to hand with swords? especially when protecting the valuable spice depot on arrakis. it seemed like a really illogical move and a terrible military tactic. i felt like it was done more for the visual "spectacle" of having hand to hand fighting but it didn't make sense in universe.2. the fremen seemingly have to trek great distances to get to these attack sites, there was a scene near the end where their army all.aprar st the top of the sand dune by the depot and would be absolutely knackered by the time they traversed the miles of sand between them and the enemy3. this brings me on to my point about them "riding" the worms as they seemingly have little control apart from nominal left and right movement. you never see them stopping the worms and dismounting. the worms never seem to stop so you would likely have to leap off, almost certainly to your death.linked into this there were scenes where there was a whole caravan of people including lady jessica in a fremen style sedan chair, how the hell did they all safely mount the worm and remain tethered and again how did they all dismount?lastly there was the horrible dirge of hans zimmer's "score". i know this is just personal taste, but i prefer music with a theme and melody rather than just atonal blats from a foghorn.i'm sure dune fans will absolutely love this and i'm pleased they've got a faithful adaptation. i also recognise the efforts of the cast and crew i just found it to be overly long and a bit dull.this was a watch once and don't need to see it again film for me.i won't be watching the next one.so caught up in it's own mythology that it fails to give any interesting characters that you can root for.it inspires no emotional engagement when the characters are all dull.visually bland.' "broke the story for no reason movies don't perfectly reflections the book and we shouldn't expect them to.that said, dune part 2 diverged in key areas for no good reason.the most inexplicable is that the whole storyline from 'will the tribe accept paul and jessica?' to paul uniting the tribes and leading them in the huge final battle takes place while jessica is pregnant. in the book her child is already about 3 - a far more plausible timescale.no changes to the movie would have been needed except adding the birth and the character of alia in a few scenes - the key one being the between the baron and the emperor.also, chani is shown as opposing paul and leaves him, the opposite of their relationship in the book.it's hard to see how a sequel can make these changes fit the storyline while keeping it intact." "it just didn't work for me my apologies to all who were enthralled by dune ii. i respect your experience. maybe if i'd have seen dune i it would have helped but i don't think so. the jerry-rigging of several religions seemed pretentious and trite while the half-dozen plot threads unraveled regularly. sweeping cig backgrounds soon became tiresome. trying to keep supporting characters straight was difficult. i tried but even at the end i was unsure of what had happened to relationships, especially to the women characters. critics have outlined what it all was supposed to be about, but i found it a bit dull. maybe i'll wait for dune i on the streams. apologies to all. 5 out of 21 found this helpful. was this review helpful? sign in to vote. permalink"
positive	"a visual masterpiece dune part 2 is dope to the most extent.visually wonderful and elevative screenplay works big time.that sound mixing was from a different planet, outrageous at times. i'd be damned if visuals and sound won't win the oscars.it stays mostly true to the novel. it's been a few years since i've read it but i didn't find stark differences.there's an ample scope for all the lead cast and everyone did a fantastic job. timothee chalamet as paul artreidis and zendaya as chani had a terrific screen presence.a must watch.at times i felt that it was an indian film due to the screenplay and action sequences.8.5 stars." "no words the best sequel i have ever seen in cinema. a masterpiece.coming into dune part two on day 2 of it's uk wide release and having already seen the unwavering reviews i was in high anticipation for what i believed could be the triumph in cinema we have been needing for quite some time. a feat that could actually set me up for disappointment. however, true to the words of my predecessors who saw the film before me, it was simply otherworldly.denis is a visionary. a creative mind that only comes around in hollywood once in a blue moon. this film is beautiful, it's vivid, it's dense in all the best ways.imax has to be a non negotiable. the images and sound are unlike many movies i have ever seen.go and see this picture immediately. 3 out of 4 found this helpful. was this review helpful? sign in to vote. permalink" "a cinematic masterpiece.. i can't believe my eyes what just i experienced in theatre, this movie is one of the best cinematic experience i've ever had.. from opening scene to end credit every second is worth it.. epic score by hans zimmer elevates the experience, filled with beautiful shots and cinematography to a great scrrenplay and some top notch acting by every cast member dune 2 will be remembered as one of the best films of this generation even after 50 years later that's my guarantee.. denis villeneuve is one of the best director of this generation who gave us masterpiece like blade runner 2049 and currently working on 3rd part of this trilogy which i can't wait to see.. action scenes were great featuring big ships, blasters laser guns and every other kind of weapons, sound effects were amazing but most importantly screenplay was well paced and story featuring blend of sci fi and fantasy elements is absolute best of the best even though it is an adaptation of 1965 novel of same name it is one of the best adaptations ever.. i loved both movies and can't wait to see what happens in future because i enjoy films about the chosen one prophecy like star wars, the matrix and now this.. i won't give any spoiler here and will not talk about anything shown in the movie since you need to see this movie for yourself to feel the magic.. don't miss it at any cost.. watch it on the biggest screen possible especially imax to enjoy epic sound effects and see the larger than life picture you'll love it.."

Label

Examples

negative

'slow, uninspiring, borng i think the second film just confirmed that dune isn't for me.i found the first one rather long and a bit boring. this second part didn't do much to change my mind. i gave it a try through.some things didn't make sense.1. why, if there are rifles/laser weapons are the majority of the battles found hand to hand with swords? especially when protecting the valuable spice depot on arrakis. it seemed like a really illogical move and a terrible military tactic. i felt like it was done more for the visual "spectacle" of having hand to hand fighting but it didn't make sense in universe.2. the fremen seemingly have to trek great distances to get to these attack sites, there was a scene near the end where their army all.aprar st the top of the sand dune by the depot and would be absolutely knackered by the time they traversed the miles of sand between them and the enemy3. this brings me on to my point about them "riding" the worms as they seemingly have little control apart from nominal left and right movement. you never see them stopping the worms and dismounting. the worms never seem to stop so you would likely have to leap off, almost certainly to your death.linked into this there were scenes where there was a whole caravan of people including lady jessica in a fremen style sedan chair, how the hell did they all safely mount the worm and remain tethered and again how did they all dismount?lastly there was the horrible dirge of hans zimmer's "score". i know this is just personal taste, but i prefer music with a theme and melody rather than just atonal blats from a foghorn.i'm sure dune fans will absolutely love this and i'm pleased they've got a faithful adaptation. i also recognise the efforts of the cast and crew i just found it to be overly long and a bit dull.this was a watch once and don't need to see it again film for me.i won't be watching the next one.so caught up in it's own mythology that it fails to give any interesting characters that you can root for.it inspires no emotional engagement when the characters are all dull.visually bland.'
"broke the story for no reason movies don't perfectly reflections the book and we shouldn't expect them to.that said, dune part 2 diverged in key areas for no good reason.the most inexplicable is that the whole storyline from 'will the tribe accept paul and jessica?' to paul uniting the tribes and leading them in the huge final battle takes place while jessica is pregnant. in the book her child is already about 3 - a far more plausible timescale.no changes to the movie would have been needed except adding the birth and the character of alia in a few scenes - the key one being the between the baron and the emperor.also, chani is shown as opposing paul and leaves him, the opposite of their relationship in the book.it's hard to see how a sequel can make these changes fit the storyline while keeping it intact."
"it just didn't work for me my apologies to all who were enthralled by dune ii. i respect your experience. maybe if i'd have seen dune i it would have helped but i don't think so. the jerry-rigging of several religions seemed pretentious and trite while the half-dozen plot threads unraveled regularly. sweeping cig backgrounds soon became tiresome. trying to keep supporting characters straight was difficult. i tried but even at the end i was unsure of what had happened to relationships, especially to the women characters. critics have outlined what it all was supposed to be about, but i found it a bit dull. maybe i'll wait for dune i on the streams. apologies to all. 5 out of 21 found this helpful. was this review helpful? sign in to vote. permalink"

positive

"a visual masterpiece dune part 2 is dope to the most extent.visually wonderful and elevative screenplay works big time.that sound mixing was from a different planet, outrageous at times. i'd be damned if visuals and sound won't win the oscars.it stays mostly true to the novel. it's been a few years since i've read it but i didn't find stark differences.there's an ample scope for all the lead cast and everyone did a fantastic job. timothee chalamet as paul artreidis and zendaya as chani had a terrific screen presence.a must watch.at times i felt that it was an indian film due to the screenplay and action sequences.8.5 stars."
"no words the best sequel i have ever seen in cinema. a masterpiece.coming into dune part two on day 2 of it's uk wide release and having already seen the unwavering reviews i was in high anticipation for what i believed could be the triumph in cinema we have been needing for quite some time. a feat that could actually set me up for disappointment. however, true to the words of my predecessors who saw the film before me, it was simply otherworldly.denis is a visionary. a creative mind that only comes around in hollywood once in a blue moon. this film is beautiful, it's vivid, it's dense in all the best ways.imax has to be a non negotiable. the images and sound are unlike many movies i have ever seen.go and see this picture immediately. 3 out of 4 found this helpful. was this review helpful? sign in to vote. permalink"
"a cinematic masterpiece.. i can't believe my eyes what just i experienced in theatre, this movie is one of the best cinematic experience i've ever had.. from opening scene to end credit every second is worth it.. epic score by hans zimmer elevates the experience, filled with beautiful shots and cinematography to a great scrrenplay and some top notch acting by every cast member dune 2 will be remembered as one of the best films of this generation even after 50 years later that's my guarantee.. denis villeneuve is one of the best director of this generation who gave us masterpiece like blade runner 2049 and currently working on 3rd part of this trilogy which i can't wait to see.. action scenes were great featuring big ships, blasters laser guns and every other kind of weapons, sound effects were amazing but most importantly screenplay was well paced and story featuring blend of sci fi and fantasy elements is absolute best of the best even though it is an adaptation of 1965 novel of same name it is one of the best adaptations ever.. i loved both movies and can't wait to see what happens in future because i enjoy films about the chosen one prophecy like star wars, the matrix and now this.. i won't give any spoiler here and will not talk about anything shown in the movie since you need to see this movie for yourself to feel the magic.. don't miss it at any cost.. watch it on the biggest screen possible especially imax to enjoy epic sound effects and see the larger than life picture you'll love it.."

Evaluation

Metrics

Label	Accuracy	Precision	Recall	F1
all	0.8571	0.9960	0.8512	0.9179

Uses

Direct Use for Inference

First install the SetFit library:

pip install setfit

Then you can load this model and run inference.

from setfit import SetFitModel

# Download from the 🤗 Hub
model = SetFitModel.from_pretrained("carlesoctav/SentimentClassifierDune64shot")
# Run inference
preds = model("does justice to the books awesome! stunning! the film follows through the spirit of the books with the ever-present internal turmoil of paul. it has the feel of mysticism of the books. the cinematography is spectacular and so is hans zimmer's music. the freemen and harkons are depicted really well and so is the planet dune. at the same time, there are many details and happenings left behind, so for people who have not read the books it's a bit difficult to follow the narrative. the movie doesn't follow thoroughly the destiny of the other of the closest friends and servents of the duke, who survived the massacre in part 1. 5 out of 8 found this helpful. was this review helpful? sign in to vote. permalink")

Training Details

Training Set Metrics

Training set	Min	Median	Max
Word count	108	228.9219	1595

Label	Training Sample Count
negative	64
positive	64

Training Hyperparameters

batch_size: (16, 16)
num_epochs: (1, 1)
max_steps: -1
sampling_strategy: oversampling
body_learning_rate: (2e-05, 1e-05)
head_learning_rate: 0.01
loss: CosineSimilarityLoss
distance_metric: cosine_distance
margin: 0.25
end_to_end: False
use_amp: False
warmup_proportion: 0.1
seed: 42
eval_max_steps: -1
load_best_model_at_end: True

Training Results

Epoch	Step	Training Loss	Validation Loss
0.0019	1	0.2744	-
0.0962	50	0.0513	-
0.1923	100	0.0022	-
0.2885	150	0.0003	-
0.3846	200	0.0001	-
0.4808	250	0.0001	-
0.5769	300	0.0001	-
0.6731	350	0.0001	-
0.7692	400	0.0001	-
0.8654	450	0.0001	-
0.9615	500	0.0001	-
1.0	520	-	0.1845

The bold row denotes the saved checkpoint.

Framework Versions

Python: 3.10.11
SetFit: 1.0.3
Sentence Transformers: 2.5.1
Transformers: 4.38.2
PyTorch: 2.0.1
Datasets: 2.18.0
Tokenizers: 0.15.2

Citation

BibTeX

@article{https://doi.org/10.48550/arxiv.2209.11055,
    doi = {10.48550/ARXIV.2209.11055},
    url = {https://arxiv.org/abs/2209.11055},
    author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
    keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
    title = {Efficient Few-Shot Learning Without Prompts},
    publisher = {arXiv},
    year = {2022},
    copyright = {Creative Commons Attribution 4.0 International}
}

carlesoctav
/

SentimentClassifierDune64shot