SciLad encoder models (like BERT/Roberta) for task-specific fine tuning.
Scilons Project
non-profit
AI & ML interests
None defined yet.
Recent Activity
View all activity
Organization Card
Scilons: Scientific Language models on steroids
-
scilons/roberta_base-512-30k-steps-texts_pq_4-deduped-Eng_Latn
0.1B • Updated • 15 -
scilons/roberta_base-512-60k-steps-texts_pq_4-deduped-Eng_Latn
Updated • 1 -
scilons/roberta_base-512-90k-steps-texts_pq_4-deduped-Eng_Latn
Updated • 2 -
scilons/roberta_base-512-120k-steps-texts_pq_4-deduped-Eng_Latn
Updated • 1
SciLad encoder models (like BERT/Roberta) for task-specific fine tuning.
-
scilons/roberta_base-512-30k-steps-texts_pq_4-deduped-Eng_Latn
0.1B • Updated • 15 -
scilons/roberta_base-512-60k-steps-texts_pq_4-deduped-Eng_Latn
Updated • 1 -
scilons/roberta_base-512-90k-steps-texts_pq_4-deduped-Eng_Latn
Updated • 2 -
scilons/roberta_base-512-120k-steps-texts_pq_4-deduped-Eng_Latn
Updated • 1
models 36
scilons/SciLaD-M-custom
Fill-Mask • 0.1B • Updated • 27
scilons/SciLaD-M-roberta
Fill-Mask • 0.1B • Updated • 22
scilons/sciroberta-512-900k-steps-texts_pq_4-deduped-Eng_Latn
Updated
scilons/sciroberta-512-800k-steps-texts_pq_4-deduped-Eng_Latn
Updated
scilons/roberta_base-512-900k-steps-texts_pq_4-deduped-Eng_Latn
Updated
scilons/sciroberta-512-700k-steps-texts_pq_4-deduped-Eng_Latn
Updated
scilons/roberta_base-512-800k-steps-texts_pq_4-deduped-Eng_Latn
Updated
scilons/sciroberta-512-600k-steps-texts_pq_4-deduped-Eng_Latn
Updated
scilons/roberta_base-512-700k-steps-texts_pq_4-deduped-Eng_Latn
Updated • 4
scilons/roberta_base-512-600k-steps-texts_pq_4-deduped-Eng_Latn
Updated
datasets 8
scilons/SciLaD-all-text-v1
Viewer • Updated • 35.3M • 8
scilons/SciLaD-all-xml-v1
Updated • 214
scilons/SciLaD-en-dedup-v1
Viewer • Updated • 11M • 10
scilons/texts-full
Updated • 2
scilons/texts_pq_3-deduped-Eng_Latn
Viewer • Updated • 10M • 2 • 1
scilons/texts_pq_3-filtered-Eng_Latn
Viewer • Updated • 12M • 3
scilons/texts_pq_3
Viewer • Updated • 35.1M • 12
scilons/texts_pq_2.1
Viewer • Updated • 919k • 2