Hugging Face's logo

adsabs
/
KAILAS

Token Classification
PyTorch
Safetensors
English
roberta
astronomy
uat
Model card Files Community
1
KAILAS / README.md
fgrezes's picture
fgrezes
added KAILAS to model card
8219d08 verified
preview code
|
raw
history blame contribute delete
1.1 kB
metadata
license: apache-2.0
language:
  - en
base_model:
  - nasa-impact/nasa-smd-ibm-v0.1
pipeline_tag: token-classification
tags:
  - astronomy
  - uat

KAILAS

KAILAS (aka Keyword Labeler At SciX aka Indus-UAT-Labeler aka nasa-smd-ibm-v0.1_UAT_Labeler) is a RoBERTa-based, Encoder-only transformer model, domain-adapted for NASA Science Mission Directorate (SMD) applications. It's fine-tuned on scientific journals and articles relevant to NASA SMD, aiming to enhance natural language technologies like information retrieval and intelligent search.
This specific fork was finetuned on SciX Digital Library (https://scixplorer.org/, formerly NASA-ADS) proprietary data to label text with UAT labels (https://astrothesaurus.org/)

Model Details

  • Base Model: RoBERTa
  • Tokenizer: Custom
  • Parameters: 125M

Training Data

  • 18K titles, abstracts, body and acknowledgments from recent, quality astronomy papers
  • approximately 217M tokens