Updated ReadME with model information
Browse files
README.md
CHANGED
@@ -1,3 +1,38 @@
|
|
1 |
-
---
|
2 |
-
license: cc-by-nc-nd-4.0
|
3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: cc-by-nc-nd-4.0
|
3 |
+
language:
|
4 |
+
- en
|
5 |
+
base_model: EleutherAI/pythia-410m
|
6 |
+
library_name: transformers
|
7 |
+
tags:
|
8 |
+
- biology
|
9 |
+
- scRNAseq
|
10 |
+
---
|
11 |
+
|
12 |
+
# Overview
|
13 |
+
This is the C2S-Pythia-410m-cell-type-conditioned-cell-generation model, built on the Pythia-410m architecture developed
|
14 |
+
by EleutherAI, fine-tuned using Cell2Sentence (C2S) on a comprehensive collection of single-cell RNA sequencing
|
15 |
+
(scRNA-seq) datasets from CellxGene and the Human Cell Atlas. Cell2Sentence is a pioneering technique that adapts
|
16 |
+
large language models (LLMs) to single-cell biology by converting scRNA-seq data into "cell sentences" — ordered
|
17 |
+
sequences of gene names based on expression levels. This model is specifically trained for cell type-conditioned
|
18 |
+
single-cell generation, enabling the generation of realistic single-cell profiles conditioned on specified cell
|
19 |
+
types.
|
20 |
+
|
21 |
+
# Training Data
|
22 |
+
This model was trained on over 57 million human and mouse cells gathered from over 800 single-cell RNA sequencing
|
23 |
+
datasets from CellxGene and the Human Cell Atlas. This dataset covers a broad range of cell types and conditions
|
24 |
+
from multiple tissues in both human and mouse.
|
25 |
+
|
26 |
+
# Tasks
|
27 |
+
This model is designed for:
|
28 |
+
|
29 |
+
- Cell type-conditioned single-cell generation: Generating single-cell profiles conditioned on specific cell types, allowing for the creation of synthetic cells that reflect the gene expression patterns of targeted cell types.
|
30 |
+
|
31 |
+
|
32 |
+
# Cell2Sentence Links
|
33 |
+
- GitHub: https://github.com/vandijklab/cell2sentence
|
34 |
+
- Paper: https://www.biorxiv.org/content/10.1101/2023.09.11.557287v3
|
35 |
+
|
36 |
+
# Pythia Links
|
37 |
+
- Paper: https://arxiv.org/pdf/2304.01373
|
38 |
+
- Hugging Face: https://huggingface.co/EleutherAI/pythia-410m
|