RaphaelMourad
/

Mistral-DNA-v1-138M-virus

virus (both rna and dna)

Model card Files Files and versions Community

RaphaelMourad commited on 7 days ago

Commit

2e58141

•

1 Parent(s): 790be30

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -13,7 +13,7 @@ tags:
 The Mistral-DNA-v1-138M-virus Large Language Model (LLM) is a pretrained generative DNA text model with 17.31M parameters x 8 experts = 138.5M parameters.
 It is derived from Mistral-7B-v0.1 model, which was simplified for DNA: the number of layers and the hidden size were reduced.
-The model was pretrained using around 15071 viruses > 1kb.
 Virus genome database was downloaded from https://www.ncbi.nlm.nih.gov/labs/virus/vssi/#/virus?SeqType_s=Genome&VirusLineage_ss=taxid:10239&SourceDB_s=RefSeq.
 NB: the DNA sequence was used, not the RNA sequence.

 The Mistral-DNA-v1-138M-virus Large Language Model (LLM) is a pretrained generative DNA text model with 17.31M parameters x 8 experts = 138.5M parameters.
 It is derived from Mistral-7B-v0.1 model, which was simplified for DNA: the number of layers and the hidden size were reduced.
+The model was pretrained using around 15071 viruses > 1kb. Virus genomes were split into 1kb sequences.
 Virus genome database was downloaded from https://www.ncbi.nlm.nih.gov/labs/virus/vssi/#/virus?SeqType_s=Genome&VirusLineage_ss=taxid:10239&SourceDB_s=RefSeq.
 NB: the DNA sequence was used, not the RNA sequence.