File size: 1,202 Bytes
f31c6e8
 
 
 
 
 
242c6cf
f31c6e8
 
 
 
 
b1ea6f4
 
861de96
b1ea6f4
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
---
license: apache-2.0
language:
- en
base_model:
- metagene-ai/METAGENE-1
base_model_relation: quantized
tags:
- DNA
- RNA
- genomic
- metagenomic
---

# METAGENE-1-AWQ-4Bit

## **Model Information**

**METAGENE-1** is a 7-billion-parameter autoregressive transformer language model, which we refer to as a *metagenomic foundation model*, that was trained on a novel corpus of diverse metagenomic DNA and RNA sequences comprising over 1.5 trillion base pairs. This dataset is sourced from a large collection of human wastewater samples, processed and sequenced using deep metagenomic (next-generation) sequencing methods. Unlike genomic models that focus on individual genomes or curated sets of specific species, the aim of METAGENE-1 is to capture the full distribution of genomic information present across the human microbiome. After pretraining, this model is designed to aid in tasks in the areas of biosurveillance, pandemic monitoring, and pathogen detection.


This repository contains [`metagene-ai/METAGENE-1-AWQ-4Bit`](https://huggingface.co/metagene-ai/METAGENE-1-AWQ-4Bit) quantized using [AutoAWQ](https://github.com/casper-hansen/AutoAWQ) from BF16 down to 4Bit with a group size 128.