Update README.md
Browse files
README.md
CHANGED
@@ -22,7 +22,7 @@ _**"How could we process images of different modalities, with different number o
|
|
22 |
**Impact:** Trained in a self-supervised manner, ChAda-ViT sets new benchmarks in biological image analysis. It not only excels in various biologically relevant tasks but also pioneers in bridging the gap across different assays. Whether it's varying microscopes, channel numbers, or types, ChAda-ViT offers a unified, powerful representation for biological images. This paves the way for enhanced interdisciplinary studies and broadens the horizon for deep learning applications in bioimage-based research.
|
23 |
|
24 |
<div align="center">
|
25 |
-
<img width="100%" alt="ChAda-ViT architecture" src="
|
26 |
</div>
|
27 |
|
28 |
## 🗾 Dataset
|
@@ -32,7 +32,7 @@ The IDRCell100k dataset is a comprehensive collection of biological images, meti
|
|
32 |
Dataset available soon...
|
33 |
|
34 |
<div align="center">
|
35 |
-
<img width="70%" alt="IDRCell100k dataset samples" src="
|
36 |
</div>
|
37 |
|
38 |
## 📈 Results
|
@@ -44,21 +44,21 @@ For detailed analyses, comprehensive results, and in-depth discussions, please r
|
|
44 |
ChAda-ViT exhibits exceptional performance across a range of classical biological image benchmarks. Its advanced architecture allows for precise and efficient analysis, outperforming existing models in accuracy and computational efficiency. This highlights the model's significant contribution to the field of bioimaging.
|
45 |
|
46 |
<div align="center">
|
47 |
-
<img width="50%" alt="Vizualization of attention maps" src="
|
48 |
</div>
|
49 |
|
50 |
### Visualization of Attention Maps
|
51 |
The model's innovative Inter-Channel Attention mechanism is visualized, demonstrating its effectiveness in focusing on crucial features within diverse channel types. These visualizations provide insights into the model's internal processing, revealing how it distinguishes and prioritizes different aspects of biological images.
|
52 |
|
53 |
<div align="center">
|
54 |
-
<img width="80%" alt="Vizualization of attention maps" src="
|
55 |
</div>
|
56 |
|
57 |
### Single Joint Embedding Space
|
58 |
ChAda-ViT uniquely embeds images from various modalities into a single, coherent representation space. This feature underscores the model's versatility and its ability to handle images from different microscopes, channel numbers, or types, facilitating a more unified approach in biological image analysis.
|
59 |
|
60 |
<div align="center">
|
61 |
-
<img width="60%" alt="Projection into a single joint embedding space" src="
|
62 |
</div>
|
63 |
|
64 |
|
|
|
22 |
**Impact:** Trained in a self-supervised manner, ChAda-ViT sets new benchmarks in biological image analysis. It not only excels in various biologically relevant tasks but also pioneers in bridging the gap across different assays. Whether it's varying microscopes, channel numbers, or types, ChAda-ViT offers a unified, powerful representation for biological images. This paves the way for enhanced interdisciplinary studies and broadens the horizon for deep learning applications in bioimage-based research.
|
23 |
|
24 |
<div align="center">
|
25 |
+
<img width="100%" alt="ChAda-ViT architecture" src="docs/chada_vit.png">
|
26 |
</div>
|
27 |
|
28 |
## 🗾 Dataset
|
|
|
32 |
Dataset available soon...
|
33 |
|
34 |
<div align="center">
|
35 |
+
<img width="70%" alt="IDRCell100k dataset samples" src="docs/idrcell100k.png">
|
36 |
</div>
|
37 |
|
38 |
## 📈 Results
|
|
|
44 |
ChAda-ViT exhibits exceptional performance across a range of classical biological image benchmarks. Its advanced architecture allows for precise and efficient analysis, outperforming existing models in accuracy and computational efficiency. This highlights the model's significant contribution to the field of bioimaging.
|
45 |
|
46 |
<div align="center">
|
47 |
+
<img width="50%" alt="Vizualization of attention maps" src="docs/classic_benchmarks.png">
|
48 |
</div>
|
49 |
|
50 |
### Visualization of Attention Maps
|
51 |
The model's innovative Inter-Channel Attention mechanism is visualized, demonstrating its effectiveness in focusing on crucial features within diverse channel types. These visualizations provide insights into the model's internal processing, revealing how it distinguishes and prioritizes different aspects of biological images.
|
52 |
|
53 |
<div align="center">
|
54 |
+
<img width="80%" alt="Vizualization of attention maps" src="docs/attn_viz.png">
|
55 |
</div>
|
56 |
|
57 |
### Single Joint Embedding Space
|
58 |
ChAda-ViT uniquely embeds images from various modalities into a single, coherent representation space. This feature underscores the model's versatility and its ability to handle images from different microscopes, channel numbers, or types, facilitating a more unified approach in biological image analysis.
|
59 |
|
60 |
<div align="center">
|
61 |
+
<img width="60%" alt="Projection into a single joint embedding space" src="docs/single_joint_embedding_space.png">
|
62 |
</div>
|
63 |
|
64 |
|