File size: 2,498 Bytes
c4927ea 4e0461c c4927ea 4e0461c 2ee64a8 c4927ea 60a2660 2395ac7 5675b18 2395ac7 c4927ea 8271ab1 c4927ea |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 |
---
language:
- en
base_model:
- Ultralytics/YOLO11
tags:
- yolo
- yolo11
- yolo11n
- yolo11n-seg
- fish
- Segmentation
datasets:
- akridge/MOUSS_fish_segment_dataset_grayscale
pipeline_tag: image-segmentation
---
# Yolo11n-seg Fish Segmentation
## Model Overview
This model was trained to detect and segment fish in underwater **Grayscale Imagery** using the YOLO11n-seg architecture, leveraging automatic training with the **Segment Anything Model (SAM)** for generating segmentation masks. The combination of detection and SAM-powered segmentation enhances the model's ability to outline fish boundaries.
- **Model Architecture**: YOLO11n-seg
- **Task**: Fish Segmentation
- **Footage Type**: Grayscale Underwater Footage
- **Classes**: 1 (Fish)
## Demo Space:
- https://huggingface.co/spaces/noaa-pifsc-ai/YOLO11_Fish-or-No-Fish-Detector-Demo_grayscale
## Test Results
## Model Weights
Download the model weights [here](./yolo11n-seg-fish-trained.pt)
## Auto-Training Process
The segmentation dataset was generated using an automated pipeline:
- **Detection Model**: A pre-trained YOLO model (https://huggingface.co/akridge/yolo11-fish-detector-grayscale/) was used to detect fish.
- **Segmentation**: The SAM model (`sam_b.pt`) was applied to generate precise segmentation masks around detected fish.
- **Output**: The dataset was saved at `/content/sam_dataset/`.
This automated process allowed for efficient mask generation without manual annotation, facilitating faster dataset creation.
## Intended Use
- Real-time fish detection and segmentation on grayscale underwater imagery.
- Post-processing of video or images for research purposes in marine biology and ecosystem monitoring.
## Training Configuration
- **Dataset**: SAM asisted segmentation dataset.
- **Training/Validation Split**: 80% training, 20% validation.
- **Number of Epochs**: 50
- **Learning Rate**: 0.001
- **Batch Size**: 16
- **Image Size**: 640x640
## Results and Metrics
The model was trained and evaluated on the generated segmentation dataset with the following results:
### Confusion Matrix
## How to Use the Model
To use the trained YOLO11n-seg model for fish segmentation:
1. **Load the Model**:
```python
from ultralytics import YOLO
# Load YOLO11n-seg model
model = YOLO("yolo11n_fish_seg_trained.pt")
# Perform inference on an image
results = model("/content/test_image.jpg")
results.show()
``` |