|
---
|
|
title: topic-clustering-global-dashboard
|
|
app_file: service_periodic.py
|
|
sdk: gradio
|
|
sdk_version: 4.43.0
|
|
---
|
|
## Build docker
|
|
```
|
|
docker build -t clustering-dashboard .
|
|
docker run -d --restart=always --name clustering-dashboard clustering-dashboard
|
|
```
|
|
|
|
## Deploy TRT
|
|
```
|
|
scp -r docker/api_trt/Dockerfile ./
|
|
docker build -t api-clustering .
|
|
docker run --gpus 1 --dns 8.8.8.8 -it -p 8633:8633 -v /home/dp04/topic-clustering-global-dashboard:/app -t --name api-clustering api-clustering
|
|
```
|
|
|
|
### Topic Clustering
|
|
1. API clustering port 8633: dùng cho phân cụm NEWS trong các loại báo cáo ( báo cáo nhanh, báo cáo tổng quan, báo cáo template,...)
|
|
- Command:
|
|
```
|
|
docker run --gpus all -it --rm -v /home/vietle/topic-clustering:/home/vietle/topic-clustering --name topic_clustering_trt_sb -p 8636:8633 topic-clustering-trt
|
|
cd /home/vietle/topic-clustering && CUDA_VISIBLE_DEVICES=<cuda_device_id> python main_cache.py
|
|
```
|
|
- screen: 52097.clustering.trt
|
|
2. API clustering social: Phân cụm tin tức social
|
|
- Command: cd /home/vietle/topic-clustering/ && source docker_venv/bin/activate && uvicorn service_social:app --host 0.0.0.0 --port 8635
|
|
- Screen: 37529.clustering.social
|
|
3. Phân cụm cho global dashboard:
|
|
- API:
|
|
```
|
|
CMD: systemctl status bzo_clustering_api_cpu.service (port 8634)
|
|
Screen: 21445.clustering.cpu
|
|
```
|
|
- Consumer:
|
|
+ Phân cụm daily:
|
|
```
|
|
Command: cd /home/vietle/topic-clustering/ && source docker_venv/bin/activate && OMP_NUM_THREADS=16 CUDA_VISIBLE_DEVICES=-1 python consumer_clustering.py
|
|
Screen: 16024.bzo.clustering_daily
|
|
```
|
|
+ Phân cụm weekly/monthly:
|
|
```
|
|
Command: cd /home/vietle/topic-clustering/ && source docker_venv/bin/activate && OMP_NUM_THREADS=16 CUDA_VISIBLE_DEVICES='-1' python consumer_merge_clustering.py
|
|
Screen: 60767.bzo.clustering_monthly
|
|
```
|
|
|
|
4. Phân cụm điểm tin:
|
|
- Command:
|
|
```
|
|
docker run --gpus all -it --rm -v /home/vietle/topic-clustering:/home/vietle/topic-clustering --name topic_clustering_trt_sb -p 8636:8633 topic-clustering-trt
|
|
cd /home/vietle/topic-clustering/ && python main_cache_Thien.py
|
|
```
|
|
|