
Albert Yu
MRU4913
AI & ML interests
None yet
Recent Activity
liked
a model
2 days ago
CohereForAI/aya-vision-32b
liked
a model
3 days ago
ART-Release/ART_v1.0
commented on
an
article
4 days ago
FastRTC: The Real-Time Communication Library for Python
Organizations
MRU4913's activity
commented on
FastRTC: The Real-Time Communication Library for Python
4 days ago
Thank you ~
commented on
FastRTC: The Real-Time Communication Library for Python
5 days ago
Yea, that's my question. I've read the docs and it says fastrtc supports concurrency. That's got me curious about the batching/others technique on the GPU when it processes multiple request at the same time.
commented on
FastRTC: The Real-Time Communication Library for Python
5 days ago
Thank you for reply. I mean batching techniques, like dynamic batching ,static batching on GPU processors. For example , whisper stt run multple concurrent prompt in parallel on GPU.
commented on
FastRTC: The Real-Time Communication Library for Python
9 days ago
Thx to all all. Great work!!!
I have a question for concurrency when use tts_model and stt_model. How does each type of model handle multiple requests at the same time. (e.g. batching technique ? cpu-only threading ....) @freddyaboulton
upvoted
an
article
9 days ago
Article
FastRTC: The Real-Time Communication Library for Python
•
126
How was r7b?
6
#3 opened 3 months ago
by
MRU4913