Mitali P

mitalipo

AI & ML interests

None yet

Recent Activity

Reacted to daniel-de-leon's post with 🔥 about 1 month ago

As the rapid adoption of chat bots and QandA models continues, so do the concerns for their reliability and safety. In response to this, many state-of-the-art models are being tuned to act as Safety Guardrails to protect against malicious usage and avoid undesired, harmful output. I published a Hugging Face blog introducing a simple, proof-of-concept, RoBERTa-based LLM that my team and I finetuned to detect toxic prompt inputs into chat-style LLMs. The article explores some of the tradeoffs of fine-tuning larger decoder vs. smaller encoder models and asks the question if "simpler is better" in the arena of toxic prompt detection. 🔗 to blog: https://huggingface.co/blog/daniel-de-leon/toxic-prompt-roberta 🔗 to model: https://huggingface.co/Intel/toxic-prompt-roberta 🔗 to OPEA microservice: https://github.com/opea-project/GenAIComps/tree/main/comps/guardrails/toxicity_detection A huge thank you to my colleagues that helped contribute: @qgao007, @mitalipo, @ashahba and Fahim Mohammad

upvoted an article about 1 month ago

Occam’s Sheath: A Simpler Approach to AI Safety Guardrails

liked a model about 2 months ago

Intel/toxic-prompt-roberta

View all activity

Articles

Model Card Generator Interface: Crafting Clear Insights into AI Models

Sep 27

• 4

Organizations

mitalipo's activity

Reacted to daniel-de-leon's post with 🔥 about 1 month ago

Post

2393

As the rapid adoption of chat bots and QandA models continues, so do the concerns for their reliability and safety. In response to this, many state-of-the-art models are being tuned to act as Safety Guardrails to protect against malicious usage and avoid undesired, harmful output. I published a Hugging Face blog introducing a simple, proof-of-concept, RoBERTa-based LLM that my team and I finetuned to detect toxic prompt inputs into chat-style LLMs. The article explores some of the tradeoffs of fine-tuning larger decoder vs. smaller encoder models and asks the question if "simpler is better" in the arena of toxic prompt detection.

🔗 to blog: https://huggingface.co/blog/daniel-de-leon/toxic-prompt-roberta
🔗 to model: Intel/toxic-prompt-roberta
🔗 to OPEA microservice: https://github.com/opea-project/GenAIComps/tree/main/comps/guardrails/toxicity_detection

A huge thank you to my colleagues that helped contribute: @qgao007 , @mitalipo , @ashahba and Fahim Mohammad