Vitaliy Chiley's picture

30 4

Vitaliy Chiley

vchiley

·

AI & ML interests

None yet

Recent Activity

authored a paper 6 months ago

Inference-Friendly Models With MixAttention

authored a paper 10 months ago

LoRA Learns Less and Forgets Less

authored a paper 10 months ago

Online Normalization for Training Neural Networks

View all activity

Organizations

vchiley's activity

authored a paper 6 months ago

Inference-Friendly Models With MixAttention

Paper • 2409.15012 • Published Sep 23, 2024

authored 6 papers 10 months ago

LoRA Learns Less and Forgets Less

Paper • 2405.09673 • Published May 15, 2024 • 88

Online Normalization for Training Neural Networks

Paper • 1905.05894 • Published May 15, 2019

Pipelined Backpropagation at Scale: Training Large Models without Batches

Paper • 2003.11666 • Published Mar 25, 2020

Memory Efficient 3D U-Net with Reversible Mobile Inverted Bottlenecks for Brain Tumor Segmentation

Paper • 2104.09648 • Published Apr 19, 2021

Adaptive Braking for Mitigating Gradient Delay

Paper • 2007.01397 • Published Jul 2, 2020

RevBiFPN: The Fully Reversible Bidirectional Feature Pyramid Network

Paper • 2206.14098 • Published Jun 28, 2022

New activity in mosaicml/mpt-7b-storywriter over 1 year ago

add explicit cast where running without autocast causes issues

#41 opened over 1 year ago by

New activity in mosaicml/mpt-7b over 1 year ago

add explicit cast where running without autocast causes issues

#60 opened over 1 year ago by

New activity in mosaicml/mpt-7b-instruct over 1 year ago

add explicit cast where running without autocast causes issues

#48 opened over 1 year ago by

New activity in mosaicml/mpt-7b-chat over 1 year ago

add explicit cast where running without autocast causes issues

#26 opened over 1 year ago by

New activity in mosaicml/mpt-7b-storywriter over 1 year ago

add text-generation pipeline example with autocast

#40 opened over 1 year ago by

New activity in mosaicml/mpt-7b-chat over 1 year ago

add text-generation pipeline example with autocast

#25 opened over 1 year ago by

New activity in mosaicml/mpt-7b-instruct over 1 year ago

add text-generation pipeline example with autocast

#47 opened over 1 year ago by

New activity in mosaicml/mpt-7b over 1 year ago

add text-generation pipeline example with autocast

#59 opened over 1 year ago by

New activity in mosaicml/mpt-7b-chat almost 2 years ago

Update modeling_mpt.py

#24 opened almost 2 years ago by

New activity in mosaicml/mpt-7b-storywriter almost 2 years ago

Update modeling_mpt.py

#39 opened almost 2 years ago by

New activity in mosaicml/mpt-7b-instruct almost 2 years ago

Update modeling_mpt.py

#44 opened almost 2 years ago by

New activity in mosaicml/mpt-7b almost 2 years ago

Update modeling_mpt.py

#55 opened almost 2 years ago by

Is it possible to add logic for handling output_attentions?

#30 opened almost 2 years ago by

abhinavkulkarni