muellerzr's picture
muellerzr HF staff
Move zero_grad
d091751
raw
history blame
287 Bytes
<pre>
for batch in dataloader:
inputs, targets = batch
inputs = inputs.to(device)
targets = targets.to(device)
outputs = model(inputs)
loss = loss_function(outputs, targets)
loss.backward()
optimizer.step()
scheduler.step()
optimizer.zero_grad()</pre>