

TITLE
Fixup no_trainer examples scripts and add more tests

COMMENTS
1

REACTIONS
+1: 0
-1: 0
laugh: 0
hooray: 0
heart: 0
rocket: 0
eyes: 0

BODY
# Fixup `no_trainer` Examples and Bolster their tests

## What does this add?

This changes the logging behavior inside the `no_trainer` scripts, slightly changes how the initial configuration is stored, and adds tests for the tracking API.

## Who is it for?

Users of `transformers` who want to try out `Accelerate` quickly

## Why is this needed?

I was made aware that the scripts were laggy when it came to how logs were sent to weights and biases when using the `no_trainer` scripts, and this was due to the step being passed in as a parameter, causing a lag in when it gets uploaded.

To follow akin to the original Accelerate scripts, these are now passed in as a `"step"` parameter to the overall dictionary logged via `accelerate.log()`

`TensorBoard` also does not like when `Enum`'s are logged, so there is a manual adjustment rightr before saving the hyperparemeters to get the enum value from the LR Scheduler type. 

Finally, as `TensorBoard` is a test requirement, I added in tests for tracking inside the no_trainer tests, as `TensorBoard` is also how we test that behavior in the CI in Accelerate proper.