edit above file and below config to have num_nodes = 2 and devices = 8

python trlx/examples/nemo_ilql_inference.py trlx/configs/nemo_configs/megatron_65b.yaml "/path/to/checkpoints"

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference API

Unable to determine this model's library. Check the docs .