[Unit Test] Add unit tests for DistributedTrainer

[xrsrke]

No description provided.

[ashishpetwal]

I would like to contribute to this issue. Could you specify more about it?

[xrsrke]

@ashishpetwal like writing a unit test for

nanotron/run_train.py

Lines 136 to 140 in 9f117ee

	trainer = DistributedTrainer(config_file)
	dataloader = get_dataloader(trainer)
	# Train
	trainer.train(dataloader)

[xrsrke]

@ashishpetwal would you like to take it?

[ashishpetwal]

I haven't written tests in Python, but if it is beginner-friendly. I would love to take it. What do you think, is there a more learning curve?

[xrsrke]

we use pytest in nanotron https://github.com/pytest-dev/pytest