Posts

In a previous guide we explored how to use Hydra(Zen) and Weights&Biases to speed up our AI research workflow. At the end of the last article I mentioned that I’m going to write a follow up for SLURM, a popular job management system for computer clusters, once I’ve gotten comfortable with it. Well, now that I’ve spent some time with it i can confidently say that it’s a huge timesaver with a low setup cost.

Many researches are often presented with having to evaluate a new model on multiple datasets or sets of hyperparameters. Research code is famously known for having bad quality due to it’s nature of being thrown away after the publication. Often times no reproducible environment is set up and everything is crammed into a hand-full of scripts, or even worse, jupyter notebooks. These overloaded scripts often try do everything from data manipulation, training and evaluation at once, but more often just ends up as a giant pile of spaghetti nobody wants to deal with.