Clever Geek Handbook

How do I change how often SLURM updates the output file (stdout)?

I am using SLURM to submit assignments on a supercomputer. I have set an option --output=log.out

to put content from job stdout to file ( log.out

). I found that the file is updated every 30-60 minutes, making it difficult to check the status of my jobs.

Any idea why it takes so long to update this file? Is there a way to change the settings so that this file is updated more often?

Using SLURM 14.03.4-2

+3


source to share


1 answer


This could be due to buffering.

Have you tried turning off output buffering as suggested in here ? I would recommend the stdbuf option:

stdbuf -o0 -e0 command



But I can't be sure without more information, as I have never experienced this behavior. What filesystem are you using?

Also, if you are using srun to run your commands, you can use the -unbuffered option, which turns off output buffering.

+4


source






More articles:


All Articles