Slurm

install slurm under fedora 26

Edit slurm.spec to avoid plugin_load_from_file: dlopen(/usr/lib64/slurm/select_linear.so): /usr/lib64/slurm/select_linear.so: undefined symbol: slurm_job_preempt_mode." Add the four lines between %...

%build
CFLAGS="$RPM_OPT_FLAGS -Wl,-z,lazy"
CXXFLAGS="$RPM_OPT_FLAGS -Wl,-z,lazy"
export CFLAGS
export CXXFLAGS
%configure \

Build slurm

rpmbuild -ta slurm*.tar.bz2

Install rpms.

yum -y install munge slurm slurm-plugins slurm-munge

configure munge

dd if=/dev/random bs=1 count=1024 > /etc/munge/munge.key
chmod 0600 /etc/munge/munge.key
chown munge /etc/munge/munge.key
systemctl start munge

test installation

Generate a credential on stdout.

munge -n

Check if a credential can be locally decoded.

munge -n | unmunge

Check if a credential can be remotely decoded.

munge -n | ssh somehost unmunge

Run a quick benchmark.

remunge

how does it work

scontrol show config

check priorities of jobs using the command

scontrol show job".

job control

Submit a job

sbatch /tmp/slurm_test_1

List jobs:

squeue

Get job details:

scontrol show job 106

Suspend a job (root only):

scontrol suspend 135

Resume a job (root only):

scontrol resume 135

Kill a job. Users can kill their own jobs, root can kill any job.

scancel 135

Hold a job

scontrol hold 139

Release a job:

scontrol release 139

List partitions:

sinfo

example job script.

#!/usr/bin/env bash
#SBATCH -p defq
#SBATCH -J simple
sleep 60

troubleshooting

Restore node.

scontrol update nodename=www state=down Reason=troubleshooting
scontrol update nodename=www state=resume