This is an old revision of the document!
Cyfronet
Applying for grant and access to Cluster
Sign up at https://portal.plgrid.pl/ Apply for grant and activate it at https://portal.plgrid.pl/services Access to the Ares cluster at the Cyfronet centre [grant required]
Login to cluster
ssh <login>@ares.cyfronet.pl <login> = plg——
Install libraries/packages using module
module avail : lists available libraries/packages module list : lists loaded libraries/packages module load <package> : loads specified package module spider <keyword> : searches available packages with the keyword module purge : purges the environment
System utilities hpc-grants : shows available grants, resource allocations, consumed resourced hpc-fs : shows available storage hpc-jobs : shows currently pending/running jobs hpc-jobs-history : shows information about past jobs
Storages
$HOME $SCRATCH $PLG_GROUPS_STORAGE (starts with “plgg”)
Install Herwig7
Load necessary modules - module load python/2.7.18-gcccore-11.2.0 module load libtool module load emacs module load gcc/11.2.0 module load gcccore/11.2.0 module load cmake/3.22.1-gcccore-11.2.0 Module load gsl/2.7-gcc-11.2.0 Download bootstrap script from https://herwig.hepforge.org/downloads.html Move to $SCRATCH or $PLG_GROUPS_STORAGE (preferred) and $./herwig-bootstrap -j4 $PWD/Herwig Activate Herwig environment : $ source Herwig/bin/activate
A sample run script (and common slurm commands)
run.sh :
#!/bin/bash
#SBATCH –job-name=Sample_Run
#SBATCH –nodes=1 #SBATCH –ntasks-per-node=1 #SBATCH –cpus-per-task=1 #SBATCH –mem-per-cpu=1GB
# set wall time to 1 day #SBATCH –time=1-00:00:00
## Name of partition ##SBATCH -p plgrid
sleep $1)
cd <Run directory>
source <path/to/>Herwig/bin/activate
export HW=Herwig
${HW} run *.run –seed=$seed -N 1000000 > /dev/null &
HWPID=“$!” wait “${HWPID}”
Run commands from CLI - Submit parallel jobs: sbatch –array=0-5 -A <grantname-suffix> run.sh Suffix = cpu, cpu-bigmem, gpu sprio: show status of pending jobs sshare : show usage of available grants
Run interactive bash session - srun -p plgrid-now -t 1:00:00 –mem=1GB -A <grantname-cpu> –pty /bin/bash
Detailed information about Ares - https://docs.cyfronet.pl/display/~plgpawlik/Ares#Ares-AccesstoAres
Slurm documentation - https://slurm.schedmd.com/quickstart.html