Starccm+¶

Support tier: 1

Read information about support tiers.

Installed versions¶

Resource	Version
Arrhenius	2406, 2410, 2502, 2506, 2510, 2602, 2606

Read information about how to load this software in your environment by searching for Lmod module.

General information¶

How to use STAR-CCM+ on Arrhenius¶

STAR-CCM+ is commercial CFD software and NAISS does not provide a license. All licenses to use STAR-CCM+ on Arrhenius must be supplied by the users.

The STAR-CCM+ executables can be accessed by loading the appropriate modules. To see which versions of STAR-CCM+ are available use the command

module avail star-ccm+

You can either set the environment variable CDLMD_LICENSE_FILE to set the proper license server (differnt from the PoD server 1999@flex.cd-adapco.com), or get access to STAR-CCM+ through a "Power on Demand (PoD)" license key

Launch STAR-CCM+ in graphical mode¶

You need to book an interactive session adding with X11 support by adding "--x11" to "salloc" then you can launch STAR-CCM+ in graphical mode as:

srun starccm+ -power -podkey your_pod_key -licpath 1999@flex.cd-adapco.com

or

export CDLMD_LICENSE_FILE=port@hostname

srun starccm+ -power

depending on the license type. "port" and "hostname" are port number and hostname of the license server. please avoid running the "starccm+ command without "srun" otherwise it will run on the login node shared among all the users

Running in batch mode¶

sample job script for running on the CPU nodes¶

Please note that you can use maximum 247 processes per node

#!/bin/bash 

#SBATCH -A <your_allocation>
#SBATCH -J star_test
#SBATCH -t 0-01:0:00
#SBATCH -N 2
#SBATCH --ntasks-per-node=247
#The following line gives axclusive access to the node without that the job will share node with other jobs
#SBATCH --exclusive 
#SBATCH -p cpu
#SBATCH -e error%J
#SBATCH -o output%J

module load STAR-CCM+/2606-impi-bdist

sim_file="my-input.sim"

export TMPDIR=/tmp
LUSTRE_ROOT=$(pwd)/config
mpi=intel
export CDLMD_LICENSE_FILE=port@hostname #In case you have a license server #in case you have a license server


#run star-ccm+: please choose one of the following commands based on your license type:

#Running with PoD key
starccm+ -power -batchsystem slurm -podkey <your PoD key> -licpath 1999@flex.cd-adapco.com -mpidriver $mpi -xsystemlibfabric -np $SLURM_NTASKS -batch run -pio -nbuserdir $LUSTRE_ROOT  ${sim_file}> my_output_file_$SLURM_JOBID 2>&1

#Running with a license server
starccm+ -power -batchsystem slurm -mpidriver $mpi -xsystemlibfabric -np $SLURM_NTASKS -batch run -pio -nbuserdir $LUSTRE_ROOT  ${sim_file}> my_output_file_$SLURM_JOBID 2>&1

sample job script for running on the GPU nodes¶

#!/bin/bash 
#SBATCH -A <your_allocation>
#SBATCH -J star_test
#SBATCH -t 0-00:10:00
#SBATCH -p gpu
#SBATCH -N 2
#SBATCH --gpus-per-node=4
#SBATCH --ntasks-per-node=8 #Set 2 MPI tasks per GPU
#SBATCH -e error%J
#SBATCH -o output%J


module load GPU/STAR-CCM+/2606-ompi-bdist

sim_file="test.sim"
export TMPDIR="/tmp"
LUSTRE_ROOT=$(pwd)/config
mpi=openmpi

#run star-ccm+: please choose one of the following commands based on your license type:

#Running with PoD key

starccm+ -batchsystem slurm -podkey <your_PoD_KEY> -licpath 1999@flex.cd-adapco.com -gpgpu "auto:$SLURM_GPUS_PER_NODE" -mpidriver $mpi -xsystemlibfabric -np $SLURM_NTASKS -batch run -pio -nbuserdir $LUSTRE_ROOT ${sim_file} > my_output_file_$SLURM_JOBID 2>&1

#Running with license server

starccm+ -batchsystem slurm -gpgpu "auto:$SLURM_GPUS_PER_NODE" -mpidriver $mpi -xsystemlibfabric -np $SLURM_NTASKS -batch run -pio -nbuserdir $LUSTRE_ROOT ${sim_file} > my_output_file_$SLURM_JOBID 2>&1