tags: Intel, Profile, MPI
What is ITAC
ITAC (included in OneAPI) is a MPI tracer and analyer for intelmpi, if your program can be compiled with Intel MPI, then you can get a detailed MPI trace data by ITAC.
How to use ITAC
setup for tracing
module use /scinet/intel/oneapi/2021u4/itac/latest/modulefiles module load itac export LD_PRELOAD=/scinet/intel/oneapi/2021u4/itac/latest/slib/libVT.so
export VT_LOGFILE_FORMAT=stfsingle export VT_PCTRACE=5 export VT_LOGFILE_NAME=...
by Config File
Just list some useful:
# This line will be ignored as a comment CURRENT-DIR "/home/l/lcl_uotiscscc/lcl_uotiscsccs1034/icon/hand/icon-intelmpi/build/experiments/exp_scc2850/scripts" # The Intel Trace Collector uses the current working directory of the process that reads the configuration on all processes to resolve relative path names. You can override the current working directory with this option. PCTRACE 5 # trace level normally use 5 PCTRACE-FAST on # trace without check fails MEM-MAXBLOCKS 16 # trace max block on memory PROCESS 0:N OFF # turn off trace for all core PROCESS 1:N:10 on # turn on trace for core #1,11,..10n+1 tile N # by turning off trace for some cores can reduce the Memory usage and accelerate the trace speed. TIME-WINDOWS 0:1, 420:720 # open trace for some time: from sec 0 to sec 1 and sec 420 to sec 720.
for more options you can find in Intel® Trace Collector User and Reference Guide
turn down the
MEM-MAXBLOCKS and use less process to trace.
visualize ITAC result