TTIC SLURM Cluster: Process Statistics
Fri Dec 8 23:55:11 CST 2023 [Docs] | [Job Process Info] | [Job Queue] | [Cluster Usage & Load]

Node User Command CPU % MEM % MEM (kb)
cpu0 NCPU: 8 load average: 0.00, 0.01, 0.05
cpu1 NCPU: 8 load average: 0.04, 0.03, 0.05
cpu2 NCPU: 8 load average: 0.00, 0.01, 0.05
cpu3 NCPU: 8 load average: 0.00, 0.01, 0.05
cpu4 NCPU: 8 load average: 0.02, 0.02, 0.05
cpu5 NCPU: 8 load average: 0.15, 0.08, 0.07
cpu6 NCPU: 8 load average: 0.00, 0.04, 0.05
cpu7 NCPU: 8 load average: 0.00, 0.01, 0.05
cpu8 NCPU: 8 load average: 0.00, 0.01, 0.05
cpu9 NCPU: 8 load average: 0.01, 0.02, 0.05
cpu10 NCPU: 8 load average: 0.00, 0.01, 0.05
cpu11 NCPU: 8 load average: 0.00, 0.01, 0.05
cpu12 NCPU: 12 load average: 0.00, 0.01, 0.05
jjery2243542 zsh 0.0 0.0 6440
cpu13 NCPU: 12 load average: 0.00, 0.01, 0.05
cpu14 NCPU: 12 load average: 0.06, 0.06, 0.05
cpu15 NCPU: 12 load average: 0.00, 0.01, 0.05
cpu16 NCPU: 12 load average: 0.00, 0.01, 0.05
cpu17 NCPU: 12 load average: 0.00, 0.01, 0.05
cpu18 NCPU: 20 load average: 0.00, 0.01, 0.05
cpu19 NCPU: 12 load average: 0.00, 0.02, 0.05
cpu20 NCPU: 64 load average: 0.23, 0.08, 0.06
cpu21 NCPU: 255 load average: 0.00, 0.01, 0.05
gpu0 NCPU: 24 load average: 0.00, 0.02, 0.05
gpu1 NCPU: 20 load average: 0.01, 0.07, 0.06
gpu2 NCPU: 20 load average: 0.00, 0.01, 0.05
gpu3 NCPU: 24 load average: 0.00, 0.01, 0.05
gpu4 NCPU: 20 load average: 0.94, 1.01, 1.14
kangrui python 100 1.2 2474612
kangrui slurm_script 0.0 0.0 1400
gpu5 NCPU: 16 load average: 0.00, 0.01, 0.05
gpu6 NCPU: 16 load average: 0.22, 0.53, 0.84
gpu7 NCPU: 20 load average: 0.00, 0.01, 0.05
gpu10 NCPU: 48 load average: 2.20, 1.24, 6.84
marcelo python 105 0.0 406020
marcelo python 103 0.0 370600
marcelo python 103 0.0 356160
marcelo python 100 0.0 380728
marcelo python 97.3 0.0 356416
marcelo python 97.0 0.0 361296
marcelo python 88.0 0.0 351372
marcelo python 83.0 0.0 295496
marcelo python 72.1 0.0 406020
marcelo python 72.0 0.0 406028
marcelo python 70.2 0.3 3314656
marcelo python 68.3 0.2 2872060
marcelo python 68.3 0.2 2872068
marcelo python 66.9 0.2 2872052
marcelo python 66.1 0.2 2871836
marcelo python 65.1 0.2 2871848
marcelo python 64.7 0.2 2872064
marcelo python 61.1 0.0 406036
marcelo python 59.5 0.0 406044
marcelo python 58.4 0.0 406040
marcelo python 58.2 0.0 406040
marcelo python 58.1 0.0 406020
marcelo python 57.9 0.2 2871764
marcelo python 57.8 0.0 406016
marcelo python 43.6 0.0 406028
marcelo python 43.4 0.0 406200
marcelo python 41.5 0.0 406028
marcelo python 40.5 0.0 406020
marcelo python 39.5 0.0 406016
marcelo python 37.7 0.0 406032
marcelo python 34.5 0.0 406020
marcelo python 18.1 0.0 402056
marcelo python 0.3 0.0 8948
marcelo slurm_script 0.1 0.0 1692
marcelo python 0.0 0.0 12
gpu11 NCPU: 20 load average: 0.00, 0.01, 0.05
gpu12 NCPU: 48 load average: 0.00, 0.26, 0.89
gpu13 NCPU: 48 load average: 0.00, 0.04, 0.05
gpu14 NCPU: 20 load average: 0.00, 0.01, 0.05
gpu15 NCPU: 20 load average: 0.04, 0.07, 0.09
gpu16 NCPU: 48 load average: 0.06, 0.11, 0.13
gpu17 NCPU: 20 load average: 0.04, 0.05, 0.12
gpu18 NCPU: 20 load average: 0.00, 0.05, 0.12
gpu19 NCPU: 20 load average: 0.37, 0.13, 0.08
gpu20 NCPU: 20 load average: 0.00, 0.02, 0.05
gpu21 NCPU: 20 load average: 0.00, 0.01, 0.05
kevinsuk bash 0.0 0.0 1744
gpu30 NCPU: 6 load average: 0.86, 0.80, 0.70
gpu31 NCPU: 4 load average: 0.41, 0.85, 1.04
marcelo jupyter-lab 0.1 0.1 92952
marcelo slurm_script 0.0 0.0 1672
marcelo bash 0.0 0.0 2532
marcelo python 0.0 0.0 59408
gpu32 NCPU: 4 load average: 1.07, 1.47, 1.25
jjahn bash 0.0 0.0 4312
gpu33 NCPU: 8 load average: 2.09, 2.11, 2.01
xdu watch 1.5 0.0 2712
xdu watch 0.2 0.0 2716
xdu bash 0.0 0.0 2588
xdu bash 0.0 0.0 2392
xdu bash 0.0 0.0 2280
xdu bash 0.0 0.0 2280
xdu watch 0.0 0.0 1076
xdu nvidia-smi 0.0 0.0 13356
gpu34 NCPU: 8 load average: 0.59, 0.46, 0.61
gpu35 NCPU: 4 load average: 1.26, 0.89, 0.53
marziyeh python 0.2 20.2 13332552
marziyeh python 0.0 1.5 1045208
marziyeh python 0.0 1.2 833316
marziyeh python 0.0 0.0 56808
marziyeh bash 0.0 0.0 2412
marziyeh jupyter-noteboo 0.0 0.2 131748
marziyeh python 0.0 1.0 658684
gpu36 NCPU: 8 load average: 0.48, 0.64, 0.88
jiahao bash 0.0 0.0 5248
jiahao python 0.0 0.0 7652
jiahao bash 0.0 0.0 5248
gpu37 NCPU: 4 load average: 0.15, 0.34, 0.48
gpu38 NCPU: 4 load average: 0.62, 0.91, 1.11
gpu39 NCPU: 8 load average: 1.06, 1.10, 1.03
gpu40 NCPU: 48 load average: 0.06, 0.16, 0.13
yanhongli bash 0.0 0.0 2256
gpu41 NCPU: 20 load average: 7.00, 7.33, 7.40
jjahn python 100 1.4 5791460
jjahn python 100 2.5 9975412
jjahn python 100 1.4 5790632
jjahn python 100 1.4 5790520
jjahn python 99.4 1.8 7415612
jjahn python 99.3 1.4 5788184
jjahn python 99.3 1.4 5789508
jjahn python 99.3 1.4 5792512
jjahn bash 0.0 0.0 1644
jjahn bash 0.0 0.0 1652
jjahn bash 0.0 0.0 1656
jjahn bash 0.0 0.0 1640
jjahn bash 0.0 0.0 1656
jjahn bash 0.0 0.0 1648
jjahn bash 0.0 0.0 1652
jjahn bash 0.0 0.0 1640
gpu42 NCPU: 12 load average: 0.45, 0.48, 0.41

TTIC SLURM Cluster: GPU Statistics
Fri Dec 8 23:55:11 CST 2023

Node Fan SpeedTemp Perf State PowerMax MemoryMax GPU Usage User
gpu085%32CP833W250W6MiB11264MiB0%
gpu085%32CP828W250W1MiB11264MiB0%
gpu085%32CP822W250W1MiB11264MiB0%
gpu085%31CP834W250W1MiB11264MiB0%
gpu185%35CP826W250W6MiB11264MiB0%
gpu185%29CP85W250W1MiB11264MiB0%
gpu185%32CP83W260W1MiB11264MiB0%
gpu185%29CP821W250W1MiB11264MiB0%
gpu285%30CP814W140W6MiB16376MiB0%
gpu285%32CP815W140W1MiB16376MiB0%
gpu285%31CP817W140W1MiB16376MiB0%
gpu285%30CP817W140W1MiB16376MiB0%
gpu385%33CP825W250W6MiB11264MiB0%
gpu385%33CP843W250W1MiB11264MiB0%
gpu385%32CP826W250W1MiB11264MiB0%
gpu385%30CP832W250W1MiB11264MiB0%
gpu485%46CP242W140W1205MiB16376MiB17%kangrui
gpu485%35CP817W140W1MiB16376MiB0%
gpu485%32CP817W140W1MiB16376MiB0%
gpu485%30CP816W140W1MiB16376MiB0%
gpu585%30CP815W140W6MiB16376MiB0%
gpu585%31CP816W140W1MiB16376MiB0%
gpu585%30CP814W140W1MiB16376MiB0%
gpu585%31CP814W140W1MiB16376MiB0%
gpu685%34CP827W250W6MiB12288MiB0%
gpu685%34CP825W250W1MiB12288MiB0%
gpu685%34CP827W250W1MiB12288MiB0%
gpu685%35CP826W250W1MiB12288MiB0%
gpu785%31CP816W280W6MiB24576MiB0%
gpu785%31CP810W280W1MiB24576MiB0%
gpu785%29CP816W280W1MiB24576MiB0%
gpu785%29CP810W280W1MiB24576MiB0%
gpu1085%36CP262W300W5169MiB49140MiB0%marcelo
gpu1085%36CP256W300W2085MiB49140MiB0%marcelo
gpu1085%35CP264W300W2085MiB49140MiB0%marcelo
gpu1085%34CP257W300W2085MiB49140MiB0%marcelo
gpu1085%35CP258W300W2085MiB49140MiB0%marcelo
gpu1085%34CP258W300W2085MiB49140MiB0%marcelo
gpu1085%36CP257W300W2085MiB49140MiB0%marcelo
gpu1085%36CP260W300W2045MiB49140MiB0%marcelo
gpu1185%32CP829W250W6MiB11264MiB0%
gpu1185%28CP814W250W1MiB11264MiB0%
gpu1185%29CP810W250W1MiB11264MiB0%
gpu1185%31CP86W250W1MiB11264MiB0%
gpu1185%29CP84W250W1MiB11264MiB0%
gpu1185%29CP87W250W1MiB11264MiB0%
gpu1185%29CP813W250W1MiB11264MiB0%
gpu1185%29CP823W250W1MiB11264MiB0%
gpu1285%31CP822W300W1MiB49140MiB0%
gpu1285%30CP819W300W1MiB49140MiB0%
gpu1285%31CP820W300W1MiB49140MiB0%
gpu1285%29CP831W300W6MiB49140MiB0%
gpu1285%30CP822W300W1MiB49140MiB0%
gpu1285%29CP830W300W1MiB49140MiB0%
gpu1285%31CP822W300W1MiB49140MiB0%
gpu1285%29CP824W300W1MiB49140MiB0%
gpu1385%31CP818W140W6MiB16376MiB0%
gpu1385%32CP816W140W6MiB16376MiB0%
gpu1385%31CP813W140W6MiB16376MiB0%
gpu1385%32CP817W140W6MiB16376MiB0%
gpu1385%31CP814W140W6MiB16376MiB0%
gpu1385%32CP819W140W6MiB16376MiB0%
gpu1385%31CP817W140W6MiB16376MiB0%
gpu1385%30CP814W140W6MiB16376MiB0%
gpu1485%32CP824W300W6MiB49140MiB0%
gpu1485%31CP820W300W1MiB49140MiB0%
gpu1485%33CP820W300W1MiB49140MiB0%
gpu1485%34CP815W300W1MiB49140MiB0%
gpu1485%30CP819W300W1MiB49140MiB0%
gpu1485%31CP818W300W1MiB49140MiB0%
gpu1485%32CP829W300W1MiB49140MiB0%
gpu1485%31CP828W300W1MiB49140MiB0%
gpu1585%34CP819W300W6MiB49140MiB0%
gpu1585%32CP817W300W1MiB49140MiB0%
gpu1585%34CP818W300W1MiB49140MiB0%
gpu1585%34CP818W300W1MiB49140MiB0%
gpu1585%30CP816W300W1MiB49140MiB0%
gpu1585%34CP820W300W1MiB49140MiB0%
gpu1585%33CP820W300W1MiB49140MiB0%
gpu1585%33CP827W300W1MiB49140MiB0%
gpu160%33CP825W300W6MiB49140MiB0%
gpu1685%37CP827W300W6MiB49140MiB0%
gpu1685%36CP823W300W6MiB49140MiB0%
gpu1685%33CP826W300W6MiB49140MiB0%
gpu1685%33CP825W300W6MiB49140MiB0%
gpu1685%32CP825W300W6MiB49140MiB0%
gpu1685%33CP822W300W6MiB49140MiB0%
gpu1685%34CP823W300W6MiB49140MiB0%
gpu1785%28CP820W250W6MiB11264MiB0%
gpu1785%26CP817W250W1MiB11264MiB0%
gpu1785%28CP828W250W1MiB11264MiB0%
gpu1785%28CP89W250W1MiB11264MiB0%
gpu1785%28CP84W250W1MiB11264MiB0%
gpu1785%28CP818W250W1MiB11264MiB0%
gpu1785%29CP817W250W1MiB11264MiB0%
gpu1785%28CP821W250W1MiB11264MiB0%
gpu1885%29CP815W250W6MiB11264MiB0%
gpu1885%27CP820W250W1MiB11264MiB0%
gpu1885%29CP87W250W1MiB11264MiB0%
gpu1885%30CP82W250W1MiB11264MiB0%
gpu1885%26CP86W250W1MiB11264MiB0%
gpu1885%28CP84W250W1MiB11264MiB0%
gpu1885%31CP816W250W1MiB11264MiB0%
gpu1885%29CP824W250W1MiB11264MiB0%
gpu1985%29CP821W250W6MiB11264MiB0%
gpu1985%26CP818W250W1MiB11264MiB0%
gpu1985%30CP821W250W1MiB11264MiB0%
gpu1985%28CP84W250W1MiB11264MiB0%
gpu1985%27CP87W250W1MiB11264MiB0%
gpu1985%29CP818W250W1MiB11264MiB0%
gpu1985%29CP821W250W1MiB11264MiB0%
gpu1985%29CP817W250W1MiB11264MiB0%
gpu2085%30CP828W300W6MiB49140MiB0%
gpu2085%28CP826W300W1MiB49140MiB0%
gpu2085%33CP826W300W1MiB49140MiB0%
gpu2085%31CP816W300W1MiB49140MiB0%
gpu2085%32CP829W300W1MiB49140MiB0%
gpu2085%31CP818W300W1MiB49140MiB0%
gpu2085%29CP830W300W1MiB49140MiB0%
gpu2085%31CP822W300W1MiB49140MiB0%
gpu2185%29CP814W140W6MiB16376MiB0%
gpu2185%31CP813W140W1MiB16376MiB0%
gpu2185%30CP814W140W1MiB16376MiB0%
gpu2185%30CP817W140W1MiB16376MiB0%
gpu2185%30CP812W140W0MiB16376MiB0%
gpu2185%30CP815W140W1MiB16376MiB0%
gpu2185%30CP813W140W1MiB16376MiB0%
gpu2185%30CP812W140W1MiB16376MiB0%
gpu2185%30CP816W140W1MiB16376MiB0%
gpu2185%31CP814W140W1MiB16376MiB0%
gpu3031%47CP057W250W0MiB12288MiB0%
gpu3030%45CP056W250W0MiB12288MiB1%
gpu3133%47CP055W260W0MiB49152MiB0%
gpu3132%45CP036W260W0MiB49152MiB0%
gpu3230%59CP075W230W0MiB24564MiB0%
gpu3230%57CP064W230W0MiB24564MiB0%
gpu3334%58CP074W260W0MiB24576MiB0%
gpu3334%46CP037W260W0MiB24576MiB0%
gpu3434%46CP057W260W0MiB24576MiB0%
gpu3433%41CP038W260W0MiB24576MiB0%
gpu3527%36CP820W250W3MiB11264MiB0%
gpu3511%62CP030W250W0MiB11264MiB0%
gpu3630%58CP080W230W0MiB24564MiB0%
gpu3630%57CP059W230W0MiB24564MiB0%
gpu3725%42CP054W250W0MiB11264MiB0%
gpu3716%46CP053W250W0MiB11264MiB1%
gpu3830%54CP068W230W0MiB24564MiB0%
gpu3830%57CP067W230W0MiB24564MiB0%
gpu3929%41CP063W250W0MiB11264MiB0%
gpu3924%41CP042W250W0MiB11264MiB0%
gpu4085%30CP820W300W1MiB49140MiB0%
gpu4085%28CP820W300W1MiB49140MiB0%
gpu4085%29CP821W300W1MiB49140MiB0%
gpu4085%27CP818W300W6MiB49140MiB0%
gpu4085%30CP816W300W1MiB49140MiB0%
gpu4085%28CP821W300W1MiB49140MiB0%
gpu4085%30CP818W300W1MiB49140MiB0%
gpu4085%28CP823W300W1MiB49140MiB0%
gpu4185%61CP2240W300W4472MiB49140MiB51%jjahn
gpu4185%56CP2239W300W4467MiB49140MiB71%jjahn
gpu4185%64CP2240W300W4467MiB49140MiB53%jjahn
gpu4185%64CP2254W300W4467MiB49140MiB67%jjahn
gpu4185%64CP2238W300W9677MiB49140MiB100%jjahn
gpu4185%63CP2249W300W4467MiB49140MiB73%jjahn
gpu4185%59CP2242W300W4467MiB49140MiB68%jjahn
gpu4185%71CP2291W300W9677MiB49140MiB100%jjahn
gpu4235%34CP020W250W0MiB11264MiB0%