Fermilab KAON & PION Cluster Status

Last Updated: Feb 09, 17:40:29
Update Interval: 60 seconds

pion cluster outage Feb 10, 4PM till Feb 11, 5PM CST
PBS: Active Maui: Active PBSNode HealthUsage LQCD dCache Up 34.13 MB/sec (0/552) Free=1310 GB 2% JPSI ClusterQCD Cluster

[+] [-]

kaon01011kaon01021kaon01031kaon01041kaon01051kaon01061kaon01071kaon01081kaon01091kaon01101kaon01111kaon01121kaon01131kaon01141kaon01151kaon01161kaon01171kaon01181kaon01191kaon01201
kaon02011kaon02021kaon02031kaon02041kaon02052kaon02062kaon02072kaon02082kaon02092kaon02102kaon02112kaon02122kaon02132kaon02142kaon02152kaon02162kaon0217 kaon02182kaon02192kaon02202
kaon03012kaon03023kaon03033kaon03043kaon03053kaon03063kaon03073kaon03083kaon03093kaon03103kaon03113kaon03123kaon03133kaon03143kaon03153kaon03163kaon03173kaon03181kaon03191kaon03201
kaon04011kaon04021kaon04031kaon04041kaon04051kaon04062kaon04072kaon04082kaon04092kaon04102kaon04112kaon04122kaon04132kaon04142kaon04152kaon04162kaon04172kaon04182kaon04192kaon04202
kaon05012kaon05023kaon0503 kaon05043kaon05053kaon05063kaon05193kaon05083kaon05093kaon05103kaon05114kaon05123kaon05133kaon05153kaon05163kaon05173kaon05183kaon05203kaon06013kaon06024
kaon06034kaon06044kaon06054kaon06064kaon06074kaon06084kaon06094kaon06104kaon06114kaon06124kaon06134kaon06144kaon06154kaon06164kaon0617 kaon06185kaon06196kaon06206kaon07016kaon07026
kaon0703 kaon07045kaon07055kaon07065kaon07075kaon07085kaon07095kaon07105kaon07115kaon07125kaon07135kaon07145kaon07156kaon07166kaon07176kaon07186kaon07196kaon07206kaon08016kaon08026
kaon08036kaon08046kaon0805 kaon08066kaon08076kaon08086kaon08096kaon08106kaon08116kaon08126kaon08136kaon08146kaon08156kaon08166kaon08176kaon0818 kaon08196kaon08206kaon09016kaon09026
kaon09036kaon09046kaon09055kaon09065kaon09075kaon09085kaon09097kaon09107kaon09117kaon09127kaon09137kaon09147kaon09157kaon09167kaon09177kaon09187kaon09197kaon09207kaon10017kaon10027
kaon10037kaon10047kaon10054kaon10064kaon10074kaon10084kaon10094kaon10104kaon10114kaon10124kaon10134kaon10144kaon10154kaon10164kaon10174kaon10184kaon10194kaon10204kaon11015kaon11025
kaon11035kaon11045kaon11055kaon11065kaon11075kaon11085kaon11095kaon11105kaon11115kaon11125kaon11135kaon11145kaon11155kaon11165kaon11178kaon11188kaon11198kaon11208kaon12028kaon1203
kaon12048kaon12058kaon12068kaon12078kaon12088kaon12098kaon12108kaon12118kaon1212 kaon12138kaon12148kaon12158kaon12169kaon1217 kaon12189kaon12199kaon12209kaon1301 kaon13029kaon13039
kaon13049kaon13059kaon13069kaon13079kaon13089kaon13099kaon13109kaon13119kaon13129kaon1313 kaon13149kaon13158kaon13168kaon1317 kaon13188kaon13198kaon13208kaon14018kaon14028kaon14038
kaon14048kaon14058kaon14068kaon14078kaon14088kaon14098kaon14108kaon14118kaon141210kaon141310kaon141410kaon141510kaon141610kaon141710kaon141810kaon141910kaon142010kaon150110kaon150210kaon150310
kaon150410kaon150510kaon150610kaon150710kaon150810kaon150910kaon151010kaon151110kaon151210kaon151310kaon151410kaon151510kaon151610kaon151710kaon1518 kaon151910kaon152010kaon160110kaon160210kaon160310
kaon160410kaon160511kaon160611kaon160711kaon160812kaon16099kaon16109kaon1611 kaon16129kaon16139kaon16149kaon16159kaon16169kaon16179kaon16189kaon16199kaon16209kaon17019kaon17029kaon17039
kaon17049kaon17059kaon170612kaon170712kaon170812kaon170912kaon171012kaon1711 kaon171212kaon171312kaon171412kaon171512kaon171612kaon171712kaon171813kaon171913kaon172013kaon180113kaon180213kaon180313
kaon180413kaon180513kaon180613kaon180713kaon180813kaon180913kaon181013kaon181113kaon181313kaon181413kaon181513kaon181613kaon181713kaon181813kaon181913kaon182013kaon190113kaon190213kaon190313kaon190413
kaon190513kaon190613kaon190713kaon190813kaon190913kaon191013kaon191114kaon191214kaon191314kaon191414kaon191514kaon191614kaon191714kaon191814kaon191914kaon1920 kaon200114kaon200214kaon200314kaon200414
kaon200514kaon200614kaon200714kaon200814kaon200914kaon201014kaon201114kaon201314kaon201414kaon201514kaon201614kaon201714kaon201814kaon201914kaon2020 kaon210114kaon210214kaon210314kaon210414kaon210514
kaon2106 kaon2107 kaon210815kaon210915kaon211015kaon211115kaon211215kaon211315kaon211415kaon2115 kaon211615kaon211715kaon211815kaon211915kaon212015kaon220115kaon220215kaon220315kaon220415kaon220515
kaon220615kaon220715kaon22087kaon220915kaon221015kaon221115kaon221215kaon2213 kaon221415kaon221515kaon221615kaon2217 kaon221815kaon221915kaon222015kaon2301 kaon230215kaon2303 kaon2304 kaon230515
kaon230615kaon230716kaon230816kaon230916kaon231016kaon231116kaon231216kaon231316kaon231416kaon2315 kaon231616kaon231716kaon231816kaon231916kaon232016kaon240116kaon240216kaon240316kaon240416kaon240516
kaon240616kaon240716kaon240816kaon240916kaon241016kaon241116kaon241216kaon241316kaon241416kaon241516kaon241616kaon2417 kaon241816kaon241916kaon242016kaon250117kaon250217kaon250317kaon250417kaon250517
kaon250617kaon250717kaon250817kaon250917kaon251017kaon251117kaon251217kaon251317kaon251417kaon251517kaon251617kaon251717kaon2518 kaon251917kaon252017kaon260117kaon260217kaon260317kaon260417kaon260517
kaon2606 kaon260717kaon260817kaon260917kaon261017kaon261117kaon261217kaon2613 kaon261417kaon2615 kaon261617kaon261718kaon261818kaon261918kaon262018kaon2701 kaon270218kaon270318kaon270418kaon270518
kaon270618kaon270718kaon270818kaon270918kaon271018kaon271118kaon271218kaon271318kaon271418kaon271518kaon271618kaon271718kaon271818kaon271918kaon272018kaon280118kaon280218kaon280318kaon280418kaon280518
kaon280618kaon280718kaon280818kaon280918kaon281012kaon281112kaon281212kaon281312kaon281412kaon281512kaon281612kaon281712kaon281812kaon281912kaon282012kaon290112kaon290212kaon2903 kaon290412kaon290512
kaon290612kaon290712kaon290812kaon290912kaon291012kaon291111kaon2912 kaon2913 kaon291419kaon291520kaon291621kaon291722kaon291822kaon291922kaon292022kaon3001 kaon3002 kaon30037kaon30047kaon30057
kaon30067kaon30077kaon3008 kaon30097kaon30107kaon30117kaon30127kaon30137kaon30147kaon30157kaon30167kaon30177kaon30187kaon3019 kaon3020
pion0101 pion0102 pion0103 pion0104 pion0105 pion0106 pion0107 pion0108 pion0109 pion0110 pion0111 pion0112 pion0113 pion0114 pion0115 pion0116 pion0117 pion0118 pion0119 pion0120
pion0121 pion0122 pion0123 pion0124 pion0125 pion0126 pion0127 pion0128 pion0129 pion0130 pion0131 pion0132 pion0133 pion0134 pion0135 pion0136 pion0137 pion0139 pion0140 pion0141
pion0142 pion0144 pion0145 pion0146 pion0147 pion0148 pion0201 pion0202 pion0203 pion0204 pion0205 pion0206 pion0207 pion0208 pion0209 pion0210 pion0211 pion0212 pion0213 pion0214
pion0215 pion0216 pion0217 pion0218 pion0219 pion0220 pion0221 pion0222 pion0223 pion0224 pion0225 pion0226 pion0227 pion0228 pion0229 pion0230 pion0231 pion0232 pion0233 pion0234
pion0235 pion0236 pion0237 pion0238 pion0239 pion0240 pion0241 pion0242 pion0243 pion0244 pion0245 pion0246 pion0247 pion0248 pion0301 pion0302 pion0303 pion0304 pion0305 pion0306
pion0307 pion0308 pion0309 pion0310 pion0311 pion0312 pion0313 pion0314 pion0315 pion0316 pion0317 pion0318 pion0319 pion0320 pion0321 pion0322 pion0323 pion0324 pion0325 pion0326
pion0327 pion0328 pion0329 pion0330 pion0331 pion0332 pion0333 pion0334 pion0335 pion0336 pion0337 pion0338 pion0339 pion0340 pion0341 pion0342 pion0343 pion0344 pion0345 pion0346
pion0347 pion0348 pion0401 pion0402 pion0403 pion0404 pion0405 pion0406 pion0407 pion0408 pion0409 pion0410 pion0411 pion0412 pion0413 pion0414 pion0415 pion0416 pion0417 pion0418
pion0419 pion0420 pion0421 pion0422 pion0423 pion0424 pion0425 pion0426 pion0427 pion0428 pion0429 pion0430 pion0431 pion0432 pion0433 pion0434 pion0435 pion0436 pion0437 pion0438
pion0439 pion0440 pion0441 pion0442 pion0443 pion0444 pion0445 pion0446 pion0447 pion0448 pion0501 pion0502 pion0503 pion0504 pion0505 pion0506 pion0507 pion0508 pion0509 pion0510
pion0511 pion0512 pion0513 pion0514 pion0515 pion0516 pion0517 pion0518 pion0519 pion0520 pion0521 pion0522 pion0523 pion0525 pion0526 pion0527 pion0528 pion0529 pion0530 pion0531
pion0532 pion0533 pion0534 pion0535 pion0536 pion0537 pion0538 pion0539 pion0540 pion0541 pion0542 pion0543 pion0544 pion0545 pion0546 pion0547 pion0548 pion0601 pion0602 pion0603
pion0604 pion0605 pion0606 pion0607 pion0608 pion0609 pion0610 pion0611 pion0612 pion0613 pion0614 pion0615 pion0616 pion0617 pion0618 pion0619 pion0620 pion0701 pion0702 pion0703
pion0704 pion0705 pion0706 pion0707 pion0708 pion0709 pion0710 pion0711 pion0712 pion0713 pion0714 pion0715 pion0716 pion0717 pion0718 pion0719 pion0720 pion0721 pion0722 pion0723
pion0724 pion0725 pion0726 pion0727 pion0728 pion0729 pion0730 pion0731 pion0732 pion0733 pion0734 pion0735 pion0736 pion0737 pion0738 pion0740 pion0741 pion0742 pion0743 pion0744
pion0745 pion0746 pion0747 pion0748 pion0801 pion0802 pion0803 pion0804 pion0805 pion0806 pion0807 pion0808 pion0809 pion0810 pion0811 pion0812 pion0813 pion0814 pion0815 pion0816
pion0817 pion0818 pion0819 pion0820 pion0821 pion0822 pion0823 pion0824 pion0825 pion0826 pion0827 pion0828 pion0829 pion0830 pion0831 pion0832 pion0833 pion0834 pion0835 pion0836
pion0837 pion0838 pion0839 pion0840 pion0841 pion0842 pion0843 pion0844 pion0845 pion0846 pion0847 pion0848 pion0901 pion0902 pion0903 pion0904 pion0905 pion0906 pion0907 pion0908
pion0909 pion0910 pion0911 pion0912 pion0913 pion0914 pion0915 pion0916 pion0917 pion0918 pion0919 pion0920 pion0921 pion0922 pion0923 pion0924 pion0925 pion0926 pion0927 pion0928
pion0929 pion0930 pion0931 pion0932 pion0933 pion0934 pion0935 pion0936 pion0937 pion0938 pion0939 pion0940 pion0941 pion0942 pion0943 pion0944 pion0945 pion0946 pion0947 pion0948
pion1001 pion1002 pion1003 pion1004 pion1005 pion1006 pion1007 pion1008 pion1009 pion1010 pion1011 pion1012 pion1013 pion1014 pion1015 pion1016 pion1017 pion1018 pion1019 pion1020
pion1021 pion1022 pion1023 pion1024 pion1025 pion1026 pion1027 pion1028 pion1029 pion1030 pion1031 pion1032 pion1033 pion1034 pion1035 pion1036 pion1037 pion1038 pion1039 pion1040
pion1041 pion1042 pion1043 pion1044 pion1045 pion1046 pion1047 pion1048 pion1101 pion1102 pion1103 pion1104 pion1105 pion1106 pion1107 pion1108 pion1109 pion1110 pion1111 pion1112
pion1113 pion1114 pion1115 pion1116 pion1117 pion1118 pion1119 pion1120 pion1121 pion1122 pion1123 pion1124 pion1125 pion1126 pion1127 pion1128 pion1129 pion1130 pion1131 pion1132
pion1133 pion1134 pion1135 pion1136 pion1137 pion1138 pion1139 pion1140 pion1141 pion1142 pion1143 pion1144 pion1146 pion1147 pion1148 pion1201 pion1202 pion1203 pion1204 pion1205
pion1206 pion1207 pion1208 pion1209 pion1210 pion1211 pion1212 pion1213 pion1214 pion1215 pion1216 pion1217 pion1218 pion1219

free : kaon:4 pion:481down : 69offline : 69reserve : 0job-exclusive : 555job-sharing : 0Usage 53%


NOTE: Users should review data stored on /data/raid and /project disks and delete or backup unused files. An up-to-date report listing data usage on /data/raid and /project is available here. (Mar 11, 2007)
2008-09 project allocations start as of July 1, 2008. Valid project names for this year are listed at this link. /usr/local/bin/lquota prints the project time allocation balance for a user. For users that may belong to more than one project, the script will print the balance for all such projects. The balance includes the time for all three clusters (qcd, pion, kaon). (Jul 1, 2008)
Queues: pion & kaon are normal priority queues & should be used for all standard running. low_kaon & low_pion are lowest priority queues & should be used for background jobs that will be run when unused nodes are available. test_kaon & test_pion queues should be used for high priority, short jobs that require modest resources. Maximum of 2 test_kaon and 2 test_pion jobs may execute at a time, but only one per user per cluster. test_kaon jobs have a maximum walltime limit of 1 hour, and a node count limit of 16 (64 cores). test_pion jobs have a maximum walltime limit of 1 hour, and a node count limit of 64 (64 cores). test queue jobs have the highest priority and will run as soon as nodes are available. Please refer to the message of the day on kaon1.fnal.gov for more information. ( Aug 1, 2008)
Upgraded the Infiniband software stack on J/Psi to OFED 1.4.2. Release notes for this version are available here.(Nov 24, 2009) NEW


[+] [-] Job List

Ref Id  Job Id    Job Name  UserSubmitted OnRun OnTime UsedTime Req  Status  QueueNodesProject
 1899009osp32b6800aOleksiy BazavovJan 29 18:06 36:00Queuedpion128thermo
 1899011osp32b6195bOleksiy BazavovJan 29 18:11 36:00Queuedpion128thermo
 1902015dynqcdDaniel NogradiFeb 7 13:16 36:00Queuedpion16higgs
 1902058dynqcdDaniel NogradiFeb 7 21:16 36:00Queuedpion16higgs
 1902059dynqcdDaniel NogradiFeb 7 21:16 36:00Queuedpion16higgs
 1902060dynqcdDaniel NogradiFeb 7 21:16 36:00Queuedpion16higgs
 1902061dynqcdDaniel NogradiFeb 7 21:16 36:00Queuedpion16higgs
 1902062dynqcdDaniel NogradiFeb 7 21:17 36:00Queuedpion16higgs
 1902092dynqcdDaniel NogradiFeb 8 01:17 36:00Queuedpion16higgs
 1902093dynqcdDaniel NogradiFeb 8 01:17 36:00Queuedpion16higgs
 1902094dynqcdDaniel NogradiFeb 8 01:17 36:00Queuedpion16higgs
 1902095dynqcdDaniel NogradiFeb 8 01:17 36:00Queuedpion16higgs
 1902097dynqcdDaniel NogradiFeb 8 05:17 36:00Queuedpion16higgs
31902188dynqcdDaniel NogradiFeb 8 07:34Feb 8 07:3434:0536:00Runninghiggs32higgs
61902189dynqcdDaniel NogradiFeb 8 07:34Feb 8 07:3534:0536:00Runninghiggs32higgs
81902190dynqcdDaniel NogradiFeb 8 07:34Feb 8 07:3534:0536:00Runninghiggs32higgs
71902193dynqcdDaniel NogradiFeb 8 07:34Feb 8 07:4633:5336:00Runninghiggs32higgs
141902194dynqcdDaniel NogradiFeb 8 07:34Feb 8 07:3434:0436:00Runninghiggs32higgs
151902195dynqcdDaniel NogradiFeb 8 07:34Feb 8 07:3434:0436:00Runninghiggs32higgs
171902197dynqcdDaniel NogradiFeb 8 07:34Feb 8 07:3434:0436:00Runninghiggs32higgs
181902198dynqcdDaniel NogradiFeb 8 07:34Feb 8 07:3534:0436:00Runninghiggs32higgs
101902200dynqcdDaniel NogradiFeb 8 07:34Feb 8 07:3534:0436:00Runninghiggs32higgs
161902201dynqcdDaniel NogradiFeb 8 07:34Feb 8 07:3534:0336:00Runninghiggs32higgs
131902202dynqcdDaniel NogradiFeb 8 07:35Feb 8 07:3734:0136:00Runninghiggs32higgs
41902203dynqcdDaniel NogradiFeb 8 07:35Feb 8 08:0633:3336:00Runninghiggs32higgs
51902204dynqcdDaniel NogradiFeb 8 07:35Feb 8 09:2132:1836:00Runninghiggs32higgs
91902205dynqcdDaniel NogradiFeb 8 07:35Feb 8 10:3031:0936:00Runninghiggs32higgs
11902206dynqcdDaniel NogradiFeb 8 07:35Feb 8 12:5428:4536:00Runninghiggs32higgs
121902213dynqcdDaniel NogradiFeb 8 11:35Feb 9 11:5405:4636:00Runninghiggs32higgs
 1902250dynqcdDaniel NogradiFeb 8 15:35 36:00Queuedhiggs32higgs
Ref Id  Job Id    Job Name  UserSubmitted OnRun OnTime UsedTime Req  Status  QueueNodesAccount
 1902251dynqcdDaniel NogradiFeb 8 15:35 36:00Queuedhiggs32higgs
 1902264dynqcdDaniel NogradiFeb 8 19:35 36:00Queuedhiggs32higgs
 1902265dynqcdDaniel NogradiFeb 8 19:35 36:00Queuedhiggs32higgs
 1902266dynqcdDaniel NogradiFeb 8 19:35 36:00Queuedhiggs32higgs
 1902267dynqcdDaniel NogradiFeb 8 19:35 36:00Queuedpion16higgs
 1902268dynqcdDaniel NogradiFeb 8 19:35 36:00Queuedpion16higgs
 1902270dynqcdDaniel NogradiFeb 8 23:35 36:00Queuedpion16higgs
 1902271dynqcdDaniel NogradiFeb 8 23:36 36:00Queuedpion16higgs
 1902272dynqcdDaniel NogradiFeb 8 23:36 36:00Queuedpion16higgs
 1902280dynqcdDaniel NogradiFeb 9 03:36 36:00Queuedpion16higgs
 1902281dynqcdDaniel NogradiFeb 9 03:36 36:00Queuedpion16higgs
 1902282dynqcdDaniel NogradiFeb 9 03:36 36:00Queuedpion16higgs
 1902283dynqcdDaniel NogradiFeb 9 03:36 36:00Queuedpion16higgs
 1902284dynqcdDaniel NogradiFeb 9 03:36 36:00Queuedpion16higgs
 1902285dynqcdDaniel NogradiFeb 9 03:36 36:00Queuedpion16higgs
 1902286dynqcdDaniel NogradiFeb 9 03:36 36:00Queuedpion16higgs
 1902287dynqcdDaniel NogradiFeb 9 03:36 36:00Queuedpion16higgs
 1902288dynqcdDaniel NogradiFeb 9 03:36 36:00Queuedpion16higgs
 1902289dynqcdDaniel NogradiFeb 9 03:36 36:00Queuedpion16higgs
 1902290dynqcdDaniel NogradiFeb 9 03:36 36:00Queuedpion16higgs
 1902291dynqcdDaniel NogradiFeb 9 03:36 36:00Queuedpion16higgs
 1902292dynqcdDaniel NogradiFeb 9 03:36 36:00Queuedpion16higgs
 1902294dynqcdDaniel NogradiFeb 9 07:36 36:00Queuedpion16higgs
 1902295dynqcdDaniel NogradiFeb 9 07:36 36:00Queuedpion16higgs
 1902296dynqcdDaniel NogradiFeb 9 07:36 36:00Queuedpion16higgs
 1902297dynqcdDaniel NogradiFeb 9 07:36 36:00Queuedpion16higgs
 1902298dynqcdDaniel NogradiFeb 9 07:36 36:00Queuedpion16higgs
 1902299dynqcdDaniel NogradiFeb 9 07:37 36:00Queuedpion16higgs
 1902300dynqcdDaniel NogradiFeb 9 07:37 36:00Queuedpion16higgs
 1902309hqdiffHarvey MeyerFeb 9 09:51 36:00Queuedpion64hqmomdif
Ref Id  Job Id    Job Name  UserSubmitted OnRun OnTime UsedTime Req  Status  QueueNodesAccount
111902311r0bcAida El-KhadraFeb 9 11:13Feb 9 11:1306:2636:00Runningkaon4charmonium
 1902313dynqcdDaniel NogradiFeb 9 11:37 36:00Queuedpion16higgs
 1902337dynqcdDaniel NogradiFeb 9 15:37 36:00Queuedhiggs32higgs
 1902338dynqcdDaniel NogradiFeb 9 15:37 36:00Queuedpion16higgs
 1902339dynqcdDaniel NogradiFeb 9 15:37 36:00Queuedpion16higgs
 1902340dynqcdDaniel NogradiFeb 9 15:37 36:00Queuedpion16higgs
21902374fpiCarleton DetarFeb 9 16:17Feb 9 16:1701:2120:00Runningkaon32milclat
191902378dynqcdKieran HollandFeb 9 17:17Feb 9 17:1700:2124:00Runningkaon1higgs
201902380dynqcdKieran HollandFeb 9 17:19Feb 9 17:1900:2024:00Runningkaon1higgs
211902382dynqcdKieran HollandFeb 9 17:21Feb 9 17:2100:1824:00Runningkaon1higgs
221902383dynqcdKieran HollandFeb 9 17:26Feb 9 17:2600:1324:00Runningkaon4higgs
 1902384dynqcdKieran HollandFeb 9 17:29 24:00Queuedkaon4higgs
 1902385dynqcdKieran HollandFeb 9 17:30 24:00Queuedkaon4higgs

last modified 12/14/2007 lqcd-admin@fnal.gov