Partial systems outage at DDC - July 1, 2015 just before 5 p.m.
Date Posted: June 2, 2015
Right before 5pm there was an issue with the cooling system at the DDC leading to a temperature increase and the subsequent powering down of some of the compute clusters, including at least some of the interactive nodes and resource managers. CHPC staff were on site at the DDC and about 6 p.m. were given the all clear to start to bring up the gear.
The compute clusters (apexarch, ash, ember, lonepeak and kingspeak) were brought back up and were scheduling jobs as of about midnight. Tangent was still having issues starting jobs properly, so until we send out another message users should not submit jobs to this cluster.
As of July 6th at 4 p.m., the tangent cluster was back in service and scheduling jobs.
If you observe any remaining issues, please let us know by sending a report to issues@chpc.utah.edu.