HPC 101: How to use the Flux Computing Cluster — June 6

Here’s an opportunity for Flux cluster users and potential users to learn more about the Flux computing cluster, creating and submitting jobs, understanding the available tools, and avoiding common pitfalls.  This will be a hands-on experience, in which you will log in to the cluster and work with jobs.  Basic Linux command-line skills are a pre-requisite, as the Flux cluster is implemented on Linux.

The class will be offered Thursday, June 6, from 1-5 PM in Room B745 East Hall.  Full details at http://unix.lsa.umich.edu/HPC101/ .  Course registration link at https://www.engin.umich.edu/form/hpc101_20130606

We plan on teaching this course again next term, so folks can take it later if they can’t make it this time.

We think graduate students will want to attend, and faculty and admins are certainly welcome as well.

Introduction to Statistical Computing on the Flux Cluster, April 9th, 3:30-5:00 pm

Tuesday, April 9, 2013 3:30-5:30 pm
Room 2001A – Modern Languages Building
David Childers, CSCAR and Bennet Fauber, CAEN HPC/Flux

This workshop assumes no prior knowledge of Flux or parallel computing. It may be useful for anyone who anticipates having many, repetitive statistical analyses, or who will be using highly iterative methods such as Monte Carlo simulation, bootstrapping/resampling, and some kinds of missing data imputation.

This workshop will provide a basic introduction to batch processing on the Flux computing cluster, including how to connect to Flux and copy files to and from it, a brief introduction to PBS (Portable Batch System), writing a basic PBS script, and submitting a job. Once that is complete, we will show examples of running SAS, Stata, and R on the cluster. We will then give a very brief introduction to parallel computing with R.

Updated March 26th: this workshop is now filled to capacity.  A wait-list is being created for those who register after 3/26 in the event that cancellations are received. If enough interested people register on the wait-list, we will look into scheduling a second workshop in the near future. Please register for the workshop (wait-list) by Wednesday, April 4th. There is no cost to attend.

You will also need to obtain an MToken and get an account on Flux at least two days prior to the workshop. Information about obtaining an MToken can be found at http://cac.engin.umich.edu/resources/loginnodes/twofactor.html
and the account application form is at
https://www.engin.umich.edu/form/cacaccountapplication.

If you have questions about the workshop, please send e-mail to statistics-on-flux@umich.edu

This workshop is co-sponsored by the Center for Statistical Consultation and Research (CSCAR) and the Office of Research Cyberinfrastructure (ORCI).

HPC 101 Session – Learn How to use the Flux Computing Cluster, February 13

Here’s an opportunity for Flux cluster users and potential users to learn more about the Flux computing cluster, creating and submitting jobs, understanding the available tools, and avoiding common pitfalls.  This will be a hands-on experience, in which you will log in to the cluster and work with jobs.  Basic Linux command-line skills are a pre-requisite, as the Flux cluster is implemented on Linux.

The class will be offered Wednesday, February 13, from 1 – 5 PM in Room B745 East Hall.  Full details at http://unix.lsa.umich.edu/HPC101/ .  Course registration link at https://www.engin.umich.edu/form/hpc101_20130213 .

We plan on teaching this course again next term, so folks can take it later if they can’t make it this time.

We think graduate students will want to attend, and faculty and admins are certainly welcome as well.

Flux Expanded to Over 8,000 Cores, Now Housed in the Modular Data Center

Flux, the University of Michigan’s shared on-campus computing cluster, has been moved to the Modular Data Center (MDC) and now contains 640TB of high-speed scratch storage and 637 hosts that provide 8,216 cores to campus. See the new Flux configuration for details.

For more information about Flux, including costing, funding, and available software, see our Flux section.

The MDC uses ambient air for cooling approximately 75% of the year, thus significantly reducing the amount of energy needed for cooling and contributing to U-M’s sustainability efforts.

HPC 101 Session – Learn How to use the Flux Computing Cluster, January 23

Here’s an opportunity for Flux cluster users and potential users to learn more about the Flux computing cluster, creating and submitting jobs, understanding the available tools, and avoiding common pitfalls.  This will be a hands-on experience, in which you will log in to the cluster and work with jobs.  Basic Linux command-line skills are a pre-requisite, as the Flux cluster is implemented on Linux.

The class will be offered Wednesday, January 23, from 1 – 5 PM in Room B745 East Hall.  Full details at http://unix.lsa.umich.edu/HPC101/ .
Course registration link at https://www.engin.umich.edu/form/hpc101_20130123 .

We plan on teaching this course again next term, so folks can take it later if they can’t make it this time.

We think graduate students will want to attend, and faculty and admins are certainly welcome as well.

Learn to Use Flux – Sept 19

Here’s an opportunity for Flux cluster users and potential users to learn more about the Flux computing cluster, creating and submitting jobs, understanding the available tools, and avoiding common pitfalls.  This will be a hands-on experience, in which you will log in to the cluster and work with jobs.  Basic Linux command-line skills are a pre-requisite, as the Flux cluster is implemented on Linux.  Full details are at unix.lsa.umich.edu/HPC101/.

Date:  Wednesday, September 19
Time:  1 – 5 PM
Location:  Room B745 East Hall

This class is appropriate for researchers who are using or contemplating using Flux for their research and graduate students. Faculty and admins are welcome as well. This course is taught every term, so those who are interestesd can take it later if they can’t make it this time.

Visitors Get First Look at U-M’s New Modular Data Center

The University of Michigan’s new Modular Data Center (MDC) was filled to capacity and humming on June 14 – with nearly 250 visitors and VIPs from across campus, as well as the state of Michigan. The occasion was the ribbon-cutting ceremony for U-M’s latest and most ecologically friendly data center.

The day began with brief remarks by U-M’s AVP and Chief Information Officer, Laura Patterson; AVP for Research Computing, Dan Atkins; Chief Financial Officer Tim Slottow; and Director of Communications Systems and Data Centers, Andy Palms. Atkins, who reminded that audience that his academic career has spanned most of the modern computer age, gave a brief history lesson to remind us how far computing has come. With the help of Andy Caird, Atkins showed part of the IIiac II computer, designed and built at the University of Illinois in the early 1960’s when he was a graduate student there.

Andy Caird, director of high-performance computing at U-M, shows the Illiac II component during Atkins' speech.

“This massive plug-in component stores only two 4-bit numbers and adds them together — that’s all it does,” said Atkins. “The entire machine was at least eight times larger than the Modular Data Center, and required hundreds of these frames plugged into 12-foot high racks. In contrast, this MDC can hold tens of thousands of enormously more powerful computers and used in parallel offer computing at least 10 trillion times more powerful than Illiac 2.” He went on to highlight the importance of the MDC to the expansion of research computing at U-M. The MDC is the future home of Flux, the university’s shared HPC research computing cluster.

Andy Palms points to the louvers and exhaust fans of the Modular Data Center. Photo courtesy of Terra Molengraff

Visitors took tours of the structure – roughly the size of a double-wide trailer – led by Andy Palms and Dick Boyd, director of telecommunications operations, who described the MDC’s airflow technology. “Rather than running what amounts to a very expensive air conditioner all year long, the MDC allows us to essentially open the windows during the colder months, and limit air conditioning to the few months in the summer when we really need it,” said Palms.

View of the upper ventilation area in the Modular Data Center

U-M received positive press coverage for being the first university in the country to employ this new kind of sustainable data center. The following list is a sample of the coverage.

June 15, University Record – Photo and caption

June 14, IT Business Edge – University of Michigan’s EcoPOD goes doublewide

June 14, Data Center Knowledge – Michigan Unveils First HP EcoPOD Modular Data Center

June 13, Concentrate Media – U-M’s energy-saving Modular Data Center cools down computing costs

June 7, ZD Net – University of Michigan thinks green with modular data center

June 1, Data Center Dynamics – University of Michigan Deploys HP EcoPod for HPC

May 31, Geek Zone Technology Community – University of Michigan takes important strides in research and sustainable computing

May 30, Voice and Data – University of Michigan Reveals Eco-friendly Data Center

May 30, Marc Hamilton’s Blog – University of Michigan’s New EcoPOD Opening Soon

May 29, CBS Detroit – U-M takes important strides in research and sustainable computing

May 21, University Record – U-M to unveil new eco-friendly data center

 

Flux Users Lunch – June 27

You are invited to drop in any time between noon and 1:30 on Wednesday, June 27 for a Flux Users Group lunch. We’ll be in Room 1180 in the Duderstadt Center, and lunch will be provided by the Office of Research Cyberinfrastructure (ORCI).

Flux operators and support staff will be available for your questions. Join us to:

  • Connect with other users doing similar work.
  • Learn about new and upcoming Flux services.
  • Share your experiences with Flux and help us improve our service.

Who should come? Any current Flux user, or anyone interested in learning more using Flux in the future.

Please RSVP by Thursday, June 21 to help us adequately plan for lunch. We look forward to seeing you there.

Learn More About Flux on May 9

Here’s an opportunity for Flux cluster users and potential users to learn more about the Flux computing cluster, creating and submitting jobs, understanding the available tools, and avoiding common pitfalls.  This will be a hands-on experience, in which you will log in to the cluster and work with jobs.  Basic Linux command-line skills are a pre-requisite, as the Flux cluster is implemented on Linux.

The class will be offered Wednesday, May 9, from 1 – 5 PM in Room B743 East Hall. Full details at unix.lsa.umich.edu/HPC101/.

Please register at engin.umich.edu/form/hpc101_20120509.

We plan on teaching this course again later in the summer, so folks can take it later if they can’t make it this time.

Please forward this to your researchers who are using or contemplating using Flux for their research.  We think graduate students will want to attend, and faculty and admins are certainly welcome as well.

Modular Data Center Arriving on April 23

A critical part of U-M’s evolving Data Center 1-2-3 strategy is the new Modular Data Center, future home to Flux.  Starting April 23, the HP EcoPOD will be delivered and placed behind the recently completed support building. See more photos of the progress.

Because the site is still a construction site, we can’t invite you to attend in person yet, but you can view the progress via a live webcamTo see the whole project from its inception through April, watch this time lapse video.

Be sure to save the date for an open house to be held the morning of June 14. We’ll post additional information here in the near future.