Explore ARCExplore ARC

Global Environment for Network Innovations (GENI)

By | Systems and Services

12141983Do you conduct research in the area of computing networking and need resources? The University of Michigan is now a participant in the GENI (Global Environment for Network Innovations) project, which provides a virtual laboratory for networking and distributed systems research and education. GENI is well suited for exploring networks at scale, thereby promoting innovations in network science, security, services and applications. GENI allows experimenters to:

  • Obtain compute resources from locations around the United States;
  • Connect compute resources using Layer 2 networks in topologies best suited to their experiments;
  • Install custom software or even custom operating systems on these compute resources;
  • Control how network switches in their experiment handle traffic flows;
  • Run their own Layer 3 and above protocols by installing protocol software in their compute resources and by providing flow controllers for their switches.

Through Advanced Research Computing – Technology Services (ARC-TS), U-M is now a GENI site, giving researchers access to local GENI nodes to improve flexibility of projects. For more information on GENI you can go to http://geni.net or contact ARC-TS at hpc-system@umich.edu

Globus

Globus

By | Systems and Services

Globus is a robust cloud-based file transfer service designed to move many large files, ranging from 10s of GBs to 10s of TBs. ARC-TS is a Globus Subscription Provider for the U-M community, which allows some U-M resources to serve as endpoints for file transfers.

The standard features of Globus include:

  • Transfers faster than SCP/SFTP (usually by a factor of two)
  • Automatic restarts or continuation when transfers are disrupted
  • Background transfers so users need not remain logged in to a system
  • Transfers of large files between your laptop/desktop and servers via Global Connect Personal
  • Data publication and discovery capabilities.

U-M’s Globus Provider status adds the following features:

  • Sharing of server directories/folders with non-U-M collaborators who are also Globus users (for transfer/copy purposes, not shared use of server)
  • Sharing of directories/folders from laptops/desktops via Globus Connect Personal clients and a Globus Plus account upgrade.

For more information on Globus, visit its website.

 

Globus Connect Personal

Globus Connect Personal allows you to transfer files to and from personal desktop and laptop computers.  Globus online allows for simple installation for Windows, Mac and Linux computers.

  • Follow the Globus instructions to download the Globus Connect Personal installers and set up an endpoint on your desktop or laptop.
  • Additional features are available for University of Michigan associates. After following the Globus instructions on installing Globus Connect Personal, add University of Michigan as your Globus Plus Sponsor in your
    Globus Account Settings. Once your request is approved, Globus Plus will allow you to transfer files between Globus Connect Personal clients and create share links to your own Globus Connect Personal client.

Sharing a MiStorage/NFS Volume

To enable sharing of a volume on MiStorage, a request must be made to the ITS service desk by calling 4-HELP or emailing 4help@umich.edu. The following information should be included:

  • MiStorage volume name
  • list of all users who need access via Globus

To add or remove users, email or call 4HELP with:

  • MiStorage volume name
  • list of users to be added or removed.

The MiStorage/NFS Volume endpoint name is umich#its-storage and once you authenticate to that endpoint within the Globus Web interface  you will see the Volume name directory listed.

Upgrading to Globus Plus

Globus users at U-M can have their standard Globus account upgraded to a Globus Plus account via the web interface.  Plus account holders can share folders via Globus Connect Personal Clients. Globus Plus is not required to share folders from Globus Server endpoints.

Please be sure you have your @umich.edu set as your contact email address in your profile.

  1. click on username menu top right
  2. Choose Globus Plus
  3. Choose get Globus Plus or if already a Plus member with another institution choose add another provider
  4. Find and click radio box for “University of Michigan” in the list.  Advanced research computing will be notified of your request after clicking Continue.

Current users, login here:

Globus

Order Service

To start using Globus, visit the Step-by-Step Getting Started Guide for Researchers.

To enable sharing of an existing endpoint, ARC-TS can add the endpoint to our management subscription. The system administrator or owner must email hpc-support@umich.edu to ask that the endpoint be put under the UM subscription to enable sharing.  Note that to be joined into the subscription the endpoint must be made public. After being added into the subscription, it can be set back to private if desired.

The request must include:

  • endpoint name = xxxx#yyyy or Displayname

The system administrator should also:

  • edit the configuration file at /etc/globus-connect-server.conf to set the following option:
  • [GridFTP]
    Sharing = True
  • review the configuration file for other relevant parameters (for example, consider setting “SharingRestrictPaths’ to restrict what users can share.
  • run GCS setup command again to read new configuration: # globus-connect-server-setup

Related Event

July 19 @ 3:00 pm - 4:30 pm

More Mixed Models

In the R world, lme4 is a great package for mixed model estimation, and the most widely used for such models.  For standard settings, few tools will do the trick…

July 22 @ 12:00 am - July 23 @ 12:00 am

GlobusWorld Tour

Globus is coming to Michigan July 22-23 to present one of their Globus Tour Workshops.  The purpose is present to developers and researchers on the use of their tools (Globus…

July 22 @ 9:00 am - 11:00 am

Transitioning from Flux to Great Lakes

Lecture w/ Q&A   No Registration required. Drop-ins only. Thanks!

July 25 @ 1:00 pm - 2:30 pm

Spin Class: No Sweat Reports in R

If you use R, there’s a decent chance you are already familiar with using Rmarkdown files and the knitr package to create reports documenting your analyses. A lesser known but…

Public Cloud Services

By | Systems and Services

U-M has service agreements with three public cloud services providers: Amazon Web Services (AWS), Google Cloud Platform (GCP), and Microsoft Azure.

For details, see the University Record article published Jan. 12, 2018.

Additional information on services provided, how to order, and pricing are available at the webpages below:

Support for researchers

ARC-TS provides consulting support for researchers interested in using public cloud services. Contact us at hpc-support@umich.edu for assistance.

Order Service

To take advantage of U-M’s agreements with public cloud providers, follow these links:

Related Event

July 19 @ 3:00 pm - 4:30 pm

More Mixed Models

In the R world, lme4 is a great package for mixed model estimation, and the most widely used for such models.  For standard settings, few tools will do the trick…

July 22 @ 12:00 am - July 23 @ 12:00 am

GlobusWorld Tour

Globus is coming to Michigan July 22-23 to present one of their Globus Tour Workshops.  The purpose is present to developers and researchers on the use of their tools (Globus…

July 22 @ 9:00 am - 11:00 am

Transitioning from Flux to Great Lakes

Lecture w/ Q&A   No Registration required. Drop-ins only. Thanks!

July 25 @ 1:00 pm - 2:30 pm

Spin Class: No Sweat Reports in R

If you use R, there’s a decent chance you are already familiar with using Rmarkdown files and the knitr package to create reports documenting your analyses. A lesser known but…

Related Event

July 19 @ 3:00 pm - 4:30 pm

More Mixed Models

In the R world, lme4 is a great package for mixed model estimation, and the most widely used for such models.  For standard settings, few tools will do the trick…

July 22 @ 12:00 am - July 23 @ 12:00 am

GlobusWorld Tour

Globus is coming to Michigan July 22-23 to present one of their Globus Tour Workshops.  The purpose is present to developers and researchers on the use of their tools (Globus…

July 22 @ 9:00 am - 11:00 am

Transitioning from Flux to Great Lakes

Lecture w/ Q&A   No Registration required. Drop-ins only. Thanks!

July 25 @ 1:00 pm - 2:30 pm

Spin Class: No Sweat Reports in R

If you use R, there’s a decent chance you are already familiar with using Rmarkdown files and the knitr package to create reports documenting your analyses. A lesser known but…