Using Data Den

Data Den is a service for preserving electronic data generated from research activities.  It is a low cost, highly durable storage system and is the largest storage system operated by ARC-TS.

Features

  • Turbo is available to researchers from any academic unit.
  • Turbo can be accessed from Mac OSX (Mavericks and Yosemite), Windows 7+, and Linux computers using NFSv3 and NFSv4
  • Turbo space can be purchased in 1TB increments
  • Turbo uses the Globus File Transfer Service
  • Turbo provides the option of secure storage for regulated and/or sensitive data
  • Turbo allows optional daily snapshots and backups of stored research data

Establish Service

See our Ordering Service page for details on how to request a Turbo volume.

Turbo costs $19.20 per terabyte per month, or $230.40 per terabyte per year, for replicated data. The cost for unreplicated data is $9.60 per terabyte per month, or $115.20 per terabyte per year. A U-M shortcode is required to order.

Permissions and Directories

When a volume is set up, the administrator associated with the account (i.e., specified by the Numeric User ID) will have full control to create directories and set permissions at the top level. This can be done with the standard Unix permission commands.

For assistance with permissions, email hpc-support@umich.edu.

File Storage and Transfer

Accessing Turbo via CIFS

Turbo Research Storage CIFS volumes can be accessed at the following path:

\\VOLUME-NAME.turbo.storage.umich.edu\VOLUME-NAME

 

For multi-protocol volumes, the UNC path is:

\\VOLUME-NAME-win.turbo.storage.umich.edu\VOLUME-NAME 
(e.g. \\flux-support-win.turbo.storage.umich.edu\flux-support)

 

To connect using Windows or Mac clients:

Windows
1. Double click on the “My Computer” icon on your desktop.
2. Click on the “Tools” menu and then select “Map Network Drive…”
3. In the first drop down menu, select the drive letter for the drive mapping. Choose a letter that is not currently in use, and “after” the letter H, in order to avoid any conflicts with other drives. In the second box, type the path to the file server as provided above.
4. Make sure to place a check the “Reconnect at login” box. This option will remember your drive mapping next time you log in to your computer.
5. Click on the “Connect using a different user name” link underneath the “Reconnect at login” box and use the following settings:
• User Name: UMROOT\uniqname (substituting your actual uniqname for the word “uniqname”)
• Password: your UMICH Kerberos ( aka Level-1) password
6. Click the “OK” button.
7. Click the “Finish” button.

Macintosh
1. In the Finder, click on the “Go” menu and select “Connect to Server…”
2. In the “Server Address” field, type the server name and path: smb://VOLUME_NAME.turbo.storage.umich.edu/VOLUME-NAME
3. Click the “Connect” button.
4. When prompted, enter your uniqname and UMICH Kerberos ( aka Level-1) password.
5. Click the “Connect” button.

Globus

Globus, previously known as Globus Online, is a powerful and easy to use file transfer service that is useful for transferring files virtually anywhere. It is available for Turbo volumes that do not contain protected health information (ePHI).

For more information, please see our Globus File Transfer page.

Flux users can use the Globus service or the Flux transfer hosts.

Lost File Recovery

Turbo volumes that are configured with snapshots will save previous versions of files.  Only files which have been snap-shotted overnight are recoverable.  Files that are lost on the same day they were created may not be recoverable.

From Linux clients: To recover files lost from your directory, navigate to the .snapshot directory at the root of your share.

$ cd /nfs/turbo/flux-admin/.snapshot
$ ls -1
daily_2015-08-24-_23-30
daily_2015-08-25-_23-30
daily_2015-08-26-_23-30
daily_2015-08-27-_23-30
daily_2015-08-28-_23-30
daily_2015-08-29-_23-30
daily_2015-08-30-_23-30

You can navigate to the snapshot directories and copy files back to your file share.
Note: The .snapshot directory may not be visible until you try enter it with cd.

From Windows clients, you can recover lost files from snapshots natively:

  • Open the directory that the deleted file was held in.
  • Right click in the directory that the file or folder was stored and select “Properties”.
  • Click on the “Previous Versions” tab when the Properties window opens.
  • A list of snapshots will be displayed.
  • Select the snapshot from which you wish to restore data.
  • In the new window, locate the file(s) you wish to restore.
  • Simply drag the file(s) or folder to their correct locations

Policies

Maintaining the overall stability of the system is paramount to us. System availability is based on our best efforts. We are staffed to provide support during normal business hours. We try very hard to provide support as broadly as possible, but cannot guarantee support on a 24 hour per day basis. Additionally, we perform system maintenance on a periodic basis, driven by the availability of software updates, staffing availability, and input from the user community. We do our best to schedule around your needs, but there will be times when the system is unavailable. For scheduled outages, we will announce them at least one month in advance on the ARC-TS home page; for unscheduled outages we will announce them as quickly as we can with as much detail as we have on that same page. You can also track ARC-TS at Twitter name ARC-TS.

Frequently Asked Questions

How can I start using Turbo?
Visit our Ordering Turbo page for information on how to order.

How can I mount Turbo on Flux?
Be sure to check the “Available to Flux” box when ordering Turbo. To change the configuration of an existing volume, visit the ITS provisioning site.

Can I store sensitive data on Turbo?
Yes, Turbo is approved for certain types of sensitive data. For more information, see the Data Security section of the Turbo Specifications page.

How can I order Turbo if I’m an LSA faculty member, LSA lecturer, or LSA GSRA/GSRI?
Please request Turbo via the LSA Research Storage Portal.

Data Den is currently available as a free pilot service.

ORDER SERVICE

Contact hpc-support@umich.edu

  • Amount of storage needed in 1TB increments
  • MCommunity Group name (group members will receive service-related notification, and can request service changes)
  • Numeric user ID of person who will administer the top level directory and grant access to other users

Contact hpc-support@umich.edu with any questions.

Related Event

September 20 @ 9:00 am - 12:00 pm

Introduction to the Linux Command Line

This course will familiarize the student with the basics of accessing and interacting with Linux computers using the GNU/Linux operating system’s Bash shell, also generically referred to as “the command…

September 20 @ 1:00 pm - 4:00 pm

Research Computing on the Great Lakes cluster

This workshop will provide a brief overview of the the new HPC environment and is intended for current Flux and Armis users.  We will use the temporary Beta HPC cluster…

September 20 @ 3:00 pm - 4:30 pm

Data management in R with data.table

Matt Dowle, author of the data.table package, describes it as, “provid[ing] a high-performance version of base R’s data.frame with syntax and feature enhancements for ease of use, convenience and programming speed.” In this workshop…

September 23 @ 1:00 pm - 4:00 pm

Introduction to the Linux Command Line

This course will familiarize the student with the basics of accessing and interacting with Linux computers using the GNU/Linux operating system’s Bash shell, also generically referred to as “the command…