Rclone on the clusters

By | | No Comments

Rclone on the clusters

We offer Rclone on our Great Lakes and Cavium clusters.

To access Rclone on Great Lakes please run the following command:

  • module load rclone

To access Rclone on the Cavium cluster you will need to paste the following into your command line:

  • /sw/dai/aarch64/centos7/rclone-v1.51.0-linux-arm64/rclone

You can also set an alias in your .bashrc file for this so you don’t have to copy and paste or type the whole path. Information on setting aliases in Linux can be found here.

Getting Started with Rclone

By | | No Comments

The first command you’ll need to run to get started with Rclone is

 

This will prompt you to choose one of the following:

 

 

Basic Rclone commands

 

 

List commands here

 

Brief overview on usage and follow with Box, Dropbox, Google Cloud, and Google Drive.

 

 

What is RClone

By | | No Comments

What can rclone do for you?

Rclone helps you:

  • Backup (and encrypt) files to cloud storage
  • Restore (and decrypt) files from cloud storage
  • Mirror cloud data to other cloud services or locally
  • Migrate data to cloud, or between cloud storage vendors
  • Mount multiple, encrypted, cached or diverse cloud storage as a disk
  • Analyse and account for data held on cloud storage using lsfljsonsizencdu
  • Union file systems together to present multiple local and/or cloud file systems as one

Features

  • Transfers
    • MD5, SHA1 hashes are checked at all times for file integrity
    • Timestamps are preserved on files
    • Operations can be restarted at any time
    • Can be to and from network, eg two different cloud providers
    • Can use multi-threaded downloads to local disk
  • Copy new or changed files to cloud storage
  • Sync (one way) to make a directory identical
  • Move files to cloud storage deleting the local after verification
  • Check hashes and for missing/extra files
  • Mount your cloud storage as a network disk
  • Serve local or remote files over HTTP/WebDav/FTP/SFTP/dlna
  • Experimental Web based GUI