Connecting Flux and XSEDE

By February 24, 2016

XSEDE is an open scientific discovery infrastructure combining leadership class resources at eleven partner sites to create an integrated, persistent computational resource. It is the successor to TeraGrid.

For general information on XSEDE, visit the XSEDE home page.

This page describes the how to connect an XSEDE allocation with a Flux allocation.

The XSEDE Client Toolkit allows Flux users to connect to XSEDE resources using the GSI interface.  This eases logins and file transfers between the two sets of resources.  The toolkit provides the commands myproxy-logingsisshgsiscpglobus-url-copy, and uberftp. Refer to XSEDE’s Data Transfers page for details on these commands.

Loading the XSEDE Client Toolkit

Load the toolkit module:

module load xsede

Getting your XSEDE User Portal ticket

Before connecting to any XSEDE resource using the GSI interface you must get an XSEDE User Portal ticket. This proves your identity and lasts for 12 hours by default. Use your XSEDE portal username and password.

myproxy-logon -l portalusername

Logins to XSEDE Resources

The command gsissh works the same as normal ssh but uses your portal ticket to authenticate.

gsissh Xsedeloginhost
gsissh gordon.sdsc.edu

Connect to the resource you have access to via your startup or XSEDE TRAC.

File Transfers

The XSEDE Client Toolkit allows file transfers between XSEDE and Flux resources and between XSEDE and XSEDE resources using gsiscp or the more complex and powerful globus-url-copy.

GSISCP

gsiscp uses the same options as normal scp allowing transfer of files between Flux resources and XSEDE resources:

Transfer file fluxfile to the XSEDE resource xsedehost into the folder folder1

gsiscp fluxfile xsedehost:folder1/

Transfer the folder xfolder from xsedehost to Flux.

gsiscp -r teragridhost:folder1 .
 

GridFTP support globus-url-copy

GridFTP is a powerful system for moving files between XSEDE sites. You can use the command globus-url-copy to initiate transfers from a Flux resource. Please refer to the XSEDE’s Data Transfers page on its use.

XSEDE Available Resources:

To find available XSEDE resources when choosing where to request your allocation see the Resource Catalog, or contact hpc-support@umich.edu.

XSEDE Training Opportunities:

XSEDE offers training throughout the year listed on the XSEDE Course Calendar. XSEDE also maintains a collection of online training resources.