Hoffman2:Data Transfer - Revision history

Hwang: /* General Usage */

2024-03-06T22:53:08Z

General Usage

← Older revision		Revision as of 22:53, 6 March 2024
Line 21:		Line 21:
	After creating an account, you need to set up endpoints to transfer from/to.		After creating an account, you need to set up endpoints to transfer from/to.
	*Hoffman2 Endpoint		*Hoffman2 Endpoint
	Hoffman2 Endpoints are already set up on Globus. Search for and select ~~either~~ '''Official UCLA Hoffman2 Cluster''' in the endpoint field.		Hoffman2 Endpoints are already set up on Globus. Search for and select '''Official UCLA Hoffman2 Cluster''' in the endpoint field.
	*CASS Endpoint		*CASS Endpoint
	[http://www.cass.idre.ucla.edu/ (Cloud Archival Storage Service)] You Need to Set this up on Globus before you can use it.		[http://www.cass.idre.ucla.edu/ (Cloud Archival Storage Service)] You Need to Set this up on Globus before you can use it.

Hwang: /* General Usage */

2024-03-06T22:52:38Z

General Usage

← Older revision		Revision as of 22:52, 6 March 2024
Line 21:		Line 21:
	After creating an account, you need to set up endpoints to transfer from/to.		After creating an account, you need to set up endpoints to transfer from/to.
	*Hoffman2 Endpoint		*Hoffman2 Endpoint
	Hoffman2 Endpoints are already set up on Globus. Search for and select either '''Official UCLA Hoffman2 ~~Data Transfer Node 1''' or '''Official UCLA Hoffman2 Data Transfer Node 2~~''' in the endpoint field.		Hoffman2 Endpoints are already set up on Globus. Search for and select either '''Official UCLA Hoffman2 Cluster''' in the endpoint field.
	*CASS Endpoint		*CASS Endpoint
	[http://www.cass.idre.ucla.edu/ (Cloud Archival Storage Service)] You Need to Set this up on Globus before you can use it.		[http://www.cass.idre.ucla.edu/ (Cloud Archival Storage Service)] You Need to Set this up on Globus before you can use it.

Jpdiaz: /* External Links */ updated links and globus endpoint names

2020-03-18T05:20:12Z

External Links: updated links and globus endpoint names

← Older revision		Revision as of 05:20, 18 March 2020
Line 19:		Line 19:

	====General Usage====		====General Usage====
	After creating an account, you need to ~~setup~~ endpoints to transfer from/to.		After creating an account, you need to set up endpoints to transfer from/to.
	*Hoffman2 Endpoint		*Hoffman2 Endpoint
	Hoffman2 ~~Endpoint is~~ already ~~setup~~ on Globus, and ~~you just need to type~~ '''~~hoffman2#ucla~~''' ~~into~~ the endpoint field.		Hoffman2 Endpoints are already set up on Globus. Search for and select either '''Official UCLA Hoffman2 Data Transfer Node 1''' or '''Official UCLA Hoffman2 Data Transfer Node 2''' in the endpoint field.
	*CASS Endpoint		*CASS Endpoint
	[http://www.cass.idre.ucla.edu/ (Cloud Archival Storage Service)] You Need to Set this up on Globus before you can use it.		[http://www.cass.idre.ucla.edu/ (Cloud Archival Storage Service)] You Need to Set this up on Globus before you can use it.
Line 99:		Line 99:
	*[http://linux.die.net/man/1/sftp Man page for sftp]		*[http://linux.die.net/man/1/sftp Man page for sftp]
	*[http://linux.die.net/man/1/rsync Man page for rsync]		*[http://linux.die.net/man/1/rsync Man page for rsync]
	*[~~http~~://www.~~ats~~.ucla.edu/~~clusters~~/~~hoffman2~~/~~gol.htm~~ Globus Online]		*[https://www.hoffman2.idre.ucla.edu/file-transfer/globus/ Globus Online]

Hwang at 16:50, 10 October 2019

2019-10-10T16:50:30Z

← Older revision		Revision as of 16:50, 10 October 2019
Line 90:		Line 90:
	====Hoffman2 Example====		====Hoffman2 Example====
	We recommend using something like		We recommend using something like
	rsync -av /PATH/TO/SRC/FILES/HERE USERNAME@~~dtn2.~~hoffman2.idre.ucla.edu:~		rsync -av /PATH/TO/SRC/FILES/HERE USERNAME@hoffman2.idre.ucla.edu:~
	to upload ''/PATH/TO/SRC/FILES/HERE'' from your local machine to your home directory on Hoffman2		to upload ''/PATH/TO/SRC/FILES/HERE'' from your local machine to your home directory on Hoffman2

Acho at 07:20, 25 May 2014

2014-05-25T07:20:28Z

← Older revision		Revision as of 07:20, 25 May 2014
Line 18:		Line 18:
	You will receive an email with a link which you need to follow to confirm your new Globus account.		You will receive an email with a link which you need to follow to confirm your new Globus account.

			====General Usage====
			After creating an account, you need to setup endpoints to transfer from/to.
			*Hoffman2 Endpoint
			Hoffman2 Endpoint is already setup on Globus, and you just need to type '''hoffman2#ucla''' into the endpoint field.
			*CASS Endpoint
			[http://www.cass.idre.ucla.edu/ (Cloud Archival Storage Service)] You Need to Set this up on Globus before you can use it.
			[[Hoffman2:Using_Globus#Adding_a_CASS_Endpoint \| Directions Here.]]
			*Local Desktop Endpoint
			If you want to transfer files between your local desktop, you need to download the Globus Desktop Client and set it up on Globus before you can transfer any files.
			[[Hoffman2:Using_Globus#Globus_Connect_Software \| Directions Here.]]

			====Transfer Files====
			*[[Hoffman2:Using_Globus#Transfer_-_Cluster_to_CASS\| Transfer -> Cluster to CASS]]

			*[[Hoffman2:Using_Globus#Transfer_-_Local_to_Cluster\| Transfer -> Local to Cluster]]


	For more information, see the IDRE instructions here		For more information, see the IDRE instructions here
	[http://hpc.ucla.edu/hoffman2/file-transfer/gol.php Globus Online]		[http://hpc.ucla.edu/hoffman2/file-transfer/gol.php Globus Online]

	~~====General Usage=====~~
	~~[[Hoffman2:Using_Globus#Local to Cluster \|Local to Cluster]]~~



Line 31:		Line 42:
	==scp==		==scp==
	A command line tool for copying files using secure encrypted channels.		A command line tool for copying files using secure encrypted channels.


	====General Usage====		====General Usage====
Line 69:		Line 79:
	put /local/file /server/file		put /local/file /server/file
	bye		bye

Acho: /* Globus Connect software */

2014-05-25T05:22:17Z

Globus Connect software

← Older revision		Revision as of 05:22, 25 May 2014
Line 18:		Line 18:
	You will receive an email with a link which you need to follow to confirm your new Globus account.		You will receive an email with a link which you need to follow to confirm your new Globus account.

	~~====Globus Connect software====~~
	If you want to transfer files to or from your local desktop machine, you need to download and install the Globus Connect software (one-time). You will need to do this step on each of your desktop machines whose files you want to transfer using Globus.

	~~#Point your browser at http://www.globus.org and click Globus Connect. You will see a popup window in a web page. If you don’t see the popup window, click the Get Globus Connect link on that page.~~
	~~#In Step One, click the button corresponding to your local platform (Mac OS, Linux or Windows) to download to your local desktop machine.~~
	~~#In Step Two, enter an Endpoint Name to identify your local machine in the Endpoint Name field, (you can ignore the Description field), and click Generate Setup Key.~~
	~~#Copy the setup key to some file and save it, since you will not see it again.~~
	~~#Install the downloaded Globus Connect software on your local desktop.~~
	~~#Run Globus Connect Installation (Windows: globus_connect_install.exe) for the initial setup, and paste in the setup key when prompted.~~

	For more information, see the IDRE instructions here		For more information, see the IDRE instructions here

Acho at 08:11, 24 May 2014

2014-05-24T08:11:26Z

← Older revision		Revision as of 08:11, 24 May 2014
Line 30:		Line 30:
	For more information, see the IDRE instructions here		For more information, see the IDRE instructions here
	[http://hpc.ucla.edu/hoffman2/file-transfer/gol.php Globus Online]		[http://hpc.ucla.edu/hoffman2/file-transfer/gol.php Globus Online]

			====General Usage=====
			[[Hoffman2:Using_Globus#Local to Cluster \|Local to Cluster]]



Line 37:		Line 41:


	===General Usage===		====General Usage====
	scp username@FROM:location username@TO:location		scp username@FROM:location username@TO:location

	===Hoffman2 Examples===		====Hoffman2 Examples====
	Copy a file from local computer to Hoffman2		Copy a file from local computer to Hoffman2
	scp /path/to/local/file username@dtn2.hoffman2.idre.ucla.edu:/path/to/destination/for/copy		scp /path/to/local/file username@dtn2.hoffman2.idre.ucla.edu:/path/to/destination/for/copy
Line 58:		Line 62:
	Another command line tool that uses secure encrypted channels. There are also GUIs that use this protocol (like [http://cyberduck.ch/ Cyberduck] or [http://filezilla-project.org/ Filezilla]).		Another command line tool that uses secure encrypted channels. There are also GUIs that use this protocol (like [http://cyberduck.ch/ Cyberduck] or [http://filezilla-project.org/ Filezilla]).

	===General Usage===		====General Usage====
	Log in to the server, then punch in your password when prompted and you'll be logged in.		Log in to the server, then punch in your password when prompted and you'll be logged in.
	sftp USERNAME@SERVERADDRESS		sftp USERNAME@SERVERADDRESS
Line 68:		Line 72:
	bye		bye

	===Hoffman2 Example===		====Hoffman2 Example====
	sftp USERNAME@dtn2.hoffman2.idre.ucla.edu		sftp USERNAME@dtn2.hoffman2.idre.ucla.edu
	get /server/file /local/file		get /server/file /local/file
Line 81:		Line 85:
	Implied in the name, syncs folder/files between filesystems. It also makes use of secure encrypted channels.		Implied in the name, syncs folder/files between filesystems. It also makes use of secure encrypted channels.

	===General Usage===		====General Usage====
	rsync [OPTION] … SRC [SRC] … [USER@]HOST:DEST		rsync [OPTION] … SRC [SRC] … [USER@]HOST:DEST

	===Hoffman2 Example===		====Hoffman2 Example====
	We recommend using something like		We recommend using something like
	rsync -av /PATH/TO/SRC/FILES/HERE USERNAME@dtn2.hoffman2.idre.ucla.edu:~		rsync -av /PATH/TO/SRC/FILES/HERE USERNAME@dtn2.hoffman2.idre.ucla.edu:~

Acho at 23:24, 23 May 2014

2014-05-23T23:24:05Z

← Older revision		Revision as of 23:24, 23 May 2014
Line 28:		Line 28:
	#Run Globus Connect Installation (Windows: globus_connect_install.exe) for the initial setup, and paste in the setup key when prompted.		#Run Globus Connect Installation (Windows: globus_connect_install.exe) for the initial setup, and paste in the setup key when prompted.

			For more information, see the IDRE instructions here
			[http://hpc.ucla.edu/hoffman2/file-transfer/gol.php Globus Online]





	~~For more information, see the IDRE instructions here~~
	~~[http://hpc.ucla.edu/hoffman2/file-transfer/gol.php Globus Online]~~

	==scp==		==scp==

Acho: /* Globus Online */

2014-05-23T23:23:00Z

Globus Online

@@ Line 12: / Line 12: @@
 '''It is the fastest way to transfer data to Hoffman2''' because it has a faster connection than other Hoffman2 nodes.
-For more information, see the ATS instructions here
+====Create a Globus Account====
-[http://www.ats.ucla.edu/clusters/hoffman2/gol.htm  Globus Online]
+First you need to create a free, Globus account (one-time):
 ==scp==

Ccn admin: 9 revisions

2014-01-16T03:14:47Z

9 revisions

← Older revision	Revision as of 03:14, 16 January 2014
(No difference)