Difference between revisions of "Hoffman2:Interactive Sessions"
(→More computing power)
|Line 50:||Line 50:|
==More computing power==
==More computing power==
Revision as of 20:45, 8 October 2019
Interactive sessions on Hoffman2 let you have access to a computing node for up to 24 hours. This is ideal for:
- running a intensive program like MATLAB (in fact that's how it works), WEKA, R or FSLView
- debugging a script you will be submitting to the queue later
- moving/tar'ing/untar'ing lots of files
- any other computing or graphics intensive operations
since you aren't supposed to use the login nodes for such heavy lifting.
To get one, you need to use the
will try to get you an interactive node.
Because you didn't specify a time limit this session will only last two hours after which you will be kicked off of the interactive node back to a login node.
And because you didn't specify a memory limit, the default is 1GB.
If you successfully get a node, your prompt will change from something like
[joebruin@login4 ~] $
to something like
[joebruin@n1234 ~] $
indicating you are on node 1234.
If you wanted to specify a a time limit for your interactive session (anything less than 24 hours), use the resource flag again and specify time in the HH:MM:SS format.
$ qrsh -l h_rt=4:00:00
will try securing an interactive node for four hours with the default amount of RAM, but if they are all taken you will be kindly told you are out of luck.
Use highp for 24+ hours job
If you need to run a very long job over 24 hours, and you are a CCN member, you can use "highp" flag to choose CCN dedicated nodes.
$ qrsh -l h_rt=48:00:00,highp
will reserve an interactive job for 48 hours in CCN's dedicated nodes (without "highp", the job will never start). Since CCN has limited nodes (12 for now), the waiting time for getting the resource might take some time when the nodes are all busy. It may take less time to start a job which requires less than 24 hour in the regular Hoffman pool. So please use highp for jobs longer than 24 hours only.
Doing something memory intensive? Like working with a lot of visualizations or multiple datasets? Use the resource flag again and specify a data request.
$ qrsh -l h_rt=4:00:00,h_data=4G
will try securing an interactive node for four hours with four gigabytes of RAM, but if no such node is available the cluster will deny your request.
More computing power
You can add more processor cores to power up your computing intensive jobs
qrsh -l h_rt=4:00:00,h_data=4G -pe shared 2
This will reserve 2 cores for the interactive mode session. Be careful that the memory reserved here will be 2 x 4G = 8G.
Sometimes inactivity on your computer will result in Hoffman2 connection break [ Broken Pipe ] (even while computing).
To prevent this from happening: For Macs - in your /etc/ssh/ssh_config -add this line to the bottom
This will tell your ssh to ping the server every 180 seconds to prevent it from timing out.