Hoffman2:Quotas: Difference between revisions

From Center for Cognitive Neuroscience
Jump to navigation Jump to search
No edit summary
No edit summary
Line 10: Line 10:
=====myquota=====
=====myquota=====
:Returns information about how much disk space you are using and how many files you have.  An example output is shown below.
:Returns information about how much disk space you are using and how many files you have.  An example output is shown below.
$ myquota
  User quotas for eplau (UID 8693) (in GBs):
  User quotas for eplau (UID 8693) (in GBs):
  Filesystem            Usage (in GB)          Quota    File Count    File Quota
  Filesystem            Usage (in GB)          Quota    File Count    File Quota
Line 19: Line 20:
=====groupquota=====
=====groupquota=====
:Returns information about how much space you and everyone in your group are using on Hoffman2. An example output is shown below.
:Returns information about how much space you and everyone in your group are using on Hoffman2. An example output is shown below.
$ groupquota
  Filesystem /home/mscohen usage: 3857 of 5120 GBs (75.3%) and 7024000 of 8000000 files (87.8%)
  Filesystem /home/mscohen usage: 3857 of 5120 GBs (75.3%) and 7024000 of 8000000 files (87.8%)
   
   
Line 68: Line 70:
* mat files
* mat files
and it gives you the option of deleting them.
and it gives you the option of deleting them.
To run it, just change into the directory you wish to clean and use the command:
$ clean_me.py





Revision as of 03:25, 5 April 2012

Users and groups of users on Hoffman2 only have access to a predefined amount of disk space and number of files.

After quota is reached, your account (or all the accounts of a usergroup) will have reduced capabilities since you won't be able to make any new files.

Back to all things Hoffman2

Stay In The Know

Keep yourself apprised of how much data you are using with these tools.

myquota
Returns information about how much disk space you are using and how many files you have. An example output is shown below.
$ myquota
User quotas for eplau (UID 8693) (in GBs):
Filesystem            Usage (in GB)          Quota     File Count     File Quota
/home/mscohen                   141           5120          58575        8000000
Filesystem /home/mscohen usage: 3857 of 5120 GBs (75.3%) and 7024000 of 8000000 files (87.8%)
/home/sbook                       1           2048              4        5000000
Filesystem /home/sbook usage: 5901 of 6144 GBs (96.1%) and 5881211 of 6000000 files (98.0%)
groupquota
Returns information about how much space you and everyone in your group are using on Hoffman2. An example output is shown below.
$ groupquota
Filesystem /home/mscohen usage: 3857 of 5120 GBs (75.3%) and 7024000 of 8000000 files (87.8%)

Space usage (in GB) for /u/home/FMRI/mscohen
userid          Usage          Quota     File Count     File Quota
--------        -----          -----     ----------     ----------
aarontre            0           5120             58        8000000
alenarto          301           5120         124547        8000000
alhead              1           5120            286        8000000
ariana            343           5120        1554618        8000000
ascott            240           5120         390940        8000000
ayc               102           5120        1538688        8000000
cculbert          143           5120         458313        8000000
cdrodrig            0           5120             48        8000000
data            n.a.
dcmoyer             2           5120           2848        8000000
diannaha            0           5120            171        8000000
eplau             141           5120          58575        8000000
ewang               0           5120            259        8000000
galiname            0           5120             24        8000000
hfard               0           5120              1        8000000
jbramen           528           5120         501460        8000000
jkyle              19           5120          75078        8000000
jlabus             19           5120           3415        8000000
jrpage              4           5120           1074        8000000
jungheel           21           5120          55444        8000000
kaavyara            0           5120           1059        8000000
kerr              873           5120         210424        8000000
mlschaef            6           5120           9816        8000000
mscohen            26           5120          28258        8000000
mundaeru            0           5120             10        8000000
p1p1p1p1           58           5120         141420        8000000
pamelita          628           5120         724094        8000000
pvaldes           158           5120          17312        8000000
sshresth            0           5120            243        8000000
weili15            58           5120         275735        8000000
xiahongj          176           5120         849633        8000000


Clean Up After Yourself

Every so often, some spring cleaning is useful. We have an app for that.

clean_me.py

Available to everyone in the FMRI usergroup on Hoffman2, this script was designed to find certain types of pesky files that have been known to build up over time but aren't actually necessary:

  • .DS_store files
  • Empty directories
  • tsplots
  • Empty files
  • Extended Attributes
  • mat files

and it gives you the option of deleting them.

To run it, just change into the directory you wish to clean and use the command:

$ clean_me.py


When it Hits the Fan

You tried to remember to clean up your files, you even kept a large dataset on your computer last weekend instead of working with it on Hoffman2. But still your quota, or your group's quota was reached. How does one fix this?

  1. First things first, run clean_me.py
  2. Start identifying what you can delete. This is a wonderful opportunity to audit your home directory to see what really is in the directory called temp-567 and what you actually put in the file subjects-az-list.
  3. Tar things up. That is to say, take that huge collection of DICOM files and turn them into a single file to cut down on overhead (remember it is about both file count and file size on Hoffman2). Unfamiliar with what tar is? Check out the Tar Tutorial.