Hoffman2:Quotas

Back to all things Hoffman2

Users and groups of users on Hoffman2 only have access to a predefined amount of disk space and number of files.

After quota is reached, your account (or all the accounts of a usergroup) will have reduced capabilities since you won't be able to make any new files.

Stay In The Know

Keep yourself apprised of how much data you are using with these tools.

Personal Quotas

myquota

Returns information about how much disk space you are using and how many files you have. An example output is shown below.

$ myquota
User quotas for eplau (UID 8693) (in GBs):
Filesystem            Usage (in GB)          Quota     File Count     File Quota
/home/mscohen                   141           5120          58575        8000000
Filesystem /home/mscohen usage: 3857 of 5120 GBs (75.3%) and 7024000 of 8000000 files (87.8%)
/home/sbook                       1           2048              4        5000000
Filesystem /home/sbook usage: 5901 of 6144 GBs (96.1%) and 5881211 of 6000000 files (98.0%)

Group Quotas

myquota -g [GROUPNAME]

Returns information about how much space you and everyone in your resource group are using on Hoffman2. An example output is shown below.

$ myquota -g mscohen
Group mscohen Report (/home/mscohen):
Username  UID    Usage (in GB)          Quota     File Count     File Quota
aarontre  9307             164           6144          81477        8000000
aburggre  8223               0           6144             10        8000000
akshaan   10094              0           6144            120        8000000
alenarto  8800             254           6144          97615        8000000
alhead    9612             100           6144           1001        8000000
ariana    8186             293           6144         420801        8000000
ayc       8955             160           6144        1180551        8000000
cdrodrig  9545               3           6144             52        8000000
dcmoyer   9397             921           6144         173754        8000000
diannaha  8134               0           6144            171        8000000
eddieyan  10322              0           6144             16        8000000
eplau     8693             523           6144         123964        8000000
eshwang1  9811               0           6144             54        8000000
fbiessma  10212              0           6144             67        8000000
fmri      1901               0           6144            479        8000000
jbramen   8369             632           6144         462428        8000000
jbrown    8187               0           6144            148        8000000
jianwen   9921               0           6144             19        8000000
kaavyara  9295               0           6144           1064        8000000
kerr      8555             487           6144          34095        8000000
kesslers  9815              25           6144          60996        8000000
mhussien  9922               0           6144             10        8000000
mlschaef  9447              11           6144          15783        8000000
mowyong   10329              0           6144            201        8000000
mscohen   4004              18           6144           8458        8000000
mundaeru  9542               0           6144             10        8000000
mwollner  9696              35           6144           2721        8000000
pamelita  8557            1280           6144         946730        8000000
root      0                  0           6144              1        8000000
sanjayra  9846               0           6144             10        8000000
xiahongj  9047             666           6144         289695        8000000
Filesystem mscohen usage: 5656 of 6144 GBs (92.1%) and 3921309 of 8000000 files (49.0%)

Clean Up After Yourself

Every so often, some spring cleaning is useful. We have an app for that.

clean_me.py

Available to everyone in the FMRI usergroup on Hoffman2, this script was designed to find certain types of pesky files that have been known to build up over time but aren't actually necessary:

• .DS_store files
• Empty directories
• tsplots
• Empty files
• Extended Attributes
• mat files

and it gives you the option of deleting them.

To run it, just change into the directory you wish to clean and use the command:

$ clean_me.py

When it Hits the Fan

You tried to remember to clean up your files, you even kept a large dataset on your computer last weekend instead of working with it on Hoffman2. But still your quota, or your group's quota was reached. How does one fix this?

1. First things first, run clean_me.py
2. Start identifying what you can delete. This is a wonderful opportunity to audit your home directory to see what really is in the directory called temp-567 and what you actually put in the file subjects-az-list.
3. Tar things up. That is to say, take that huge collection of DICOM files and turn them into a single file to cut down on overhead (remember it is about both file count and file size on Hoffman2). Unfamiliar with what tar is? Check out the Tar Tutorial.