Hoffman2:Quotas
Users and groups of users on Hoffman2 only have access to a predefined amount of disk space and number of files.
- After quota is reached, your account (or all the accounts of a usergroup) will have reduced capabilities since you won't be able to make any new files.
Stay In The Know
Keep yourself apprised of how much data you are using with these tools.
Personal Quotas
myquota
- Returns information about how much disk space you are using and how many files you have. An example output is shown below.
$ myquota User quotas for eplau (UID 8693) (in GBs): Filesystem Usage (in GB) Quota File Count File Quota /home/mscohen 141 5120 58575 8000000 Filesystem /home/mscohen usage: 3857 of 5120 GBs (75.3%) and 7024000 of 8000000 files (87.8%) /home/sbook 1 2048 4 5000000 Filesystem /home/sbook usage: 5901 of 6144 GBs (96.1%) and 5881211 of 6000000 files (98.0%)
Group Quotas
myquota -g [GROUPNAME]
- Returns information about how much space you and everyone in your resource group are using on Hoffman2. An example output is shown below.
$ myquota -g mscohen Group mscohen Report (/home/mscohen): Username UID Usage (in GB) Quota File Count File Quota aarontre 9307 164 6144 81477 8000000 aburggre 8223 0 6144 10 8000000 akshaan 10094 0 6144 120 8000000 alenarto 8800 254 6144 97615 8000000 alhead 9612 100 6144 1001 8000000 ariana 8186 293 6144 420801 8000000 ayc 8955 160 6144 1180551 8000000 cdrodrig 9545 3 6144 52 8000000 dcmoyer 9397 921 6144 173754 8000000 diannaha 8134 0 6144 171 8000000 eddieyan 10322 0 6144 16 8000000 eplau 8693 523 6144 123964 8000000 eshwang1 9811 0 6144 54 8000000 fbiessma 10212 0 6144 67 8000000 fmri 1901 0 6144 479 8000000 jbramen 8369 632 6144 462428 8000000 jbrown 8187 0 6144 148 8000000 jianwen 9921 0 6144 19 8000000 kaavyara 9295 0 6144 1064 8000000 kerr 8555 487 6144 34095 8000000 kesslers 9815 25 6144 60996 8000000 mhussien 9922 0 6144 10 8000000 mlschaef 9447 11 6144 15783 8000000 mowyong 10329 0 6144 201 8000000 mscohen 4004 18 6144 8458 8000000 mundaeru 9542 0 6144 10 8000000 mwollner 9696 35 6144 2721 8000000 pamelita 8557 1280 6144 946730 8000000 root 0 0 6144 1 8000000 sanjayra 9846 0 6144 10 8000000 xiahongj 9047 666 6144 289695 8000000 Filesystem mscohen usage: 5656 of 6144 GBs (92.1%) and 3921309 of 8000000 files (49.0%)
Clean Up After Yourself
Every so often, some spring cleaning is useful. We have an app for that.
clean_me.py
Available to everyone in the FMRI usergroup on Hoffman2, this script was designed to find certain types of pesky files that have been known to build up over time but aren't actually necessary:
- .DS_store files
- Empty directories
- tsplots
- Empty files
- Extended Attributes
- mat files
and it gives you the option of deleting them.
To run it, just change into the directory you wish to clean and use the command:
$ clean_me.py
When it Hits the Fan
You tried to remember to clean up your files, you even kept a large dataset on your computer last weekend instead of working with it on Hoffman2. But still your quota, or your group's quota was reached. How does one fix this?
- First things first, run
clean_me.py - Start identifying what you can delete. This is a wonderful opportunity to audit your home directory to see what really is in the directory called temp-567 and what you actually put in the file subjects-az-list.
- Tar things up. That is to say, take that huge collection of DICOM files and turn them into a single file to cut down on overhead (remember it is about both file count and file size on Hoffman2). Unfamiliar with what tar is? Check out the Tar Tutorial.