Hoffman2:Singularity: Difference between revisions
Jump to navigation
Jump to search
(Created page with " == Singularity == Singularity is a type of container technology, is provided in Hoffman2 currently. ===How to use Singularity=== In a CentOs 7 Node, load Singularity module...") |
|||
| (8 intermediate revisions by the same user not shown) | |||
| Line 2: | Line 2: | ||
== Singularity == | == Singularity == | ||
Singularity is a type of container technology | Singularity is a type of container technology. It is provided in Hoffman2 currently. | ||
===How to use Singularity=== | ===How to use Singularity=== | ||
The example code here is from IDRE team's | |||
[https://gitlab.idre.ucla.edu/cpeterson/singularity_ws/-/tree/master | gitlab]. | |||
Please check it up for more information. | |||
====Interactive mode ==== | |||
In a CentOs 7 Node, load Singularity module as | In a CentOs 7 Node, load Singularity module as | ||
module load singularity | module load singularity | ||
singularity shell --userns $H2_CONTAINER_LOC/tensorflow-2.4.1-gpu-jupyter.sif | |||
Then run your command inside of the container | |||
python3 tf-example.py > tf-example-batch.out | |||
====Batch mode==== | |||
Add the following line into your batch job script | |||
module load singularity/3.7.1 | |||
Use "singularity exec" to run command in Singularity container | |||
Example | |||
singularity exec --userns $H2_CONTAINER_LOC/tensorflow-2.4.1-gpu-jupyter.sif python3 tf-example.py > tf-example-batch.out | |||
===Convert Docker image for Singularity=== | |||
Docker image can be converted for Singularity | |||
export SINGULARITY_CACHEDIR=$SCRATCH/singularity_cache | |||
singularity pull tensorflow-1.15.5-gpu-jupyter.sif docker://tensorflow/tensorflow:1.15.5-gpu-jupyter | |||
Latest revision as of 22:38, 12 August 2021
Singularity
Singularity is a type of container technology. It is provided in Hoffman2 currently.
How to use Singularity
The example code here is from IDRE team's | gitlab. Please check it up for more information.
Interactive mode
In a CentOs 7 Node, load Singularity module as
module load singularity singularity shell --userns $H2_CONTAINER_LOC/tensorflow-2.4.1-gpu-jupyter.sif
Then run your command inside of the container
python3 tf-example.py > tf-example-batch.out
Batch mode
Add the following line into your batch job script
module load singularity/3.7.1
Use "singularity exec" to run command in Singularity container
Example
singularity exec --userns $H2_CONTAINER_LOC/tensorflow-2.4.1-gpu-jupyter.sif python3 tf-example.py > tf-example-batch.out
Convert Docker image for Singularity
Docker image can be converted for Singularity
export SINGULARITY_CACHEDIR=$SCRATCH/singularity_cache singularity pull tensorflow-1.15.5-gpu-jupyter.sif docker://tensorflow/tensorflow:1.15.5-gpu-jupyter