Python []

Python

Versions of Python available via modules:

python/2.7.14
python/3.6.3
python/3.7.2
python/3.7.12
python/3.8.12
python/3.9.10

Python virtualenv

Virtualenv is a tool to create isolated Python environments.

Python 2.7.14 virtualenv

Create a virtual environment for "machine-learning":

module load gnu/5.4.0
module load python/2.7.14
module load cuda/8.0.61.2
module list
which python
python2 -m pip install --user --upgrade pip
python2 -m pip install --user virtualenv
mkdir -p "$HOME/local/tools/python/2.7.14/virtualenv/machine-learning"
python2 -m virtualenv "$HOME/local/tools/python/2.7.14/virtualenv/machine-learning"

Activate "machine-learning" virtual environment:

source "$HOME/local/tools/python/2.7.14/virtualenv/machine-learning/bin/activate"

Install packages in "machine-learning" virtual environment:

pip install --upgrade opencv-python Pillow sklearn h5py scikit-image cython easydict

Deactivate "machine-learning" virtual environment:

deactivate

Python 3.6.3 virtualenv

Available virtual environments for Python 3.6.3:

opencv
tensorflow
tensorflow-gpu

Site installation

Activate "opencv" virtual environment:

module load gnu/5.4.0
module load python/3.6.3

source '/hpc/share/tools/python/3.6.3/virtualenv/opencv/bin/activate'

Activate "tensorflow" virtual environment:

module load gnu/5.4.0
module load python/3.6.3

source '/hpc/share/tools/python/3.6.3/virtualenv/tensorflow/bin/activate'

Activate "tensorflow-gpu" virtual environment:

module load gnu/5.4.0
module load python/3.6.3
module load cuda/9.0.176
module load cudnn/7.1.1

source '/hpc/share/tools/python/3.6.3/virtualenv/tensorflow-gpu/bin/activate'

Deactivate the virtual environment:

deactivate

User installation

Create "opencv" virtual environment (just once):

module load gnu/5.4.0
module load python/3.6.3

hpc-make-virtualenv-opencv

Update "opencv" virtual environment (every time you want to update):

module load gnu/5.4.0
module load python/3.6.3

hpc-make-virtualenv-opencv

Activate "opencv" virtual environment:

module load gnu/5.4.0
module load python/3.6.3

source "$HOME/local/tools/python/3.6.3/virtualenv/opencv/bin/activate"

Create "tensorflow" virtual environment (just once):

module load gnu/5.4.0
module load python/3.6.3

hpc-make-virtualenv-tensorflow

Update "tensorflow" virtual environment (every time you want to update):

module load gnu/5.4.0
module load python/3.6.3

hpc-make-virtualenv-tensorflow

Activate "tensorflow" virtual environment:

module load gnu/5.4.0
module load python/3.6.3

source "$HOME/local/tools/python/3.6.3/virtualenv/tensorflow/bin/activate"

Create "tensorflow-gpu" virtual environment (just once):

module load gnu/5.4.0
module load python/3.6.3

hpc-make-virtualenv-tensorflow-gpu

Update "tensorflow-gpu" virtual environment (every time you want to update):

module load gnu/5.4.0
module load python/3.6.3

hpc-make-virtualenv-tensorflow-gpu