Python
Versions of Python available via modules:
- python/2.7.14
- python/3.6.3
- python/3.7.2
- python/3.7.12
- python/3.8.12
- python/3.9.10
Python virtualenv
Virtualenv is a tool to create isolated Python environments.
Python 2.7.14 virtualenv
Create a virtual environment for "machine-learning":
module load gnu/5.4.0 module load python/2.7.14 module load cuda/8.0.61.2 module list which python python2 -m pip install --user --upgrade pip python2 -m pip install --user virtualenv mkdir -p "$HOME/local/tools/python/2.7.14/virtualenv/machine-learning" python2 -m virtualenv "$HOME/local/tools/python/2.7.14/virtualenv/machine-learning"
Activate "machine-learning" virtual environment:
source "$HOME/local/tools/python/2.7.14/virtualenv/machine-learning/bin/activate"
Install packages in "machine-learning" virtual environment:
pip install --upgrade opencv-python Pillow sklearn h5py scikit-image cython easydict
Deactivate "machine-learning" virtual environment:
deactivate
Python 3.6.3 virtualenv
Available virtual environments for Python 3.6.3:
- opencv
- tensorflow
- tensorflow-gpu
Site installation
Activate "opencv" virtual environment:
module load gnu/5.4.0 module load python/3.6.3 source '/hpc/share/tools/python/3.6.3/virtualenv/opencv/bin/activate'
Activate "tensorflow" virtual environment:
module load gnu/5.4.0 module load python/3.6.3 source '/hpc/share/tools/python/3.6.3/virtualenv/tensorflow/bin/activate'
Activate "tensorflow-gpu" virtual environment:
module load gnu/5.4.0 module load python/3.6.3 module load cuda/9.0.176 module load cudnn/7.1.1 source '/hpc/share/tools/python/3.6.3/virtualenv/tensorflow-gpu/bin/activate'
Deactivate the virtual environment:
deactivate
User installation
Create "opencv" virtual environment (just once):
module load gnu/5.4.0 module load python/3.6.3 hpc-make-virtualenv-opencv
Update "opencv" virtual environment (every time you want to update):
module load gnu/5.4.0 module load python/3.6.3 hpc-make-virtualenv-opencv
Activate "opencv" virtual environment:
module load gnu/5.4.0 module load python/3.6.3 source "$HOME/local/tools/python/3.6.3/virtualenv/opencv/bin/activate"
Create "tensorflow" virtual environment (just once):
module load gnu/5.4.0 module load python/3.6.3 hpc-make-virtualenv-tensorflow
Update "tensorflow" virtual environment (every time you want to update):
module load gnu/5.4.0 module load python/3.6.3 hpc-make-virtualenv-tensorflow
Activate "tensorflow" virtual environment:
module load gnu/5.4.0 module load python/3.6.3 source "$HOME/local/tools/python/3.6.3/virtualenv/tensorflow/bin/activate"
Create "tensorflow-gpu" virtual environment (just once):
module load gnu/5.4.0 module load python/3.6.3 hpc-make-virtualenv-tensorflow-gpu
Update "tensorflow-gpu" virtual environment (every time you want to update):
module load gnu/5.4.0 module load python/3.6.3 hpc-make-virtualenv-tensorflow-gpu
Activate "tensorflow-gpu" virtual environment:
module load gnu/5.4.0 module load python/3.6.3 module load cuda/9.0.176 module load cudnn/7.1.1 source '/hpc/share/tools/python/3.6.3/virtualenv/tensorflow-gpu/bin/activate'
Deactivate the virtual environment:
deactivate