===== Python ====
Versions of Python available via modules:
- python/2.7.14
- python/3.6.3
- python/3.7.2
- python/3.7.12
- python/3.8.12
- python/3.9.10
- python/3.11.5
==== Python virtualenv ====
[[https://virtualenv.pypa.io/en/stable|Virtualenv]] is a tool to create isolated Python environments.
=== Python 2.7.14 virtualenv ===
Create a virtual environment for "machine-learning":
module load gnu/5.4.0
module load python/2.7.14
module load cuda/8.0.61.2
module list
which python
python2 -m pip install --user --upgrade pip
python2 -m pip install --user virtualenv
mkdir -p "$HOME/local/tools/python/2.7.14/virtualenv/machine-learning"
python2 -m virtualenv "$HOME/local/tools/python/2.7.14/virtualenv/machine-learning"
Activate "machine-learning" virtual environment:
source "$HOME/local/tools/python/2.7.14/virtualenv/machine-learning/bin/activate"
Install packages in "machine-learning" virtual environment:
pip install --upgrade opencv-python Pillow sklearn h5py scikit-image cython easydict
Deactivate "machine-learning" virtual environment:
deactivate
=== Python 3.6.3 virtualenv ===
Available virtual environments for Python 3.6.3:
* opencv
* tensorflow
* tensorflow-gpu
== Site installation ==
Activate "opencv" virtual environment:
module load gnu/5.4.0
module load python/3.6.3
source '/hpc/share/tools/python/3.6.3/virtualenv/opencv/bin/activate'
----
Activate "tensorflow" virtual environment:
module load gnu/5.4.0
module load python/3.6.3
source '/hpc/share/tools/python/3.6.3/virtualenv/tensorflow/bin/activate'
----
Activate "tensorflow-gpu" virtual environment:
module load gnu/5.4.0
module load python/3.6.3
module load cuda/9.0.176
module load cudnn/7.1.1
source '/hpc/share/tools/python/3.6.3/virtualenv/tensorflow-gpu/bin/activate'
----
Deactivate the virtual environment:
deactivate
== User installation ==
Create "opencv" virtual environment (just once):
module load gnu/5.4.0
module load python/3.6.3
hpc-make-virtualenv-opencv
Update "opencv" virtual environment (every time you want to update):
module load gnu/5.4.0
module load python/3.6.3
hpc-make-virtualenv-opencv
Activate "opencv" virtual environment:
module load gnu/5.4.0
module load python/3.6.3
source "$HOME/local/tools/python/3.6.3/virtualenv/opencv/bin/activate"
----
Create "tensorflow" virtual environment (just once):
module load gnu/5.4.0
module load python/3.6.3
hpc-make-virtualenv-tensorflow
Update "tensorflow" virtual environment (every time you want to update):
module load gnu/5.4.0
module load python/3.6.3
hpc-make-virtualenv-tensorflow
Activate "tensorflow" virtual environment:
module load gnu/5.4.0
module load python/3.6.3
source "$HOME/local/tools/python/3.6.3/virtualenv/tensorflow/bin/activate"
----
Create "tensorflow-gpu" virtual environment (just once):
module load gnu/5.4.0
module load python/3.6.3
hpc-make-virtualenv-tensorflow-gpu
Update "tensorflow-gpu" virtual environment (every time you want to update):
module load gnu/5.4.0
module load python/3.6.3
hpc-make-virtualenv-tensorflow-gpu
Activate "tensorflow-gpu" virtual environment:
module load gnu/5.4.0
module load python/3.6.3
module load cuda/9.0.176
module load cudnn/7.1.1
source '/hpc/share/tools/python/3.6.3/virtualenv/tensorflow-gpu/bin/activate'
----
Deactivate the virtual environment:
deactivate