Versions of Python available via modules:

1. python/2.7.14
2. python/3.6.3
3. python/3.7.2
4. python/3.7.12
5. python/3.8.12
6. python/3.9.10
7. python/3.11.5

Virtualenv is a tool to create isolated Python environments.

Create a virtual environment for machine-learning:

module load gnu/5.4.0
module load python/2.7.14
module load cuda/8.0.61.2
module list
which python
python2 -m pip install --user --upgrade pip
python2 -m pip install --user virtualenv
mkdir -p "$HOME/local/tools/python/2.7.14/virtualenv/machine-learning"
python2 -m virtualenv "$HOME/local/tools/python/2.7.14/virtualenv/machine-learning"

Activate machine-learning virtual environment:

source "$HOME/local/tools/python/2.7.14/virtualenv/machine-learning/bin/activate"

Install packages in machine-learning virtual environment:

pip install --upgrade opencv-python Pillow sklearn h5py scikit-image cython easydict

Deactivate machine-learning virtual environment:

deactivate

Available virtual environments for Python 3.6.3:

• opencv
• tensorflow
• tensorflow-gpu

Activate opencv virtual environment:

module load gnu/5.4.0
module load python/3.6.3

source '/hpc/share/tools/python/3.6.3/virtualenv/opencv/bin/activate'

Activate tensorflow virtual environment:

module load gnu/5.4.0
module load python/3.6.3

source '/hpc/share/tools/python/3.6.3/virtualenv/tensorflow/bin/activate'

Activate tensorflow-gpu virtual environment:

module load gnu/5.4.0
module load python/3.6.3
module load cuda/9.0.176
module load cudnn/7.1.1

source '/hpc/share/tools/python/3.6.3/virtualenv/tensorflow-gpu/bin/activate'

Deactivate the virtual environment:

deactivate

Create opencv virtual environment (just once):

module load gnu/5.4.0
module load python/3.6.3

hpc-make-virtualenv-opencv

Update opencv virtual environment (every time you want to update):

module load gnu/5.4.0
module load python/3.6.3

hpc-make-virtualenv-opencv

Activate opencv virtual environment:

module load gnu/5.4.0
module load python/3.6.3

source "$HOME/local/tools/python/3.6.3/virtualenv/opencv/bin/activate"

Create tensorflow virtual environment (just once):

module load gnu/5.4.0
module load python/3.6.3

hpc-make-virtualenv-tensorflow

Update tensorflow virtual environment (every time you want to update):

module load gnu/5.4.0
module load python/3.6.3

hpc-make-virtualenv-tensorflow

Activate tensorflow virtual environment:

module load gnu/5.4.0
module load python/3.6.3

source "$HOME/local/tools/python/3.6.3/virtualenv/tensorflow/bin/activate"

Create tensorflow-gpu virtual environment (just once):

module load gnu/5.4.0
module load python/3.6.3

hpc-make-virtualenv-tensorflow-gpu

Update tensorflow-gpu virtual environment (every time you want to update):

module load gnu/5.4.0
module load python/3.6.3

hpc-make-virtualenv-tensorflow-gpu

Activate tensorflow-gpu virtual environment:

module load gnu/5.4.0
module load python/3.6.3
module load cuda/9.0.176
module load cudnn/7.1.1

source '/hpc/share/tools/python/3.6.3/virtualenv/tensorflow-gpu/bin/activate'

Deactivate the virtual environment:

deactivate

Require a node with srun:

srun \
    --job-name=srun \
    --nodes=1 \
    --ntasks-per-node=1 \
    --cpus-per-task=1 \
    --time=0-01:00:00 \
    --mem=1G \
    --partition=cpu \
    --qos=normal \
    --pty \
    bash

Create my_venv_with_jupyter virtual environment (just once):

mkdir -p "$HOME/local/tools/python/3.6.8/virtualenv/my_venv_with_jupyter"
python3 -m venv "$HOME/local/tools/python/3.6.8/virtualenv/my_venv_with_jupyter"
source "$HOME/local/tools/python/3.6.8/virtualenv/my_venv_with_jupyter/bin/activate"
python3 -m pip install --upgrade pip
python3 -m pip install --upgrade jupyter notebook ipyparallel
#python3 -m pip install --upgrade other_packages_for_my_project
deactivate

Update my_venv_with_jupyter virtual environment (every time you want to update):

source "$HOME/local/tools/python/3.6.8/virtualenv/my_venv_with_jupyter/bin/activate"
python3 -m pip install --upgrade pip
python3 -m pip install --upgrade jupyter notebook ipyparallel
#python3 -m pip install --upgrade other_packages_for_my_project
deactivate

Activate my_venv_with_jupyter virtual environment:

source "$HOME/local/tools/python/3.6.8/virtualenv/my_venv_with_jupyter/bin/activate"

Start the Jupyter Notebook Server:

hpc-jupyter-notebook

Follow the instructions on the screen:

Open another shell and run the following command:

ssh -N -L 127.0.0.1:*****:wn**.hpc.unipr.it:***** ***.***@login.hpc.unipr.it

To access the notebook, open in a browser the URL which starts with
    http://127.0.0.1 (last line below)

Stop the Jupyter Notebook Server:

Press CTRL + C.

Deactivate the virtual environment:

deactivate