===== Python ====

Versions of Python available via modules:

  - python/2.7.14
  - python/3.6.3
  - python/3.7.2
  - python/3.7.12
  - python/3.8.12
  - python/3.9.10
  - python/3.11.5

===== Python virtualenv =====

[[https://virtualenv.pypa.io/en/stable|Virtualenv]] is a tool to create isolated Python environments.

==== Python 2.7.14 virtualenv ====

Create a virtual environment for ''machine-learning'':

<code>
module load gnu/5.4.0
module load python/2.7.14
module load cuda/8.0.61.2
module list
which python
python2 -m pip install --user --upgrade pip
python2 -m pip install --user virtualenv
mkdir -p "$HOME/local/tools/python/2.7.14/virtualenv/machine-learning"
python2 -m virtualenv "$HOME/local/tools/python/2.7.14/virtualenv/machine-learning"
</code>

Activate ''machine-learning'' virtual environment:

<code>
source "$HOME/local/tools/python/2.7.14/virtualenv/machine-learning/bin/activate"
</code>

Install packages in ''machine-learning'' virtual environment:

<code>
pip install --upgrade opencv-python Pillow sklearn h5py scikit-image cython easydict
</code>

Deactivate ''machine-learning'' virtual environment:

<code>
deactivate
</code>

==== Python 3.6.3 virtualenv ====

Available virtual environments for Python 3.6.3:
  * opencv
  * tensorflow
  * tensorflow-gpu

=== Site installation ===

Activate ''opencv'' virtual environment:

<code>
module load gnu/5.4.0
module load python/3.6.3

source '/hpc/share/tools/python/3.6.3/virtualenv/opencv/bin/activate'
</code>

----

Activate ''tensorflow'' virtual environment:

<code>
module load gnu/5.4.0
module load python/3.6.3

source '/hpc/share/tools/python/3.6.3/virtualenv/tensorflow/bin/activate'
</code>

----

Activate ''tensorflow-gpu'' virtual environment:

<code>
module load gnu/5.4.0
module load python/3.6.3
module load cuda/9.0.176
module load cudnn/7.1.1

source '/hpc/share/tools/python/3.6.3/virtualenv/tensorflow-gpu/bin/activate'
</code>

----

Deactivate the virtual environment:

<code>
deactivate
</code>

=== User installation ===

Create ''opencv'' virtual environment (just once):

<code>
module load gnu/5.4.0
module load python/3.6.3

hpc-make-virtualenv-opencv
</code>

Update ''opencv'' virtual environment (every time you want to update):

<code>
module load gnu/5.4.0
module load python/3.6.3

hpc-make-virtualenv-opencv
</code>

Activate ''opencv'' virtual environment:

<code>
module load gnu/5.4.0
module load python/3.6.3

source "$HOME/local/tools/python/3.6.3/virtualenv/opencv/bin/activate"
</code>

----

Create ''tensorflow'' virtual environment (just once):

<code>
module load gnu/5.4.0
module load python/3.6.3

hpc-make-virtualenv-tensorflow
</code>

Update ''tensorflow'' virtual environment (every time you want to update):

<code>
module load gnu/5.4.0
module load python/3.6.3

hpc-make-virtualenv-tensorflow
</code>

Activate ''tensorflow'' virtual environment:

<code>
module load gnu/5.4.0
module load python/3.6.3

source "$HOME/local/tools/python/3.6.3/virtualenv/tensorflow/bin/activate"
</code>

----

Create ''tensorflow-gpu'' virtual environment (just once):

<code>
module load gnu/5.4.0
module load python/3.6.3

hpc-make-virtualenv-tensorflow-gpu
</code>

Update ''tensorflow-gpu'' virtual environment (every time you want to update):

<code>
module load gnu/5.4.0
module load python/3.6.3

hpc-make-virtualenv-tensorflow-gpu
</code>

Activate ''tensorflow-gpu'' virtual environment:

<code>
module load gnu/5.4.0
module load python/3.6.3
module load cuda/9.0.176
module load cudnn/7.1.1

source '/hpc/share/tools/python/3.6.3/virtualenv/tensorflow-gpu/bin/activate'
</code>

----

Deactivate the virtual environment:

<code>
deactivate
</code>

==== Python 3.6.8 virtualenv ====

=== User installation ===

Require a node with ''srun'':

<code>
srun \
    --job-name=srun \
    --nodes=1 \
    --ntasks-per-node=1 \
    --cpus-per-task=1 \
    --time=0-01:00:00 \
    --mem=1G \
    --partition=cpu \
    --qos=normal \
    --pty \
    bash
</code>

Create ''my_venv_with_jupyter'' virtual environment (just once):

<code>
mkdir -p "$HOME/local/tools/python/3.6.8/virtualenv/my_venv_with_jupyter"
python3 -m venv "$HOME/local/tools/python/3.6.8/virtualenv/my_venv_with_jupyter"
source "$HOME/local/tools/python/3.6.8/virtualenv/my_venv_with_jupyter/bin/activate"
python3 -m pip install --upgrade pip
python3 -m pip install --upgrade jupyter notebook ipyparallel
#python3 -m pip install --upgrade other_packages_for_my_project
deactivate
</code>

Update ''my_venv_with_jupyter'' virtual environment (every time you want to update):

<code>
source "$HOME/local/tools/python/3.6.8/virtualenv/my_venv_with_jupyter/bin/activate"
python3 -m pip install --upgrade pip
python3 -m pip install --upgrade jupyter notebook ipyparallel
#python3 -m pip install --upgrade other_packages_for_my_project
deactivate
</code>

Activate ''my_venv_with_jupyter'' virtual environment:

<code>
source "$HOME/local/tools/python/3.6.8/virtualenv/my_venv_with_jupyter/bin/activate"
</code>

Start the ''Jupyter Notebook Server'':

<code>
hpc-jupyter-notebook
</code>

Follow the instructions on the screen:

<code>
Open another shell and run the following command:

ssh -N -L 127.0.0.1:*****:wn**.hpc.unipr.it:***** ***.***@login.hpc.unipr.it

To access the notebook, open in a browser the URL which starts with
    http://127.0.0.1 (last line below)
</code>

Stop the ''Jupyter Notebook Server'':

Press ''CTRL'' + ''C''.

Deactivate the virtual environment:

<code>
deactivate
</code>