Grad_metadata

Env Preparing

Using VSCode Dev Contariners

Tutorial

Python 3 -> Additional Options -> 3.11-bullseye -> ZSH Plugins (Last One) -> Trust @devcontainers-contrib -> Keep Defaults Setup venv:

python3.11 -m venv .venv
source .venv/bin/activate

Using VSCode WSL2: Ubuntu 22.04.3 LTS

Tutorial

Install Ubuntu 22.04.3 LTS -> Update Ubuntu Packages -> Install Python 3.11 -> Open Project in WSL2 Using VSCode

Install Python 3.11

sudo apt update
sudo apt install software-properties-common
sudo add-apt-repository ppa:deadsnakes/ppa
sudo apt install python3.11
sudo apt install python3.11-dev

Setup venv:

sudo apt install python3.11-venv
python3.11 -m venv .venv
source .venv/bin/activate

Install requirements:

pip install --upgrade pip -i https://pypi.tuna.tsinghua.edu.cn/simple
pip install -r /root/Grad_metadata_project/requirements.txt -i https://pypi.tuna.tsinghua.edu.cn/simple
pip install -r /root/Grad_metadata_project/requirements.txt --upgrade
pip freeze > requirements_freeze.txt

Install GUI (Graphical User Interface) toolkit (optional)

sudo apt update 
sudo apt install python3-tk

Install Cuda (optional):

sudo apt install nvidia-cuda-toolkit

Auto Build

The auto build will be triggered by pushing any tag named like release-v$version. For instance, push a tag named as v0.0.1 will build a docker image of 0.0.1 version.

#list existing tags
git tag
#creat a new tag
git tag v0.0.1
#push this tag to origin
git push origin v0.0.1

RUN

nohup .venv/bin/python3.11 src/calculation.py > /dev/null 2>&1 &

nohup .venv/bin/python3.11 src/calculation_0.py > /dev/null 2>&1 &
nohup .venv/bin/python3.11 src/calculation_1.py > /dev/null 2>&1 &
nohup .venv/bin/python3.11 src/calculation_2.py > /dev/null 2>&1 &
nohup .venv/bin/python3.11 src/calculation_3.py > /dev/null 2>&1 &
nohup .venv/bin/python3.11 src/calculation_4.py > /dev/null 2>&1 &
nohup .venv/bin/python3.11 src/calculation_5.py > /dev/null 2>&1 &

nohup .venv/bin/python3.11 src/back_calculation_0.py > /dev/null 2>&1 &
nohup .venv/bin/python3.11 src/back_calculation_1.py > /dev/null 2>&1 &
nohup .venv/bin/python3.11 src/back_calculation_2.py > /dev/null 2>&1 &
nohup .venv/bin/python3.11 src/back_calculation_3.py > /dev/null 2>&1 &
nohup .venv/bin/python3.11 src/back_calculation_4.py > /dev/null 2>&1 &
nohup .venv/bin/python3.11 src/back_calculation_5.py > /dev/null 2>&1 &

nohup .venv/bin/python3.11 src/analysis_all.py > log.txt 2>&1 &

nohup .venv/bin/python3.11 src/analysis_large_remove_refs_id.py > log_large.txt 2>&1 &
nohup .venv/bin/python3.11 src/analysis_large_all.py > log_large_all.txt 2>&1 &


sudo pkill -f python3.11