mirror of
https://github.com/Hestia-Homes/Model.git
synced 2026-06-30 13:10:47 +00:00
Add extra steps to readme and makefile
This commit is contained in:
parent
b2f606055f
commit
469938bb25
2 changed files with 21 additions and 5 deletions
|
|
@ -13,8 +13,13 @@ env:
|
||||||
. .training_env/bin/activate
|
. .training_env/bin/activate
|
||||||
pip install --upgrade pip
|
pip install --upgrade pip
|
||||||
pip install -r requirements/training/training-dev.txt && pre-commit install
|
pip install -r requirements/training/training-dev.txt && pre-commit install
|
||||||
|
|
||||||
|
echo " --- TO ACTIVATE THE ENVIRONMENT --- "
|
||||||
echo "Run source .training_env/bin/activate to activate the virtual environment"
|
echo "Run source .training_env/bin/activate to activate the virtual environment"
|
||||||
|
|
||||||
|
.PHONY: check-all
|
||||||
|
check-all: pre-commit run -a
|
||||||
|
|
||||||
.PHONY: build
|
.PHONY: build
|
||||||
build:
|
build:
|
||||||
docker-compose build
|
docker-compose build
|
||||||
|
|
|
||||||
|
|
@ -3,6 +3,13 @@
|
||||||
Starter Readme:
|
Starter Readme:
|
||||||
Steps for pipeline:
|
Steps for pipeline:
|
||||||
|
|
||||||
|
- (WIP) Set up the training development environment
|
||||||
|
- Change directory to this folder (simulation_system)
|
||||||
|
- Run the following command `make env PYTHON_VERSION=3.10.12`
|
||||||
|
- This will install the specified python version using `pyenv` and select this version as the global python version
|
||||||
|
- It will install all training packages as specified in the training-dev.txt requirements file, including the pre-commit hooks
|
||||||
|
- Run `source .training_env/bin/activate` to use this environment
|
||||||
|
|
||||||
- (WIP) Use Makefile to start up mock up s3 service
|
- (WIP) Use Makefile to start up mock up s3 service
|
||||||
- By running `make init`, this will run the `docker-compose build` and `docker-compose up -d`, which spins up a S3 service
|
- By running `make init`, this will run the `docker-compose build` and `docker-compose up -d`, which spins up a S3 service
|
||||||
- This docker compose is running in detached mode `-d`, so will no output anything to the terminal
|
- This docker compose is running in detached mode `-d`, so will no output anything to the terminal
|
||||||
|
|
@ -27,7 +34,7 @@ Steps for pipeline:
|
||||||
|
|
||||||
- Once model build is finished, you can run the `prediction.py` file to generate prediction
|
- Once model build is finished, you can run the `prediction.py` file to generate prediction
|
||||||
- By default, the prediction pipeline will select the best model based on **mean absolute error** from the model registry
|
- By default, the prediction pipeline will select the best model based on **mean absolute error** from the model registry
|
||||||
- This can be overwritten by specifying a model_path, which will load an alternative model
|
- This can be overwritten by specifying a model_path, which will load an alternative model
|
||||||
- There are two ways of getting data into the pipeline:
|
- There are two ways of getting data into the pipeline:
|
||||||
- Using the `--data` argument:
|
- Using the `--data` argument:
|
||||||
- This is a JSON string which can be passed as `python3 predictions.py --data '{"TOTAL_FLOOR_AREA": 1}'`
|
- This is a JSON string which can be passed as `python3 predictions.py --data '{"TOTAL_FLOOR_AREA": 1}'`
|
||||||
|
|
@ -55,12 +62,16 @@ Steps for pipeline:
|
||||||
- Add precommit hooks (linters, branch names, etc)
|
- Add precommit hooks (linters, branch names, etc)
|
||||||
- Sphinx documentation
|
- Sphinx documentation
|
||||||
- Sort out local mock up services
|
- Sort out local mock up services
|
||||||
- Sort out Model Registry
|
- Sort out Model Registry
|
||||||
- Sort out Data version control
|
- Sort out Data version control
|
||||||
|
- pre-commit hooks:
|
||||||
|
- The types of hooks that we want (safety, bandit, iso8 etc)
|
||||||
|
- The customisations we require
|
||||||
|
- Add sphinx documentation
|
||||||
- Data Science:
|
- Data Science:
|
||||||
- Implement a metrics class, to hold all metric
|
- Implement a metrics class, to hold all metric
|
||||||
- Rebuild metrics script (Could be a one off but good to have)
|
- Rebuild metrics script (Could be a one off but good to have)
|
||||||
- Determine metrics
|
- Determine metrics
|
||||||
- Implement and test custom model (Tensorflow Decision Trees etc)
|
- Implement and test custom model (Tensorflow Decision Trees etc)
|
||||||
- Orchestration:
|
- Orchestration:
|
||||||
- Lambda handler for the pipeline
|
- Lambda handler for the pipeline
|
||||||
|
|
|
||||||
Loading…
Add table
Reference in a new issue