Skip to content

Commit 1d5e900

Browse files
AbeshithAbeshith
committed
Airflow Updated
1 parent 2b210d1 commit 1d5e900

40 files changed

Lines changed: 2427 additions & 113 deletions

‎.gitignore‎

Whitespace-only changes.

‎__pycache__/model_dag.cpython-311.pyc‎

15.6 KB
Binary file not shown.

‎artifacts/model_evaluation/metrics.json‎

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
{
2+
"rmse": 2.102408382953637,
3+
"mae": 1.5072424263746285,
4+
"r2": 0.9988652238714363
5+
}

‎config/config.yaml‎

Lines changed: 7 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -19,4 +19,10 @@ model_trainer:
1919
root_dir: artifacts/model_trainer
2020
train_data_path: artifacts/data_transformation/train.csv
2121
test_data_path: artifacts/data_transformation/test.csv
22-
model_name: model.joblib
22+
model_name: model.joblib
23+
24+
model_evaluation:
25+
root_dir: artifacts/model_evaluation
26+
model_path: artifacts/model_trainer/model.joblib
27+
test_data_path: artifacts/data_transformation/test.csv
28+
metrics_file_name: metrics.json

‎logs/2025-07-12_11-18-19.log/2025-07-12_11-18-19.log‎

Lines changed: 40 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,40 @@
1+
[2025-07-12 11:18:34,141] 1025 httpx - INFO - HTTP Request: GET https://dagshub.com/api/v1/user "HTTP/1.1 200 OK"
2+
[2025-07-12 11:18:34,159] 107 dagshub - INFO - Accessing as abheshith7
3+
[2025-07-12 11:18:34,547] 1025 httpx - INFO - HTTP Request: GET https://dagshub.com/api/v1/repos/abheshith7/MachineLearning_PipeLine "HTTP/1.1 200 OK"
4+
[2025-07-12 11:18:34,890] 1025 httpx - INFO - HTTP Request: GET https://dagshub.com/api/v1/user "HTTP/1.1 200 OK"
5+
[2025-07-12 11:18:34,891] 107 dagshub - INFO - Initialized MLflow to track repo "abheshith7/MachineLearning_PipeLine"
6+
[2025-07-12 11:18:34,891] 107 dagshub - INFO - Repository abheshith7/MachineLearning_PipeLine initialized!
7+
[2025-07-12 11:18:35,267] 1025 httpx - INFO - HTTP Request: GET https://dagshub.com/api/v1/repos/abheshith7/MachineLearning_PipeLine "HTTP/1.1 200 OK"
8+
[2025-07-12 11:18:35,267] 107 dagshub - INFO - Initialized MLflow to track repo "abheshith7/MachineLearning_PipeLine"
9+
[2025-07-12 11:18:35,282] 107 dagshub - INFO - Repository abheshith7/MachineLearning_PipeLine initialized!
10+
[2025-07-12 11:18:35,282] 20 src.mlpipeline.logging - INFO - >>>>>> stage Model Evaluation Stage started <<<<<<
11+
[2025-07-12 11:18:35,289] 25 src.mlpipeline.logging - INFO - yaml file: config\config.yaml loaded sucessfully
12+
[2025-07-12 11:18:35,289] 25 src.mlpipeline.logging - INFO - yaml file: config\params.yaml loaded sucessfully
13+
[2025-07-12 11:18:35,301] 25 src.mlpipeline.logging - INFO - yaml file: config\schema.yaml loaded sucessfully
14+
[2025-07-12 11:18:35,304] 44 src.mlpipeline.logging - INFO - Creating a Directory at: artifacts
15+
[2025-07-12 11:18:35,305] 44 src.mlpipeline.logging - INFO - Creating a Directory at: artifacts/model_evaluation
16+
[2025-07-12 11:18:38,782] 33 src.mlpipeline.logging - ERROR - The feature names should match those that were passed during fit.
17+
Feature names unseen at fit time:
18+
- id
19+
Traceback (most recent call last):
20+
File "D:\MachineLearning PipeLine\run_model_evaluation.py", line 24, in main
21+
model_evaluation_pipeline.initiate_model_evaluation()
22+
File "D:\MachineLearning PipeLine\src\mlpipeline\pipeline\model_evaluation_pipeline.py", line 19, in initiate_model_evaluation
23+
model_evaluation.log_into_mlflow()
24+
File "D:\MachineLearning PipeLine\src\mlpipeline\components\model_evaluation.py", line 40, in log_into_mlflow
25+
predictions = model.predict(X_test)
26+
^^^^^^^^^^^^^^^^^^^^^
27+
File "D:\MachineLearning PipeLine\.venv\Lib\site-packages\sklearn\ensemble\_forest.py", line 1065, in predict
28+
X = self._validate_X_predict(X)
29+
^^^^^^^^^^^^^^^^^^^^^^^^^^^
30+
File "D:\MachineLearning PipeLine\.venv\Lib\site-packages\sklearn\ensemble\_forest.py", line 637, in _validate_X_predict
31+
X = validate_data(
32+
^^^^^^^^^^^^^^
33+
File "D:\MachineLearning PipeLine\.venv\Lib\site-packages\sklearn\utils\validation.py", line 2929, in validate_data
34+
_check_feature_names(_estimator, X, reset=reset)
35+
File "D:\MachineLearning PipeLine\.venv\Lib\site-packages\sklearn\utils\validation.py", line 2787, in _check_feature_names
36+
raise ValueError(message)
37+
ValueError: The feature names should match those that were passed during fit.
38+
Feature names unseen at fit time:
39+
- id
40+

‎logs/2025-07-12_11-19-50.log/2025-07-12_11-19-50.log‎

Lines changed: 54 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,54 @@
1+
[2025-07-12 11:19:54,415] 1025 httpx - INFO - HTTP Request: GET https://dagshub.com/api/v1/user "HTTP/1.1 200 OK"
2+
[2025-07-12 11:19:54,418] 107 dagshub - INFO - Accessing as abheshith7
3+
[2025-07-12 11:19:54,766] 1025 httpx - INFO - HTTP Request: GET https://dagshub.com/api/v1/repos/abheshith7/MachineLearning_PipeLine "HTTP/1.1 200 OK"
4+
[2025-07-12 11:19:55,136] 1025 httpx - INFO - HTTP Request: GET https://dagshub.com/api/v1/user "HTTP/1.1 200 OK"
5+
[2025-07-12 11:19:55,149] 107 dagshub - INFO - Initialized MLflow to track repo "abheshith7/MachineLearning_PipeLine"
6+
[2025-07-12 11:19:55,149] 107 dagshub - INFO - Repository abheshith7/MachineLearning_PipeLine initialized!
7+
[2025-07-12 11:19:55,568] 1025 httpx - INFO - HTTP Request: GET https://dagshub.com/api/v1/repos/abheshith7/MachineLearning_PipeLine "HTTP/1.1 200 OK"
8+
[2025-07-12 11:19:55,581] 107 dagshub - INFO - Initialized MLflow to track repo "abheshith7/MachineLearning_PipeLine"
9+
[2025-07-12 11:19:55,581] 107 dagshub - INFO - Repository abheshith7/MachineLearning_PipeLine initialized!
10+
[2025-07-12 11:19:55,581] 20 src.mlpipeline.logging - INFO - >>>>>> stage Model Evaluation Stage started <<<<<<
11+
[2025-07-12 11:19:55,581] 25 src.mlpipeline.logging - INFO - yaml file: config\config.yaml loaded sucessfully
12+
[2025-07-12 11:19:55,581] 25 src.mlpipeline.logging - INFO - yaml file: config\params.yaml loaded sucessfully
13+
[2025-07-12 11:19:55,593] 25 src.mlpipeline.logging - INFO - yaml file: config\schema.yaml loaded sucessfully
14+
[2025-07-12 11:19:55,593] 44 src.mlpipeline.logging - INFO - Creating a Directory at: artifacts
15+
[2025-07-12 11:19:55,593] 44 src.mlpipeline.logging - INFO - Creating a Directory at: artifacts/model_evaluation
16+
[2025-07-12 11:20:00,395] 58 src.mlpipeline.logging - INFO - json file saved at: metrics.json
17+
[2025-07-12 11:20:01,808] 33 src.mlpipeline.logging - ERROR - INTERNAL_ERROR: Response: {'error': 'unsupported endpoint, please contact support@dagshub.com'}
18+
Traceback (most recent call last):
19+
File "D:\MachineLearning PipeLine\run_model_evaluation.py", line 24, in main
20+
model_evaluation_pipeline.initiate_model_evaluation()
21+
File "D:\MachineLearning PipeLine\src\mlpipeline\pipeline\model_evaluation_pipeline.py", line 19, in initiate_model_evaluation
22+
model_evaluation.log_into_mlflow()
23+
File "D:\MachineLearning PipeLine\src\mlpipeline\components\model_evaluation.py", line 70, in log_into_mlflow
24+
mlflow.sklearn.log_model(model, "model", registered_model_name="XGBModel")
25+
File "D:\MachineLearning PipeLine\.venv\Lib\site-packages\mlflow\sklearn\__init__.py", line 426, in log_model
26+
return Model.log(
27+
^^^^^^^^^^
28+
File "D:\MachineLearning PipeLine\.venv\Lib\site-packages\mlflow\models\model.py", line 1161, in log
29+
model = mlflow.initialize_logged_model(
30+
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
31+
File "D:\MachineLearning PipeLine\.venv\Lib\site-packages\mlflow\tracking\fluent.py", line 2130, in initialize_logged_model
32+
model = _create_logged_model(
33+
^^^^^^^^^^^^^^^^^^^^^
34+
File "D:\MachineLearning PipeLine\.venv\Lib\site-packages\mlflow\tracking\fluent.py", line 2257, in _create_logged_model
35+
return MlflowClient().create_logged_model(
36+
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
37+
File "D:\MachineLearning PipeLine\.venv\Lib\site-packages\mlflow\tracking\client.py", line 5371, in create_logged_model
38+
return self._tracking_client.create_logged_model(
39+
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
40+
File "D:\MachineLearning PipeLine\.venv\Lib\site-packages\mlflow\tracking\_tracking_service\client.py", line 824, in create_logged_model
41+
return self.store.create_logged_model(
42+
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
43+
File "D:\MachineLearning PipeLine\.venv\Lib\site-packages\mlflow\store\tracking\rest_store.py", line 936, in create_logged_model
44+
response_proto = self._call_endpoint(CreateLoggedModel, req_body)
45+
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
46+
File "D:\MachineLearning PipeLine\.venv\Lib\site-packages\mlflow\store\tracking\rest_store.py", line 135, in _call_endpoint
47+
return call_endpoint(
48+
^^^^^^^^^^^^^^
49+
File "D:\MachineLearning PipeLine\.venv\Lib\site-packages\mlflow\utils\rest_utils.py", line 590, in call_endpoint
50+
response = verify_rest_response(response, endpoint)
51+
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
52+
File "D:\MachineLearning PipeLine\.venv\Lib\site-packages\mlflow\utils\rest_utils.py", line 304, in verify_rest_response
53+
raise RestException(json.loads(response.text))
54+
mlflow.exceptions.RestException: INTERNAL_ERROR: Response: {'error': 'unsupported endpoint, please contact support@dagshub.com'}

‎logs/2025-07-12_11-22-18.log/2025-07-12_11-22-18.log‎

Lines changed: 54 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,54 @@
1+
[2025-07-12 11:22:23,287] 1025 httpx - INFO - HTTP Request: GET https://dagshub.com/api/v1/user "HTTP/1.1 200 OK"
2+
[2025-07-12 11:22:23,304] 107 dagshub - INFO - Accessing as abheshith7
3+
[2025-07-12 11:22:23,685] 1025 httpx - INFO - HTTP Request: GET https://dagshub.com/api/v1/repos/abheshith7/MachineLearning_PipeLine "HTTP/1.1 200 OK"
4+
[2025-07-12 11:22:24,051] 1025 httpx - INFO - HTTP Request: GET https://dagshub.com/api/v1/user "HTTP/1.1 200 OK"
5+
[2025-07-12 11:22:24,051] 107 dagshub - INFO - Initialized MLflow to track repo "abheshith7/MachineLearning_PipeLine"
6+
[2025-07-12 11:22:24,066] 107 dagshub - INFO - Repository abheshith7/MachineLearning_PipeLine initialized!
7+
[2025-07-12 11:22:24,438] 1025 httpx - INFO - HTTP Request: GET https://dagshub.com/api/v1/repos/abheshith7/MachineLearning_PipeLine "HTTP/1.1 200 OK"
8+
[2025-07-12 11:22:24,444] 107 dagshub - INFO - Initialized MLflow to track repo "abheshith7/MachineLearning_PipeLine"
9+
[2025-07-12 11:22:24,452] 107 dagshub - INFO - Repository abheshith7/MachineLearning_PipeLine initialized!
10+
[2025-07-12 11:22:24,452] 20 src.mlpipeline.logging - INFO - >>>>>> stage Model Evaluation Stage started <<<<<<
11+
[2025-07-12 11:22:24,460] 25 src.mlpipeline.logging - INFO - yaml file: config\config.yaml loaded sucessfully
12+
[2025-07-12 11:22:24,468] 25 src.mlpipeline.logging - INFO - yaml file: config\params.yaml loaded sucessfully
13+
[2025-07-12 11:22:24,474] 25 src.mlpipeline.logging - INFO - yaml file: config\schema.yaml loaded sucessfully
14+
[2025-07-12 11:22:24,476] 44 src.mlpipeline.logging - INFO - Creating a Directory at: artifacts
15+
[2025-07-12 11:22:24,476] 44 src.mlpipeline.logging - INFO - Creating a Directory at: artifacts/model_evaluation
16+
[2025-07-12 11:22:33,935] 58 src.mlpipeline.logging - INFO - json file saved at: metrics.json
17+
[2025-07-12 11:22:35,364] 33 src.mlpipeline.logging - ERROR - INTERNAL_ERROR: Response: {'error': 'unsupported endpoint, please contact support@dagshub.com'}
18+
Traceback (most recent call last):
19+
File "D:\MachineLearning PipeLine\run_model_evaluation.py", line 24, in main
20+
model_evaluation_pipeline.initiate_model_evaluation()
21+
File "D:\MachineLearning PipeLine\src\mlpipeline\pipeline\model_evaluation_pipeline.py", line 19, in initiate_model_evaluation
22+
model_evaluation.log_into_mlflow()
23+
File "D:\MachineLearning PipeLine\src\mlpipeline\components\model_evaluation.py", line 70, in log_into_mlflow
24+
mlflow.sklearn.log_model(model, "model", registered_model_name="XGBModel")
25+
File "D:\MachineLearning PipeLine\.venv\Lib\site-packages\mlflow\sklearn\__init__.py", line 426, in log_model
26+
return Model.log(
27+
^^^^^^^^^^
28+
File "D:\MachineLearning PipeLine\.venv\Lib\site-packages\mlflow\models\model.py", line 1161, in log
29+
model = mlflow.initialize_logged_model(
30+
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
31+
File "D:\MachineLearning PipeLine\.venv\Lib\site-packages\mlflow\tracking\fluent.py", line 2130, in initialize_logged_model
32+
model = _create_logged_model(
33+
^^^^^^^^^^^^^^^^^^^^^
34+
File "D:\MachineLearning PipeLine\.venv\Lib\site-packages\mlflow\tracking\fluent.py", line 2257, in _create_logged_model
35+
return MlflowClient().create_logged_model(
36+
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
37+
File "D:\MachineLearning PipeLine\.venv\Lib\site-packages\mlflow\tracking\client.py", line 5371, in create_logged_model
38+
return self._tracking_client.create_logged_model(
39+
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
40+
File "D:\MachineLearning PipeLine\.venv\Lib\site-packages\mlflow\tracking\_tracking_service\client.py", line 824, in create_logged_model
41+
return self.store.create_logged_model(
42+
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
43+
File "D:\MachineLearning PipeLine\.venv\Lib\site-packages\mlflow\store\tracking\rest_store.py", line 936, in create_logged_model
44+
response_proto = self._call_endpoint(CreateLoggedModel, req_body)
45+
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
46+
File "D:\MachineLearning PipeLine\.venv\Lib\site-packages\mlflow\store\tracking\rest_store.py", line 135, in _call_endpoint
47+
return call_endpoint(
48+
^^^^^^^^^^^^^^
49+
File "D:\MachineLearning PipeLine\.venv\Lib\site-packages\mlflow\utils\rest_utils.py", line 590, in call_endpoint
50+
response = verify_rest_response(response, endpoint)
51+
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
52+
File "D:\MachineLearning PipeLine\.venv\Lib\site-packages\mlflow\utils\rest_utils.py", line 304, in verify_rest_response
53+
raise RestException(json.loads(response.text))
54+
mlflow.exceptions.RestException: INTERNAL_ERROR: Response: {'error': 'unsupported endpoint, please contact support@dagshub.com'}

‎logs/2025-07-12_11-23-17.log/2025-07-12_11-23-17.log‎

Lines changed: 19 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,19 @@
1+
[2025-07-12 11:23:20,743] 1025 httpx - INFO - HTTP Request: GET https://dagshub.com/api/v1/user "HTTP/1.1 200 OK"
2+
[2025-07-12 11:23:20,760] 107 dagshub - INFO - Accessing as abheshith7
3+
[2025-07-12 11:23:21,156] 1025 httpx - INFO - HTTP Request: GET https://dagshub.com/api/v1/repos/abheshith7/MachineLearning_PipeLine "HTTP/1.1 200 OK"
4+
[2025-07-12 11:23:21,474] 1025 httpx - INFO - HTTP Request: GET https://dagshub.com/api/v1/user "HTTP/1.1 200 OK"
5+
[2025-07-12 11:23:21,480] 107 dagshub - INFO - Initialized MLflow to track repo "abheshith7/MachineLearning_PipeLine"
6+
[2025-07-12 11:23:21,480] 107 dagshub - INFO - Repository abheshith7/MachineLearning_PipeLine initialized!
7+
[2025-07-12 11:23:21,877] 1025 httpx - INFO - HTTP Request: GET https://dagshub.com/api/v1/repos/abheshith7/MachineLearning_PipeLine "HTTP/1.1 200 OK"
8+
[2025-07-12 11:23:21,891] 107 dagshub - INFO - Initialized MLflow to track repo "abheshith7/MachineLearning_PipeLine"
9+
[2025-07-12 11:23:21,891] 107 dagshub - INFO - Repository abheshith7/MachineLearning_PipeLine initialized!
10+
[2025-07-12 11:23:21,891] 20 src.mlpipeline.logging - INFO - >>>>>> stage Model Evaluation Stage started <<<<<<
11+
[2025-07-12 11:23:21,893] 25 src.mlpipeline.logging - INFO - yaml file: config\config.yaml loaded sucessfully
12+
[2025-07-12 11:23:21,895] 25 src.mlpipeline.logging - INFO - yaml file: config\params.yaml loaded sucessfully
13+
[2025-07-12 11:23:21,895] 25 src.mlpipeline.logging - INFO - yaml file: config\schema.yaml loaded sucessfully
14+
[2025-07-12 11:23:21,895] 44 src.mlpipeline.logging - INFO - Creating a Directory at: artifacts
15+
[2025-07-12 11:23:21,895] 44 src.mlpipeline.logging - INFO - Creating a Directory at: artifacts/model_evaluation
16+
[2025-07-12 11:23:26,901] 58 src.mlpipeline.logging - INFO - json file saved at: metrics.json
17+
[2025-07-12 11:23:27,570] 79 src.mlpipeline.logging - WARNING - Failed to log model to MLflow: INTERNAL_ERROR: Response: {'error': 'unsupported endpoint, please contact support@dagshub.com'}
18+
[2025-07-12 11:23:27,570] 83 src.mlpipeline.logging - INFO - Model evaluation completed successfully
19+
[2025-07-12 11:23:28,270] 26 src.mlpipeline.logging - INFO - >>>>>> stage Model Evaluation Stage completed <<<<<<

0 commit comments

Comments
 (0)