When does a physics-based model outperform machine learning, when does ML win, and how can hybrid approaches combine both for better robustness and interpretability? System to Model (Simple but Powerful)
We intentionally choose a system that is:
- physically interpretable
- time-dependent
- sensor-like
Chosen System: # Thermal system (1st-order dynamic system) β analogous to many real sensors (temperature, drift, latency, noise)
Physical model: ππ(π‘)ππ‘=βπ(π(π‘)βππππ£)+π’(π‘)dt/dT(t)=βkβ (T(t)βTenvβ)+u(t)
Where:
T(t) = system state (measured) T_env = environment k = system constant u(t) = external input / disturbance
Modeling Approach: Physics model β baseline prediction ML model β predicts residual error
Evaluation & Validation: compare: RMSE MAE robustness to noise behavior under missing data generalization to unseen inputs
Also include: qualitative plots error breakdowns failure cases
Tools: Python numpy pandas scikit-learn matplotlib
scipy