Hybrid Stacking of Multilayer Perceptron, Convolutional Neural Network, and Light Gradient Boosting Machine for Short-Term Load Forecasting
DOI:
https://doi.org/10.12928/biste.v7i4.14410Keywords:
Short-Term Load Forecasting, Hybrid Stacking, LightGBM, Convolutional Neural Network, Multilayer Perceptron, Ridge RegressionAbstract
Short-term load forecasting (STLF) is essential for scheduling, dispatch, and demand-side management. Real-world load series exhibit rapid local fluctuations and calendar or exogenous influences that challenge single-model approaches. This study proposes a hybrid stacking framework combining a Multilayer Perceptron (MLP), a 1-D Convolutional Neural Network (CNN), and a Light Gradient Boosting Machine (LightGBM), integrated through a ridge-regression meta-learner. The CNN extracts local temporal patterns from sliding windows of the load series, and the MLP processes tabular features such as lags, rolling statistics, and calendar/holiday indicators. At the same time, LightGBM captures nonlinear interactions in the same feature space. Base learners are trained using a rolling TimeSeriesSplit to avoid temporal leakage, and their out-of-fold predictions are used as inputs for the meta-learner. Early stopping regularizes the neural models. Experimental backtests on Queensland electricity demand data (89,136 half-hourly samples) demonstrate that the stacked model achieves markedly lower forecasting errors, with MAPE ≈ 0.81%, corresponding to a 24% reduction compared to CNN (MAPE ≈ 1.07%) and a 32% reduction compared to MLP (MAPE ≈ 1.19%). Regarding runtime, LightGBM is the fastest (25s) but least accurate, while the stacked model requires longer computation (2488s) yet delivers the most reliable forecasts. Overall, the proposed framework balances accuracy and robustness, and it is modular, reproducible, and extensible to additional exogenous inputs or base learners.
References
A. Irankhah, S. R. Saatlou, M. H. Yaghmaee, S. Ershadi-Nasab, and M. Alishahi, “A parallel CNN-BiGRU network for short-term load forecasting in demand-side management,” 2022 12th Int. Conf. Comput. Knowl. Eng. ICCKE 2022, pp. 511–516, 2022, https://doi.org/10.1109/ICCKE57176.2022.9960036.
X. Tang, H. Chen, W. Xiang, J. Yang, and M. Zou, “Short-Term Load Forecasting Using Channel and Temporal Attention Based Temporal Convolutional Network,” Electr. Power Syst. Res., vol. 205, p. 107761, 2022, https://doi.org/10.1016/j.epsr.2021.107761.
X. Zhang, “Forecasting Short-Term Electricity Load with Combinations of Singular Spectrum Analysis,” Arab. J. Sci. Eng., vol. 48, no. 2, pp. 1609–1624, 2023, https://doi.org/10.1007/s13369-022-06934-y.
Y. Q. Tan, Y. X. Shen, X. Y. Yu, and X. Lu, “Day-ahead electricity price forecasting employing a novel hybrid frame of deep learning methods: A case study in NSW, Australia,” Electr. Power Syst. Res., vol. 220, p. 109300, 2023, https://doi.org/10.1016/j.epsr.2023.109300.
A. Oza, D. K. Patel, and B. J. Ranger, “Fusion ConvLSTM-Net: Using Spatiotemporal Features to Increase Residential Load Forecast Horizon,” IEEE Access, vol. 13, pp. 12190–12202, 2025, https://doi.org/10.1109/ACCESS.2025.3528072.
H. Mansoor and M. Y. Ali, “Spatio-Temporal Short-Term Load Forecasting Using Graph Neural Networks,” 2023 12th Int. Conf. Renew. Energy Res. Appl., pp. 320–323, 2023, https://doi.org/10.1109/ICRERA59003.2023.10269401.
B. Aksoy and M. Koru, “Estimation of Casting Mold Interfacial Heat Transfer Coefficient in Pressure Die Casting Process by Artificial Intelligence Methods,” Arab. J. Sci. Eng., vol. 45, no. 11, pp. 8969-8980, 2020, https://doi.org/10.1007/s13369-020-04648-7.
C. Cai, Y. Tao, Q. Ren, and G. Hu, “Short-term load forecasting based on MB-LSTM neural network,” Proc. - 2020 Chinese Autom. Congr. CAC 2020, pp. 5402–5406, 2020, https://doi.org/10.1109/CAC51589.2020.9326696.
P. Kumar and P. Samui, “Reliability-Based Load and Resistance Factor Design of an Energy Pile with CPT Data Using Machine Learning Techniques,” Arab. J. Sci. Eng., vol. 49, no. 4, pp. 4831-4860, 2023, https://doi.org/10.1007/s13369-023-08253-2.
A. Jayanth Balaji, B. B. Nair, D. S. Harish Ram, and K. K. George, “A Novel Approach to Faster Convergence and Improved Accuracy in Deep Learning based Electrical Energy Consumption Forecast Models for Large Consumer Groups,” IEEE Access, vol. 13, pp. 15090–15157, 2025, https://doi.org/10.1109/ACCESS.2025.3527863.
Q. Shen, L. Mo, G. Liu, J. Zhou, Y. Zhang, and P. Ren, “Short-Term Load Forecasting Based on Multi-Scale Ensemble Deep Learning Neural Network,” IEEE Access, vol. 11, pp. 111963–111975, 2023, https://doi.org/10.1109/ACCESS.2023.3322167.
C. Wei, D. Pi, M. Ping, and H. Zhang, “Short-term load forecasting using spatial-temporal embedding graph neural network,” Electr. Power Syst. Res., vol. 225, p. 109873, 2023, https://doi.org/10.1016/j.epsr.2023.109873.
A. Sharma and S. K. Jain, “A Novel Two-Stage Framework for Mid-Term Electric Load Forecasting,” IEEE Trans. Ind. Informatics, vol. 20, no. 1, pp. 247–255, 2024, https://doi.org/10.1109/TII.2023.3259445.
X. Dong, S. Deng, and D. Wang, “A short-term power load forecasting method based on k-means and SVM,” J. Ambient Intell. Humaniz. Comput., vol. 13, no. 11, pp. 5253–5267, 2022, https://doi.org/10.1007/s12652-021-03444-x.
D. Usman, K. Abdul, and D. Asim, “A Data-Driven Temporal Charge Profiling of Electric Vehicles,” Arab. J. Sci. Eng., vol. 48, no. 11, pp. 15195–15206, 2023, https://doi.org/10.1007/s13369-023-08036-9.
Y. Liu, Z. Liang, and X. Li, “C,” IEEE Open J. Ind. Electron. Soc., vol. 4, pp. 451–462, 2023, https://doi.org/10.1109/OJIES.2023.3319040.
M. A. Acquah and Y. Jin, “Spatiotemporal Sequence-to-Sequence Clustering for Electric Load Forecasting,” IEEE Access, vol. 11, pp. 5850–5863, 2023, https://doi.org/10.1109/ACCESS.2023.3235724.
H. Zhang, Y. Zhang, and Z. Xu, “Thermal Load Forecasting of an Ultra-short-term Integrated Energy System Based on VMD-CNN-LSTM,” Proc. - 2022 Int. Conf. Big Data, Inf. Comput. Network, BDICN 2022, pp. 264–269, 2022, https://doi.org/10.1109/BDICN55575.2022.00058.
Z. Cai, S. Dai, Q. Ding, J. Zhang, D. Xu, and Y. Li, “Gray wolf optimization-based wind power load mid-long term forecasting algorithm,” Comput. Electr. Eng., vol. 109, p. 108769, 2023, https://doi.org/10.1016/j.compeleceng.2023.108769.
N. M. M. Bendaoud, N. Farah, and S. Ben Ahmed, “Applying load profiles propagation to machine learning based electrical energy forecasting,” Electr. Power Syst. Res., vol. 203, p. 107635, 2022, https://doi.org/10.1016/j.epsr.2021.107635.
A. O. Aseeri, “Effective RNN-Based Forecasting Methodology Design for Improving Short-Term Power Load Forecasts: Application to Large-Scale Power-Grid Time Series,” J. Comput. Sci., vol. 68, p. 101984, 2023, https://doi.org/10.1016/j.jocs.2023.101984.
T. Kavzoglu and A. Teke, “Predictive Performances of Ensemble Machine Learning Algorithms in Landslide Susceptibility Mapping Using Random Forest , Extreme Gradient Boosting ( XGBoost ) and Natural Gradient Boosting ( NGBoost ),” Arab. J. Sci. Eng., vol. 47, no. 6, pp. 7367–7385, 2022, https://doi.org/10.1007/s13369-022-06560-8.
S. Zhou, Q. Zhang, P. Xiao, B. Xu, and G. Luo, “UniLF: A novel short-term load forecasting model uniformly considering various features from multivariate load data,” Sci. Rep., vol. 15, no. 1, p. 4282, 2025, https://doi.org/10.1038/s41598-025-88566-4.
S. Ghani, S. Kumari, and S. Ahmad, “Prediction of the Seismic Effect on Liquefaction Behavior of Fine-Grained Soils Using Artificial Intelligence-Based Hybridized Modeling,” Arab. J. Sci. Eng., vol. 47, no. 4, pp. 5411–5441, 2022, https://doi.org/10.1007/s13369-022-06697-6.
S. Li, J. Wang, H. Zhang, and Y. Liang, “Short-term load forecasting system based on sliding fuzzy granulation and equilibrium optimizer,” Appl. Intell., vol. 53, no. 19, pp. 21606–21640, 2023, https://doi.org/10.1007/s10489-023-04599-0.
L. Semmelmann, S. Henni, and C. Weinhardt, “Load forecasting for energy communities: a novel LSTM-XGBoost hybrid model based on smart meter data,” vol. 5(Suppl 1), p. 24, 2022. https://doi.org/10.1186/s42162-022-00212-9.
C. M. Liapis, A. Karanikola, and S. Kotsiantis, “A multivariate ensemble learning method for medium-term energy forecasting,” Neural Comput. Appl., vol. 35, no. 29, pp. 21479–21497, 2023, https://doi.org/10.1007/s00521-023-08777-6.
W. Zhang, “Short-term Load Forecasting of Power Model Based on CS-Catboost Algorithm,” 2022 IEEE 10th Jt. Int. Inf. Technol. Artif. Intell. Conf., vol. 10, pp. 2295–2299, 2022, https://doi.org/10.1109/ITAIC54216.2022.9836483.
L. Zhang and D. Jánošík, “Enhanced short-term load forecasting with hybrid machine learning models: CatBoost and XGBoost approaches,” Expert Syst. Appl., vol. 241, 2024, https://doi.org/10.1016/j.eswa.2023.122686.
C. Zhang, Z. Chen, and J. Zhou, “Research on Short-Term Load Forecasting Using K-means Clustering and CatBoost Integrating Time Series Features,” Chinese Control Conf. CCC, pp. 6099–6104, 2020, https://doi.org/10.23919/CCC50068.2020.9188856.
R. Panigrahi, N. R. Patne, B. V. Surya Vardhan, and M. Khedkar, “Short-term load analysis and forecasting using stochastic approach considering pandemic effects,” Electr. Eng., vol. 106, no. 3, pp. 3097–3108, 2024, https://doi.org/10.1007/s00202-023-02135-4.
F. A. Nahid, W. Ongsakul, J. G. Singh, and J. Roy, “Short-term customer-centric electric load forecasting for low carbon microgrids using a hybrid model,” Energy Systems, pp. 1-57. 2024, https://doi.org/10.1007/s12667-024-00704-5.
N. A. Orka, S. Samit, M. Nazmush, S. Shahi, and A. Ahmed, “Artificial Intelligence-Based Online Control Scheme for the Interconnected Thermal Power Systems Regulations,” Arab. J. Sci. Eng., vol. 48, no. 11, pp. 15153–15176, 2023, https://doi.org/10.1007/s13369-023-07995-3.
W. Zhang, H. Zhan, H. Sun, and M. Yang, “Probabilistic load forecasting for integrated energy systems based on quantile regression patch time series Transformer,” Energy Reports, vol. 13, no. September 2024, pp. 303–317, 2025, https://doi.org/10.1016/j.egyr.2024.11.057.
Y. Feng, J. Zhu, P. Qiu, X. Zhang, and C. Shuai, “Short-term Power Load Forecasting Based on TCN-BiLSTM-Attention and Multi-feature Fusion,” Arab. J. Sci. Eng., vol. 50, no. 8, pp. 5475-5486, 2024, https://doi.org/10.1007/s13369-024-09351-5.
L. Semmelmann, M. Hertel, K. J. Kircher, R. Mikut, V. Hagenmeyer, and C. Weinhardt, “The impact of heat pumps on day-ahead energy community load forecasting,” Appl. Energy, vol. 368, p. 123364, 2024, https://doi.org/10.1016/j.apenergy.2024.123364.
O. Cagcag Yolcu, H. K. Lam, and U. Yolcu, “Short-term load forecasting: cascade intuitionistic fuzzy time series—univariate and bivariate models,” Neural Comput. Appl., vol. 5, 2024, https://doi.org/10.1007/s00521-024-10280-5.
W. Yang, S. N. Sparrow, and D. C. H. Wallom, “A comparative climate-resilient energy design: Wildfire Resilient Load Forecasting Model using multi-factor deep learning methods,” Appl. Energy, vol. 368, p. 123365, 2024, https://doi.org/10.1016/j.apenergy.2024.123365.
B. Zhou, H. Wang, Y. Xie, G. Li, D. Yang, and B. Hu, “Regional short-term load forecasting method based on power load characteristics of different industries,” Sustain. Energy, Grids Networks, vol. 38, 2024, https://doi.org/10.1016/j.segan.2024.101336.
M. A. Jahin, M. S. H. Shovon, J. Shin, I. A. Ridoy, and M. F. Mridha, “Big Data—Supply Chain Management Framework for Forecasting: Data Preprocessing and Machine Learning Techniques,” Arch. Comput. Methods Eng., vol. 31, no. 6, pp. 3619–3645, 2024, https://doi.org/10.1007/s11831-024-10092-9.
G. Rozinaj, “Comprehensive Electric load forecasting using ensemble machine learning methods,” 2022 29th Int. Conf. Syst. Signals Image Process., pp. 1–4, 2022, https://doi.org/10.1109/IWSSIP55020.2022.9854390.
G. F. Fan, R. T. Zhang, C. C. Cao, Y. H. Yeh, and W. C. Hong, “Applications of empirical wavelet decomposition, statistical feature extraction, and antlion algorithm with support vector regression for resident electricity consumption forecasting,” Nonlinear Dyn., vol. 111, no. 21, pp. 20139–20163, 2023, https://doi.org/10.1007/s11071-023-08922-9.
H. Min, F. Lin, K. Wu, J. Lu, Z. Hou, and C. Zhan, “Broad learning system based on Savitzky – Golay filter and variational mode decomposition for short-term load forecasting,” 2022 IEEE Int. Symp. Prod. Compliance Eng. - Asia, pp. 1–6, https://doi.org/10.1109/ISPCE-ASIA57917.2022.9970794.
Z. Li and Z. Tian, “Enhancing real-time and day-ahead load forecasting accuracy with deep learning and weighed ensemble approach,” Appl. Intell., vol. 55, no. 4, pp. 1–23, 2025, https://doi.org/10.1007/s10489-024-06155-w.
Y. Wang, S. Feng, B. Wang, and J. Ouyang, “Deep transition network with gating mechanism for multivariate time series forecasting,” Appl. Intell., vol. 53, no. 20, pp. 24346–24359, 2023, https://doi.org/10.1007/s10489-023-04503-w.
V. K. Saini, R. Kumar, A. S. Al-Sumaiti, A. Sujil, and E. Heydarian-Forushani, “Learning based short term wind speed forecasting models for smart grid applications: An extensive review and case study,” Electr. Power Syst. Res., vol. 222, p. 109502, 2023, https://doi.org/10.1016/j.epsr.2023.109502.
G. Memarzadeh and F. Keynia, “Short-term electricity load and price forecasting by a new optimal LSTM-NN based prediction algorithm,” Electr. Power Syst. Res., vol. 192, 2021, https://doi.org/10.1016/j.epsr.2020.106995.
J.-W. Xiao, X.-Y. Cui, X.-K. Liu, H. Fang, and P.-C. Li, “Improved 3D LSTM: A Video Prediction Approach to Long Sequence Load Forecasting,” IEEE Trans. Smart Grid, vol. 16, no. 2, pp. 1–1, 2024, https://doi.org/10.1109/TSG.2024.3458989.
K. Song et al., “Short-term load forecasting based on CEEMDAN and dendritic deep learning,” Knowledge-Based Syst., vol. 294, 2024, https://doi.org/10.1016/j.knosys.2024.111729.
S. Deng, X. Dong, L. Tao, J. Wang, Y. He, and D. Yue, “Multi-type load forecasting model based on random forest and density clustering with the influence of noise and load patterns,” Energy, vol. 307, 2024, https://doi.org/10.1016/j.energy.2024.132635.
T. Zhang, Y. Huang, H. Liao, and Y. Liang, “A hybrid electric vehicle load classification and forecasting approach based on GBDT algorithm and temporal convolutional network,” Appl. Energy, vol. 351, p. 121768, 2023, https://doi.org/10.1016/j.apenergy.2023.121768.
D. A. Khan, A. Arshad, and Z. Ali, “Performance Analysis of Machine Learning Techniques for Load Forecasting,” ICET 2021 - 16th Int. Conf. Emerg. Technol. 2021, Proc., pp. 1–6, 2021, https://doi.org/10.1109/ICET54505.2021.9689903.
J. Shi, W. Zhang, Y. Bao, D. W. Gao, and Z. Wang, “Load Forecasting of Electric Vehicle Charging Stations: Attention Based Spatiotemporal Multi-Graph Convolutional Networks,” IEEE Trans. Smart Grid, vol. PP, no. 8, p. 1, 2023, https://doi.org/10.1109/TSG.2023.3321116.
A. Khaleghi and H. Karimipour, “A Probabilistic-Based Approach for Detecting Simultaneous Load Redistribution Attacks Through Entropy Analysis and Deep Learning,” IEEE Trans. Smart Grid, vol. 16, no. 2, pp. 1851–1861, 2024, https://doi.org/10.1109/TSG.2024.3524455.
B. Chen, W. Yang, B. Yan, and K. Zhang, “An advanced airport terminal cooling load forecasting model integrating SSA and CNN-Transformer,” Energy Build., vol. 309, p. 114000, 2024, https://doi.org/10.1016/j.enbuild.2024.114000.
A. Stratman, T. Hong, M. Yi, and D. Zhao, “Net Load Forecasting with Disaggregated Behind-the-Meter PV Generation,” IEEE Trans. Ind. Appl., vol. 59, no. 1, pp. 5341–5351, 2023, https://doi.org/10.1109/TIA.2023.3276356.
A. Mystakidis et al., “Energy generation forecasting: elevating performance with machine and deep learning,” Computing, vol. 105, no. 8, pp. 1623–1645, 2023, https://doi.org/10.1007/s00607-023-01164-y.
M. Alkasassbeh and S. A. Baddar, “Intrusion Detection Systems : A State-of-the-Art Taxonomy and Survey,” Arab. J. Sci. Eng., vol. 48, no. 8, pp. 10021–10064, 2023, https://doi.org/10.1007/s13369-022-07412-1.
W. Tercha, S. A. Tadjer, and F. Chekired, “Machine Learning-Based Forecasting of Temperature and Solar Irradiance for Photovoltaic Systems,” Energies, vol. 17, no. 5, p. 1124, 2024, https://doi.org/10.3390/en17051124.
U. Sencan and G. S. N. Arica, “Forecasting of Day-Ahead Electricity Price Using Long Short-Term Memory-Based Deep Learning Method,” Arab. J. Sci. Eng., vol. 47, no. 11, pp. 14025–14036, 2022, https://doi.org/10.1007/s13369-022-06632-9.
P. Nedić, I. Djurović, M. Ćalasan, S. Kovačević, and K. Pavlović, “Electrical energy load forecasting using a hybrid N-BEATS - CNN Approach: Case study Montenegro,” Electr. Power Syst. Res., vol. 247, p. 111749, 2025, https://doi.org/10.1016/j.epsr.2025.111749.
W. Lin, D. Wu, and M. Jenkin, “Electric Load Forecasting for Individual Households via Spatial-temporal Knowledge Distillation,” IEEE Trans. Power Syst., vol. 40, no. 1, pp. 572–584, 2024, https://doi.org/10.1109/TPWRS.2024.3393926.
R. Tian, J. Wang, Z. Sun, J. Wu, X. Lu, and L. Chang, “Multi-Scale Spatial-Temporal Graph Attention Network for Charging Station Load Prediction,” IEEE Access, vol. 13, pp. 29000–29017, 2025, https://doi.org/10.1109/ACCESS.2025.3541118.
H. Wang, J. D. Watson, and N. R. Watson, “A Lyapunov-based nonlinear direct power control for grid-side converters interfacing renewable energy in weak grids,” Electr. Power Syst. Res., vol. 221, p. 109408, 2023, https://doi.org/10.1016/j.epsr.2023.109408.
N. B. Vanting, Z. Ma, and B. N. Jørgensen, “Evaluation of neural networks for residential load forecasting and the impact of systematic feature identification,” Energy Informatics, vol. 5, no. 4, pp. 1–24, 2022, https://doi.org/10.1186/s42162-022-00224-5.
H. Hu, Z. Cheng, and H. Fan, “Short-term load forecasting method based on deep learning under digital driving,” In 2022 Asian Conference on Frontiers of Power and Energy (ACFPE), pp. 188-192, pp. 188–192, 2024, https://doi.org/10.1109/ACFPE56003.2022.9952181.
B. Mechanism, J. Xiao, P. Liu, H. Fang, and X. Liu, “Short-Term Residential Load Forecasting With Baseline-Refinement Profiles and,” IEEE Trans. Smart Grid, vol. 15, no. 1, pp. 1052–1062, 2024, https://doi.org/10.1109/TSG.2023.3290598.
Y. Ding, C. Huang, K. Liu, P. Li, and W. You, “Short-term forecasting of building cooling load based on data integrity judgment and feature transfer,” Energy Build., vol. 283, p. 112826, 2023, https://doi.org/10.1016/j.enbuild.2023.112826.
S. V. Oprea and A. Bâra, “On-grid and off-grid photovoltaic systems forecasting using a hybrid meta-learning method,” Knowl. Inf. Syst., vol. 66, no. 4, pp. 2575–2606, 2024, https://doi.org/10.1007/s10115-023-02037-8.
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Trung Dung Nguyen, Nguyen Anh Tuan
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
This journal is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
