IMPLEMENTATION OF CROSS-VALIDATION ON HANG SENG INDEX FORECASTING USING HOLT’S EXPONENTIAL SMOOTHING AND AUTO-ARIMA METHOD
Abstract
This study applies a rolling window cross-validation to evaluate the multi-step forecasts instead of using the traditional single split for Hang Sheng Index (HSI) forecasting. The forecasting methods discussed in this study are Holt's Exponential Smoothing and auto ARIMA, chosen because of their ability to model trend data as in the daily HSI. This research aims to evaluate up to five step forecast values obtained by the two forecasting methods built in the training data with rolling window cross-validation. In the experiment, each of the 21 auto ARIMA and Holt's models was constructed from 84 observations (as in-sample data) obtained from the rolling window cross-validation. The one to five step forecast values of daily HSI are then calculated using those models, and the accuracy of each forecast value is evaluated based on Mean Absolute Percentage Error (MAPE). The results show that the Auto ARIMA model produces a lower MAPE value than Holt's model, namely 2.9196%, 4.6553%, 6.4012%, 8.3083%, and 10.3781%, respectively, for one to five steps ahead. Therefore, auto ARIMA is more recommended for forecasting HSI values up to five steps ahead than Holt's method.
Downloads
References
L. J. Tashman, “Out-of-sample tests of forecasting accuracy: an analysis and review,” International Journal of Forecast, vol. 16, pp. 437–450, 2000, doi: 10.1016/S0169-2070(00)00065-0.
W. Sulandari, Y. Yudhanto, S. Subanti, E. Zukhronah, and M. Z. Subarkah, “Implementing Time Series Cross Validation to Evaluate the Forecasting Model Performance,” International Conference on Mathematics and Science Education, KnE Life Science, pp. 229-238, 2024, doi: 10.18502/kls.v8i1.15584.
“Hang Seng Indexes,” 2022. www.hsi.com.hk/eng/indexes/all-indexes/hsi (accessed May 13, 2022).
R. D. P. Aji and N. Abundanti, “The Effect of Asia Regional Stock Price Index on the Indonesia Composite Index (ICI) on the Indonesia Stock Exchange,” European Journal of Business and Management Research, vol. 7, no. 2, pp. 100–106, Mar. 2022, doi: 10.24018/ejbmr.2022.7.2.1337.
“Hang Seng Indexes Year-End Reports,” 2023. www.hsi.com.hk/eng/resources-education/reports (accessed May 03, 2023).
A. R. Alias, N. Y. Zainun, and I. A. Rahman, “Comparison between ARIMA and DES Methods of Forecasting Population for Housing Demand in Johor,” ICTTE, 2016, doi: 10.1051/matecconf/20168107002.
A. Muchayan, “Comparison of Holt and Brown’s Double Exponential Smoothing Methods in The Forecast of Moving Price for Mutual Funds,” Journal of Applied Science, Engineering, Technology, and Education, vol. 1, no. 2, pp. 183–192, Dec. 2019, doi: 10.35877/454ri.asci1167.
W. K. A. W. Ahmad and S. Ahmad, “Arima model and exponential smoothing method: A comparison,” in AIP Conference Proceedings, 2013, pp. 1312–1321. doi: 10.1063/1.4801282.
R. J. Hyndman and Y. Khandakar, “Automatic Time Series Forecasting: The forecast Package for R,” Journal of Statistical Software , vol. 27, no. 3, pp. 1–22, 2008, doi: 10.18637/jss.v027.i03.
S. Tiwari, A. Bharadwaj, and S. Gupta, “Stock Price Prediction Using Data Analytics,” International Conference on Advances in Computing, Communication and Control (ICAC3), pp. 1–5, 2017, doi: 10.1109/ICAC3.2017.8318783.
S. Kalyoncu, A. Jamil, J. Rasheed, M. Yesiltepe, and C. Djeddi, “Machine Learning Methods for Stock Market Analysis,” in 3rd International Conference on Data Science and Applications (ICONDATA), 2020.
Z. Liu and X. Yang, “Cross-validation for uncertain autoregressive model,” Commun Stat Simul Comput, vol. 51, no. 8, pp. 4715–4726, 2022, doi: 10.1080/03610918.2020.1747077.
M. K. Okasha, “Using Support Vector Machines in Financial Time Series Forecasting,” Int J Stat Appl, vol. 4, no. 1, pp. 28–39, 2014, doi: 10.5923/j.statistics.20140401.03.
D. Koutsandreas, E. Spiliotis, F. Petropoulos, and V. Assimakopoulos, “On the selection of forecasting accuracy measures,” Journal of the Operational Research Society, vol. 73, no. 5, pp. 937–954, 2022, doi: 10.1080/01605682.2021.1892464.
H. Hewamalage, K. Ackermann, and C. Bergmeir, “Forecast evaluation for data scientists: common pitfalls and best practices,” Data Min Knowl Discov, vol. 37, no. 2, pp. 788–832, Mar. 2023, doi: 10.1007/s10618-022-00894-5.
W. Sulandari, Suhartono, Subanar, P. C. Rodrigues, “Exponential Smoothing on Modeling and Forecasting Multiple Seasonal Time Series: An Overview,” Fluctuation and Noise Letters, vol. 20, no. 4, - 2130003-1 pp. 2130003-10, 2021, doi: 10.1142/S0219477521300032.
A. Nazim and A. Afthanorhan, “A comparison between single exponential smoothing (SES), double exponential smoothing (DES), holt’s (brown) and adaptive response rate exponential smoothing (ARRES) techniques in forecasting Malaysia population,” Global Journal of Mathematical Analysis, vol. 2, no. 4, p. 276, Sep. 2014, doi: 10.14419/gjma.v2i4.3253.
R.J. Hyndman, A.B. Koehler, R.D. Snyder, and S. Grose., “A State Space Framework for Automatic Forecasting Using Exponential Smoothing Methods,” 2002(18), pp. 439-454. doi: https://doi.org/10.1016/S0169-2070(01)00110-8.
S. A. Shukor, S.F. Sufahani, K.Khalid, M.H.A. Wahab, S.Z.S Idrus, A. Ahmad, and T.S> Subramaniam, “Forecasting Stock Market Price of Gold, Silver, Crude Oil and Platinum by Using Double Exponential Smoothing, Holt’s Linear Trend and Random Walk,” in Journal of Physics: Conference Series, IOP Publishing Ltd, Jun. 2021. doi: 10.1088/1742-6596/1874/1/012087.
G. E. P. Box, G. M. Jenkins, and G. C. Reinsel, “Time series analysis : forecasting and control,” J. Wiley & Sons, 2008. doi: 10.1002/9781118619193.
J. Fattah, L. Ezzine, Z. Aman, H. El Moussami, and A. Lachhab, “Forecasting of demand using ARIMA model,” International Journal of Engineering Business Management, vol. 10, Oct. 2018, doi: 10.1177/1847979018808673.
W. W. S. Wei, “Writing a Book on Multivariate Time Series Analysis and its Applications View project,” 2006.
R. J. Hyndman and G. Athanasopoulus, “Forecasting: Principles and Practice (2nd ed),” 2018. https://otexts.com/fpp2/ (accessed Mar. 13, 2023).
H. Hassani and M. R. Yeganegi, “Sum of squared ACF and the Ljung–Box statistics,” Physica A: Statistical Mechanics and its Applications, vol. 520, pp. 81–86, Apr. 2019, doi: 10.1016/j.physa.2018.12.028.
M. Saculinggan and E. A. Balase, “Empirical Power Comparison of Goodness of Fit Tests for Normality in The Presence of Outliers,” in Journal of Physics: Conference Series, Institute of Physics Publishing, 2013. doi: 10.1088/1742-6596/435/1/012041.
K. M. U. B. Konarasinghe, “Modeling COVID-19 Epidemic of USA, UK and Russia,” Journal of New Frontiers in Healthcare and Biological Sciences, vol. 1, no. 1, pp. 1–14, 2020, [Online]. Available: www.imathm.edu.lk/publications
V. Yadav and S. Nath, “Forecasting of PM Models and Exponential Smoothing Technique,” Asian Journal of Water, Environment and Pollution, vol. 14, no. 4, pp. 109–113, 2017, doi: 10.3233/AJW-170041.
Copyright (c) 2025 Christy Sheldy Sucipto, Winita Sulandari, Yuliana Susanti
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this Journal agree to the following terms:
- Author retain copyright and grant the journal right of first publication with the work simultaneously licensed under a creative commons attribution license that allow others to share the work within an acknowledgement of the work’s authorship and initial publication of this journal.
- Authors are able to enter into separate, additional contractual arrangement for the non-exclusive distribution of the journal’s published version of the work (e.g. acknowledgement of its initial publication in this journal).
- Authors are permitted and encouraged to post their work online (e.g. in institutional repositories or on their websites) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published works.
1.gif)
