Optimization under Uncertainty: Machine Learning Approach

Authors

  • Reza Mohammadi * Department of Industrial Management, Faculty of Management and Accounting, Shahid Beheshti University, Tehran, Iran
  • Hasan Farsijani Associated Professor of Industrial Management, Shahid Beheshti University, Tehran, Iran

DOI:

https://doi.org/10.59615/ijimes.3.2.23

DOR:

https://dorl.net/dor/20.1001.1.27832678.2023.3.2.3.9

Keywords:

Optimization, Supply Chain, Uncertainty, Machine Learning

Abstract

Data is the new oil. From the beginning of the 21st century, data is similar to what oil was in the 18th century, an immensely untapped valuable asset. This paper reviews recent advances in the field of optimization under uncertainty via a modern data lens and highlights key research challenges and the promise of data-driven optimization that organically integrates machine learning and mathematical programming for decision-making under uncertainty. A brief review of classical mathematical programming techniques for hedging against uncertainty is first presented, along with their wide spectrum of applications in Process Systems Engineering. we provide an introduction to the topic of uncertainty in machine learning as well as an overview of attempts so far at handling uncertainty in general and formalizing this distinction in particular. In line with the statistical tradition, uncertainty has long been perceived as almost synonymous with standard probability and probabilistic predictions. Yet, due to the steadily increasing relevance of machine learning for practical applications and related issues such as safety requirements, new problems, and challenges have recently been identified by machine learning scholars, and these problems may call for new methodological developments.

Downloads

Download data is not yet available.

References

Dorri-Nokorani, B., & Mohammadi, R. (2023). The Role of Internet of Things (IoT) and Industry 4.0 on Human Resource Management, Applied Researches in Management and Accounting, Vol 7.

Hammer, B., & Villmann, T. (2007). How to Process Uncertainty in Machine Learning? European Symposium on Artificial Neural Networks Bruges (Belgium), 25-27 April 2007, d-side public. ISBN 2-930307-07-2.

Mohammadi, R. (2023). The Role of Strategic Foresight on Dynamic Capabilities, International Journal of Innovation in Management Economics and Social Science, Vol 3, No 1, pp. 40-45.

Theodossiou, N., Karakatsanis, D., Kougias, T. (2014). The history of optimization. Applications in water resource management, IWA Regional Symposium on water, Wastewater and Environment: Traditions and Culture, Patras, Greece.

Aravantinos, V.; Schlicht, P. Making the relationship between uncertainty estimation and safety less uncertain. In Proceedings of the IEEE 2020 Design, Automation & Test in Europe Conference & Exhibition (DATE), Grenoble, France, 9–13 March 2020; pp. 1139–1144.

Liu, J.Z.; Paisley, J.; Kioumourtzoglou, M.A.; Coull, B. Accurate uncertainty estimation and decomposition in ensemble learning. arXiv 2019, arXiv:1911.04061.

Shrestha, D.L.; Solomatine, D.P. Machine learning approaches for estimation of prediction interval for the model output. Neural Netw. 2006, 19, 225–235.

Abdar, M.; Pourpanah, F.; Hussain, S.; Rezazadegan, D.; Liu, L.; Ghavamzadeh, M.; Fieguth, P.; Cao, X.; Khosravi, A.; Acharya, U.R.; et al. A review of uncertainty quantification in deep learning: Techniques, applications and challenges. Inf. Fusion 2021, 76, 243–297.

Vaysse, K.; Lagacherie, P. Using quantile regression forest to estimate uncertainty of digital soil mapping products. Geoderma 2017, 291, 55–64.

Govindan, K., Fattahi, M., & Keyvanshokooh, E. (2017). Supply chain network design under uncertainty: A comprehensive review and future research directions, European Journal of Operation Research, Vol 263, Issue 1, pp.108-141.

Huberts, W., Donders, W. P., Delhaas, T., & van de Vosse, F. N. (2014). Applicability of the polynomial chaos expansion method for personalization of a cardiovascular pulse wave propagation model International Journal for Numerical Methods in Biomedical. Engineering, 30, 1679–1704.

Ning, C., & You, F. (2019). Optimization under uncertainty in the era of big data and deep learning: When machine learning meets mathematical programming, Computers & Chemical Engineering, Vol 125, pp. 434-448.

Sahinidis, N. V. (2004). Optimization under uncertainty: state-of-the-art and opportunities, Computers & Chemical Engineering, Vol 28, Issue 6-7, pp. 971-983.

Acar, E., Bayrak, G., Jung, Y., Lee, I., Ramu, R., & Ravichandran, S. S. (2021). Modeling, analysis, and optimization under uncertainties: a review, Structural and Multidisciplinary Optimization, Vol 64, pp. 2909-24-945.

Masheh, B. (2018). Machine Learning Algorithms - A Review, International Journal of Science and Research (IJSR),

Doshi, R., Hiran, K. K., Jain, R. K., & Lakhwani, K. (2022). Machine Learning, Master Supervised and Unsupervised Learning Algorithms with Real Examples, BPB Publications, ISBN: 978-93-91392-352.

Hullermeier, E., & Waegeman, W. (2021). Aleatoric and epistemic uncertainty in machine learning: an introduction to concepts and methods, Machine Learning, Vol 110, pp. 457-506.

Grossmann, I. E. (2012). Advances in mathematical programming models for enterprise-wide optimization, Computers & Chemical Engineering, Vol 47, pp. 2-18.

Schmidt, J., Marques, M. R. G., Botti, S., & Marques, M. A. L. (2019). Recent advances and applications of machine learning in solid-state materials science. npj Computational Materials, 5, 83.

Gal, Y. (2016). Uncertainty in deep learning. Cambridge: University of Cambridge.

Cunningham, P., Cord, M., & Delany, S. J. (2008). Supervised Learning, Machine Learning Techniques for Multimedia, pp. 21-49.

Liu, X.; Zhang, F.; Hou, Z.; Wang, Z.; Mian, L.; Zhang, J.; Tang, J. Self-supervised learning: Generative or contrastive. arXiv, 2020; arXiv:2006.08218.

Jaiswal, A., Babu, A. R., Zaki Zadeh, M., Banerjee, D., & Makedon, F. (2021). A Survey on Contrastive Self-Supervised Learning, Technologies, Vol 9, Issue 1.

Schmarje, L., Satntarossa, M., Schroder, S.M., Koch, R. (2021). A Survey on Semi-, Self- and Unsupervised Learning for Image Classification, IEEE Access, Vol 9.

Locatello, F., Bauer, S., Lucic, M., …. (2019). Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representations, Proceedings of the 36th International Conference on Machine Learning, PMLR 97:4114-4124, 2019.

Usama, M., Qadir, J., Reza, A., Arif, H., Yau, K. A., Elkhatib, Y., Hussain, A., & Al-Fuqaha, A. (2019). Unsupervised Machine Learning for Networking: Techniques, Applications and Research Challenges, IEEE Access, Electronic ISSN: 2169-3536.

Aradi, S. (2020). Survey of Deep Reinforcement Learning for Motion Planning of Autonomous Vehicles, IEEE Transactions on Intelligent Transportation Systems, Vol 23, Issue 2.

Uperty, A., Rawat, D. B. (2020). Reinforcement Learning for IoT Security: A Comprehensive Survey, IEEE Internet of Things Journal, Vol 8, Issue 11.

Downloads

Published

2023-06-03

How to Cite

Mohammadi, R., & Farsijani, H. . (2023). Optimization under Uncertainty: Machine Learning Approach. International Journal of Innovation in Management, Economics and Social Sciences, 3(2), 23–32. https://doi.org/10.59615/ijimes.3.2.23

Issue

Section

Original Research