Data-Driven Capital Allocation in Financial Markets: Evidence from Reinforcement Learning and Risk-Aware Portfolio Optimization

DOI:

https://doi.org/10.63646/WBVW7314

Keywords:

Capital allocation; Reinforcement learning; Portfolio optimisation; Risk management; Actor–critic methods; Proximal policy optimisation; Data analytics; Non-stationary markets

Abstract

Capital allocation in modern financial markets is complicated by non-stationary return dynamics, abrupt regime shifts, asymmetric tail risk, and path-dependent transaction costs that traditional mean–variance optimisation is poorly equipped to address. This study develops and empirically evaluates a data-driven reinforcement learning framework for risk-aware portfolio optimisation that couples an asynchronous advantage actor–critic engine with a clipped proximal policy update. The proposed Dynamic Actor–Critic with Clipped Proximal Policy Optimisation (DAC-CPPO) agent is trained on two publicly accessible datasets obtained from Kaggle: the Intelligent Finance Assets dataset (7,000 records, 32 features) and the Massive Yahoo Finance dataset (approximately 603,000 records, 9 base features). Prior to learning, Z-score normalisation cleans and rescales the raw features, after which Linear Discriminant Analysis compresses redundant technical indicators into a compact, class-separable state vector. A Sharpe-based reward function encodes the risk–return trade-off directly into the policy gradient, while the clipping mechanism bounds probability-ratio updates to suppress destabilising swings in portfolio weights. Across a 250-trading-day back-test, DAC-CPPO attains a Sharpe ratio of 1.91, a cumulative return of 1.12, a realised volatility of 0.14, and classification accuracy of 97.6% with an MAE of 0.074 and RMSE of 0.081, materially outperforming mean–variance, tree-based, sequence-based, and baseline reinforcement learning benchmarks. An ablation study isolates the marginal contribution of each architectural element, and a sensitivity analysis on the clipping threshold identifies an interior optimum that reconciles policy stability with responsiveness to regime change. The findings provide both theoretical and practical guidance for deploying deep reinforcement learning in data-driven capital allocation pipelines subject to realistic market frictions.

How to Cite

Wang, J., & Wang, M. (2025). Data-Driven Capital Allocation in Financial Markets: Evidence from Reinforcement Learning and Risk-Aware Portfolio Optimization. Journal of Business and Data Analytics, 3(3), 84-110. https://doi.org/10.63646/WBVW7314

References

Agrawal, A., Amos, B., Barratt, S., Boyd, S., Diamond, S., & Kolter, J. Z. (2019). Differentiable convex optimization layers. Advances in Neural Information Processing Systems, 32. https://doi.org/10.48550/arXiv.1910.12430

Ait-Sahalia, Y., & Brandt, M. W. (2001). Variable selection for portfolio choice. The Journal of Finance, 56(4), 1297–1351. https://doi.org/10.1111/0022-1082.00369

Amos, B., & Kolter, J. Z. (2017). OptNet: Differentiable optimization as a layer in neural networks. Proceedings of the 34th International Conference on Machine Learning (ICML), 136–145. https://doi.org/10.48550/arXiv.1703.00443

Ang, A., & Bekaert, G. (2002). International asset allocation with regime shifts. The Review of Financial Studies, 15(4), 1137–1187. https://doi.org/10.1093/rfs/15.4.1137

Araci, D. (2019). FinBERT: Financial sentiment analysis with pre-trained language models. arXiv preprint. https://doi.org/10.48550/arXiv.1908.10063

Avramov, D., & Zhou, G. (2010). Bayesian portfolio analysis. Annual Review of Financial Economics, 2, 25–47. https://doi.org/10.1146/annurev-financial-120209-133947

Babaeizadeh, M., Frosio, I., Tyree, S., Clemons, J., & Kautz, J. (2017). Reinforcement learning through asynchronous advantage actor-critic on a GPU. International Conference on Learning Representations (ICLR). https://doi.org/10.48550/arXiv.1611.06256

Ban, G. Y., El Karoui, N., & Lim, A. E. B. (2018). Machine learning and portfolio optimization. Management Science, 64(3), 1136–1154. https://doi.org/10.1287/mnsc.2016.2644

Betancourt, C., & Chen, W. H. (2021). Deep reinforcement learning for portfolio management of markets with a dynamic number of assets. Expert Systems with Applications, 164, 114002. https://doi.org/10.1016/j.eswa.2020.114002

Black, F., & Litterman, R. (1992). Global portfolio optimization. Financial Analysts Journal, 48(5), 28–43. https://doi.org/10.2469/faj.v48.n5.28

Bollerslev, T. (1986). Generalized autoregressive conditional heteroskedasticity. Journal of Econometrics, 31(3), 307–327. https://doi.org/10.1016/0304-4076(86)90063-1

Brandt, M. W. (2010). Portfolio choice problems. In Handbook of Financial Econometrics, Volume 1: Tools and Techniques (pp. 269–336). Elsevier. https://doi.org/10.1016/B978-0-444-50897-3.50008-0

Butler, A., & Kwon, R. H. (2023). Integrating prediction in mean-variance portfolio optimization. Quantitative Finance, 23(3), 429–452. https://doi.org/10.1080/14697688.2022.2162432

Campbell, J. Y., & Viceira, L. M. (2002). Strategic Asset Allocation: Portfolio Choice for Long-Term Investors. Oxford University Press. https://doi.org/10.1093/0198296940.001.0001

Carhart, M. M. (1997). On persistence in mutual fund performance. The Journal of Finance, 52(1), 57–82. https://doi.org/10.1111/j.1540-6261.1997.tb03808.x

Ceria, S., & Stubbs, R. A. (2006). Incorporating estimation errors into portfolio selection: Robust portfolio construction. Journal of Asset Management, 7(2), 109–127. https://doi.org/10.1057/palgrave.jam.2240207

Chopra, V. K., & Ziemba, W. T. (1993). The effect of errors in means, variances, and covariances on optimal portfolio choice. The Journal of Portfolio Management, 19(2), 6–11. https://doi.org/10.3905/jpm.1993.409440

Cont, R. (2001). Empirical properties of asset returns: stylized facts and statistical issues. Quantitative Finance, 1(2), 223–236. https://doi.org/10.1080/713665670

Deng, Y., Bao, F., Kong, Y., Ren, Z., & Dai, Q. (2016). Deep direct reinforcement learning for financial signal representation and trading. IEEE Transactions on Neural Networks and Learning Systems, 28(3), 653–664. https://doi.org/10.1109/TNNLS.2016.2522401

Ding, X., Zhang, Y., Liu, T., & Duan, J. (2015). Deep learning for event-driven stock prediction. Proceedings of the 24th International Joint Conference on Artificial Intelligence (IJCAI), 2327–2333. https://doi.org/10.5555/2832415.2832572

Elmachtoub, A. N., & Grigas, P. (2022). Smart 'predict, then optimize'. Management Science, 68(1), 9–26. https://doi.org/10.1287/mnsc.2020.3922

Engle, R. F. (1982). Autoregressive conditional heteroscedasticity with estimates of the variance of United Kingdom inflation. Econometrica, 50(4), 987–1007. https://doi.org/10.2307/1912773

Engstrom, L., Ilyas, A., Santurkar, S., Tsipras, D., Janoos, F., Rudolph, L., & Madry, A. (2020). Implementation matters in deep policy gradients: A case study on PPO and TRPO. International Conference on Learning Representations (ICLR). https://doi.org/10.48550/arXiv.2005.12729

Fama, E. F. (1965). The behavior of stock-market prices. The Journal of Business, 38(1), 34–105. https://doi.org/10.1086/294743

Fama, E. F., & French, K. R. (1993). Common risk factors in the returns on stocks and bonds. Journal of Financial Economics, 33(1), 3–56. https://doi.org/10.1016/0304-405X(93)90023-5

Feng, G., Giglio, S., & Xiu, D. (2020). Taming the factor zoo: A test of new factors. The Journal of Finance, 75(3), 1327–1370. https://doi.org/10.1111/jofi.12883

Fischer, T., & Krauss, C. (2018). Deep learning with long short-term memory networks for financial market predictions. European Journal of Operational Research, 270(2), 654–669. https://doi.org/10.1016/j.ejor.2017.11.054

Fisher, R. A. (1936). The use of multiple measurements in taxonomic problems. Annals of Eugenics, 7(2), 179–188. https://doi.org/10.1111/j.1469-1809.1936.tb02137.x

Goldfarb, D., & Iyengar, G. (2003). Robust portfolio selection problems. Mathematics of Operations Research, 28(1), 1–38. https://doi.org/10.1287/moor.28.1.1.14260

Gu, S., Kelly, B., & Xiu, D. (2020). Empirical asset pricing via machine learning. The Review of Financial Studies, 33(5), 2223–2273. https://doi.org/10.1093/rfs/hhaa009

Guasoni, P., & Robertson, S. (2012). Portfolios and risk premia for the long run. The Annals of Applied Probability, 22(1), 239–284. https://doi.org/10.1214/11-AAP767

Haarnoja, T., Zhou, A., Abbeel, P., & Levine, S. (2018). Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor. Proceedings of the 35th International Conference on Machine Learning (ICML), 1861–1870. https://doi.org/10.48550/arXiv.1801.01290

Heaton, J. B., Polson, N. G., & Witte, J. H. (2017). Deep learning for finance: deep portfolios. Applied Stochastic Models in Business and Industry, 33(1), 3–12. https://doi.org/10.1002/asmb.2209

Henderson, P., Islam, R., Bachman, P., Pineau, J., Precup, D., & Meger, D. (2018). Deep reinforcement learning that matters. Proceedings of the AAAI Conference on Artificial Intelligence, 32(1). https://doi.org/10.1609/aaai.v32i1.11694

Hull, J., & White, A. (2017). Optimal delta hedging for options. Journal of Banking & Finance, 82, 180–190. https://doi.org/10.1016/j.jbankfin.2017.05.006

Jiang, Z., Xu, D., & Liang, J. (2017). A deep reinforcement learning framework for the financial portfolio management problem. arXiv preprint. https://doi.org/10.48550/arXiv.1706.10059

Kahneman, D., & Tversky, A. (1979). Prospect theory: An analysis of decision under risk. Econometrica, 47(2), 263–291. https://doi.org/10.2307/1914185

Kakade, S. M. (2001). A natural policy gradient. Advances in Neural Information Processing Systems, 14, 1531–1538. https://doi.org/10.5555/2980539.2980738

Ke, Z. T., Kelly, B. T., & Xiu, D. (2019). Predicting returns with text data. NBER Working Paper No. 26186. https://doi.org/10.3386/w26186

Krauss, C., Do, X. A., & Huck, N. (2017). Deep neural networks, gradient-boosted trees, random forests: Statistical arbitrage on the S&P 500. European Journal of Operational Research, 259(2), 689–702. https://doi.org/10.1016/j.ejor.2016.10.031

Ledoit, O., & Wolf, M. (2003). Improved estimation of the covariance matrix of stock returns with an application to portfolio selection. Journal of Empirical Finance, 10(5), 603–621. https://doi.org/10.1016/S0927-5398(03)00007-0

Ledoit, O., & Wolf, M. (2004). Honey, I shrunk the sample covariance matrix. The Journal of Portfolio Management, 30(4), 110–119. https://doi.org/10.3905/jpm.2004.110

Liu, X. Y., Yang, H., Chen, Q., Zhang, R., Yang, L., Xiao, B., & Wang, C. D. (2020). FinRL: A deep reinforcement learning library for automated stock trading in quantitative finance. arXiv preprint. https://doi.org/10.48550/arXiv.2011.09607

Longin, F., & Solnik, B. (2001). Extreme correlation of international equity markets. The Journal of Finance, 56(2), 649–676. https://doi.org/10.1111/0022-1082.00340

Mandelbrot, B. (1963). The variation of certain speculative prices. The Journal of Business, 36(4), 394–419. https://doi.org/10.1086/294632

Markowitz, H. (1959). Portfolio Selection: Efficient Diversification of Investments. New York: John Wiley & Sons. https://doi.org/10.2307/2975974

Martinez, A. M., & Kak, A. C. (2001). PCA versus LDA. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(2), 228–233. https://doi.org/10.1109/34.908974

Merton, R. C. (1969). Lifetime portfolio selection under uncertainty: The continuous-time case. The Review of Economics and Statistics, 51(3), 247–257. https://doi.org/10.2307/1926560

Merton, R. C. (1971). Optimum consumption and portfolio rules in a continuous-time model. Journal of Economic Theory, 3(4), 373–413. https://doi.org/10.1016/0022-0531(71)90038-X

Michaud, R. O. (1989). The Markowitz optimization enigma: Is 'optimized' optimal? Financial Analysts Journal, 45(1), 31–42. https://doi.org/10.2469/faj.v45.n1.31

Michaud, R. O., & Michaud, R. O. (2008). Efficient asset management: A practical guide to stock portfolio optimization and asset allocation. Oxford University Press. https://doi.org/10.1093/oso/9780195331912.001.0001

Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T., Harley, T., Silver, D., & Kavukcuoglu, K. (2016). Asynchronous methods for deep reinforcement learning. Proceedings of the 33rd International Conference on Machine Learning (ICML), 1928–1937. https://doi.org/10.48550/arXiv.1602.01783

Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013). Playing Atari with deep reinforcement learning. arXiv preprint. https://doi.org/10.48550/arXiv.1312.5602

Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., ... & Hassabis, D. (2015). Human-level control through deep reinforcement learning. Nature, 518(7540), 529–533. https://doi.org/10.1038/nature14236

Moody, J., & Saffell, M. (2001). Learning to trade via direct reinforcement. IEEE Transactions on Neural Networks, 12(4), 875–889. https://doi.org/10.1109/72.935097

Moody, J., & Wu, L. (1997). Optimization of trading systems and portfolios. Proceedings of the IEEE/IAFE 1997 Computational Intelligence for Financial Engineering (CIFEr), 300–307. https://doi.org/10.1109/CIFER.1997.618944

Nevmyvaka, Y., Feng, Y., & Kearns, M. (2006). Reinforcement learning for optimized trade execution. Proceedings of the 23rd International Conference on Machine Learning (ICML), 673–680. https://doi.org/10.1145/1143844.1143929

Peters, J., & Schaal, S. (2008). Reinforcement learning of motor skills with policy gradients. Neural Networks, 21(4), 682–697. https://doi.org/10.1016/j.neunet.2008.02.003

Rockafellar, R. T., & Uryasev, S. (2000). Optimization of conditional value-at-risk. Journal of Risk, 2, 21–42. https://doi.org/10.21314/JOR.2000.038

Schulman, J., Levine, S., Abbeel, P., Jordan, M., & Moritz, P. (2015). High-dimensional continuous control using generalized advantage estimation. arXiv preprint. https://doi.org/10.48550/arXiv.1506.02438

Schulman, J., Levine, S., Abbeel, P., Jordan, M., & Moritz, P. (2015). Trust region policy optimization. Proceedings of the 32nd International Conference on Machine Learning (ICML), 1889–1897. https://doi.org/10.48550/arXiv.1502.05477

Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017). Proximal policy optimization algorithms. arXiv preprint. https://doi.org/10.48550/arXiv.1707.06347

Sezer, O. B., Gudelek, M. U., & Ozbayoglu, A. M. (2020). Financial time series forecasting with deep learning: A systematic literature review: 2005–2019. Applied Soft Computing, 90, 106181. https://doi.org/10.1016/j.asoc.2020.106181

Sharpe, W. F. (1964). Capital asset prices: A theory of market equilibrium under conditions of risk. The Journal of Finance, 19(3), 425–442. https://doi.org/10.1111/j.1540-6261.1964.tb02865.x

Sharpe, W. F. (1994). The Sharpe ratio. The Journal of Portfolio Management, 21(1), 49–58. https://doi.org/10.3905/jpm.1994.409501

Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., Van Den Driessche, G., ... & Hassabis, D. (2016). Mastering the game of Go with deep neural networks and tree search. Nature, 529(7587), 484–489. https://doi.org/10.1038/nature16961

Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., ... & Hassabis, D. (2017). Mastering the game of Go without human knowledge. Nature, 550(7676), 354–359. https://doi.org/10.1038/nature24270

Sun, S., Wang, R., & An, B. (2023). Reinforcement learning for quantitative trading. ACM Transactions on Intelligent Systems and Technology, 14(3), 1–29. https://doi.org/10.1145/3582560

Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An introduction. IEEE Transactions on Neural Networks, 9(5), 1054. https://doi.org/10.1109/TNN.1998.712192

Tamar, A., Glassner, Y., & Mannor, S. (2015). Optimizing the CVaR via sampling. Proceedings of the AAAI Conference on Artificial Intelligence, 29(1). https://doi.org/10.1609/aaai.v29i1.9561

Tetlock, P. C. (2007). Giving content to investor sentiment: The role of media in the stock market. The Journal of Finance, 62(3), 1139–1168. https://doi.org/10.1111/j.1540-6261.2007.01232.x

Théate, T., & Ernst, D. (2021). An application of deep reinforcement learning to algorithmic trading. Expert Systems with Applications, 173, 114632. https://doi.org/10.1016/j.eswa.2021.114632

Van Hasselt, H., Guez, A., & Silver, D. (2016). Deep reinforcement learning with double Q-learning. Proceedings of the AAAI Conference on Artificial Intelligence, 30(1). https://doi.org/10.1609/aaai.v30i1.10295

Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., ... & Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30. https://doi.org/10.48550/arXiv.1706.03762

Williams, R. J. (1992). Simple statistical gradient-following algorithms for connectionist reinforcement learning. Machine Learning, 8(3), 229–256. https://doi.org/10.1007/BF00992696

Yang, H., Liu, X. Y., Zhong, S., & Walid, A. (2020). Deep reinforcement learning for automated stock trading: An ensemble strategy. Proceedings of the First ACM International Conference on AI in Finance (ICAIF), 1–8. https://doi.org/10.1145/3383455.3422540

Zhang, Z., Zohren, S., & Roberts, S. (2020). Deep learning for portfolio optimization. The Journal of Financial Data Science, 2(4), 8–20. https://doi.org/10.3905/jfds.2020.1.042

Zhang, Z., Zohren, S., & Roberts, S. (2020). Deep reinforcement learning for trading. The Journal of Financial Data Science, 2(2), 25–40. https://doi.org/10.3905/jfds.2020.1.030