Are Clouds ready to accelerate ad hoc financial simulations?
Abstract
Applications employed in the financial services industry to capture and estimate a variety of risk metrics are underpinned by stochastic simulations which are data, memory and computationally intensive. Many of these simulations are routinely performed on production-based computing systems. Ad hoc simulations in addition to routine simulations are required to obtain up-to-date views of risk metrics. Such simulations are currently not performed as they cannot be accommodated on production clusters, which are typically over committed resources. Scalable, on-demand and pay-as-you go Virtual Machines (VMs) offered by the cloud are a potential platform to satisfy the data, memory and computational constraints of the simulation. However, “Are clouds ready to accelerate ad hoc financial simulations?” The research reported in this paper aims to experimentally verify this question by developing and deploying an important financial simulation, referred to as ‘Aggregate Risk Analysis’ on the cloud. Parallel techniques to improve efficiency and performance of the simulations are explored. Challenges such as accommodating large input data on limited memory VMs and rapidly processing data for real-time use are surmounted. The key result of this investigation is that Aggregate Risk Analysis can be accommodated on cloud VMs. Acceleration of up to 24x using multiple hardware accelerators over the implementation on a single accelerator, 6x over a multiple core implementation and approximately 60x over a baseline implementation was achieved on the cloud. However, computational time is wasted for every dollar spent on the cloud due to poor acceleration over multiple virtual cores. Interestingly, private VMs can offer better performance than public VMs on comparable underlying hardware.
Citation
Varghese , B & Barker , A D 2014 , Are Clouds ready to accelerate ad hoc financial simulations? in BDC '14 Proceedings of the 2014 IEEE/ACM International Symposium on Big Data Computing . IEEE Computer Society , pp. 54-63 . https://doi.org/10.1109/BDC.2014.9
Publication
BDC '14 Proceedings of the 2014 IEEE/ACM International Symposium on Big Data Computing
Type
Conference item
Rights
© 2014. IEEE. This is the accepted manuscript of a conference paper originally submitted to the International Symposium on Big Data Computing (BDC2014) Are Clouds ready to accelerate ad hoc financial simulations? Varghese, B. & Barker, A. D. 12 Aug 2014 BDC '14 Proceedings of the 2014 IEEE/ACM International Symposium on Big Data Computing Pages 54-63. IEEE Computer Society.
Description
Date of Acceptance: 15/10/2014Collections
Items in the St Andrews Research Repository are protected by copyright, with all rights reserved, unless otherwise indicated.