PrePrint: A Highly Practical Approach towards Achieving Minimum Datasets Storage Cost in the Cloud

from IEEE Transactions on Parallel and Distributed Systems

Massive computation power and storage capacity of cloud computing systems allow scientists to deploy computation and data intensive applications without infrastructure investment, where large application datasets can be stored in the cloud. Based on the pay-as-you-go model, storage strategies and benchmarking approaches have been developed for cost-effectively storing large volume of generated application datasets in the cloud. However, they are either insufficiently cost-effective for the storage or impractical to be used at runtime. In this paper, towards achieving the minimum cost benchmark, we propose a novel highly cost-effective and practical storage strategy that can automatically decide whether a generated dataset should be stored or not at runtime in the cloud. The main focus of this strategy is the local-optimisation for the trade-off between computation and storage, whilst secondarily also taking users’ (optional) preferences on storage into consideration. Both theoretical analysis and simulations conducted on general (random) datasets as well as specific real world applications with Amazon’s cost model show that the cost-effectiveness of our strategy is close to or even the same as the minimum cost benchmark, and the efficiency is very high for practical runtime utilisation in the cloud.



Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / 更改 )

Twitter picture

You are commenting using your Twitter account. Log Out / 更改 )

Facebook photo

You are commenting using your Facebook account. Log Out / 更改 )

Google+ photo

You are commenting using your Google+ account. Log Out / 更改 )

Connecting to %s