TUM Logo

Evaluating the performance of continuous test-based cloud service certification

Continuous test-based cloud certification uses tests to automatically and repeatedly evaluate whether a cloud service satisfies customer requirements over time. However, inaccurate tests can decrease customers' trust in test results and can lead to providers disputing results of test-based certification techniques. In this paper, we propose an approach how to evaluate the performance of test-based cloud certification techniques. Our method allows to infer conclusions about the general performance of test-based techniques, compare alternative techniques, and compare alternative configurations of test-based techniques. We present experimental results on how we used our approach to evaluate and compare exemplary test-based techniques which support the certification of requirements related to security, reliability and availability.

Evaluating the performance of continuous test-based cloud service certification

17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGRID

Authors: Phlilipp Stephanow and Christian Banse
Year/month: 2017/
Booktitle: 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGRID
Pages: 1117-1126
Address: Madrid, Spain Los Alamitos, Calif
Publisher: IEEE
Fulltext: click here

Abstract

Continuous test-based cloud certification uses tests to automatically and repeatedly evaluate whether a cloud service satisfies customer requirements over time. However, inaccurate tests can decrease customers' trust in test results and can lead to providers disputing results of test-based certification techniques. In this paper, we propose an approach how to evaluate the performance of test-based cloud certification techniques. Our method allows to infer conclusions about the general performance of test-based techniques, compare alternative techniques, and compare alternative configurations of test-based techniques. We present experimental results on how we used our approach to evaluate and compare exemplary test-based techniques which support the certification of requirements related to security, reliability and availability.

Bibtex:

@inproceedings { stephanowEvaluation2017,
author = { Phlilipp Stephanow and Christian Banse},
title = { Evaluating the performance of continuous test-based cloud service certification },
year = { 2017 },
booktitle = { 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGRID },
address = { Madrid, Spain Los Alamitos, Calif },
pages = { 1117-1126 },
publisher = { IEEE },
url = { http://dx.doi.org/10.1109/CCGRID.2017.134 },

}