Evaluating the performance of continuous test-based cloud service certification
Continuous test-based cloud certification uses tests to automatically and repeatedly evaluate whether a cloud service satisfies customer requirements over time. However, inaccurate tests can decrease customers' trust in test results and can lead to providers disputing results of test-based certification techniques. In this paper, we propose an approach how to evaluate the performance of test-based cloud certification techniques. Our method allows to infer conclusions about the general performance of test-based techniques, compare alternative techniques, and compare alternative configurations of test-based techniques. We present experimental results on how we used our approach to evaluate and compare exemplary test-based techniques which support the certification of requirements related to security, reliability and availability.
Evaluating the performance of continuous test-based cloud service certification
17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGRID
Authors: | Phlilipp Stephanow and Christian Banse |
Year/month: | 2017/ |
Booktitle: | 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGRID |
Pages: | 1117-1126 |
Address: | Madrid, Spain Los Alamitos, Calif |
Publisher: | IEEE |
Fulltext: | click here |
Abstract |
|
Continuous test-based cloud certification uses tests to automatically and repeatedly evaluate whether a cloud service satisfies customer requirements over time. However, inaccurate tests can decrease customers' trust in test results and can lead to providers disputing results of test-based certification techniques. In this paper, we propose an approach how to evaluate the performance of test-based cloud certification techniques. Our method allows to infer conclusions about the general performance of test-based techniques, compare alternative techniques, and compare alternative configurations of test-based techniques. We present experimental results on how we used our approach to evaluate and compare exemplary test-based techniques which support the certification of requirements related to security, reliability and availability. |
Bibtex:
@inproceedings { stephanowEvaluation2017,author = { Phlilipp Stephanow and Christian Banse},
title = { Evaluating the performance of continuous test-based cloud service certification },
year = { 2017 },
booktitle = { 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGRID },
address = { Madrid, Spain Los Alamitos, Calif },
pages = { 1117-1126 },
publisher = { IEEE },
url = { http://dx.doi.org/10.1109/CCGRID.2017.134 },
}