Setting up an experimental evaluation for architecture-based Software Performance Engineering (SPE) approaches requires enormous efforts. This includes the selection and installation of representative applications, usage profiles, supporting tools, infrastructures, etc. Quantitative comparisons with related approaches are hardly possible due to limited repeatability of previous experiments by other researchers.
CASPA is a ready-to-use and extensible evaluation platform that already includes example applications and state-of-the-art SPE components, such as monitoring and model extraction. The platform explicitly provides interfaces to replace applications and components by custom(ized) components. The platform builds on state-of-the-art technologies such as container-based virtualization.
Details on the platform are described in the following publication:
- Düllmann, T.F., Heinrich, R., van Hoorn, A., Pitakrat, T., Walter, J., Willnecker, F.: CASPA: A platform for comparability of architecture-based software performance engineering approaches. In: Proceedings of the 2017 IEEE International Conference on Software Architecture (ICSA 2017). IEEE. 2017. Full text (PDF)
- A Kubernetes cluster can be set up either on a local machine or in a cloud environment:
- minikube for setting up on a local machine
- Physical/virtual cluster for setting up in a cloud environment
- InfluxDB
- Grafana
- Kubernetes addons
The workload generator is application-specific and can be found in the corresponding application directory.