How to Measure and Evaluate Web Applications in a Consistent Way

Abstract

In the present chapter we analyze the rationale to measure and evaluate software and web applications or products from different perspectives. First, we focus on the process for measurement and evaluation, i.e. the main technical activities that might be planned. Second, we discuss a measurement and evaluation framework that relies on a sound conceptual base. This framework so-called INCAMI (Information Need, Concept model, Attribute, Metric and Indicator) is based on our ontological proposal of metrics and indicators. The underlying hypothesis is that without appropriate recorded metadata of information needs, attributes, metrics and indicators it is difficult to ensure measure and indicator values are repeatable and comparable among organizations projects. Moreover, analyses and comparisons could be performed in an inconsistent way. Third, in order to illustrate the measurement and evaluation process and framework with specific models and procedures an inspection methodology named WebQEM (Web Quality Evaluation Method) is used. In addition, a case study on the external quality of the shopping cart component of a typical e-commerce website is carried out. Finally, additional discussions about the flexibility of the measurement and evaluation framework as well as concluding remarks are drawn.