Can UX Over Time Be Reliably Evaluated? - Verifying the Reliability of ERM

Abstract

Experience Recollection Method (ERM) was announced at HCII 2018 conference by the author and is a research method for the UX (User Experience) that evaluates the contents and degrees of UX. It is a memory-based measurement method for the UX where the informants are asked about the content and degree of episodes concerning the use of targeted artifact (product, system or service) along with the rough time scale. Although the method requests episodes on the artifact usage, it doesn’t ask the time information in detail considering the vagueness of memory, hence it does not generate the visual representation of UX curve/graph in such methods as CORPUS, iScale, UX Curve and UX graph. This presentation is based on the data that was obtained in FY 2017 for the same informants once in September and another in January. We compared two data and checked if the information obtained by ERM has a certain degree of reliability, i.e. the nepisode in the first survey is kept in the second survey and if the rating scale value are almost the same. This presentation is based on the comparison of two datasets. Generally speaking, ERM was confirmed to have the high reliability and provide a reliable information on the UX.