Assessment of pragmatic abilities and cognitive substrates (APACS) brief remote: a novel tool for the rapid and tele-evaluation of pragmatic skills in Italian

Abstract

Healthcare services require rapid assessment tools, as well as the possibility of using them flexibly in different contexts, such as those experienced during the COVID-19 pandemic, that favor remote interaction over traditional care. These needs become especially challenging when assessing language and communication skills, for which few tools exist. This work aimed to develop and evaluate the psychometric properties of a novel test for the rapid and tele-assessment of pragmatic skills in Italian-speaking individuals, including an alternate form to allow for monitoring and follow-up. Inspired by Gricean pragmatics and modelled after the already validated Assessment of Pragmatic Abilities and Cognitive Substrates (APACS) in-person test, the new APACS Brief Remote test includes 18 original items assessing discourse and non-literal language understanding in expressive and receptive modalities. The test lasts approximately 10 min and is suited for videoconference administration. Results from a sample of 141 healthy participants indicate that both reliability (internal consistency, test-retest, and inter-rater) and validity (measured via APACS and verbal and cognitive tests) of the APACS Brief Remote are adequate. The alternate form of the test can be considered as equivalent. Among demographic variables, the analysis highlighted especially the role of age. Perceived experience with the videoconference administration was positive, supporting the feasibility of APACS Brief Remote across ages and educational levels. The APACS Brief Remote represents a useful tool to promote evidence-based tele-assessment practices in the domain of pragmatics, for instance for online follow-up assessment, in a vast range of clinical conditions that might cause communicative difficulties.