Evaluation models for digital and remote solutions

  • Measure the added value provided by the implemented initiative.
  • Identify the critical elements of the initiative both in its design and implementation.
  • Analyse the results and impacts of the initiative as well as its effectiveness and efficiency.
  • Enable the transfer of knowledge by promoting the replication of best practices in similar situations.

01. Evaluation

In the context of the assessing digital non-face-to-face care solutions, the frame of reference in Catalonia is based on an adaptation of international models: Model for Assessment of Telemedicine Applications (MAST) and the guide to assessing the impact of telehealth and telecare of the I Scottish Centre for Telehealth and Telecare (SCTT) and its aim is to carry out a holistic assessment process that includes all the phases of the initiative, from the identification of the need and the design of the solution, through its development and incorporation into clinical practice and finally, the obtaining of results and analysis of the obtained impact:

 

02. Actors, scope of assessment and use cases

The assessment framework takes into account different aspects: the actors involved in the use of the digital solution, the different dimensions to be considered in the assessment and the specific use cases of the assessed solution:

Clinical and health dimension

Measures the capacity of the service to improve the individual’s health condition (slow the progression of the disease, fragility or loss of independence or accelerate the rehabilitation or self-management of the disease or pathology).

Economic dimension and effectiveness

Assessment of expenses and earnings after the implementation of the service and cost-benefit analysis (CBA), cost minimization analysis (CMA), cost-effectiveness analysis (CEA), cost-consequence analysis (CCA).

Process management, organizational and leadership dimension

Takes into account what types of resources and processes need to be created or organized when implementing a new initiative and what types of changes or consequences their use can produce.

User experience dimension

Measures, among other things, the perception and satisfaction of the different agents involved in relation to the digital non-face-to-face service.

Sociocultural, ethical and legal dimension

Assessment of the social, ethical and legal aspects of the initiative, both for the digital solution and for the service.

Functional and technological dimension

Assesses aspects such as data security, privacy and protection, usability, reliability, etc.