Evaluating robot effectiveness for older adults and their care partners

Abstract

Effectiveness generally refers to the attribute of a system, process, or product to support its users in completing actions accurately (adapted from ISO 9241-11 usability definition (ISO,1998)). The effectiveness of a robot to support an older adult therefore refers to the degree of accuracy and completeness with which older adults can accomplish their goals using the robot. The satisfaction of the older adults in this process is vital because it impacts their comfort, willingness to use, actual use, and eventual acceptance of the robot (Boot et al., 2020). Older adults and their care partners have been reported to be open to robots as a care tool (Shishehgar et al., 2019). However, a critical question emerges - are robots ready? Is the task completion process satisfying to the users? These are the questions motivating this research wherein we examined the effectiveness of robots to support older adults and their care partners. Method We examined literature in the past 5 years to identify relevant studies that focused on assistive robots for the care of older adults and to support their care partners. We focused on four stakeholder groups: older adults with mobility impairments, older adults with cognitive impairments, professional caregivers, and family care partners. We identified a total of 44 papers that focused on these areas. We evaluated the robot effectiveness using a Likert scale (1-poor to 5-excellent) based on measures reported in the articles related to overall effectiveness such as accuracy or completion of the task by the robot. We evaluated user satisfaction using a Likert scale (1-very dissatisfied to 5-very satisfied) based on measures in the articles related to the users’ acceptance of the work completed by the robot and the manner in which it completed the task. We identified emerging themes and gaps that could influence effectiveness and user satisfaction. Results and Discussion Our ratings of documented robot effectiveness  (M=3.55, SD=0.41)and user satisfaction (M=3.49, SD=0.11) were both in the positive direction above the mid-point fo the scale. The themes and gaps observed centered around: (i) utility – robot interventions show potential to support older adults with mobility and cognitive impairments with various tasks of daily living; (ii) learning support – adequate training along with instructional support materials are needed to operate these robots; (iii) ease of use and personalization – older adults and professional caregivers had similar viewpoints on ease of communication, control, behavior, appearance and ability to be tailored to their personal preferences; and. (iv) error recovery modalities – recurring robot failures were mentioned in several studies without much discussion on design intended to support the user’s handling of the robot in these situations. Overall, our review revealed a positive trend in the effectiveness of the current state of assistive robots to support older adults and their care partners. It also highlighted areas of improvements that could bridge the gap between development and actual use of the robots by the care recipients and care partners to improve their quality of life.