Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Monday, March 11, 2019 at 4:00 PM to 4:30 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Advertisement

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 08.09.19 in Vol 6, No 2 (2019): Jul-Dec

Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/12010, first published Aug 22, 2018.

This paper is in the following e-collection/theme issue:

    Original Paper

    Exoskeletons With Virtual Reality, Augmented Reality, and Gamification for Stroke Patients’ Rehabilitation: Systematic Review

    1School of Computing, Engineering and Mathematics, Western Sydney University, Rydalmere, Australia

    2College of Information Technology, United Arab Emirates University, Al Ain, Abu Dhabi, United Arab Emirates

    3Swinburne University of Technology, Melbourne, Australia

    Corresponding Author:

    Fady Alnajjar, PhD

    College of Information Technology

    United Arab Emirates University

    PO Box 15551

    Al Ain, Abu Dhabi

    United Arab Emirates

    Phone: 971 37673333

    Email: fady.alnajjar@uaeu.ac.ae


    ABSTRACT

    Background: Robot-assisted therapy has become a promising technology in the field of rehabilitation for poststroke patients with motor disorders. Motivation during the rehabilitation process is a top priority for most stroke survivors. With current advancements in technology there has been the introduction of virtual reality (VR), augmented reality (AR), customizable games, or a combination thereof, that aid robotic therapy in retaining, or increasing the interests of, patients so they keep performing their exercises. However, there are gaps in the evidence regarding the transition from clinical rehabilitation to home-based therapy which calls for an updated synthesis of the literature that showcases this trend. The present review proposes a categorization of these studies according to technologies used, and details research in both upper limb and lower limb applications.

    Objective: The goal of this work was to review the practices and technologies implemented in the rehabilitation of poststroke patients. It aims to assess the effectiveness of exoskeleton robotics in conjunction with any of the three technologies (VR, AR, or gamification) in improving activity and participation in poststroke survivors.

    Methods: A systematic search of the literature on exoskeleton robotics applied with any of the three technologies of interest (VR, AR, or gamification) was performed in the following databases: MEDLINE, EMBASE, Science Direct & The Cochrane Library. Exoskeleton-based studies that did not include any VR, AR or gamification elements were excluded, but publications from the years 2010 to 2017 were included. Results in the form of improvements in the patients’ condition were also recorded and taken into consideration in determining the effectiveness of any of the therapies on the patients.

    Results: Thirty studies were identified based on the inclusion criteria, and this included randomized controlled trials as well as exploratory research pieces. There were a total of about 385 participants across the various studies. The use of technologies such as VR-, AR-, or gamification-based exoskeletons could fill the transition from the clinic to a home-based setting. Our analysis showed that there were general improvements in the motor function of patients using the novel interfacing techniques with exoskeletons. This categorization of studies helps with understanding the scope of rehabilitation therapies that can be successfully arranged for home-based rehabilitation.

    Conclusions: Future studies are necessary to explore various types of customizable games required to retain or increase the motivation of patients going through the individual therapies.

    JMIR Rehabil Assist Technol 2019;6(2):e12010

    doi:10.2196/12010

    KEYWORDS



    Introduction

    Background

    Stroke refers to a sudden, often catastrophic neurological event that can lead to long-term adult disability. The American Heart Association (AHA) is responsible for providing up-to-date statistics related to heart disease and stroke. According to Benjamin et al [1], the AHA released a 2017 statistics report on heart disease and stroke that stated that approximately 795,000 stroke episodes occur in the US each year. With current advancements in medical technology there has been a decrease in the rate of stroke incidents, but it can still cause paralysis and muscle weakness. Such impairments can result in motor deficits that disturb a stroke survivor's capacity to live independently.

    There are several reasons for stroke occurrence, which could be related to an increased risk of a collection of symptoms caused by disorders affecting the brain (eg, dementia) [2]. Various rehabilitation techniques have been used in the area of rehabilitation-based interactive technology to assist patients in recovering from impairments, and those techniques come under the umbrella of conventional therapy, exoskeleton or robot-aided therapy, virtual reality (VR) or augmented reality (AR) therapy, games-based therapy, or a combination of any of these. These forms of therapy can be done either in the clinic or in an in-home setting. In addition to these, there is a new technology known as telerehabilitation [3] that leverages the use of VR in home settings by providing patients access to real-time rehabilitation services through the internet while they sit at home.

    One of the most effective techniques is robot-aided therapy, which has been gradually increasing in use primarily because patients may consider traditional rehabilitation therapy to be tiring and exhaustive. This may decrease their motivation and cohesion to the treatment, thus resulting in only minor improvement in the health of poststroke patients [4-6]. Various experimental evidence suggests that robot-assisted (or exoskeleton) rehabilitation has been effective in keeping patients motivated and interested in treatment for both upper or lower limb impairments [7,8]. With advancements in technology, there has also been an uptake of VR, AR, and Gamification for the purposes of rehabilitation [9], along with robotic rehabilitation [10,11], primarily to increase engagement, immersion and motivation on behalf of the patient. Both Colombo et al and Alankus et al [12,13] concluded and showed the positive effect of exoskeleton robots and games in poststroke rehabilitation. Wearable devices such as exoskeletons can also relay real-time feedback for any VR-based interactions [14].

    Apart from these studies, Housman et al [15] showed user satisfaction survey results in which 90% of participants agreed to the fact that robot- or games-assisted therapies were less confusing, and improvements were very easy to track compared to traditional or conventional therapies. Further, it is thought that gamification can increase repetition, engagement, and range of care within the context of rehabilitation [16,17]. Games are not only useful for the field of rehabilitation, but they are also considered to be highly impactful and relevant in other medical and health fields. Russoniello et al [18] conducted a randomized controlled trial (RCT) study in which the effects of video games on stress-related disorders were tested, with the conclusion being that games were beneficial for their prevention and treatment. In another study, children who had cerebral palsy made use of a game (EyeToy) which was able to improve their upper extremity functions over time [19].

    Virtual Reality, Augmented Reality and Gamification

    VR is a virtual form of a real entity, object or environment. According to Schultheis et al [20], VR can be regarded as an enhanced version of human-computer interaction (HCI) in which the human interacts with a three-dimensional (3D) interface and is immersed in a synthetic environment comprised of digital objects. Various devices, such as earphones and head-mounted displays (HMDs), are used to support this form of technology. VR has already become popular in the fields of science, music, education and training, and healthcare, but in areas such as poststroke rehabilitation it has been an immense benefit. For example, Katz et al [21] described the effectiveness of VR in treating poststroke patients through their street program. In this study, the patients were suffering from Unilateral Spatial Neglect (USN), which happens because of right hemisphere—caused stroke. VR can provide the opportunity to create and customize a patient’s training based on their interests. This could increase their motivation to continue training and increase their attention during their sessions, both of which are essential factors for effective rehabilitation.

    As mentioned above, traditional methods of rehabilitation might lead to a patient’s loss of interest in their therapy, as it often involves daily repetitive tasks. VR encourages patients to participate in their therapy by either incorporating games in the form of exercises or through other interactive means. With the current state of VR in rehabilitation services, a new form of therapy has gradually emerged that is known as Virtual Rehabilitation [22]. Virtual rehabilitation is defined as the ability of VR to provide therapy to patients using its hardware and simulation. Apart from a definition, Burdea also lists classifications and taxonomy for Virtual Rehabilitation [22]. Classification is done based on the area of study, the rehabilitation protocol, or the availability of a therapeutic team for the patient. Hardware used in VR is multipurpose and can be used for different patients suffering from different types of strokes (eg, a hand glove can be used to do strengthening exercises as well as other motor improvement exercises.) Therefore, VR provides an interactive and motivational environment, where patients feel encouraged to participate in clinical or home-based trials.

    We must also consider the advancements in VR technology in recent years by the inclusion of sixth and seventh generation gaming systems, which include various popular systems such as the Xbox 360 Kinect and the Nintendo Wii. Yates et al [23] discussed various commercial gaming systems and gave extensive information regarding the features of these VR systems. When more realism (such as through the inclusion of tangible or physical objects in the virtual world) is added to VR, it gives rise to a new technology called AR. The user feels more realism as they receive more control over virtual objects by interacting with real objects. The virtual view of the world, or an environment, is superimposed in the real world, so therefore VR and AR lie at the opposite ends of a reality-virtuality spectrum.

    Slowly, AR is also gaining traction in the field of rehabilitation. According to Khademi et al [24], when a haptic device was used with AR in an experiment, there were improvements in hand stiffness that proved the potential of a haptic AR rehab system. In another study, Mousavi et al [25] trained and assessed subjects side by side with the help of multiple groups. One group used AR while the other one used traditional HCI via a personal computer and a mouse. The results of this study showed increased motor movements in the group using the AR technology as compared to the traditional means of interaction.

    In addition to these two technologies (VR and AR), video games are often used in rehabilitation services these days as they play an essential part in encouraging patients to participate in therapeutic exercises. It should be noted that VR- or AR-interaction can be nongamified or nonplayful, which is why we prefer to delineate them. Games are used with specific hardware depending on the physical condition of the patients, and various game attributes are considered while developing games for rehabilitation purposes. There are several types of games used in rehabilitation services, such as two-dimensional (2D), 3D, VR and AR games, and other natural user interfaces such as Wii, PlayStation, Wii Balance, Xbox, and Kinect. Alankus et al [13] developed games for stroke-affected patients and identified three important attributes in this space: social context (multiplayer versus single player), motion type (single-muscle motion versus multiple-muscle motion) and cognitive challenge (easy versus difficult). Audio-visual cues and performance-related online information was also provided to patients as another means of boosting their motivation.

    It should be noted that most of the games used in rehabilitation are commercial, off-the-shelf games. In a study conducted by Acosta et al [26], the feasibility of using the Nintendo Wii was assessed in a group of 20 patients, and it was concluded that use of computing gaming devices might be a benefit for rehabilitation. Burke et al [27] discussed various games (eg, Rabbit Chase, Bubble Trouble and Arrow Attack), and identified game design principles which were significant for upper limb stroke rehabilitation. However, the aim of our paper is to investigate and review the coupling of such gaming elements, or virtual reality, with an exoskeleton or robotic device.

    Exoskeleton means an extension to the (human) skeleton, but in simplistic terms, some researchers have defined an exoskeleton as any transparent device that a user or patient may wear or attach upon themselves and that extends their natural motor capabilities by determining their intent [28]. They are popular for enhancing human strength and speed via their internal components, which is a composition of electric motors, levers, and hydraulics. There are many exoskeletons available, like Amadeo, HandCARE, ARMin IV, and CyberGlove, that are used to assist patients in participating in rehabilitation sessions.

    To summarize, in our review we intended to ascertain the possible interactions of rehabilitation robotics or exoskeletons with AR or VR (forming the two major components considered within our review, that is, the hardware and the interfacing technology), that is, to use the intermediate interfaces employed as a means of supplementing the rehabilitation process using exoskeleton-based hardware. Therefore, we set out to perform an exploratory review of the field of rehabilitation robotics with an additive aspect of technical scope, focusing on solutions and prototypes in the area of exoskeletons that interfaced with software mediums. Our methodology focused on the common approach carried out when doing systematic reviews; however, our analysis and reflections were mainly based on qualitative grouping and meta-synthesis, due to the preliminary nature of our work and the heterogeneous and multidisciplinary character of our considered papers.

    To further motivate our approach, work and research objectives, we scanned the literature to extract review articles like ours, and two recent studies emerged. The first focused primarily on the prospect of exoskeletons for stroke rehabilitation [29] and the second discussed the possibility of VR-based interactions for rehabilitation [30]. We essentially combined the two and investigated what would happen when both hardware-based rehabilitation aids and software interfaces depicting virtual reality or gaming mechanisms were merged.

    Therefore, to conclude, the aim of this review was to examine the potential and latest trends in the area of exoskeleton- or robotic-aided therapy in combination with VR, AR, or gamification for the improvement of motor function for poststroke patients. Specifically, we aimed to determine: (1) if such a coupled approach or setting could provide positive outcomes for patients; (2) trends and popular configurations across both types of exoskeletons and software mediums; and (3) future challenges in the field of exoskeleton-based HCI therapy.


    Methods

    Databases Searched and Search Terms Used

    We conducted this review according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines [31]. The following databases were searched for relevant studies: MEDLINE, EMBASE, Science Direct and The Cochrane Library, and studies conducted between the years 2010 to 2017 were included. An electronic search of the literature was performed using search terms such as “post-stroke rehabilitation, exoskeleton, robotic device, virtual reality, or augmented reality, or gamification”.

    Inclusion and Exclusion Criteria

    Inclusion criteria were as follows: (1) experimental, explorative or RCT studies on poststroke rehabilitation, (2) VR, AR, or gamification visual feedback, (3) stroke-affected patients; and (4) use of an exoskeleton or robotic device. As per our interpretation for this review, a VR or AR environment in the field of robot-aided rehabilitation is a replica of the real-world environment that is achieved after using hardware devices and a wearable exoskeleton device in liaison with each other.

    The exclusion criteria for our study were: (1) studies done without the use of any robotic device or exoskeleton; (2) studies with nonvirtual or nonaugmented environments, or an absence of games; and (3) publications or articles in languages other than English. As mentioned before, due to the heterogenous nature of the collated studies, data was synthesized qualitatively.


    Results

    Search Results

    A total of 504 articles were identified from electronic searches and a total of 56 were identified through reference searches or other sources. We excluded 129 citations which were only at title and abstract stage, resulting in 204 full-text articles. Of these, 132 citations were excluded at the full-text stage, with reasons mentioned in Figure 1 as per the exclusion criteria for this paper. 30 studies reported across 30 publications were identified for inclusion in this review.

    Figure 1. Selection of articles for review.
    View this figure

    Overview of Included Papers

    All articles published in English and in the years 2010 to 2017 were included. Four studies were published in the year 2010 and one in the year 2017, with size of the samples involved in the studies ranging from 1-47 participants per study; however, 13 studies had less than 10 participants. In two of the studies, healthy users of the devices were used as controls to compare the improvements of the patients [32,33]. Apart from this, one clinical study [34] was performed with just one patient who attended six sessions three times a week for two weeks, where it was found that the VR-based system resulted in effective upper-limb rehabilitation for this patient.

    The average time poststroke for the participants involved in these studies, as mentioned in the articles, varied from less than six months to several years. Four studies did not mention the poststroke period at all [32,33,35-37], while three studies (10%) were held during the subacute (less than three months poststroke) stage [38-40]. All the other papers in our sample carried out their studies during the chronic stage (greater than three months poststroke). Most of the studies (28/30) considered designing rehabilitation therapies for upper limb while only two studies involved lower limb. Several measurement assessment scales were used in the studies that were used to assess improvements in motor functions which we then analyzed. Some of the scales included were the Chedoke-McMaster Stroke Assessment (CMSA), the Fugl-Meyer Motor Assessment (FMA), the Wolf Motor Function Test (WMFT), and the Modified Ashworth Scale (MAS), among others. An overview of some of the criteria used is provided as a summarized table below (see Table 1), whereas a detailed overview of the entire dataset is provided in Multimedia Appendix 1. The entire sample of 30 studies is also available in the reference list [26,32-36,38-61].

    Table 1. Overview of some of the criteria of our review and their associated frequencies (N=30).
    View this table

    Discussion

    Key Findings

    The studies were categorized into different fields, and of all 30 studies half of them used VR therapy while the other half used some gaming concepts. The studies that involved the use of an exoskeleton or robotic device along with VR, AR, or gamification were within the inclusion criteria of this review, so thirty exoskeletons or robotic devices were included. Of these devices, three exoskeletons emerged as slightly more popular in use: ARMin, Bi-Manu Track and ArmeoSpring. These devices each had repeated use in two studies while 24 studies made use of entirely different exoskeletons or robotic devices.

    Klamroth-Marganska [41] made use of the ARMin exoskeleton in a 3D workspace with 7 degrees of freedom (DOF) for arm motor impairment in their study. This study was carried out among 38 poststroke patients who attended a total of 24 sessions (45 min/session) where they used VR Games that had their difficulty level adjusted by the therapist. This study resulted in improvement in the affected arm that was trained using ARMin, and audio-visual feedback was also provided to the patients through the VR games to elevate their motivation. Another lab-based empirical study [32] used the fourth version of the ARMin exoskeleton for 30 healthy and 8 impaired subjects, all of who played games with varying difficulty levels during the practice round. After that, feedback was taken from the participants using questionnaires. That study concluded that stroke-affected subjects were more interested in playing multiplayer games as compared to single player, as that allowed them to interact with peers or partners (dependent on the personality traits of the participants).

    Another exoskeleton device, Armeo Spring, was used in two other papers selected for analysis [42,43]. In the Grimm et al study, an Armeo Spring device with 7 DOF was used for a clinical study involving five subjects who attended 20 sessions of therapy over four weeks (20 min/session). A VR interface was used with the exoskeleton and the difficulty level of the exercise was adjusted as per a patient’s performance, with a provision for feedback on movement quality. Improvements in kinematic parameters were observed, thus making this particular VR-exoskeleton setup an effective combination for poststroke rehabilitation. In the Gijbels et al article, the Armeo exoskeleton was used with VR-based, nongamified learning (domestic cleaning tasks) for 10 subjects performing exercises three times per week, for a total of eight weeks. Each session lasted for 30 minutes, and auditory-visual performance feedback was provided both before and after the practice. The main outcome of this study was that functional gains in motor movement were reached at the end of the two-month study period, even for patients with high levels of disability.

    In the year 2011, several studies were published that made use of exoskeletons with other technologies, and here we summarize a few as case studies. Lambercy et al [44] had a study of 13 poststroke participants using HapticKnob and games which resulted in improvements in their hand and arm motor functions, while Acosta et al [26] used 3D arm coordination training alongside video games and concluded that the duo would be useful for stroke rehabilitation. Similarly, two other studies by da Silva et al and Stein et al [40,62] made use of Data Gloves and Amadeo alongside VR and games, which led to improvements in multiple measures of motor performance in the participants involved in the study. In addition, Bi-Manu-Track with games and Robotic Upper Extremity Repetitive Trainer (RUPERT) with VR were used for both clinical and home-based rehabilitation such as in [53]. In this study, out of the two patients the first showed improvement in movement smoothness on targets while the second did not experience any ascending or descending trend in smoothness.

    The studies mentioned so far mostly involved one part of the human body (arm), but Connelly et al [35] discussed hand improvements in which the PneuGlove with 6 DOF (Servomotor actuator) was used in a clinical study that engaged 14 patients for six weeks (60 min/session). An HMD was used to measure haptic feedback in the study, and as a result, a great increase in FMA scores were achieved. In a different study, a home-based trial was done on hand motor function improvements [45] wherein Hand Mentor Pro (HMP) was used alongside video games. From this study, visual biofeedback about the quality and quantity of wrist movements was attained, which resulted in improvements in ARAT scores. In a more recent study, Khor et al [46] discussed the improvements in a 30 min, robot-assisted study for 7 participants who actively took part in clinical and home-based rehab therapy, and who showed improvements in both hand and arm functions. This therapy was assisted by the CR2-Haptic device alongside a VR game, and it was reported that all subjects were comfortable with the therapy. The study also reported on the low cost of its hardware due to a reduced number of sensors and actuators, but this had the negative effect of lowering the customization and scalability of the exoskeleton.

    We noticed that there was less academic literature for lower limb rehabilitation compared to upper limb rehabilitation, but our review still included two studies that involved lower limb rehabilitation. Forrester et al and Mirelman et al [47,63] described the effectiveness of the use of the exoskeletons Anklebot (3 DOF) and Rutgers Ankle Rehabilitation System (RARS) (6 DOF), alongside VR and video games, for ankle and foot rehabilitation. Improvements in walking velocity and paretic ankle motor control, as well as an increase in peak plantarflexion moment and in ankle power generation, were observed. Through further snowballing searches after the primary search, we also located two additional studies that employed the Lokomat exoskeleton for leg rehabilitation [64,65]. Both of these studies utilized VR as their key interfacing medium, but the former was a study with adults where a racing game was the main object of interest, while the second was a study with children where games such as soccer were incorporated. Both studies reported generally increased levels of engagement from the participants and thus further outlined the potential of robot-aided rehabilitation for lower limbs using VR. An interesting observation was the absence of AR-based systems for stroke rehabilitation in our sample. The requirement of additional hardware over exoskeletons and real-time tracking might be a deterrent. With the current advancements in AR systems (such as HoloLens), we would expect their application in clinical and medical settings to grow.

    Future Challenges in the Field of Rehabilitation

    Although positive results and improvements in motor function were observed in most of the studies, the results from this systematic review also depict that most rehab services are carried out in groups in clinics while home-based rehab is rarely attempted using the current configuration of interactive technologies. Group therapies in a clinical or lab setting are done so that patients feel motivated by collaborating with, or competing against, each other. In home-based rehabilitation, it is possible that patients might feel overwhelmed or isolated with the advanced forms of technology necessary for their therapy. In this case, the technology and the therapy sessions need to be designed in a way such that patients feel motivated and confident during home-based rehabilitation sessions as well (such as through online-tailored gaming). Thus, game-based rehabilitation can play a key role and provide a suitable interfacing medium for VR or AR, with 10 of our sample of 30 papers associating gaming with virtual reality. Use of customized games should be encouraged so that games are designed to keep in mind a particular target user, which could drive motivation in those people who play these specialized games at home as a part of their rehabilitation process. Articles in our sample indicated the key considerations that researchers must focus on while designing games for rehabilitation (also known as serious games), with key elements of discussion including: whether the play is meaningful, if engagement or motivation is retained, the difficulty level of the game, the role of customization, the range and type of feedback acquired, and the overall usability of the gameplay. Lastly, the interaction technique used is also a key consideration in game-based rehabilitation, with what gestures result in what game event easily being dictated by the motor movements required (such as whether the game interaction will involve grasping, pinching or linear limb movements).

    However, there are some limitations to this review. For example, different types of assessment scale and quality of collected data were used, which makes it difficult to compare the outcomes and results accurately or quantitatively against each other. In addition, some articles could have been missed in the review due to very specific search criteria.

    Conclusion

    This review was carried out to collect data from different clinical trials and then to categorize and explore them to find the effectiveness of VR, AR, or gamification when used in combination with an exoskeleton or robotic device for the rehabilitation of poststroke patients. It was found that very little work is done to make use of these technologies for rehabilitation of lower limbs when compared to upper limbs, and that there are a wide variety of exoskeleton-based devices currently in use. Apart from this, the review also states that these exoskeleton-based devices are rarely available for home-based trials. This shows that there is a considerable gap in the transition of rehabilitation services from a clinical environment to a home-based setting. Future work should focus on the successful application of VR, AR, or gamification technology to engage poststroke patients in rehabilitation therapies done at their homes. In addition, commercial, off-the-shelf games may be deployed easily, but efforts must be dedicated to designing games for rehabilitation to keep in mind the user and allow for customization to facilitate their motivation.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    Detailed overview of our dataset of 30 papers.

    PDF File (Adobe PDF File)333 KB

    References

    1. Benjamin EJ, Blaha MJ, Chiuve SE, Cushman M, Das SR, Deo R, American Heart Association Statistics CommitteeStroke Statistics Subcommittee. Heart Disease and Stroke Statistics-2017 Update: A Report From the American Heart Association. Circulation 2017 Mar 07;135(10):e146-e603 [FREE Full text] [CrossRef] [Medline]
    2. Pendlebury S, Rothwell PM. Prevalence, incidence, and factors associated with pre-stroke and post-stroke dementia: a systematic review and meta-analysis. Lancet Neurol 2009 Nov;8(11):1006-1018. [CrossRef] [Medline]
    3. Golomb M, McDonald BC, Warden SJ, Yonkman J, Saykin AJ, Shirley B, et al. In-home virtual reality videogame telerehabilitation in adolescents with hemiplegic cerebral palsy. Arch Phys Med Rehabil 2010 Jan;91(1):1-8.e1. [CrossRef] [Medline]
    4. Kondo I. Frailty in an aging society and the applications of robots. Japanese Journal of Comprehensive Rehabilitation Science 2019;10:47-49. [CrossRef]
    5. Wojtara T, Sasaki M, Konosu H, Yamashita M, Shimoda S, Alnajjar F, et al. Artificial balancer - supporting device for postural reflex. Gait Posture 2012 Mar;35(2):316-321. [CrossRef] [Medline]
    6. Ozaki K, Kondo I, Hirano S, Kagaya H, Saitoh E, Osawa A, et al. Training with a balance exercise assist robot is more effective than conventional training for frail older adults. Geriatr Gerontol Int 2017 Nov;17(11):1982-1990. [CrossRef] [Medline]
    7. Okajima S, Alnajjar F, Yamasaki H, Itkonen M, García AC, Hasegawa Y, et al. Grasp-training Robot to Activate Neural Control Loop for Reflex and Experimental Verification. 2018 Presented at: IEEE International Conference on Robotics and Automation (ICRA); 2018; Brisbane. [CrossRef]
    8. Kwakkel G, Kollen BJ, Krebs HI. Effects of robot-assisted therapy on upper limb recovery after stroke: a systematic review. Neurorehabil Neural Repair 2008;22(2):111-121 [FREE Full text] [CrossRef] [Medline]
    9. Alimanova M. Gamification of hand rehabilitation process using virtual reality tools: Using leap motion for hand rehabilitation. 2017 Presented at: First IEEE International Conference on Robotic Computing (IRC); 2017; Taichung, Taiwan. [CrossRef]
    10. Zheng J, Shi P, Yu H. A Virtual Reality Rehabilitation Training System Based on Upper Limb Exoskeleton Robot. 2018 Presented at: 10th IEEE International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC); 2018; Hangzhou, China.
    11. Bouteraa Y, Abdallah I, Elmogy A. Training of Hand Rehabilitation Using Low Cost Exoskeleton and Vision-Based Game Interface. J Intell Robot Syst 2019 Jan 5:1-17. [CrossRef]
    12. Colombo R, Pisano F, Mazzone A, Delconte C, Micera S, Carrozza MC, et al. Design strategies to improve patient motivation during robot-aided rehabilitation. J Neuroeng Rehabil 2007 Mar 19;4:3 [FREE Full text] [CrossRef] [Medline]
    13. Alankus G, Lazar A, May M, Kelleher C. Towards customizable games for stroke rehabilitation. 2010 Presented at: SIGCHI Conference on Human Factors in Computing Systems; 2010; Atlanta, Georgia, USA p. 2113-2122. [CrossRef]
    14. Powell W, Rizzo A, Sharkey PM, Merrick J. Innovations and challenges in the use of virtual reality technologies for rehabilitation. Journal of Alternative Medicine Research 2018;10(1) [FREE Full text]
    15. Housman S, Scott KM, Reinkensmeyer DJ. A randomized controlled trial of gravity-supported, computer-enhanced arm exercise for individuals with severe hemiparesis. Neurorehabil Neural Repair 2009 Jun;23(5):505-514. [CrossRef] [Medline]
    16. Gauthier L. Gaming for the Brain: Video Gaming to Rehabilitate the Upper Extremity After Stroke. Neuromodulation (Second Edition) 2018:465-476. [CrossRef]
    17. Petrie R. Victoria University of Wellington. 2018. Designing an augmented reality video game to assist stroke patients with independent rehabilitation   URL: https://researcharchive.vuw.ac.nz/xmlui/handle/10063/7023 [accessed 2019-08-29]
    18. Russoniello C, O'Brien K, Parks JM. The effectiveness of casual video games in improving mood and decreasing stress. Journal of CyberTherapy and Rehabilitation 2009;2(1):53-66 [FREE Full text]
    19. Jannink M, van der Wilden GJ, Navis DW, Visser G, Gussinklo J, Ijzerman M. A low-cost video game applied for training of upper extremity function in children with cerebral palsy: a pilot study. Cyberpsychol Behav 2008 Mar;11(1):27-32. [CrossRef] [Medline]
    20. Schultheis M, Rizzo A. The application of virtual reality technology in rehabilitation. Rehabilitation Psychology 2001;46(3):296-311. [CrossRef]
    21. Katz N, Ring H, Naveh Y, Kizony R, Feintuch U, Weiss PL. Interactive virtual environment training for safe street crossing of right hemisphere stroke patients with unilateral spatial neglect. Disabil Rehabil 2005 Oct 30;27(20):1235-1243. [CrossRef] [Medline]
    22. Burdea G. Virtual rehabilitation--benefits and challenges. Methods Inf Med 2003;42(5):519-523. [Medline]
    23. Yates M, Kelemen A, Sik Lanyi C. Virtual reality gaming in the rehabilitation of the upper extremities post-stroke. Brain Inj 2016;30(7):855-863. [CrossRef] [Medline]
    24. Khademi M, Hondori H, Lopes C, Dodakian L, Cramer S. Haptic augmented reality to monitor human arm's stiffness in rehabilitation. 2012 Presented at: IEEE-EMBS Conference on Biomedical Engineering and Sciences; 2012; Langkawi, Malaysia. [CrossRef]
    25. Mousavi Hondori H, Khademi M, Dodakian L, McKenzie A, Lopes CV, Cramer SC. Choice of Human-Computer Interaction Mode in Stroke Rehabilitation. Neurorehabil Neural Repair 2016 Mar;30(3):258-265 [FREE Full text] [CrossRef] [Medline]
    26. Acosta A, Dewald HA, Dewald JPA. Pilot study to test effectiveness of video game on reaching performance in stroke. J Rehabil Res Dev 2011;48(4):431-444 [FREE Full text] [Medline]
    27. Burke J, McNeill M, Charles D, Morrow P, Crosbie J, McDonough S. Optimising engagement for stroke rehabilitation using serious games. Vis Comput 2009 Aug 27;25(12):1085-1099. [CrossRef]
    28. Pratt J, Krupp B, Morse C, Collins S. The RoboKnee: an exoskeleton for enhancing strength and endurance during walking. 2004 Presented at: IEEE International Conference on Robotics and Automation; 2004; New Orleans, LA, USA, USA. [CrossRef]
    29. Gassert R, Dietz V. Rehabilitation robots for the treatment of sensorimotor deficits: a neurophysiological perspective. J Neuroeng Rehabil 2018 Jun 05;15(1):46 [FREE Full text] [CrossRef] [Medline]
    30. Laver K, Lange B, George S, Deutsch JE, Saposnik G, Crotty M. Virtual reality for stroke rehabilitation. Cochrane Database Syst Rev 2017 Nov 20;11:CD008349 [FREE Full text] [CrossRef] [Medline]
    31. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ 2009 Jul 21;339:b2700 [FREE Full text] [CrossRef] [Medline]
    32. Novak D, Nagle A, Keller U, Riener R. Increasing motivation in robot-aided arm rehabilitation with competitive and cooperative gameplay. J Neuroeng Rehabil 2014 Apr 16;11:64 [FREE Full text] [CrossRef] [Medline]
    33. Ueki S, Kawasaki H, Ito S, Nishimoto Y, Abe M, Aoki T, et al. Development of a Hand-Assist Robot With Multi-Degrees-of-Freedom for Rehabilitation Therapy. IEEE/ASME Trans. Mechatron 2012 Feb 01;17(1):136-146. [CrossRef]
    34. Kan P, Huq R, Hoey J, Goetschalckx R, Mihailidis A. The development of an adaptive upper-limb stroke rehabilitation robotic system. J Neuroeng Rehabil 2011 Jun 16;8:33 [FREE Full text] [CrossRef] [Medline]
    35. Connelly L, Jia Y, Toro ML, Stoykov ME, Kenyon RV, Kamper DG. A pneumatic glove and immersive virtual reality environment for hand rehabilitative training after stroke. IEEE Trans Neural Syst Rehabil Eng 2010 Oct 01;18(5):551-559. [CrossRef] [Medline]
    36. Delbressine F, Timmermans A, Beursgens L, de Jong M, van Dam A, Verweij D, et al. Motivating arm-hand use for stroke patients by serious games. In: Conf Proc IEEE Eng Med Biol Soc. 2012 Presented at: 34th Annual International Conference of the IEEE Engineering in Medicine and Biology Society; 2012; San Diego p. 3564-3567. [CrossRef]
    37. Zhang M, Davies TC, Xie S. Effectiveness of robot-assisted therapy on ankle rehabilitation--a systematic review. J Neuroeng Rehabil 2013 Mar 21;10:30 [FREE Full text] [CrossRef] [Medline]
    38. Buschfort R, Brocke J, Hess A, Werner C, Waldner A, Hesse S. Arm studio to intensify the upper limb rehabilitation after stroke: concept, acceptance, utilization and preliminary clinical results. J Rehabil Med 2010 Apr;42(4):310-314 [FREE Full text] [CrossRef] [Medline]
    39. Comani S, Velluto L, Schinaia L, Cerroni G, Serio A, Buzzelli S, et al. Monitoring Neuro-Motor Recovery From Stroke With High-Resolution EEG, Robotics and Virtual Reality: A Proof of Concept. IEEE Trans Neural Syst Rehabil Eng 2015 Nov;23(6):1106-1116. [CrossRef] [Medline]
    40. da Silva Cameirão M, Bermúdez I Badia S, Duarte E, Verschure PFMJ. Virtual reality based rehabilitation speeds up functional recovery of the upper extremities after stroke: a randomized controlled pilot study in the acute phase of stroke using the rehabilitation gaming system. Restor Neurol Neurosci 2011;29(5):287-298. [CrossRef] [Medline]
    41. Klamroth-Marganska V, Blanco J, Campen K, Curt A, Dietz V, Ettlin T, et al. Three-dimensional, task-specific robot therapy of the arm after stroke: a multicentre, parallel-group randomised trial. Lancet Neurol 2014 Feb;13(2):159-166. [CrossRef] [Medline]
    42. Grimm F, Naros G, Gharabaghi A. Closed-Loop Task Difficulty Adaptation during Virtual Reality Reach-to-Grasp Training Assisted with an Exoskeleton for Stroke Rehabilitation. Front Neurosci 2016;10:518 [FREE Full text] [CrossRef] [Medline]
    43. Gijbels D, Lamers I, Kerkhofs L, Alders G, Knippenberg E, Feys P. The Armeo Spring as training tool to improve upper limb functionality in multiple sclerosis: a pilot study. J Neuroeng Rehabil 2011 Jan 24;8:5 [FREE Full text] [CrossRef] [Medline]
    44. Lambercy O, Dovat L, Yun H, Wee SK, Kuah CWK, Chua KSG, et al. Effects of a robot-assisted training of grasp and pronation/supination in chronic stroke: a pilot study. J Neuroeng Rehabil 2011 Nov 16;8:63 [FREE Full text] [CrossRef] [Medline]
    45. Wolf S, Sahu K, Bay RC, Buchanan S, Reiss A, Linder S, et al. The HAAPI (Home Arm Assistance Progression Initiative) Trial: A Novel Robotics Delivery Approach in Stroke Rehabilitation. Neurorehabil Neural Repair 2015;29(10):958-968 [FREE Full text] [CrossRef] [Medline]
    46. Khor K, Chin PJH, Yeong CF, Su ELM, Narayanan ALT, Abdul Rahman H, et al. Portable and Reconfigurable Wrist Robot Improves Hand Function for Post-Stroke Subjects. IEEE Trans Neural Syst Rehabil Eng 2017 Oct;25(10):1864-1873. [CrossRef] [Medline]
    47. Mirelman A, Patritti BL, Bonato P, Deutsch JE. Effects of virtual reality training on gait biomechanics of individuals post-stroke. Gait Posture 2010 Apr;31(4):433-437. [CrossRef] [Medline]
    48. Forrester L, Roy A, Krebs HI, Macko RF. Ankle training with a robotic device improves hemiparetic gait after a stroke. Neurorehabil Neural Repair 2011 May;25(4):369-377 [FREE Full text] [CrossRef] [Medline]
    49. House G, Burdea G, Polistico K, Roll D, Kim J, Grampurohit N, et al. Integrative rehabilitation of residents chronic post-stroke in skilled nursing facilities: the design and evaluation of the BrightArm Duo. Disabil Rehabil Assist Technol 2016 Nov;11(8):683-694. [CrossRef] [Medline]
    50. Cameirão MS, Badia SBI, Duarte E, Frisoli A, Verschure PFMJ. The combined impact of virtual reality neurorehabilitation and its interfaces on upper extremity functional recovery in patients with chronic stroke. Stroke 2012 Oct;43(10):2720-2728. [CrossRef] [Medline]
    51. Liao W, Wu CY, Hsieh YW, Lin KC, Chang WY. Effects of robot-assisted upper limb rehabilitation on daily function and real-world arm activity in patients with chronic stroke: a randomized controlled trial. Clin Rehabil 2012 Feb;26(2):111-120. [CrossRef] [Medline]
    52. Hsieh Y, Wu CY, Liao WW, Lin KC, Wu KY, Lee CY. Effects of treatment intensity in upper limb robot-assisted therapy for chronic stroke: a pilot randomized controlled trial. Neurorehabil Neural Repair 2011;25(6):503-511. [CrossRef] [Medline]
    53. Zhang H, Austin H, Buchanan S, Herman R, Koeneman J, He J. Feasibility studies of robot-assisted stroke rehabilitation at clinic and home settings using RUPERT. 2011 Presented at: IEEE International Conference on Rehabilitation Robotics; 2011; Zurich, Switzerland p. 5975440. [CrossRef]
    54. Frisoli A, Procopio C, Chisari C, Creatini I, Bonfiglio L, Bergamasco M, et al. Positive effects of robotic exoskeleton training of upper limb reaching movements after stroke. J Neuroeng Rehabil 2012 Jun 09;9:36 [FREE Full text] [CrossRef] [Medline]
    55. Mihelj M, Novak D, Milavec M, Ziherl J, Olenšek A, Munih M. Virtual Rehabilitation Environment Using Principles of Intrinsic Motivation and Game Design. Presence: Teleoperators and Virtual Environments 2012 Feb;21(1):1-15. [CrossRef]
    56. Sivan M, Gallagher J, Makower S, Keeling D, Bhakta B, O'Connor RJ, et al. Home-based Computer Assisted Arm Rehabilitation (hCAAR) robotic device for upper limb exercise after stroke: results of a feasibility study in home setting. J Neuroeng Rehabil 2014 Dec 12;11:163 [FREE Full text] [CrossRef] [Medline]
    57. Amirabdollahian F, Ates S, Basteris A, Cesario A, Buurke J, Hermens H, et al. Design, development and deployment of a hand/wrist exoskeleton for home-based rehabilitation after stroke - SCRIPT project. Robotica 2014 Sep 23;32(8):1331-1346. [CrossRef]
    58. Stein J, Bishop J, Gillen G, Helbok R. A pilot study of robotic-assisted exercise for hand weakness after stroke. In: IEEE Int Conf Rehabil Robot. 2011 Presented at: Rehabilitation Robotics (ICORR), IEEE International Conference on. . IEEE; 2011; Zurich p. 5975426. [CrossRef]
    59. Dovat L, Lambercy O, Salman B, Johnson V, Milner T, Gassert R, et al. A technique to train finger coordination and independence after stroke. Disabil Rehabil Assist Technol 2010 Jul;5(4):279-287. [CrossRef] [Medline]
    60. Merians A, Fluet GG, Qiu Q, Saleh S, Lafond I, Adamovich SV. Integrated arm and hand training using adaptive robotics and virtual reality simulations. In: 8th Annual International Conference on Dissability, Virtual Reality and Associated Technologies. 2010 Presented at: the International Conference on Disability, Virtual Reality and Associated Technology; 2010; Chile.
    61. Simkins M, Fedulow I, Kim H, Abrams G, Byl N, Rosen J. Robotic Rehabilitation Game Design for Chronic Stroke. Games Health J 2012 Dec;1(6):422-430. [CrossRef] [Medline]
    62. Stein J, Bishop J, Gillen G, Helbok R. A pilot study of robotic-assisted exercise for hand weakness after stroke. In: IEEE Int Conf Rehabil Robot. 2011 Presented at: IEEE International Conference on Rehabilitation Robotics; 2011; Zurich, Switzerland p. 5975426. [CrossRef]
    63. Forrester L, Roy A, Krebs HI, Macko RF. Ankle training with a robotic device improves hemiparetic gait after a stroke. Neurorehabil Neural Repair 2011 May;25(4):369-377 [FREE Full text] [CrossRef] [Medline]
    64. Zimmerli L, Jacky M, Lünenburger L, Riener R, Bolliger M. Increasing patient engagement during virtual reality-based motor rehabilitation. Arch Phys Med Rehabil 2013 Sep;94(9):1737-1746. [CrossRef] [Medline]
    65. Brütsch K, Koenig A, Zimmerli L, Mérillat-Koeneke S, Riener R, Jäncke L, et al. Virtual reality for enhancement of robot-assisted gait training in children with central gait disorders. J Rehabil Med 2011 May;43(6):493-499 [FREE Full text] [CrossRef] [Medline]


    Abbreviations

    2D: two-dimensional
    3D: three-dimensional
    AHA: American Heart Association
    AR: augmented reality
    CMSA: Chedoke-McMaster Stroke Assessment
    DOF: degrees of freedom
    FMA: Fugl-Meyer Motor Assessment
    HCI: human-computer interaction
    HMD: head-mounted display
    HMP: Hand Mentor Pro
    MAS: Modified Ashworth Scale
    MRC: Medical Research Council
    PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses
    RARS: Rutgers Ankle Rehabilitation System
    RCT: randomized controlled trial
    RUPERT: Robotic Upper Extremity Repetitive Trainer
    USN: Unilateral Spatial Neglect
    VR: virtual reality
    WMFT: Wolf Motor Function Test


    Edited by G Eysenbach; submitted 22.08.18; peer-reviewed by Anonymous, B Birckhead; comments to author 12.10.18; revised version received 09.12.18; accepted 18.07.19; published 08.09.19

    ©Omar Mubin, Fady Alnajjar, Nalini Jishtu, Belal Alsinglawi, Abdullah Al Mahmud. Originally published in JMIR Rehabilitation and Assistive Technology (http://rehab.jmir.org), 23.09.2019

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Rehabilitation and Assistive Technology, is properly cited. The complete bibliographic information, a link to the original publication on http://rehab.jmir.org/, as well as this copyright and license information must be included.