Published on 12.11.18 in Vol 5, No 2 (2018): Jul-Dec
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/10099, first published Feb 12, 2018.
Patient-Reported Outcome of Physical Therapy in Amyotrophic Lateral Sclerosis: Observational Online Study
Background: Physical therapy is an essential component of multidisciplinary treatment in amyotrophic lateral sclerosis (ALS). However, the meaning of physical therapy beside preservation of muscular strength and functional maintenance is not fully understood.
Objective: The purpose of this study was to examine patients’ perception of physical therapy during symptom progression using an internet assessment approach.
Methods: A prospective, longitudinal, observational study was performed. Recruitment took place in an ALS center in Berlin, Germany. Online self-assessment was established on a case management platform over 6 months. Participants self-assessed the progression of the disease with the ALS Functional Rating Scale-Revised (ALSFRS-R) and tracked the efficacy of targeted physical therapy using Measure Yourself Medical Outcome Profile (MYMOP). We used the net promoter score (NPS) to inquire into recommendation levels of physical therapy.
Results: Forty-five participants with ALS were included in the study. Twenty-seven (60.0%) started the online assessment. The mean duration of physical therapy sessions per week was 142.7 minutes (SD 60.4) with a mean frequency of 2.9 (SD 1.2) per week. As defined by MYMOP input, the most concerning symptoms were reported in the legs (62.2%), arms (31.1%), and less frequently in the torso (6.7%). As expected for a progressive disease, there was a functional decline of 3 points in the ALSFRS-R at the end of the observation period (n=20). Furthermore, the MYMOP showed a significant loss of 0.8 in the composite score, 0.9 in the activity score and 0.8 in the targeted symptom. In spite of functional decline, the recommendation for physical therapy jumped from a baseline value of 20 NPS points to a very high 50 points at the end of study (P=.05).
Conclusions: Physical therapy is perceived as an important treatment method by patients with ALS. Despite functional deterioration, patients are satisfied with physical therapy and recommend this intervention. The results also underline how the meaning of physical therapy changes throughout the disease. Physical therapy in ALS has to be regarded as a supportive and palliative health care intervention beyond functional outcome parameters.
JMIR Rehabil Assist Technol 2018;5(2):e10099
- amyotrophic lateral sclerosis;
- physical therapy;
- net promoter score;
- online self-assessment
Amyotrophic lateral sclerosis (ALS) is a fatal neurodegenerative disease. The disease is characterized by a loss of motor neurons in the cortex, brain stem, and spinal cord resulting in progressive motor deficits and paralysis of the muscles that control limb movement, swallowing, and breathing . As the disease progresses, muscles responsible for fine and gross motor functions are affected, leading to a decline in motor skills. As there is no current curative treatment for ALS, managing these complex symptoms depends on multidisciplinary care. Symptomatic, rehabilitative, and palliative therapy are typically delivered by a multiprofessional team that consists of neurologists, nurses, and therapists working in a coordinated and organized manner [ ]. An important part of this multidisciplinary treatment is physical therapy, which is widely prescribed and applied in the treatment of ALS. A European survey has shown that 83% of ALS patients receive physical therapy [ ]. Physiotherapists play an essential role on the multidisciplinary care team as they emphasize improving the function and quality of life in patients who require physical and functional dimensions of palliative care [ ].
Experimental data [- ] and several randomized clinical trials showed moderate effects and benefits of submaximal resistive exercises, especially in the early stages of the disease [ , ]. The neuromuscular mechanism was thought to prevent disuse atrophy and more efficient motor unit recruitment. Excessive or high resistance exercises have been associated with overwork damage and thus are not recommended in ALS treatment [ ]. The key focus for physical therapists is to delay the decline of muscular strength by submaximal resistance exercise, which has been shown to be safe and efficacious. Additionally, because pain and spasticity worsen the burden of ALS, physical therapy also addresses these symptoms. Along with other service providers, physical therapists support the provision and adjustment of adaptive equipment and mobility aids [ ]. However, there is still uncertainty about best practices concerning the manner, duration, and frequency of physical therapy. This lack of defined treatment guidelines arises from the large clinical heterogeneity of ALS syndromes, the different therapeutic approaches, and the individual expectations of patients and therapists.
Thus, this study aimed to:
- Evaluate the frequency and duration of physical therapy sessions among ALS patients
- Determine the most bothersome motor symptoms
- Identify recommendation levels for physical therapy and the Net Promoter Score (NPS) at the beginning and end of the study
We investigated the recommendation of physical therapy to symptom progression in ALS. Furthermore, we explored whether the recommendation of physical therapy is related to the most concerning motor symptom, disease severity, duration, or the frequency of physical therapy sessions for ALS patients.
Study Design and Recruitment
This was a prospective, longitudinal, observational study that recruited a consecutive cohort of participants from the ALS outpatient department at Charité-Universitätsmedizin Berlin, Germany. A baseline assessment of epidemiological data, symptoms, type and amount of physical therapy was performed with 45 individuals, 20 of whom completed online surveys over a 6-months period, tracking symptom severity, restriction of activity, and recommendation for physical therapy.
The digital and internet-supported case management network Ambulanzpartner Soziotechnologie (APST) was used for online self-assessment and evaluation of physical therapy . APST encompasses the services of case management coordinators, a tailored digital management platform and assessment tools for self-evaluation, services, therapy and assistive devices [ ]. Patients and their caregivers were granted access to the APST platform through personalized accounts.
Inclusion criteria for this study involved a possible, probable or definitive diagnosis of ALS following the revised El Escorial criteria , a stage of a disease where at least one motor function was restricted, and participation in physical therapy. Patients with other severe life-limiting diseases or who showed clinically significant cognitive impairment were not eligible for this trial. For online assessment, participants used the digital case management program provided by APST [ ].
Variables and Data Sources
Physical therapy was prescribed by a neurologist specializing in ALS and undertaken by physical therapists trained in the treatment of neurological disorders including ALS. In addition to physical therapy, patients received special treatments such as massages, lymphatic drainage, thermal treatment, and breathing therapy if needed. The overall time and frequency of individual physical therapy sessions per week were documented, as were additional special treatments.
Amyotrophic Lateral Sclerosis Functional Rating Scale-Revised
We evaluated the functional impairment of participants using the ALS Functional Rating Scale-Revised (ALSFRS-R), through online self-assessment . This scale is a validated and widely used instrument that gauges the fine and gross motor functions of the arms and legs, bulbar functions, and breathing abilities. It comprises 12 short, clear questions with 5 anchor points (0-4) for response options. Hence, the total range of the scale spans 0 to 48 points, with fewer points representing poorer functioning and higher disease severity. The loss of ALSFRS-R value per month, or delta ALSFRS-R, indicates the rate of deterioration and predicts survival [ ].
Measure Yourself Medical Outcome Profile
To focus on specific bothersome or disabling motor symptoms we employed the Measure Yourself Medical Outcome Profile (MYMOP) [, ]. This instrument has not been used in patients with ALS before but has been suggested as an individualized patient-reported outcome measure in primary care physical therapy [ ]. The MYMOP is a brief, patient-generated, problem-specific questionnaire, which requires participants to specify a symptom that concerns them most. Subsequently, participants evaluate the severity of this symptom on a 7-point Likert scale (eg, weakness of the right leg could score 0 for “as good as it could be” to 6 for “as bad as it could be”) as compared to the previous week. The second part of the survey uses the same scale to assess whether the symptom is limiting or preventing a daily activity or movement, such as walking. Participants also rate general well-being. Follow-up questionnaires address the original concerns. All domains (symptom severity, restriction of activity, and well-being) can be analyzed individually or as a total score, the profile score, that equals the mean of the subscores recorded (score 0-6).
Net Promoter Score
To evaluate the overall recommendation of physical therapy, we used a numeric rating scale (NRS) that derives from the Net Promoter Score (NPS) [, ], which is used in customer relation management and has recently been introduced to clinical assessment [ , ]. The NPS is an easy-to-use, one-item questionnaire that is based on the question “How likely is it, that you would recommend the service to a friend or colleague?” Participants were asked to score on a 0 to 10 NRS, with 10 being extremely likely to recommend the therapy. The percentage of participants whose response was between 0-6 was subtracted from the percentage of those whose scores were 9-10 ( ) to calculate the NPS. Participants with the values 7 and 8 were assumed to be indifferent or passive. Therefore, the NPS can be as low as –100 if everybody is a detractor, or as high as +100 if everybody is a promoter. A positive NPS is regarded as good, and an NPS of more than 50 is considered excellent. Alternatively, to avoid problems of NPS categorization, it is possible to refrain from calculating the NPS and only report the average NRS which reflects the recommendation [ ].
Data were analyzed with IBM SPSS Statistics (Version 24.0) for Microsoft Windows. Results were expressed as mean (SD) if normally distributed and medians (maximum/minimum) if the distribution was non-Gaussian. Correlational analysis was performed with the Spearman rho (ρ) because of the ordinal nature of the scales. A statistically significant difference of paired samples was analyzed with a t test. The recommendation was tested with the Wilcoxon test for related samples. A P value of <.05 (two-tailed) was considered significant. Due to the observational design of the study, the data has not been adjusted for multiple comparisons.
Protocol Approvals and Registrations
The study protocol was approved by the Medical Ethics Committee of the Charité-Universitätsmedizin Berlin, Germany. A data safety and monitoring board supervised the study. Signed patient information and informed consent forms were obtained from all participating patients.
Forty-five participants were included in this study and performed the baseline assessment. Sixty percent (27/45) also consented to online assessment through MYMOP and the recommendation of physical therapy for 20 weeks. Twenty of the 45 (44%) participants finished the 20-week online assessment providing complete data sets ().
The mean age of all participants at baseline was 59.2 years (SD 10.6) with a relatively long disease duration of 27 months (median min/max 3/203) due to a higher percentage of long-term survivors in our trial. The mean duration of physical therapy was 142.7 minutes per week (SD 60.4) and mean frequency was 2.9 sessions per week (SD 1.2). Occupational therapy and speech and language therapy are not included in these values. The demographics and baseline characteristics of the participants are presented in.
|Characteristic||All patients, (N=45)||Online patients, (n=27)||Online patients-dropouts, (n=7)||Online patients-no dropouts, (n=20)|
|Age (years), mean (SD)||59.2 (10.6)||59.4 (11.1)||58.0 (5.6)||59.9 (12.5)|
|Gender, n (%)|
|Female||16 (36)||7 (35)||3 (43)||4 (20)|
|Male||29 (64)||20 (65)||4 (57)||16 (80)|
|ALSFRS-Ra baseline, mean (SD)||36.9 (6.9)||38.5 (4.8)||36.1 (5.0)||39.4 (1.0)|
|Delta ALSFRS-Rb, mean (SD)||0.57 (0.51)||0.61 (0.57)||0.86 (0.27)||0.53 (0.11)|
|Disease duration (months), median (min/max)||27.0 (3/203)||25.0 (3/194)||16.0 (9/87)||26.5 (3/195)|
|Total MYMOPc baseline, mean (SD)||3.0 (0.9)||3.0 (0.9)||3.1 (1.1)||2.9 (0.9)|
|PTd time per week (minutes), mean (SD)||142.7 (60.4)||151.1 (63.5)||157.1 (70.4)||149.0 (62.7)|
|Overall time prescribed (minutes), mean (SD)||269.3 (138.6)||263.6 (110.7)||216.6 (58.5)||280.1 (120.7)|
|PT frequency per week, mean (SD)||2.9 (1.2)||2.9 (1.2)||2.9 (1.5)||3.0 (1.2)|
aALSFRS-R: Amyotrophic Lateral Sclerosis Functional Rating Scale-Revised.
bLoss of ALSFRS-R points per month.
cMYMOP: Measure Yourself Medical Outcome Profile.
dPT: physical therapy.
The Duration and Frequency of Physical Therapy
There was no significant difference between prescribed physical therapy time and session frequency in the different baseline cohorts. Given the fact that a regular physical therapy unit lasts between 45 to 60 minutes and patients receive 3 units per week, the mean duration of therapy sessions amounts to 2 and a half to 3 hours per week. Interestingly, an additional 2 hours per week were granted for special treatments. Only online participants who completed the study prematurely received fewer special treatment time of just 1 hour per week. However, this did not reach statistical significance (P=.19).
Disease Progression and Functional Impairment
The ALSFRS-R at baseline was comparable with other trials, but the ALS progression rate was 0.57 (SD 0.4), which is lower than in an average ALS population where the loss is usually 0.8 to 0.9 of a point . In the online cohort, the constant decline in motor function was represented by an expected significant decline in the total ALSFRS-R from 39.4 to 36.4 (P=.05).
The 18/45 (40%) patients who did not participate in the online assessment showed a significantly more advanced stage of the disease compared to those who attended (ALSFRS-R: 34.4 versus 38.5, P=.05). Seven of 45 (16%) participants withdrew from the online survey after 7.7 weeks (SD 5.8). Among these participants a higher proportion was female (43% versus 20%) and tended to be more affected (ALSFRS-R: 36.1 versus 39.4, P=.13) with a higher rate of progression (delta ALSFRS-R: 0.72 versus 0.53, P=.19).
The Most Bothersome Symptom, Activity, and Well-Being
Based on the initial MYMOP questionnaire, 62% (28/45) of participants defined symptoms in the legs as most bothersome, while 31% (14/45) cited restrictions in their arms as the most important issue. Three of the 45 participants (7%) named axial symptoms like torso weakness as the dominating symptom ().
The total MYMOP of all cohorts at baseline was similar between 2.9 and 3.1. The profile score of MYMOP at baseline of 3.0 (SD 0.9, N=45) did not significantly correlate with the total ALSFRS-R at baseline (r=.27, P=.17). Whereas the correlation of the MYMOP with the according ALSFRS-R subscore related to functional loss of arms and legs was significant (r=.45, P=.003). However, the highest correlation was seen between the ALSFRS-R lower extremities subscore and the MYMOP symptom assessment subscore (r=.62, P<.001). This correlation was reproducible throughout the trial.
In the online cohort (n=20,) the profile score of MYMOP increased from 2.9 to 3.7 (P=.005). The MYMOP subscores for activity increased from 3.1 to 4.0 (P=.02). The burden of the target symptom increased from 3.1 to 3.9 (P=.02). The well-being subscore displayed a strong trend towards poorer well-being after 20 weeks (from 2.6 to 3.2) but without statistical significance (P=.08).
The 7/27 (26%) online participants who withdrew initially showed a poorer well-being subscore in the MYMOP as compared to participants who finished the assessment (3.4 versus 2.6, P=.08).
|Outcome parameter||Baseline, mean (SD)||Week 20, mean (SD)||P valuea|
|ALSFRS-Rb||39.4 (1.0)||36.4 (1.3)||<.001|
|MYMOPc, profile||2.9 (0.2)||3.7 (0.2)||.005|
|MYMOP, well-being||2.6 (0.3)||3.2 (0.3)||.08|
|MYMOP, activity||3.1 (0.2)||4.0 (0.3)||.02|
|MYMOP, symptom||3.1 (0.2)||3.9 (0.3)||.02|
|Recommendation||7.6 (0.4)||8.6 (0.3)||.02|
aWilcoxon test for related samples.
bALSFRS-R: Amyotrophic Lateral Sclerosis Functional Rating Scale-Revised.
cMYMOP: Measure Yourself Medical Outcome Profile.
dNPS: Net Promotor Score.
Recommendation Levels for Physical Therapy
The total value of the recommendation of physical therapy went from 7.6 to 8.6 (P=.02,). In the 7/45 (16%) withdrawing participants, we could see a not statistically significant decrease of recommendation based on the last assessment before withdrawal: 7.4 (SD 2.2) versus 7.0 (SD 3.5).
The recommendation was not influenced by the factors (1) age, (2) gender, (3) amount of physical therapy, (4) location of the most concerning symptom, (5) degree of functional impairment, and (6) well-being or activity (data not shown). Based on the recommendation we calculated the NPS, which increased from 20 at the beginning to 50 at the end of the observation interval ().
This study aimed to determine patients’ perception of physical therapy during disease progression. To our knowledge, there are few systematic reports about the extent to which physical therapy is applied to ALS patients. Baseline assessment of this study revealed a mean duration of 269.3 minutes of prescribed physical therapy including special treatments and a mean frequency of three units per week. Our data did not show a significant correlation between the recommendation of physical therapy and the extent (duration and frequency) of its application.
The ALS progression, measured by the ALSFRS-R, was complimented by the MYMOP in order to show the effect of motor decline on the perception of physical therapy. The correlation between MYMOP and the motor domain of the ALSFRS-R was strong, although this score is unable to measure new or coexisting problems and concerns. The patient-centered assessment was unable to measure other perceived benefits, like the social and psychological meanings of physical therapy.
However, the studies found no evidence that declines in well-being, motor function, or levels of activity significantly degrade the overall recommendation of physical therapy. Remarkably, throughout the study, the rating of physical therapy improved in the majority of participants despite the functional decline. As shown by the NPS rating of 20 in the first online assessment, we found strong satisfaction with physical therapy. By week 20 the NPS value reached a value of 50, which is considered to be excellent and shows a high acceptance of physical therapy within the studied cohort.
Our findings must be considered in the context of their limitations. Out of all 45 participants, male patients were overrepresented in comparison to the general ALS population. This inadequacy was exacerbated in the online cohort, which we also have observed in previous online assessment trials. To reduce this bias, we attempted to recruit participants offline. However, women were more likely to terminate the assessment early. The 7 participants who discontinued online-assessment showed a trend towards faster progression, lower well-being and lower recommendation of physical therapy. Presumably, more aggressive disease progression might be a reason for dropping out, as might discontent with physical therapy. Measuring satisfaction using online self-assessment can be challenging. The NPS enables patients to rate physical therapy from the perspective of their own experience. At the same time, it is a 1-dimensional questionnaire and therefore assumed to be less reliable and more volatile than a composite index. In future studies, multidimensional or open designs should be considered to explore patients’ perspectives towards physical therapy in greater depth.
Further limitations in the study were the single center recruitment and the small sample size. Therefore, generalizations must be made with caution. Our cohort was representative of the ALS population regarding mean age and ALSFRS-R, but the participants showed a longer mean disease duration. The progression rate of 0.52 (SD 0.4) is lower than in an average ALS population, which is because a wider range of disease progression was represented as compared to homogenized populations within pharmaceutical trials. We can imagine that long-time survivors and patients whose diseases are progressing slowly will have a certain and eventually more positive attitude towards physical therapy, even though the effect of therapy on motor function might be considered more relevant in the early stages of the disease. Finally, our population was seen at a specialist center supported by a case management platform. Furthermore, it is located in an advanced country with a universal multi-payer health system where costs for physical therapy are covered mostly by compulsory health insurances. Consequently, our findings may not be broadly applicable to other populations.
The overall positive assessment of physical therapy cannot be fully explained with the established rehabilitative concept of physical therapy. Our data suggest physical therapy plays an important role in a palliative context, where therapy and presumably the therapist hold considerable meaning for the patient. Physical therapists serving as interdisciplinary team members in palliative settings provide care for patients that extend beyond physical and bodily aims. Embracing this concept could entail shifting priorities across a disease continuum, and changing the perception of physical therapists as well as other allied health specialists . Palliative and multidisciplinary approaches should be encouraged during the education, training, and qualification of physical therapists to implement the changing perceptions of physical therapy.
This work was supported by the Joint Program-Neurodegenerative Disease Research (JPND 01ED1402A). The project was supported through the following funding organizations under the aegis of JPND: (1) Agency for Innovation by Science and Technology and Research Foundation, Flanders region, (2) Bundesministerium für Bildung und Forschung (BMBF), Germany, (3) Economic and Social Research Council, United Kingdom, (4) Health Research Board, Ireland, (5) Ministry of Health and Ministry of Education, Universities and Research, Italy, and (6) The Netherlands Organization for Health Research and Development, The Netherlands. The authors wish to thank Hilfe für ALS-kranke Menschen, Angelika-von-Hagen-Fonds für Palliativmedizin bei der ALS and Bremer ALS Stiftung for funding and continuous support. We acknowledge support from the German Research Foundation (DFG) and the Open Access Publication Fund of Charité-Universitätsmedizin Berlin.
Conflicts of Interest
TM received consultancy fees from Cytokinetics, GSK, and Desitin Arzneimittel GmbH and served on scientific advisory boards for Cytokinetics, GSK, and TEVA. TM and CM are founders of the internet platform Ambulanzpartner and hold shares of Ambulanzpartner Soziotechnologie APST GmbH.
- Francis K, Bach JR, DeLisa JA. Evaluation and rehabilitation of patients with adult motor neuron disease. Arch Phys Med Rehabil 1999 Aug;80(8):951-963. [Medline]
- Ng L, Khan F, Mathers S. Multidisciplinary care for adults with amyotrophic lateral sclerosis or motor neuron disease. Cochrane Database Syst Rev 2009 Oct 07(4):CD007425. [CrossRef] [Medline]
- Borasio GD, Shaw PJ, Hardiman O, Ludolph AC, Sales LML, Silani V, European ALS Study Group. Standards of palliative care for patients with amyotrophic lateral sclerosis: results of a European survey. Amyotroph Lateral Scler Other Motor Neuron Disord 2001 Sep;2(3):159-164. [Medline]
- Egan KA, Abbott P. Interdisciplinary Team Training. Journal of Hospice & Palliative Nursing 2002;4(3):161-171. [CrossRef]
- Carreras I, Yuruker S, Aytan N, Hossain L, Choi J, Jenkins BG, et al. Moderate exercise delays the motor performance decline in a transgenic model of ALS. Brain Res 2010 Feb 08;1313:192-201 [FREE Full text] [CrossRef] [Medline]
- Kirkinezos IG, Hernandez D, Bradley WG, Moraes CT. Regular exercise is beneficial to a mouse model of amyotrophic lateral sclerosis. Ann Neurol 2003 Jun;53(6):804-807. [CrossRef] [Medline]
- Veldink JH, Bär PR, Joosten EAJ, Otten M, Wokke JHJ, van den Berg LH. Sexual differences in onset of disease and response to exercise in a transgenic model of ALS. Neuromuscul Disord 2003 Nov;13(9):737-743. [Medline]
- Dal Bello-Haas V, Florence JM. Therapeutic exercise for people with amyotrophic lateral sclerosis or motor neuron disease. Cochrane Database Syst Rev 2013 May 31(5):CD005229. [CrossRef] [Medline]
- Drory VE, Goltsman E, Reznik JG, Mosek A, Korczyn AD. The value of muscle exercise in patients with amyotrophic lateral sclerosis. J Neurol Sci 2001 Oct 15;191(1-2):133-137. [Medline]
- Majmudar S, Wu J, Paganoni S. Rehabilitation in amyotrophic lateral sclerosis: why it matters. Muscle Nerve 2014 Jul;50(1):4-13 [FREE Full text] [CrossRef] [Medline]
- Ambulanzpartner Soziotechnologie APST GmbH. 2018. digital and internet-supported case management network URL: https://www.ambulanzpartner.de/ [accessed 2018-02-10] [WebCite Cache]
- Funke A, Spittel S, Grehl T, Grosskreutz J, Kettemann D, Petri S, et al. Provision of assistive technology devices among people with ALS in Germany: a platform-case management approach. Amyotroph Lateral Scler Frontotemporal Degener 2018 Aug;19(5-6):342-350. [CrossRef] [Medline]
- Brooks BR. El Escorial World Federation of Neurology criteria for the diagnosis of amyotrophic lateral sclerosis. Subcommittee on Motor Neuron Diseases/Amyotrophic Lateral Sclerosis of the World Federation of Neurology Research Group on Neuromuscular Diseases and the El Escorial “Clinical limits of amyotrophic lateral sclerosis” workshop contributors. J Neurol Sci 1994 Jul;124 Suppl:96-107. [Medline]
- Maier A, Holm T, Wicks P, Steinfurth L, Linke P, Münch C, et al. Online assessment of ALS functional rating scale compares well to in-clinic evaluation: a prospective trial. Amyotroph Lateral Scler 2012 Feb;13(2):210-216 [FREE Full text] [CrossRef] [Medline]
- Kimura F, Fujimura C, Ishida S, Nakajima H, Furutama D, Uehara H, et al. Progression rate of ALSFRS-R at time of diagnosis predicts survival time in ALS. Neurology 2006 Jan 24;66(2):265-267. [CrossRef] [Medline]
- Paterson C. Seeking the patient's perspective: a qualitative assessment of EuroQol, COOP-WONCA charts and MYMOP. Qual Life Res 2004 Jun;13(5):871-881. [CrossRef] [Medline]
- Hermann K, Kraus K, Herrmann K, Joos S. A brief patient-reported outcome instrument for primary care: German translation and validation of the Measure Yourself Medical Outcome Profile (MYMOP). Health Qual Life Outcomes 2014 Jul 19;12:112 [FREE Full text] [CrossRef] [Medline]
- Kyte DG, Calvert M, van der Wees PJ, ten Hove R, Tolan S, Hill JC. An introduction to patient-reported outcome measures (PROMs) in physiotherapy. Physiotherapy 2015 Jun;101(2):119-125 [FREE Full text] [CrossRef] [Medline]
- Reichheld F. The Ultimate Question 2.0: How Net Promoter Companies Thrive in a Customer-Driven World. The Ultimate Question: Harvard Business Review Press; 2011.
- Krol MW, de Boer D, Delnoij DM, Rademakers JJDJM. The Net Promoter Score--an asset to patient experience surveys? Health Expect 2015 Dec;18(6):3099-3109 [FREE Full text] [CrossRef] [Medline]
- Stein N, Brooks K. A Fully Automated Conversational Artificial Intelligence for Weight Loss: Longitudinal Observational Study Among Overweight and Obese Adults. JMIR Diabetes 2017 Nov 01;2(2):e28. [CrossRef]
- Hamilton DF, Lane JV, Gaston P, Patton JT, Macdonald DJ, Simpson AHRW, et al. Assessing treatment outcomes using a single question: the net promoter score. Bone Joint J 2014 May;96-B(5):622-628. [CrossRef] [Medline]
- Kollewe K, Mauss U, Krampfl K, Petri S, Dengler R, Mohammadi B. ALSFRS-R score and its ratio: a useful predictor for ALS-progression. J Neurol Sci 2008 Dec 15;275(1-2):69-73. [CrossRef] [Medline]
- Wilson CM, Stiller CH, Doherty DJ, Thompson KA. The Role of Physical Therapists Within Hospice and Palliative Care in the United States and Canada. Am J Hosp Palliat Care 2017 Feb;34(1):34-41. [CrossRef] [Medline]
|ALS: amyotrophic lateral sclerosis|
|ALSFRS-R: Amyotrophic Lateral Sclerosis Functional Rating Scale-Revised|
|APST: Ambulanzpartner Soziotechnologie APST GmbH|
|MYMOP: Measure Yourself Medical Outcome Profile|
|NPS: Net Promoter Score|
|NRS: numeric rating scale|
|PT: physical therapy|
Edited by G Eysenbach; submitted 12.02.18; peer-reviewed by P Wicks, S Petri; comments to author 03.08.18; revised version received 28.09.18; accepted 01.10.18; published 12.11.18
©Robert Meyer, Susanne Spittel, Laura Steinfurth, Andreas Funke, Dagmar Kettemann, Christoph Münch, Thomas Meyer, André Maier. Originally published in JMIR Rehabilitation and Assistive Technology (http://rehab.jmir.org), 12.11.2018.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Rehabilitation and Assistive Technology, is properly cited. The complete bibliographic information, a link to the original publication on http://rehab.jmir.org/, as well as this copyright and license information must be included.