Published on in Vol 2, No 1 (2015): Jan-Jun

Measurement and Data Transmission Validity of a Multi-Biosensor System for Real-Time Remote Exercise Monitoring Among Cardiac Patients

Measurement and Data Transmission Validity of a Multi-Biosensor System for Real-Time Remote Exercise Monitoring Among Cardiac Patients

Measurement and Data Transmission Validity of a Multi-Biosensor System for Real-Time Remote Exercise Monitoring Among Cardiac Patients

Original Paper

1National Institute for Health Innovation, University of Auckland, Auckland, New Zealand

2Department of Sport and Exercise Science, University of Auckland, Auckland, New Zealand

3Department of Computer Science, University of Auckland, Auckland, New Zealand

4Department of Medicine, University of Auckland, Auckland, New Zealand

Corresponding Author:

Jonathan C Rawstorn, BSc (Hons)

Department of Sport and Exercise Science

University of Auckland

Private Bag 92019

Auckland, 1142

New Zealand

Phone: 64 9 373 7599 ext 84498

Fax:64 9 373 7043

Email: j.rawstorn@auckland.ac.nz


Background: Remote telemonitoring holds great potential to augment management of patients with coronary heart disease (CHD) and atrial fibrillation (AF) by enabling regular physiological monitoring during physical activity. Remote physiological monitoring may improve home and community exercise-based cardiac rehabilitation (exCR) programs and could improve assessment of the impact and management of pharmacological interventions for heart rate control in individuals with AF.

Objective: Our aim was to evaluate the measurement validity and data transmission reliability of a remote telemonitoring system comprising a wireless multi-parameter physiological sensor, custom mobile app, and middleware platform, among individuals in sinus rhythm and AF.

Methods: Participants in sinus rhythm and with AF undertook simulated daily activities, low, moderate, and/or high intensity exercise. Remote monitoring system heart rate and respiratory rate were compared to reference measures (12-lead ECG and indirect calorimeter). Wireless data transmission loss was calculated between the sensor, mobile app, and remote Internet server.

Results: Median heart rate (-0.30 to 1.10 b∙min-1) and respiratory rate (-1.25 to 0.39 br∙min-1) measurement biases were small, yet statistically significant (all P≤.003) due to the large number of observations. Measurement reliability was generally excellent (rho=.87-.97, all P<.001; intraclass correlation coefficient [ICC]=.94-.98, all P<.001; coefficient of variation [CV]=2.24-7.94%), although respiratory rate measurement reliability was poor among AF participants (rho=.43, P<.001; ICC=.55, P<.001; CV=16.61%). Data loss was minimal (<5%) when all system components were active; however, instability of the network hosting the remote data capture server resulted in data loss at the remote Internet server during some trials.

Conclusions: System validity was sufficient for remote monitoring of heart and respiratory rates across a range of exercise intensities. Remote exercise monitoring has potential to augment current exCR and heart rate control management approaches by enabling the provision of individually tailored care to individuals outside traditional clinical environments.

JMIR Rehabil Assist Technol 2015;2(1):e2

doi:10.2196/rehab.3633

Keywords



Cardiovascular diseases remain the leading cause of morbidity and mortality worldwide, accounting for around one third (approximately 17 million) of deaths globally, with the greatest proportion of deaths attributed to coronary heart disease (CHD) [1]. Cardiac rehabilitation (CR) is an essential component of CHD management [2,3], and international guidelines consistently identify exercise training as a central element of CR [4-6]. The beneficial effects of exercise-based CR (exCR) on all-cause and cardiac mortality are comparable with comprehensive CR [7-10], and exercise training can concurrently improve an array of modifiable cardiac risk factors including hypertension, dyslipidemia, insulin resistance, overweight and obesity, and exercise capacity [10-15]. Despite these benefits, many eligible patients are not referred for CR [16], and uptake is low among those who are referred [17,18]. Common participation barriers include transport limitations, work commitments, and inconvenient program scheduling [19]. Among those who do undertake CR, adherence to prescribed exercise is poor with up to 50% of participants dropping out of regular exercise within 6 months of program completion [20-22]. It is clear traditional CR delivery models do not meet the needs of many eligible patients, and innovation is required to enhance participation and adherence.

Home-based exCR has been introduced to broaden access and participation and confers similar improvements in mortality, cardiac events, and cardiac risk factors compared to center-based CR [23]. Home-based programs overcome several traditional participation barriers, but many do not include physiological monitoring that is typical during center-based exCR. In addition to concerns about patient safety, a lack of physiological monitoring also restricts the potential to individualize and optimally manage exercise prescription. As the beneficial effects of exCR are dose-dependent [11,24,25], remote physiological monitoring may help home-based exCR participants to achieve recommended exercise training loads and improve program outcomes.

Physiological monitoring has recently been identified as a particularly important direction for the future development of home-based exCR [26], but to date, most telehealth CR interventions have utilized fixed-line communication tools (eg, telephone, Internet, videoconferencing, transtelephonic electrocardiogram [ECG]) that constrain participants within the home environment. Recent advances in mobile sensor technologies and rapidly growing access to mobile broadband [27] enable real-time remote physiological monitoring outside fixed-line communication networks, and these technologies should be integrated into telehealth CR [28].

A survey of wearable physiological monitoring devices identified several key requirements including measurement validity, data transmission integrity, real-time data processing, ease of use, and scalability [29]. While few existing monitoring systems addressed all requirements the commercially available BioHarness (Zephyr Technology) scored highly [29]. This multi-parameter wireless biosensor quantifies heart rate, single lead ECG, respiratory rate, tri-axial body acceleration, and torso posture via sensors embedded in a textile chest strap or compression-fit vest. On-board memory and Bluetooth connectivity enable data to be stored locally or transmitted wirelessly to compatible devices such as smartphones, tablets, and computers. The low-profile design, ease of use, and advanced array of sensors make this device well suited for remote exercise monitoring. Early model BioHarness devices have been validated [30-35]; however, the current model has yet to be evaluated in either clinical or non-clinical populations.

Most wearable physiological sensors do not support long-range data transmission to remotely located monitoring stations. Therefore, remote monitoring requires physiological sensors to be combined with devices capable of collating and transmitting sensor data to remote monitoring stations for review and action by health care professionals. Smartphones are a preferable intermediary as, in combination with appropriate mobile or Web apps, they provide a ready-to-use mobile platform capable of logging and transmitting data via ubiquitous wireless data networks (eg, Bluetooth, Wi-Fi, 3G, and 4G). Portability, compatibility with several data networks, substantial computational capability, and routine integration of motion and location sensors further enhance the potential utility of smartphones for remote exercise monitoring. Moreover, continued rapid global smartphone market penetration growth [36] will likely reduce the necessity for health care providers to supply smartphones to would-be remote monitoring system end users. To date, there is a lack of published research combining physiological sensors with mobile data transmission technologies. A system comprising ECG and global positioning system (GPS) sensors, and a smartphone has been evaluated for remotely monitoring cardiac patients during exercise [37]. Remote data transmission was interrupted during 8.6% of completed exercise sessions; however, the amount of data lost and the subsequent impact on real-time remote monitoring were not described.

We have developed a custom mobile app and middleware platform to provide real-time transmission of physiological and clinical data, via smartphones, to remotely located monitoring centers [38]. Bi-directional communication capability enables health care professionals to provide users with instantaneous feedback that could prompt rapid changes in exercise behavior, enhance exercise self-efficacy, deliver educational information and provide support. Frequent access to remotely recorded heart rate data during rest, activities of daily living, and exercise could enable physicians to assess the impact of pharmacological intervention on heart rate control. In combination with the communication capability, this could assist physicians to titrate AF patients’ medications in order to achieve optimal heart rate control. Our platform has shown promise in preliminary proof of concept research; however, a robust assessment of wireless data transmission reliability is required.

This study aimed to evaluate the sensor measurement validity and wireless data transmission reliability of a remote physiological monitoring system comprising the BioHarness, custom app, and middleware platform among individuals in sinus rhythm. Given that AF is the most common sustained cardiac arrhythmia and is a common comorbidity in CHD [39], system validity was also assessed in individuals with AF to determine whether the sensor was robust to a common cardiac dysrhythmia.


Overview

A dual-phase cross-sectional study was conducted to assess system validity among convenience samples of healthy recreationally active individuals in sinus rhythm (ie, systole initiated at the sinoatrial node and proliferated via normal cardiac conduction pathways; Phase One), and individuals with AF (Phase Two). Phase One participants were recruited via contacts and local sport clubs. Phase Two participants were recruited via outpatient cardiology clinics. This dual-phase approach enabled safe assessment of sensor measurement validity across a broad range of exercise intensities. Phase One participants completed constant, intermittent, and incremental intensity exercise at moderate to maximal levels of intensity. Phase Two participants completed constant intensity exercise and simulated daily activities at low to moderate levels of intensity. Phase One was approved by the University of Auckland Human Participants Ethics Committee (2011/7674). Phase Two was approved by the New Zealand Health and Disability Ethics Committee (CEN/11/11058), respectively. All volunteers provided written informed consent. Procedures common to Phases One and Two are outlined below, followed by phase-specific exercise procedures.

Common Procedures

The remote physiological monitoring system comprised the BioHarness (version 3 with chest strap; Figure 1), a smartphone (Xperia Arc S, Sony Ericsson Mobile Communications AB, Sweden) utilizing the Android operating system (v2.3.4, Google Inc.), a custom mobile app with integrated middleware platform (Figure 2), and a remote monitoring Internet server (Odin) [38]. Physiological data, transmitted to the smartphone via Bluetooth, were displayed throughout exercise, stored locally, and transmitted to the remote Internet server in near real-time (30-second data packet transmission interval).

On arrival at the laboratory, participants underwent baseline measurement of stature and body mass, and familiarization with exercise ergometers. Participants were instrumented with a 12-lead ECG (AT-110, Schiller AG), BioHarness, and indirect calorimeter (Metalyzer, Cortex Biophysik GmBH). Adhesive electrodes were applied at standard ECG sites following recommended skin preparation procedures [40], and electrical cables were secured to minimize signal artefact. Calorimeter gas sensors were calibrated via a two-point procedure using gases of known composition, the volume transducer was calibrated using a 3000 mLcalibration syringe (Hans Rudolph), and the internal barometer was calibrated against a mercury barometer (SK1256, Sato Keiryoki Manufacturing).

Activation of ECG, BioHarness, and calorimeter data logging followed a standardized procedure to ensure accurate data synchronization. Data were recorded during 180 seconds of seated rest prior to, and throughout exercise. A 60-second transition period was included prior to locomotive exercise to enable treadmill initiation.

Figure 1. Zephyr BioHarness.
View this figure
Figure 2. Custom mobile app screenshot.
View this figure

Phase One Exercise Procedures

During Phase One, participants completed three discrete bouts of treadmill running during two laboratory-based trials. During Trial One, participants ran on a motorized treadmill (EX200, Powersport) at 0% incline to determine the velocity eliciting 50% heart rate reserve (V50%HRR). Following instrumentation, participants completed an incremental protocol to assess peak oxygen uptake (V̇O2peak), operationally defined as the highest measured V̇O2. Treadmill velocity (V50%HRR) remained constant, and the incline was increased by 1% every 60 seconds until volitional exhaustion. Mean V̇O2 during the final 30 seconds of each workload was plotted as a function of treadmill incline, and inclines eliciting 50%, 66%, 70% and 90% V̇O2peak were derived via linear interpolation. After 30 minutes of rest, participants completed a 30 minute constant intensity treadmill running protocol (C30) at an incline eliciting 66% V̇O2peak. During Trial Two, participants completed a 30-minute intermittent intensity treadmill protocol (I30) comprising three repetitions of a 10-minute exercise block. Each exercise block included five sequential 2-minute stages at inclines eliciting 50%, 70%, 90%, 70%, and 50% V̇O2peak, respectively. Mean levels of exercise intensity were equivalent in the C30 and I30 protocols.

Phase Two Exercise Procedures

During Phase Two, participants completed three bouts of exercise during a single laboratory-based trial. Participants self-selected light-to-moderate levels of exercise intensity during treadmill and cycle ergometer (Velotron, RacerMate Inc.) familiarization. Following instrumentation, participants undertook 10 minutes of treadmill walking, 10 minutes of cycling, and sequential 3-minute bouts of simulated daily activities (sweeping and vacuuming). Walk, cycle, and daily activity bouts were separated by 5 minutes of seated rest.

Data Analysis

Reference heart rate measures were manually calculated from synchronized ECG waveforms as the average rate during the final 10 seconds of each minute. Reference respiratory rate was captured by the calorimeter at 0.10 Hz. BioHarness and calorimeter data were downloaded using the manufacturers’ software (BioHarness Log Downloader v1.0.24 and MetaSoft v3.9.3, respectively) and exported for manual analysis. BioHarness data were down-sampled to match reference measures. Data outside the manufacturers specified measurement ranges were excluded prior to analysis.

Phase One and Two data were analyzed separately following identical procedures using SPSS v20.0.0. Consistent with guidelines for assessing measurement validity in this field [41], a multi-faceted approach was undertaken to evaluate BioHarness heart rate and respiratory rate measurement accuracy and reliability. Heart rate and respiratory rate data were non-normally distributed, and a nonparametric analytical approach was implemented where necessary. Wilcoxon signed-rank tests for matched pairs were conducted to assess systematic biases between sensor and reference measures. Kruskal-Wallis analyses of variance were performed to assess the effect of Activity (Phase One: rest, transition, run; Phase Two: rest, transition, walk, cycle, sweep, vacuum) on measurement biases. Statistically significant main effects were explored using Dunn-Bonferroni corrected paired comparisons.

Spearman’s rank-order correlation coefficients (rho) and two-way random effects intraclass correlation coefficients (ICC) for absolute agreement were calculated to describe relative measurement reliability [41]. Absolute measurement reliability was assessed by calculating the standard error of measurement (SEM) and coefficient of variation (CV) [41] and a non-parametric approach to the 95% limits of agreement (LoA) similar to that described by Bland & Altman [42], in which the LoA were calculated as the 2.5th and 97.5th percentile ranked biases. The threshold for statistical significance was set at alpha<.05.

Wireless data transmission reliability was evaluated by determining data loss between the BioHarness, App, and remote monitoring server (Odin). Reference sample sizes were calculated as the product of exercise duration and sensor sampling frequency. These analyses utilized data logged at the BioHarness’ native summary frequency (1 Hz) as the aforementioned down-sampling procedures had potential to conceal intermittent data loss.


Overview

Participant characteristics are summarized in Table 1. Ten and eight participants completed all Phase One and Two activity bouts, respectively. Unidentified trial-wide technical errors affected heart rate and respiratory rate measurements during two separate Phase Two trials. The outlying nature of these datasets was confirmed by 2 independent investigators, and they were excluded from analyses.

Table 1. Participant characteristics (Phase One: participants in sinus rhythm; Phase Two: participants with atrial fibrillation).

Phase One, mean (SD)Phase Two, mean (SD)
Sample size/male10/68/5
Age, years26.68 (3.26)69.68 (9.53)
Body mass, kg71.10 (11.53)77.46 (18.81)
Stature, m1.73 (0.06)1.69 (0.12)
Peak oxygen consumption, ml∙kg-1∙min-150.82 (4.51)Not assessed

Measurement Accuracy

The BioHarness systematically underestimated heart rate (z=-3.01, P=.003) and respiratory rate (z=-21.57, P<.001) during Phase One, although the median biases were small (Tables 2 and 3). A statistically significant effect of Activity on measurement bias was detected for respiratory rate (H2=40.96, P<.001), but not heart rate (H2=0.83, P=.66). Dunn-Bonferroni corrected paired comparisons revealed systematic differences in respiratory rate measurement biases between all three levels of Activity (all P<.001 to P=.04; Table 3).

The BioHarness systematically overestimated heart rate (z=-3.28, P=.001) and respiratory rate (z=-4.47, P<.001) during Phase Two, although negative biases were observed during some activities (Tables 2 and 3). A statistically significant effect of Activity was detected on respiratory rate (H5=203.07, P<.001; Table 3), but not heart rate (H5=4.41, P=.49; Table 2). Dunn-Bonferroni-corrected paired comparisons revealed systematic differences in respiratory rate measurement biases between all levels of Activity (P<.001 to P=.02; Table 3) with the exception of walk and cycle (P=.12; Table 3).

BioHarness measurement error was relatively consistent across the measurement ranges, although a degree of heteroscedasticity was apparent among Phase Two respiratory rate measures (Figure 3).

Table 2. Biases between BioHarness and reference heart rate (Phase One: participants in sinus rhythm; Phase Two participants with atrial fibrillation)a.

Heart rate
Median b∙min-1Bias b∙min-1Bias %
Phase OneRestREF72.00 (18.00)0.00 (4.45)0.02 (5.55)
BH70.75 (23.38)
TransitionREF108.00 (30.00)-0.80 (7.20)-0.65 (7.38)
BH97.00 (31.18)
RunREF162.00 (18.00)-0.30 (4.60)-0.20 (2.80)
BH163.50 (16.40)
TotalREF162.00 (24.00)-0.30 (4.53)b-0.20 (2.96)
BH160.70 (13.40)
Phase TwoRestREF84.00 (24.00)2.10 (4.55)2.06 (5.77)
BH89.10 (29.45)
TransitionREF108.00 (6.00)1.10 (9.30)1.67 (8.78)
BH91.70 (21.30)
WalkREF126.00 (40.50)0.65 (9.25)0.49 (7.82)
BH130.20 (46.58)
CycleREF120.00 (60.00)1.90 (11.50)1.79 (9.66)
BH121.80 (72.50)
SweepREF108.00 (27.00)-3.60 (12.00)-3.75 (9.70)
BH103.10 (20.05)
VacuumREF108.00 (30.00)3.20 (13.76)3.47 (13.46)
BH101.30 (33.34)
TotalREF108.00 (48.00)1.10 (9.75)c1.23 (8.61)
BH106.55 (51.68)

aTable reports median (IQR) reference (REF) and BioHarness (BH) heart rates, absolute (b·min-1) and relative (%) biases.

bP=.003.

cP=.001.

Table 3. Biases between BioHarness and reference respiratory rate (Phase One: participants in sinus rhythm; Phase Two participants with atrial fibrillation)a.



Median br∙min-1Bias br∙min-1 bBias %
Phase OneRestREF17.00 (6.75)-0.28 (4.00)tR-1.56 (23.42)
BH16.15 (5.44)
TransitionREF19.30 (7.33)-2.20 (5.72)rR-12.17 (29.52)
BH17.65 (6.32)
RunREF41.70 (12.00)-1.36 (4.58)rt-3.30 (10.65)
BH40.80 (10.09)
TotalREF39.90 (15.30)-1.25 (4.65)c-3.33 (12.01)
BH39.02 (13.40)
Phase TwoRestREF18.50 (6.65)-0.88 (4.30)twcsv-4.89 (21.77)
BH17.29 (4.80)
TransitionREF19.70 (8.30)-5.73 (5.97)rwcsv-28.02 (23.69)
BH14.34 (4.92)
WalkREF22.30 (5.85)0.81 (6.34)rtsv3.12 (30.80)
BH25.16 (6.35)
CycleREF25.00 (7.28)0.28 (7.65)rtsv1.04 (28.84)
BH26.69 (6.94)
SweepREF22.00 (6.05)6.61 (16.35)rtwcv27.22 (77.73)
BH31.03 (11.87)
VacuumREF19.65 (9.33)9.42 (10.18)rtwcs43.89 (67.69)
BH31.55 (9.72)
TotalREF22.10 (7.18)0.39 (7.33)c1.56 (31.88)
BH24.26 (11.02)

aTable reports median (IQR) reference (REF) and BioHarness (BH) respiratory rates, absolute (br·min-1) and relative (%) biases.

bThe letters r t R= rest, transition, run; statistically significantly different compared to Phase One rest, transition, Run (P<.001 to P=.04). The letters r t w c s v = rest, transition, walk, cycle, sweep, vacuum; statistically significantly different compared to Phase Two rest, transition, walk, cycle, sweep, and vacuum (P<.001 to P=.02).

cStatistically significantly different compared to reference measures (P<.001).

Figure 3. Sensor measurement error as a function of mean measurement magnitude (solid reference lines = mean biases, dashed reference lines = 95% limits of agreement).
View this figure

Measurement Reliability

BioHarness and reference heart rate measures were strongly correlated during both phases (Table 4), indicating excellent relative measurement reliability. The SEM, CV, and LoA for heart rate were similar during both phases (Table 4). Small SEM and CV indicate acceptable absolute heart rate measurement reliability during both phases; however, the non-parametrically derived LoA were relatively wide (Figure 3). Asymmetric LoA reflect the aforementioned non-normal measurement error distributions. BioHarness and reference respiratory rate measures were strongly correlated during Phase One, but not Phase Two (Table 4). Phase One respiratory rate SEM and CV were small, but the LoA were relatively wide (Figure 3). The respiratory rate SEM, CV, and LoA were substantially larger during Phase Two (Table 4) and reflect poor absolute measurement reliability. While the magnitude of the Phase Two respiratory rate SEM was comparable to the heart rate SEM during both phases, it represents a larger proportion of the total measurement range and therefore, markedly lower absolute measurement reliability.

Table 4. Relative and absolute reliability of BioHarness heart rate and respiratory rate measuresa.

RelativeAbsolute

rhoICCSEM, min-1LoA, min-1CV, %
Phase OneHR.92b.98b5.20(-21.87, 9.26)2.24
RR.87b.94b2.78(-13.73, 9.41)7.94
Phase TwoHR.97b.98b4.77(-13.39, 23.79)4.05
RR.43b.55b4.60(-11.58, 18.91)16.61

aTable reports Spearman’s rank-order correlation coefficient (rho), two-way random effects intraclass correlation coefficient (ICC), standard error of measurement (SEM), non-parametric 95% limits of agreement (LoA), and coefficient of variation (CV) for heart rate (HR) and respiratory rate (RR).

bStatistically significant P<.001.

Wireless Data Transmission Reliability

Zero biases were observed between BioHarness, App, and Odin measurements, indicating sensor measurement validity was unaffected by wireless data transmission. Phase One BioHarness, App, and Odin data loss were 4.1%, 0.2%, and 21.3%, respectively. Failure to record data throughout two V̇O2peak bouts accounted for all BioHarness data loss. However, these errors did not compromise BioHarness-to-App data transmission. A terminal App crash during one exercise bout accounted for all Phase One App data loss. Outages of the data network hosting the Odin server precluded App-to-Odin data transmission throughout five exercise bouts, and this instability accounted for 15.5% Odin data loss. Unidentified intermittent data capture errors accounted for the remaining Odin data loss (5.9%).

Phase Two BioHarness, App, and Odin data loss were 0.0%, 0.6%, and 1.1%, respectively. Phase Two was unaffected by Odin network stability and data loss occurred as a result of intermittent errors similar to those observed during Phase One.


Principal Findings

This study evaluated the sensor measurement and wireless data transmission validity of a remote physiological monitoring system among participants in sinus rhythm and AF. Heart and respiratory rates differed systematically from reference measures across a range of exercise intensities and activities, but the magnitudes of these biases were small. Measurement reliability was generally acceptable, and wireless data capture was excellent when all components of the monitoring system were operational. However, instability of the data network hosting the Odin remote monitoring server resulted in substantial data loss during some exercise bouts.

The small magnitudes of heart rate and respiratory rate measurement biases are unlikely to impair interpretation of physiological stress or workload during remote monitoring. As a caveat, larger biases during simulated sweeping and vacuuming may indicate reduced sensor stability and increased movement artefact during activities requiring substantial upper limb movement. Recent evidence suggests conductive fabric sensors embedded in a textile vest are subject to less movement artefact than traditional adhesive ECG electrodes [43]. Thus the BioHarness compression-fit vest may improve sensor measurement validity; however, it was not publicly available during this experiment and could not be assessed.

Heart rate and respiratory rate measurement biases were comparable to some, but not all previous evaluations of similar sensors’ measurement validity. Biases were smaller than those reported for a previous model BioHarness during laboratory- and field-based locomotion [31,32,34] but comparable to those reported during incremental and constant intensity treadmill running [35]. As it is not possible to determine the extent to which iterative hardware and software development contributes to measurement accuracy, caution should be taken when generalizing our results to earlier model devices.

Relative heart rate measurement reliability was excellent across a range of activities and workloads. Correlation coefficients compare favorably with evaluations of previous model BioHarness devices [32,35] and other wearable physiological sensing devices [44-47]. Small SEM, and CV substantially smaller than a previously established criterion for acceptability [45] indicate good absolute heart rate measurement reliability during both phases. Relatively wide LoA are consistent with previous BioHarness evaluations [34,35] and reflect infrequent large measurement errors. While high frequency data are attractive for real-time remote exercise monitoring, the effect of infrequent outlying measurement errors may unnecessarily confound real-time data interpretation. Many wearable physiological sensors support much higher frequency monitoring than is typically provided during center-based supervised exercise. Thus it may be acceptable to sacrifice some temporal resolution in order to increase measurement reliability. Post-processed down-sampling is recommended to account for the temporal instability of respiratory gas exchange data during exercise [48,49], and a similar approach warrants consideration for real-time monitoring of high-frequency physiological data. Aggregating individual data packets, which were transmitted every 30 seconds during this experiment, may overcome the effects of infrequent outlying measurement errors. However, further investigation is required to determine the optimal balance between temporal resolution and measurement reliability.

Respiratory rate measurement reliability was comparable with evaluations of previous BioHarness models [31,35] and other wearable physiological monitors featuring inductive plethysmographs during Phase One [45,47,50] but was notably reduced during Phase Two. This was unexpected, but not without precedent [33,34]. The major methodological discrepancies between phases were the inclusion of upper body activities (simulated sweeping and vacuuming), lower levels of activity intensity, and older aged participants of lower exercise training status during Phase Two. Activities requiring substantial upper limb movement could impair the BioHarness respiratory rate sensor; however, post-hoc sensitivity analyses (not presented) did not support this effect. As low intensity activities are associated with small tidal volumes and thoracic wall displacements [51], it is possible the BioHarness respiratory rate sensor may be confounded during low levels of exercise intensity. Again, however, post-hoc sensitivity analyses did not support this effect. Pulmonary mechanics are impaired among older aged individuals (independent of pathophysiological conditions) and those with respiratory muscle weakness [52,53]. However, data describing pulmonary mechanics were not collected during this study, and the mechanism(s) underlying poor Phase Two respiratory rate measurement reliability remain unknown.

Remote physiological monitoring is contingent on reliable data transmission to a remotely located monitoring station. Data capture was generally excellent throughout this experiment; however, several errors were identified. Unresolved data logging errors precluded data storage on the local BioHarness memory during two exercise bouts; however, remote data transmission was unaffected and all data were successfully transmitted to the remote monitoring server during these errors. While local BioHarness data capture was necessary to assess sensor measurement validity, the middleware platform responds to network instability by temporarily caching all data until a network connection is re-established. Thus local BioHarness data capture would not be required in a production-ready remote monitoring system. The institutional network that hosted the Odin server throughout this study was subject to inconsistent power supply and undisclosed maintenance events. Resulting Odin server outages affected five exercise bouts during three Phase One trials. Relocating Odin to a robust host network will resolve this issue and is an immediate priority for future iterations of the monitoring system. After accounting for host network instability, Odin captured 94.7% and 98.9% of data during Phases One and Two, respectively. Iterative development is required to resolve the remaining App and Odin data capture errors; however, data capture reliability was sufficient for real-time remote monitoring given that a stable App-to-Odin connection was confirmed before beginning exercise.

Limitations

A potential limitation of this study was the small sample size. However, as the unit of analysis was the number of sensor observations, rather than the number of participants, the design had sufficient statistical power to detect clinically significant biases between BioHarness and reference measures of heart rate and respiratory rate.

As with all studies evaluating physiological sensor validity, these results may be confounded by factors influencing the quality of data from the BioHarness and reference sensors. Positional overlap between ECG (V1-V6) and BioHarness electrodes may have impaired BioHarness electrode skin contact, particularly among participants with small chest circumferences requiring ECG electrodes to be closely grouped. Interrupted skin contact could explain the occasional presence of large measurement errors apparent in the relatively wide heart rate LoA.

Similarly, the design of the BioHarness respiratory rate sensor dictated that it was typically located above ECG electrodes V5 and V6. Compression of the respiratory rate sensor against underlying ECG electrodes could impair measurement validity; however, this would be expected to affect both phases and is unlikely to explain the reduced measurement reliability observed during Phase Two.

Implications

Remote physiological monitoring has numerous potential applications in both clinical and non-clinical settings. Remote monitoring has been identified as an important future development in home-based exCR [26] and may help to bridge the gap between center- and home-based programs for individuals who are unable to attend traditional exCR. Real-time remote physiological monitoring could help home-based exCR participants’ to achieve and adhere to recommended exercise training loads, and this may optimize beneficial exercise-induced physiological adaptations. Moreover, bi-directional communication capability will enable exercise physiologists to provide instantaneous individualized feedback, educational information, and support based on real-time physiological responses. While remote exCR should not replace center-based programs, it may provide a viable alternative for those who are unable or unwilling to attend supervised exCR. Robust trials are now required to determine the efficacy and safety of remotely monitored exCR. Given that center-based exCR is the gold standard treatment in many countries, it seems prudent to compare remotely monitored exCR with center-based programs.

Remote physiological monitoring also has potential applications outside of exCR and could be used to monitor heart rate control in people with AF. Management of patients with AF involves consideration of either a rhythm control approach (attempt to maintain sinus rhythm) or one of rate control, which is often the preferred approach. Reduction of the rapid heart rate in AF increases the diastolic filling periods and left ventricular stroke volume [39]. Current guidelines recommend an individualized approach to AF rate control, using a combination of pharmacological agents such as beta-blockers, calcium channel blockers, and digoxin [39]. However, heart rate control during exercise remains problematic for many patients with AF, even when receiving medications. Guidelines recommend that patients who experience symptoms associated with AF during exercise should be assessed during exercise and have their pharmacological treatment titrated to achieve a physiological chronotropic response and avoid bradycardia [39]. The most common approach for monitoring arrhythmias during everyday life is Holter monitoring (24 hours to 7 days) [39]. This approach is highly regarded and valuable for clinical decision making; however, it is time and resource intensive to monitor data and can be intrusive for patients. Remote monitoring systems such as the one described in this paper have several advantages over traditional Holter monitoring. The conductive textile electrodes embedded into wearable physiological sensors overcome the discomfort associated with adhesive electrodes. Moreover, data from integrated motion sensors could be used to delineate periods of rest and physical activity, and these contextual data may augment interpretation of heart rate control among patients with AF. Finally, embedding automated data collation and processing within remote monitoring servers can eliminate manual data handling and improve the efficiency of data processing and reporting. Collectively these characteristics could assist physicians to assess the effects of pharmacological intervention and titrate AF patients’ medications in order to optimize heart rate control at rest and during exercise. Future research is needed to determine the utility of such remote monitoring in this and other translational contexts.

Conclusion

The remote monitoring system evaluated in this experiment has sufficient measurement accuracy for quantifying heart rate and respiratory rate among individuals in sinus rhythm and with AF when gold standard clinical sensors are unavailable. Wireless data transmission reliability was generally excellent. Remote physiological monitoring has potential application as an alternate method for delivering exercise-based cardiac rehabilitation and enhancing the management of heart rate control for individuals with atrial fibrillation.

Acknowledgments

This study was supported by a funding grant from the New Zealand Heart Foundation, a not-for-profit non-governmental organization. The Heart Foundation had no role in experimental design, data collection, or manuscript preparation.

Authors' Contributions

All authors contributed to the design, data collection, analysis and interpretation, drafting of the article, and final approval of the manuscript.

Conflicts of Interest

None declared.

  1. Roger VL, Go AS, Lloyd-Jones DM, Benjamin EJ, Berry JD, Borden WB, American Heart Association Statistics CommitteeStroke Statistics Subcommittee. Heart disease and stroke statistics--2012 update: a report from the American Heart Association. Circulation 2012 Jan 3;125(1):e2-e220 [FREE Full text] [CrossRef] [Medline]
  2. Balady GJ, Fletcher BJ, Froelicher ES, Hartley LH, Krauss RM, Oberman A, et al. Cardiac rehabilitation programs. A statement for healthcare professionals from the American Heart Association. Circulation 1994 Sep 01;90(3):1602-1610. [CrossRef] [Medline]
  3. World Health Organization. Rehabilitation after cardiovascular diseases, with special emphasis on developing countries. Report of a WHO Expert Committee. World Health Organization Technical Report Series 1993;831:1-122. [Medline]
  4. Balady GJ, Williams MA, Ades PA, Bittner V, Comoss P, Foody JAM, American Heart Association Exercise‚ Cardiac Rehabilitation‚Prevention Committee, Council on Clinical Cardiology, Councils on Cardiovascular Nursing‚ Epidemiology and Prevention‚Nutrition‚ Physical Activity‚Metabolism, American Association of Cardiovascular and Pulmonary Rehabilitation. Core components of cardiac rehabilitation/secondary prevention programs: 2007 update: a scientific statement from the American Heart Association Exercise, Cardiac Rehabilitation, and Prevention Committee, the Council on Clinical Cardiology; the Councils on Cardiovascular Nursing, Epidemiology and Prevention, and Nutrition, Physical Activity, and Metabolism; and the American Association of Cardiovascular and Pulmonary Rehabilitation. J Cardiopulm Rehabil Prev 2007;27(3):121-129. [CrossRef] [Medline]
  5. Graham I, Atar D, Borch-Johnsen K, Boysen G, Burell G, Cifkova R, Op Reimer Wilma Scholte, European Society of Cardiology (ESC), European Association for Cardiovascular Prevention and Rehabilitation (EACPR), Council on Cardiovascular Nursing, European Association for Study of Diabetes (EASD), International Diabetes Federation Europe (IDF-Europe), European Stroke Initiative (EUSI), Society of Behavioural Medicine (ISBM), European Society of Hypertension (ESH), WONCA Europe (European Society of General Practice/Family Medicine), European Heart Network (EHN), European Atherosclerosis Society (EAS). European guidelines on cardiovascular disease prevention in clinical practice: full text. Fourth Joint Task Force of the European Society of Cardiology and other societies on cardiovascular disease prevention in clinical practice (constituted by representatives of nine societies and by invited experts). Eur J Cardiovasc Prev Rehabil 2007 Sep;14 Suppl 2:S1-113. [CrossRef] [Medline]
  6. Leon AS, Franklin BA, Costa F, Balady GJ, Berra KA, Stewart KJ, Council on Clinical Cardiology (Subcommittee on Exercise‚ Cardiac Rehabilitation‚Prevention), Council on Nutrition‚ Physical Activity‚ and Metabolism (Subcommittee on Physical Activity), American association of Cardiovascular and Pulmonary Rehabilitation. Cardiac rehabilitation and secondary prevention of coronary heart disease: an American Heart Association scientific statement from the Council on Clinical Cardiology (Subcommittee on Exercise, Cardiac Rehabilitation, and Prevention) and the Council on Nutrition, Physical Activity, and Metabolism (Subcommittee on Physical Activity), in collaboration with the American association of Cardiovascular and Pulmonary Rehabilitation. Circulation 2005 Jan 25;111(3):369-376 [FREE Full text] [CrossRef] [Medline]
  7. Clark AM, Hartling L, Vandermeer B, McAlister FA. Meta-analysis: secondary prevention programs for patients with coronary artery disease. Ann Intern Med 2005 Nov 1;143(9):659-672. [Medline]
  8. Heran BS, Chen JM, Ebrahim S, Moxham T, Oldridge N, Rees K, et al. Exercise-based cardiac rehabilitation for coronary heart disease. Cochrane Database Syst Rev 2011(7):CD001800 [FREE Full text] [CrossRef] [Medline]
  9. Lawler PR, Filion KB, Eisenberg MJ. Efficacy of exercise-based cardiac rehabilitation post-myocardial infarction: a systematic review and meta-analysis of randomized controlled trials. Am Heart J 2011 Oct;162(4):571-584.e2. [CrossRef] [Medline]
  10. Taylor RS, Brown A, Ebrahim S, Jolliffe J, Noorani H, Rees K, et al. Exercise-based rehabilitation for patients with coronary heart disease: systematic review and meta-analysis of randomized controlled trials. Am J Med 2004 May 15;116(10):682-692. [CrossRef] [Medline]
  11. Ades PA, Savage PD, Toth MJ, Harvey-Berino J, Schneider DJ, Bunn JY, et al. High-calorie-expenditure exercise: a new approach to cardiac rehabilitation for overweight coronary patients. Circulation 2009 May 26;119(20):2671-2678 [FREE Full text] [CrossRef] [Medline]
  12. Shaw K, Gennat H, O'Rourke P, Del MC. Exercise for overweight or obesity. Cochrane Database Syst Rev 2006(4):CD003817. [CrossRef] [Medline]
  13. Thomas DE, Elliott EJ, Naughton GA. Exercise for type 2 diabetes mellitus. Cochrane Database Syst Rev 2006(3):CD002968. [CrossRef] [Medline]
  14. Martin BJ, Arena R, Haykowsky M, Hauer T, Austford LD, Knudtson M, et al. Cardiovascular fitness and mortality after contemporary cardiac rehabilitation. Mayo Clin Proc 2013 May;88(5):455-463. [CrossRef] [Medline]
  15. Artham SM, Lavie CJ, Milani RV, Chi Y, Goldman CK. Benefits of Exercise Training in Secondary Prevention of Coronary and Peripheral Arterial Disease. Vascular Disease Prevention 2008 Aug 01;5(3):156-168. [CrossRef]
  16. Bethell HJ, Evans JA, Turner SC, Lewin RJ. The rise and fall of cardiac rehabilitation in the United Kingdom since 1998. J Public Health (Oxf) 2007 Mar;29(1):57-61 [FREE Full text] [CrossRef] [Medline]
  17. Suaya JA, Shepard DS, Normand SLT, Ades PA, Prottas J, Stason WB. Use of cardiac rehabilitation by Medicare beneficiaries after myocardial infarction or coronary bypass surgery. Circulation 2007 Oct 9;116(15):1653-1662 [FREE Full text] [CrossRef] [Medline]
  18. Walters DL, Aroney CN, Chew DP, Bungey L, Coverdale SG, Allan R, et al. Variations in the application of cardiac care in Australia. Med J Aust 2008 Feb 18;188(4):218-223. [Medline]
  19. Neubeck L, Freedman SB, Clark AM, Briffa T, Bauman A, Redfern J. Participating in cardiac rehabilitation: a systematic review and meta-synthesis of qualitative data. Eur J Prev Cardiol 2012 Jun;19(3):494-503. [Medline]
  20. Ades PA, Maloney A, Savage P, Carhart RL. Determinants of physical functioning in coronary patients: response to cardiac rehabilitation. Arch Intern Med 1999 Oct 25;159(19):2357-2360. [Medline]
  21. van der Wal MHL, Jaarsma T, Moser DK, Veeger NJ, van Gilst WH, van Veldhuisen DJ. Compliance in heart failure patients: the importance of knowledge and beliefs. Eur Heart J 2006 Feb;27(4):434-440 [FREE Full text] [CrossRef] [Medline]
  22. Bock BC, Albrecht AE, Traficante RM, Clark MM, Pinto BM, Tilkemeier P, et al. Predictors of exercise adherence following participation in a cardiac rehabilitation program. Int J Behav Med 1997;4(1):60-75. [CrossRef] [Medline]
  23. Dalal HM, Zawada A, Jolly K, Moxham T, Taylor RS. Home based versus centre based cardiac rehabilitation: Cochrane systematic review and meta-analysis. BMJ 2010;340:b5631 [FREE Full text] [Medline]
  24. Hammill BG, Curtis LH, Schulman KA, Whellan DJ. Relationship between cardiac rehabilitation and long-term risks of death and myocardial infarction among elderly Medicare beneficiaries. Circulation 2010 Jan 5;121(1):63-70 [FREE Full text] [CrossRef] [Medline]
  25. Moholdt T, Madssen E, Rognmo Ø, Aamot IL. The higher the better? Interval training intensity in coronary heart disease. J Sci Med Sport 2014 Sep;17(5):506-510. [CrossRef] [Medline]
  26. Worringham CJ, Stewart IB. Exercise-Based Cardiac Rehabilitation for the 21st Century. Curr Cardiovasc Risk Rep 2013 Jun 19;7(4):288-292. [CrossRef]
  27. International Telecommunication Union. The World in 2014: ICT Facts and Figures. Geneva, Switzerland: International Telecommunication Union; 2014.   URL: http://www.itu.int/en/ITU-D/Statistics/Pages/facts/default.aspx [accessed 2015-03-03] [WebCite Cache]
  28. Piotrowicz E, Piotrowicz R. Cardiac telerehabilitation: current situation and future challenges. Eur J Prev Cardiol 2013 Jun;20(2 Suppl):12-16. [CrossRef] [Medline]
  29. Pantelopoulos A, Bourbakis NG. A Survey on Wearable Sensor-Based Systems for Health Monitoring and Prognosis. IEEE Transactions on Systems, Man, and Cybernetics - Part C: Applications and Reviews 2010 Jan;40(1):1-12. [CrossRef]
  30. Bianchi W, Hsieh Y, Hill P, Saheed M, Terzis A, Rothman R. Revitalizing a Vital Sign: Measurement of Respiratory Rate With a Thoracic Belt Improves Detection of Tachypnea at Primary Triage. Annals of Emergency Medicine 2011 Oct;58(4):S305-S306. [CrossRef] [Medline]
  31. Hailstone J, Kilding AE. Reliability and Validity of the Zephyr™ BioHarness™ to Measure Respiratory Responses to Exercise. Measurement in Physical Education and Exercise Science 2011 Oct;15(4):293-300. [CrossRef]
  32. Johnstone JA, Ford PA, Hughes G, Watson T, Garrett AT. BioHarness™ multivariable monitoring device: part. I: validity. J Sports Sci Med 2012;11(3):400-408 [FREE Full text] [Medline]
  33. Johnstone JA, Ford PA, Hughes G, Watson T, Garrett AT. BioHarness™ Multivariable Monitoring Device: Part. II: Reliability. J Sports Sci Med 2012;11(3):409-417 [FREE Full text] [Medline]
  34. Johnstone JA, Ford PA, Hughes G, Watson T, Mitchell ACS, Garrett AT. Field based reliability and validity of the BioHarness™ multivariable monitoring device. J Sports Sci Med 2012;11(4):643-652 [FREE Full text] [Medline]
  35. Kim JH, Roberge R, Powell JB, Shafer AB, Jon WW. Measurement accuracy of heart rate and respiratory rate during graded exercise and sustained exercise in the heat using the Zephyr BioHarness™. Int J Sports Med 2013 Jun;34(6):497-501. [CrossRef] [Medline]
  36. IPSOS MediaCT, Google Inc.. Our Mobile Planet.: IPSOS MediaCT; 2013.   URL: https://think.withgoogle.com/mobileplanet/en/downloads/ [accessed 2015-03-03] [WebCite Cache]
  37. Worringham C, Rojek A, Stewart I. Development and feasibility of a smartphone, ECG and GPS based system for remotely monitoring exercise in cardiac rehabilitation. PLoS One 2011;6(2):e14669 [FREE Full text] [CrossRef] [Medline]
  38. Warren I, Weerasinghe T, Maddison R, Wang Y. OdinTelehealth: A Mobile Service Platform for Telehealth. Procedia Computer Science 2011 Nov;5(22):681-688 [FREE Full text] [CrossRef] [Medline]
  39. European Heart Rhythm Association, European Association for Cardio-Thoracic Surgery, Camm AJ, Kirchhof P, Lip GY, Schotten U, et al. Guidelines for the management of atrial fibrillation: the Task Force for the Management of Atrial Fibrillation of the European Society of Cardiology (ESC). Eur Heart J 2010 Oct;31(19):2369-2429 [FREE Full text] [CrossRef] [Medline]
  40. Kligfield P, Gettes LS, Bailey JJ, Childers R, Deal BJ, Hancock EW, American Heart Association Electrocardiography and Arrhythmias Committee‚ Council on Clinical Cardiology, American College of Cardiology Foundation, Heart Rhythm Society. Recommendations for the standardization and interpretation of the electrocardiogram. Part I: The electrocardiogram and its technology. A scientific statement from the American Heart Association Electrocardiography and Arrhythmias Committee, Council on Clinical Cardiology; the American College of Cardiology Foundation; and the Heart Rhythm Society. Heart Rhythm 2007 Mar;4(3):394-412. [CrossRef] [Medline]
  41. Atkinson G, Nevill AM. Statistical methods for assessing measurement error (reliability) in variables relevant to sports medicine. Sports Med 1998 Oct;26(4):217-238. [Medline]
  42. Bland JM, Altman DG. Measuring agreement in method comparison studies. Stat Methods Med Res 1999 Jun;8(2):135-160. [Medline]
  43. Di Rienzo M, Racca V, Rizzo F, Bordoni B, Parati G, Castiglioni P, et al. Evaluation of a textile-based wearable system for the electrocardiogram monitoring in cardiac patients. Europace 2013 Apr;15(4):607-612 [FREE Full text] [CrossRef] [Medline]
  44. Barreira TV, Kang M, Caputo JL, Farley RS, Renfrow MS. Validation of the Actiheart monitor for the measurement of physical activity. International Journal of Exercise Science 2009;2(1):60-71.
  45. Kent L, O'Neill B, Davison G, Nevill A, Elborn JS, Bradley JM. Validity and reliability of cardiorespiratory measurements recorded by the LifeShirt during exercise tests. Respir Physiol Neurobiol 2009 Jun 30;167(2):162-167. [CrossRef] [Medline]
  46. Brage S, Brage N, Franks PW, Ekelund U, Wareham NJ. Reliability and validity of the combined heart rate and movement sensor Actiheart. Eur J Clin Nutr 2005 Apr;59(4):561-570. [CrossRef] [Medline]
  47. Liu Y, Zhu SH, Wang GH, Ye F, Li PZ. Validity and reliability of multiparameter physiological measurements recorded by the Equivital LifeMonitor during activities of various intensities. J Occupational and Environmental Hygeine 2013;10(2):78-85. [CrossRef] [Medline]
  48. Robergs RA, Dwyer D, Astorino T. Recommendations for improved data processing from expired gas analysis indirect calorimetry. Sports Med 2010 Feb 1;40(2):95-111. [CrossRef] [Medline]
  49. American Thoracic Society, American College of Chest Physicians. ATS/ACCP Statement on cardiopulmonary exercise testing. Am J Respir Crit Care Med 2003 Jan 15;167(2):211-277. [CrossRef] [Medline]
  50. Witt JD, Fisher JR, Guenette JA, Cheong KA, Wilson BJ, Sheel AW. Measurement of exercise ventilation by a portable respiratory inductive plethysmograph. Respir Physiol Neurobiol 2006 Dec;154(3):389-395. [CrossRef] [Medline]
  51. Jones AM, Doust JH. Assessment of the lactate and ventilatory thresholds by breathing frequency in runners. Journal of Sports Sciences 1998 Jan;16(7):667-675. [CrossRef]
  52. Gibson GJ, Pride NB, Davis JN, Loh LC. Pulmonary mechanics in patients with respiratory muscle weakness. Am Rev Respir Dis 1977 Mar;115(3):389-395. [Medline]
  53. Gibson GJ, Pride NB, O'cain C, Quagliato R. Sex and age differences in pulmonary mechanics in normal nonsmoking subjects. J Appl Physiol 1976 Jul;41(1):20-25. [Medline]


AF: atrial fibrillation
C30: constant intensity 30-minute exercise protocol
CHD: coronary heart disease
CR: cardiac rehabilitation
CV: coefficient of variation
ECG: electrocardiogram
exCR: exercise-based cardiac rehabilitation
GPS: global positioning system
I30: intermittent intensity 30 minute exercise protocol
ICC: intraclass correlation coefficient
LOA: limits of agreement
SEM: standard error of measurement
V̇O2peak: peak oxygen consumption


Edited by G Eysenbach; submitted 23.06.14; peer-reviewed by M Varnfield; comments to author 14.12.14; revised version received 18.12.14; accepted 19.12.14; published 20.03.15

Copyright

©Jonathan C Rawstorn, Nicholas Gant, Ian Warren, Robert Neil Doughty, Nigel Lever, Katrina K Poppe, Ralph Maddison. Originally published in JMIR Rehabilitation and Assistive Technology (http://rehab.jmir.org), 20.03.2015.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Rehabilitation and Assistive Technology, is properly cited. The complete bibliographic information, a link to the original publication on http://rehab.jmir.org/, as well as this copyright and license information must be included.