Elsevier

Computer Networks

Volume 138, 19 June 2018, Pages 192-200
Computer Networks

HealCam: Energy-efficient and privacy-preserving human vital cycles monitoring on camera-enabled smart devices

https://doi.org/10.1016/j.comnet.2018.03.033Get rights and content

Abstract

In this paper, we present HealCam, an energy-efficient and privacy-preserving human vital signs (e.g., respiration cycles) monitoring system on camera-enabled smart devices. HealCam incorporates the related theories of compressive sensing in its system to reduce the sampling rate while preserving data privacy. HealCam saves significant cost on video processing via low-rate and non-uniform random sampling. It also provides a privacy-preserved data collection and enquiry service via lightweight compressive encryption and decryption scheme. According to our evaluations on real datasets, HealCam achieves high accuracy on respiration cycles reconstruction with extremely low average frame rate, i.e., 1 FPS, via non-uniform random sampling compared with traditional uniform sampling strategy. Then we implement HealCam on smartphones to evaluate its resource consumption. The results show that, HealCam is 23.6 times more energy efficient and 26.7 times faster than the original approach on video processing. Its data encryption component is 172 times faster while consumes only 1.01% energy compared with the corresponding state-of-the-art.

Introduction

Human vital signs, e.g., respiration and heartbeat cycles, are important references for medical diagnoses and healthcare applications. These vital cycles can be monitored by the dedicated equipments in hospital, e.g., an ElectroCardioGram (ECG)  [1] for heartbeat cycles monitoring. However, these equipments are expensive, cumbersome and require special expertise to use; therefore are not appropriate for usage in collecting daily health statistics of patients or the elderly in nursing-house, aged-care facilities or even at home. As the vision of smart healthcare, the future of medical applications should leverage the pervasive smart devices under different environments to provide intelligent, seamless and non-intrusive healthcare services. Therefore, the traditional dedicated and cumbersome equipments are not appropriate.

Extracting the cycles of respiration and heartbeat from continues video recordings of human faces has been extensively studied in the literature [2] and the current state-of-the-art is based on detecting the subtle head motions [3] using the embedded cameras on high performance PCs. The video-based approaches are quite promising as they do not require any special expertise to use and the high-resolution on-board cameras are now pervasive on different embedded smart devices including smartphones, Augmented Reality/Virtual Reality (AR/VR) glasses, tablets and etc. (see Fig. 1). The flexibility and user experience of the video-based approaches will be significantly improved if implemented on the camera-enabled smart devices. However, video processing is known to be computationally prohibitive for resource-constrained smart devices and the computational issues are ignored in previous research.

A straightforward solution for reducing the video computation cost on smart devices is offloading the computationally intensive tasks to the high performance computing facilities, such as local servers or remote cloud computing services [4]. However, offloading the video recordings of individuals’ faces is quite privacy-intrusive. Moreover, the extracted vital cycles themselves are significantly private as it can be used to infer individuals’ health status. Individuals’ health related data has substantially commercial values and it is highly likely that it will be targeted by hackers in the future in the same way that credit card information is now.

In this paper, we focus on monitoring the respiration cycles and addressing the above issues, we propose a novel energy-efficient and privacy-preserving human respiration cycles monitoring system, HealCam, on camera-enabled smart devices by incorporating relevant theories of compressive sensing. The contributions of this paper are as follows,

  • In this paper, we propose HealCam for video-based human respiration cycles monitoring on camera-enabled smart devices. To the best of our knowledge, this is the first relevant system running on resource-constrained devices.

  • As the minimal frame rate of uniform approach is bounded by the theory of Nyquist frequency and noises, to reduce the sampling rate, we propose a non-uniform random sampling strategy inspired by compressive sensing, instead of traditional uniform sampling to reduce the local video computation cost on the smart devices. According to the evaluation on the real datasets, it achieves significantly higher reconstruction accuracy at extremely low sampling rate compared with the uniform sampling strategy.

  • We incorporate a lightweight compressive encryption and decryption algorithm in HealCam, based on compressive sensing, for privacy-preserved data collection and enquiry with smart devices.

  • At last, we implement HealCam on smartphones to evaluate its resource consumptions. The results show that HealCam significantly reduces the energy consumption on both local video computing and data encryption.

This paper is organized as followed: Section 2 gives introduction about the work related to monitoring human vital cycles and corresponding encryption methods. Section 3 mentions the detail of HealCam’s system architecture. In Section 4 results of experiments conducted on real world dataset are given. Finally Section 5 concludes the paper.

Section snippets

Related work

Daily human vital cycles monitoring via smart devices has become one of the research topics with the introduction of Smart Health Projects [5]. Studies [6] showed that the accurate daily health data enabled us to understand how our bodies were functioning and could be helpful in detecting serious illnesses in early stage. Nanotechnology and wireless communications are the most common methods used in smart health applications. In [7], a smart shirt was designed to measure ECG and acceleration

System architecture

The system architecture of HealCam can be vastly divided into two major stages. The first is the energy-efficient respiration cycles extraction and encryption; the second is privacy-preserving historical records enquiry. Specifically, in the first stage, the respiration cycles are extracted from tracking the head motions of the target in a continuous video stream on smartphones. Non-uniform random sampling is applied to reduce the number of frames for further processing to significantly save

Dataset evaluations

The aim of this section is to evaluate the performance on reconstruction accuracy of our proposed sampling approach, i.e., non-uniform Random Sampling using Dictionary Learning (termed as RSDL) on reconstruction. We first determine whether the respiration cycles can be sparsely represented with the learned dictionary. We then evaluate the reconstruction accuracy of RSDL and compare it with the other two methods, RSDCT and uniform Interpolation. RSDCT applies random sampling but uses standard

Conclusion

In this paper, we propose HealCam, an energy-efficient and privacy-preserved respiration cycles monitoring system on camera-enabled smart devices. The overall system design is based on the related theories of compressive sensing. First we apply non-uniform random sampling instead of the traditional uniform sampling to reduce the video processing cost while achieving significantly better reconstruction accuracy. Then by facilitating lightweight compressive sensing based encryption and decryption

Acknowledgment

This work is partially supported by National Natural Science Foundation of China under Grant 61702133, Natural Science Foundation of Heilongjiang Province under grant QC2017069, the Fundamental Research Funds for the Central Universities Grant HEUCFJ160601, the China Postdoctoral Science Foundation No.166875 and Heilongjiang Postdoctoral Fund No. LBH-Z16042.

Qing Yang is a PhD student in the College of Computer Science and Technology, Harbin Engineering University(HEU). She received the bachelor degree of software engineering from HEU. She is a visiting PhD student in the Commonwealth Scientific and Industrial Organization(CSIRO) in Australia. Her main research interests are wearable/ mobile computing and privacy preserving in mobile sensor networks.

References (29)

  • C. Takano et al.

    Heart rate measurement based on a time-lapse image

    Med.Eng. Phys.

    (2007)
  • M.-Z. Poh et al.

    Advancements in noncontact, multiparameter physiological measurements using a webcam

    IEEE Trans. Biomed. Eng.

    (2011)
  • G. Balakrishnan et al.

    Detecting pulse from head motions in video

    Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition

    (2013)
  • M. Armbrust et al.

    A view of cloud computing

    Commun. ACM

    (2010)
  • M. Macr et al.

    Smart health project 2.0:integration and expectations of smart health topics

    ACM Sigbioinform. Record

    (2015)
  • S. Ahmari et al.

    Biomesensi: a wearable multi-sensing platform for bio-medical applications

    (2015)
  • P. Kumar, Communication in personal healthcare : Issues using 802.15.4 for personal healthcare...
  • S.W. Lee et al.

    A remote behavioral monitoring system for elders living alone

    International Conference on Control, Automation and Systems

    (2007)
  • H. Ren et al.

    Bioeffects control in wireless biomedical sensor networks

    Sensor Ad Hoc Communications Networks, Secon 06 IEEE Communications Society on

    (2006)
  • A. Prathosh et al.

    Estimation of respiratory pattern from video using selective ensemble aggregation

    IEEE Trans. Signal Process.

    (2017)
  • S. Suzuki et al.

    Development of non-contact monitoring system of heart rate variability (hrv)-an approach of remote sensing for ubiquitous technology

    International Conference on Ergonomics and Health Aspects of Work with Computers

    (2009)
  • M.Z. Poh et al.

    Non-contact, automated cardiac pulse measurements using video imaging and blind source separation.

    Opt. Express

    (2010)
  • D. Yin et al.

    Attribute couplet attacks and privacy preservation in social networks

    IEEE Access

    (2017)
  • A. Tripathi, Data access and integrity with authentication in hybrid cloud...
  • Cited by (3)

    Qing Yang is a PhD student in the College of Computer Science and Technology, Harbin Engineering University(HEU). She received the bachelor degree of software engineering from HEU. She is a visiting PhD student in the Commonwealth Scientific and Industrial Organization(CSIRO) in Australia. Her main research interests are wearable/ mobile computing and privacy preserving in mobile sensor networks.

    Yiran Shen received the PhD degree in computer science and engineering from the University of New South Wales. He is an associate professor in the College of Computer Science and Technology, Harbin Engineering University (HEU). He was SMART Scholar at Singapore-MIT Alliance for Research and Technology before he joined HEU. He publishes regularly at top-tier conferences and journals. His current research interests are wearable/ mobile computing, wireless sensor networks and applications of compressive sensing. He is a member of the IEEE.

    Fengyuan Yang is a Graduate student in the College of Computer Science and Technology, Harbin Engineering University (HEU). His current research interests are wearable/ mobile computing.

    Jianpei Zhang is the Professor at College of Computer Science and Technology, Harbin Engineering University. He is also the leader of Software and Social Computing Research Group. He received his PhD from Harbin Engineering University. His research interests include data mining, database systems and software engineering.

    Wanli Xue is a PhD candidate in Department of Computer Science and Engineer of the University of New South Wales. He is also a member of Networks Research Group of Data61 CSIRO, which used to be NICTA. He received the Master degree from the University of Tasmania. His current research interests as well as PhD topic are about Cyber-Physical Systems and private IoT.

    Hongkai Wen is an Assistant Professor in Department of Computer Science, University of Warwick. Before that he obtained his D.Phil at the University of Oxford, and became a post-doctoral researcher in a joint project between Oxford Computer Science and Robotics Institute. Broadly speaking, his research belongs to the area of Cyber-Physical Systems, which use networked smart devices to sense and interactive with the physical world.

    View full text