HealCam: Energy-efficient and privacy-preserving human vital cycles monitoring on camera-enabled smart devices
Introduction
Human vital signs, e.g., respiration and heartbeat cycles, are important references for medical diagnoses and healthcare applications. These vital cycles can be monitored by the dedicated equipments in hospital, e.g., an ElectroCardioGram (ECG) [1] for heartbeat cycles monitoring. However, these equipments are expensive, cumbersome and require special expertise to use; therefore are not appropriate for usage in collecting daily health statistics of patients or the elderly in nursing-house, aged-care facilities or even at home. As the vision of smart healthcare, the future of medical applications should leverage the pervasive smart devices under different environments to provide intelligent, seamless and non-intrusive healthcare services. Therefore, the traditional dedicated and cumbersome equipments are not appropriate.
Extracting the cycles of respiration and heartbeat from continues video recordings of human faces has been extensively studied in the literature [2] and the current state-of-the-art is based on detecting the subtle head motions [3] using the embedded cameras on high performance PCs. The video-based approaches are quite promising as they do not require any special expertise to use and the high-resolution on-board cameras are now pervasive on different embedded smart devices including smartphones, Augmented Reality/Virtual Reality (AR/VR) glasses, tablets and etc. (see Fig. 1). The flexibility and user experience of the video-based approaches will be significantly improved if implemented on the camera-enabled smart devices. However, video processing is known to be computationally prohibitive for resource-constrained smart devices and the computational issues are ignored in previous research.
A straightforward solution for reducing the video computation cost on smart devices is offloading the computationally intensive tasks to the high performance computing facilities, such as local servers or remote cloud computing services [4]. However, offloading the video recordings of individuals’ faces is quite privacy-intrusive. Moreover, the extracted vital cycles themselves are significantly private as it can be used to infer individuals’ health status. Individuals’ health related data has substantially commercial values and it is highly likely that it will be targeted by hackers in the future in the same way that credit card information is now.
In this paper, we focus on monitoring the respiration cycles and addressing the above issues, we propose a novel energy-efficient and privacy-preserving human respiration cycles monitoring system, HealCam, on camera-enabled smart devices by incorporating relevant theories of compressive sensing. The contributions of this paper are as follows,
- •
In this paper, we propose HealCam for video-based human respiration cycles monitoring on camera-enabled smart devices. To the best of our knowledge, this is the first relevant system running on resource-constrained devices.
- •
As the minimal frame rate of uniform approach is bounded by the theory of Nyquist frequency and noises, to reduce the sampling rate, we propose a non-uniform random sampling strategy inspired by compressive sensing, instead of traditional uniform sampling to reduce the local video computation cost on the smart devices. According to the evaluation on the real datasets, it achieves significantly higher reconstruction accuracy at extremely low sampling rate compared with the uniform sampling strategy.
- •
We incorporate a lightweight compressive encryption and decryption algorithm in HealCam, based on compressive sensing, for privacy-preserved data collection and enquiry with smart devices.
- •
At last, we implement HealCam on smartphones to evaluate its resource consumptions. The results show that HealCam significantly reduces the energy consumption on both local video computing and data encryption.
This paper is organized as followed: Section 2 gives introduction about the work related to monitoring human vital cycles and corresponding encryption methods. Section 3 mentions the detail of HealCam’s system architecture. In Section 4 results of experiments conducted on real world dataset are given. Finally Section 5 concludes the paper.
Section snippets
Related work
Daily human vital cycles monitoring via smart devices has become one of the research topics with the introduction of Smart Health Projects [5]. Studies [6] showed that the accurate daily health data enabled us to understand how our bodies were functioning and could be helpful in detecting serious illnesses in early stage. Nanotechnology and wireless communications are the most common methods used in smart health applications. In [7], a smart shirt was designed to measure ECG and acceleration
System architecture
The system architecture of HealCam can be vastly divided into two major stages. The first is the energy-efficient respiration cycles extraction and encryption; the second is privacy-preserving historical records enquiry. Specifically, in the first stage, the respiration cycles are extracted from tracking the head motions of the target in a continuous video stream on smartphones. Non-uniform random sampling is applied to reduce the number of frames for further processing to significantly save
Dataset evaluations
The aim of this section is to evaluate the performance on reconstruction accuracy of our proposed sampling approach, i.e., non-uniform Random Sampling using Dictionary Learning (termed as RSDL) on reconstruction. We first determine whether the respiration cycles can be sparsely represented with the learned dictionary. We then evaluate the reconstruction accuracy of RSDL and compare it with the other two methods, RSDCT and uniform Interpolation. RSDCT applies random sampling but uses standard
Conclusion
In this paper, we propose HealCam, an energy-efficient and privacy-preserved respiration cycles monitoring system on camera-enabled smart devices. The overall system design is based on the related theories of compressive sensing. First we apply non-uniform random sampling instead of the traditional uniform sampling to reduce the video processing cost while achieving significantly better reconstruction accuracy. Then by facilitating lightweight compressive sensing based encryption and decryption
Acknowledgment
This work is partially supported by National Natural Science Foundation of China under Grant 61702133, Natural Science Foundation of Heilongjiang Province under grant QC2017069, the Fundamental Research Funds for the Central Universities Grant HEUCFJ160601, the China Postdoctoral Science Foundation No.166875 and Heilongjiang Postdoctoral Fund No. LBH-Z16042.
Qing Yang is a PhD student in the College of Computer Science and Technology, Harbin Engineering University(HEU). She received the bachelor degree of software engineering from HEU. She is a visiting PhD student in the Commonwealth Scientific and Industrial Organization(CSIRO) in Australia. Her main research interests are wearable/ mobile computing and privacy preserving in mobile sensor networks.
References (29)
- et al.
Heart rate measurement based on a time-lapse image
Med.Eng. Phys.
(2007) - et al.
Advancements in noncontact, multiparameter physiological measurements using a webcam
IEEE Trans. Biomed. Eng.
(2011) - et al.
Detecting pulse from head motions in video
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition
(2013) - et al.
A view of cloud computing
Commun. ACM
(2010) - et al.
Smart health project 2.0:integration and expectations of smart health topics
ACM Sigbioinform. Record
(2015) - et al.
Biomesensi: a wearable multi-sensing platform for bio-medical applications
(2015) - P. Kumar, Communication in personal healthcare : Issues using 802.15.4 for personal healthcare...
- et al.
A remote behavioral monitoring system for elders living alone
International Conference on Control, Automation and Systems
(2007) - et al.
Bioeffects control in wireless biomedical sensor networks
Sensor Ad Hoc Communications Networks, Secon 06 IEEE Communications Society on
(2006) - et al.
Estimation of respiratory pattern from video using selective ensemble aggregation
IEEE Trans. Signal Process.
(2017)
Development of non-contact monitoring system of heart rate variability (hrv)-an approach of remote sensing for ubiquitous technology
International Conference on Ergonomics and Health Aspects of Work with Computers
Non-contact, automated cardiac pulse measurements using video imaging and blind source separation.
Opt. Express
Attribute couplet attacks and privacy preservation in social networks
IEEE Access
Cited by (3)
Sequence Data Matching and Beyond: New Privacy-Preserving Primitives Based on Bloom Filters
2020, IEEE Transactions on Information Forensics and SecurityIndoor interference classification based on WiFi channel state information
2018, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Qing Yang is a PhD student in the College of Computer Science and Technology, Harbin Engineering University(HEU). She received the bachelor degree of software engineering from HEU. She is a visiting PhD student in the Commonwealth Scientific and Industrial Organization(CSIRO) in Australia. Her main research interests are wearable/ mobile computing and privacy preserving in mobile sensor networks.
Yiran Shen received the PhD degree in computer science and engineering from the University of New South Wales. He is an associate professor in the College of Computer Science and Technology, Harbin Engineering University (HEU). He was SMART Scholar at Singapore-MIT Alliance for Research and Technology before he joined HEU. He publishes regularly at top-tier conferences and journals. His current research interests are wearable/ mobile computing, wireless sensor networks and applications of compressive sensing. He is a member of the IEEE.
Fengyuan Yang is a Graduate student in the College of Computer Science and Technology, Harbin Engineering University (HEU). His current research interests are wearable/ mobile computing.
Jianpei Zhang is the Professor at College of Computer Science and Technology, Harbin Engineering University. He is also the leader of Software and Social Computing Research Group. He received his PhD from Harbin Engineering University. His research interests include data mining, database systems and software engineering.
Wanli Xue is a PhD candidate in Department of Computer Science and Engineer of the University of New South Wales. He is also a member of Networks Research Group of Data61 CSIRO, which used to be NICTA. He received the Master degree from the University of Tasmania. His current research interests as well as PhD topic are about Cyber-Physical Systems and private IoT.
Hongkai Wen is an Assistant Professor in Department of Computer Science, University of Warwick. Before that he obtained his D.Phil at the University of Oxford, and became a post-doctoral researcher in a joint project between Oxford Computer Science and Robotics Institute. Broadly speaking, his research belongs to the area of Cyber-Physical Systems, which use networked smart devices to sense and interactive with the physical world.