论文标题
结合可见光和红外成像,以有效检测呼吸道感染,例如便携式装置上的Covid-19
Combining Visible Light and Infrared Imaging for Efficient Detection of Respiratory Infections such as COVID-19 on Portable Device
论文作者
论文摘要
在过去的几个月中,2019年冠状病毒病(Covid-19)已成为严重的全球流行病,并在全球范围内造成了巨大的损失。对于如此大规模的流行病,对潜在病毒载体的早期检测和分离对于遏制流行病的传播至关重要。最近的研究表明,Covid-19的一个重要特征是病毒感染引起的异常呼吸状态。在流行病期间,许多人倾向于戴口罩以降低生病的风险。因此,在本文中,我们提出了一种便携式非接触方法,以通过分析呼吸特征来筛选戴口罩的健康状况。该设备主要由Flir One Thermal相机和一部Android手机组成。这可能有助于在实际情况(例如学校和医院的预测)下确定COVID-19的潜在患者。在这项工作中,我们通过从双模式摄像机和深度学习体系结构获得的RGB和热视频的组合进行了健康筛查。我们首先通过使用面部识别来为戴口罩的人们完成呼吸道数据捕获技术。然后,将具有注意机制的双向GRU神经网络应用于呼吸数据,以获得健康筛查结果。验证实验的结果表明,我们的模型可以在现实世界数据集中以83.7 \%的精度识别呼吸中的健康状况。异常的呼吸数据和正常呼吸数据的一部分是从隶属于上海若o汤大学医学院的瑞昂医院收集的。其他正常的呼吸数据是从研究人员周围健康的人那里获得的。这项工作表明,提议的便携式和智能健康筛查装置可以用作呼吸道感染的预扫描方法,这可能有助于对抗当前的Covid-19-19。
Coronavirus Disease 2019 (COVID-19) has become a serious global epidemic in the past few months and caused huge loss to human society worldwide. For such a large-scale epidemic, early detection and isolation of potential virus carriers is essential to curb the spread of the epidemic. Recent studies have shown that one important feature of COVID-19 is the abnormal respiratory status caused by viral infections. During the epidemic, many people tend to wear masks to reduce the risk of getting sick. Therefore, in this paper, we propose a portable non-contact method to screen the health condition of people wearing masks through analysis of the respiratory characteristics. The device mainly consists of a FLIR one thermal camera and an Android phone. This may help identify those potential patients of COVID-19 under practical scenarios such as pre-inspection in schools and hospitals. In this work, we perform the health screening through the combination of the RGB and thermal videos obtained from the dual-mode camera and deep learning architecture.We first accomplish a respiratory data capture technique for people wearing masks by using face recognition. Then, a bidirectional GRU neural network with attention mechanism is applied to the respiratory data to obtain the health screening result. The results of validation experiments show that our model can identify the health status on respiratory with the accuracy of 83.7\% on the real-world dataset. The abnormal respiratory data and part of normal respiratory data are collected from Ruijin Hospital Affiliated to The Shanghai Jiao Tong University Medical School. Other normal respiratory data are obtained from healthy people around our researchers. This work demonstrates that the proposed portable and intelligent health screening device can be used as a pre-scan method for respiratory infections, which may help fight the current COVID-19 epidemic.