论文标题
递归深层视频:一种超级分辨率算法,用于片芯片实验的延时显微镜
Recursive Deep Prior Video: a Super Resolution algorithm for Time-Lapse Microscopy of organ-on-chip experiments
论文作者
论文摘要
基于芯片(OOC)的生物学实验利用轻度延时显微镜(TLM)直接观察细胞运动,这是基本生物学过程的可观察的特征。高空间分辨率对于通过TLM从记录的实验中捕获细胞动力学和相互作用至关重要。不幸的是,由于身体和成本限制,并非总是可能获得高分辨率视频。为了克服这个问题,我们在这里提出了一种新的基于深度学习的算法,该算法将众所周知的深层图像(DIP)扩展到TLM视频超级分辨率(SR),而无需进行任何培训。提出的递归深层视频(RDPV)方法引入了一些新颖性。根据新的递归更新规则与有效的早期停止标准相结合,对每个框架的浸入网络体系结构的权重开始初始化。此外,DIP损失函数受到两个基于两个不同的总变化(TV)项的惩罚。该方法已在合成(即人为生成)以及与肿瘤免疫相互作用相关的OOC实验的真实视频中进行了验证。将实现的结果与几种最先进的深度学习SR算法进行了比较。
Biological experiments based on organ-on-chips (OOCs) exploit light Time-Lapse Microscopy (TLM) for a direct observation of cell movement that is an observable signature of underlying biological processes. A high spatial resolution is essential to capture cell dynamics and interactions from recorded experiments by TLM. Unfortunately, due to physical and cost limitations, acquiring high resolution videos is not always possible. To overcome the problem, we present here a new deep learning-based algorithm that extends the well known Deep Image Prior (DIP) to TLM Video Super Resolution (SR) without requiring any training. The proposed Recursive Deep Prior Video (RDPV) method introduces some novelties. The weights of the DIP network architecture are initialized for each of the frames according to a new recursive updating rule combined with an efficient early stopping criterion. Moreover, the DIP loss function is penalized by two different Total Variation (TV) based terms. The method has been validated on synthetic, i.e., artificially generated, as well as real videos from OOC experiments related to tumor-immune interaction. Achieved results are compared with several state-of-the-art trained deep learning SR algorithms showing outstanding performances.