Biological experiments based on organ-on-chips (OOCs) exploit light Time-Lapse Microscopy (TLM) for a direct observation of cell movement that is an observable signature of underlying biological processes. A high spatial resolution is essential to capture cell dynamics and interactions from recorded experiments by TLM. Unfortunately, due to physical and cost limitations, acquiring high resolution videos is not always possible. To overcome the problem, we present here a new deep learning-based algorithm that extends the well-known Deep Image Prior (DIP) to TLM Video Super Resolution without requiring any training. The proposed Recursive Deep Prior Video method introduces some novelties. The weights of the DIP network architecture are initialized for each of the frames according to a new recursive updating rule combined with an efficient early stopping criterion. Moreover, the DIP loss function is penalized by two different Total Variation-based terms. The method has been validated on synthetic, i.e., artificially generated, as well as real videos from OOC experiments related to tumor-immune interaction. The achieved results are compared with several state-of-the-art trained deep learning Super Resolution algorithms showing outstanding performances.

Cascarano, P., Comes, M.c., Mencattini, A., Parrini, M.c., Piccolomini, E.l., Martinelli, E. (2021). Recursive Deep Prior Video: A super resolution algorithm for time-lapse microscopy of organ-on-chip experiments. MEDICAL IMAGE ANALYSIS, 72 [10.1016/j.media.2021.102124].

Recursive Deep Prior Video: A super resolution algorithm for time-lapse microscopy of organ-on-chip experiments

Mencattini A.;Martinelli E.
2021-01-01

Abstract

Biological experiments based on organ-on-chips (OOCs) exploit light Time-Lapse Microscopy (TLM) for a direct observation of cell movement that is an observable signature of underlying biological processes. A high spatial resolution is essential to capture cell dynamics and interactions from recorded experiments by TLM. Unfortunately, due to physical and cost limitations, acquiring high resolution videos is not always possible. To overcome the problem, we present here a new deep learning-based algorithm that extends the well-known Deep Image Prior (DIP) to TLM Video Super Resolution without requiring any training. The proposed Recursive Deep Prior Video method introduces some novelties. The weights of the DIP network architecture are initialized for each of the frames according to a new recursive updating rule combined with an efficient early stopping criterion. Moreover, the DIP loss function is penalized by two different Total Variation-based terms. The method has been validated on synthetic, i.e., artificially generated, as well as real videos from OOC experiments related to tumor-immune interaction. The achieved results are compared with several state-of-the-art trained deep learning Super Resolution algorithms showing outstanding performances.
2021
Pubblicato
Rilevanza internazionale
Articolo
Esperti anonimi
Settore ING-INF/07 - MISURE ELETTRICHE ED ELETTRONICHE
English
Convolutional neural networks
Deep image prior
Light time-lapse microscopy
Living cell videos
Super resolution
Algorithms
Image Processing, Computer-Assisted
Time-Lapse Imaging
Microscopy
Neural Networks, Computer
Cascarano, P., Comes, M.c., Mencattini, A., Parrini, M.c., Piccolomini, E.l., Martinelli, E. (2021). Recursive Deep Prior Video: A super resolution algorithm for time-lapse microscopy of organ-on-chip experiments. MEDICAL IMAGE ANALYSIS, 72 [10.1016/j.media.2021.102124].
Cascarano, P; Comes, Mc; Mencattini, A; Parrini, Mc; Piccolomini, El; Martinelli, E
Articolo su rivista
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2108/289497
Citazioni
  • ???jsp.display-item.citation.pmc??? 2
  • Scopus 17
  • ???jsp.display-item.citation.isi??? 15
social impact