The advances in the deep learning field have paved the way to novel strategies to represent digital image data in the form of synthetic descriptors. Variational Auto-Encoders (VAE) architectures are generative powerful tools not only to reconstruct input images but also to extract meaningful information for the task of pattern classification. The first part of the VAE network, called encoder, aims to condense the image information into a reduced set of low-level descriptors, called latent variables. The second part, called decoder, aims to use the latent variable in a reverse process that reconstructs the original image in output. In this work, we exploited the VAE-based latent representation of colour normalized dermoscopic images for the discrimination of malignant and benign skin lesions. In particular, we investigated the sensitivity to the effect of skin colour variations over the final reconstruction error and on the discrimination capability of the VAE latent variables in terms of individual Area Under the roC curve (AUC). By exploiting and adapting state-of-the art skin colour variation models we obtained a performance worsening of about 10% either in the reconstruction error and in the discrimination capability of the latent variables. The achieved preliminary results demonstrate that, with suitable VAE adaptation, latent descriptors could be used in automatic skin lesions classification frameworks.

Casti, P., Mencattini, A., Cardarelli, S., Antonelli, G., Filippi, J., D(')Orazio, M., et al. (2022). Sensitivity analysis of latent variables in Variational Autoencoders for Dermoscopic Image Analysis. In 2022 IEEE International Symposium on Medical Measurements and Applications (MeMeA): proceedings (pp.1-6). New York : IEEE [10.1109/MeMeA54994.2022.9856459].

Sensitivity analysis of latent variables in Variational Autoencoders for Dermoscopic Image Analysis

Casti, P.;Mencattini, A.;Cardarelli, S.;Antonelli, G.;Filippi, J.;D(')Orazio, M.;Martinelli, E.
2022-01-01

Abstract

The advances in the deep learning field have paved the way to novel strategies to represent digital image data in the form of synthetic descriptors. Variational Auto-Encoders (VAE) architectures are generative powerful tools not only to reconstruct input images but also to extract meaningful information for the task of pattern classification. The first part of the VAE network, called encoder, aims to condense the image information into a reduced set of low-level descriptors, called latent variables. The second part, called decoder, aims to use the latent variable in a reverse process that reconstructs the original image in output. In this work, we exploited the VAE-based latent representation of colour normalized dermoscopic images for the discrimination of malignant and benign skin lesions. In particular, we investigated the sensitivity to the effect of skin colour variations over the final reconstruction error and on the discrimination capability of the VAE latent variables in terms of individual Area Under the roC curve (AUC). By exploiting and adapting state-of-the art skin colour variation models we obtained a performance worsening of about 10% either in the reconstruction error and in the discrimination capability of the latent variables. The achieved preliminary results demonstrate that, with suitable VAE adaptation, latent descriptors could be used in automatic skin lesions classification frameworks.
IEEE International Symposium on Medical Measurements and Applications (MeMeA 2022)
Messina, Italy
2022
17
Rilevanza internazionale
2022
Settore IMIS-01/B - Misure elettriche ed elettroniche
English
Dermoscopy
Sensitivity analysis
Skin colour model
Skin lesions
Variational autoencoders
Intervento a convegno
Casti, P., Mencattini, A., Cardarelli, S., Antonelli, G., Filippi, J., D(')Orazio, M., et al. (2022). Sensitivity analysis of latent variables in Variational Autoencoders for Dermoscopic Image Analysis. In 2022 IEEE International Symposium on Medical Measurements and Applications (MeMeA): proceedings (pp.1-6). New York : IEEE [10.1109/MeMeA54994.2022.9856459].
Casti, P; Mencattini, A; Cardarelli, S; Antonelli, G; Filippi, J; D(')Orazio, M; Martinelli, E
File in questo prodotto:
File Dimensione Formato  
Sensitivity_analysis_of_latent_variables_in_Variational_Autoencoders_for_Dermoscopic_Image_Analysis.pdf

solo utenti autorizzati

Tipologia: Versione Editoriale (PDF)
Licenza: Copyright dell'editore
Dimensione 1.77 MB
Formato Adobe PDF
1.77 MB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2108/430263
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 3
  • ???jsp.display-item.citation.isi??? 1
social impact