In recent years, following the exploding spread of Social Networking platforms, more and more people have started to share large quantities of data on Internet where they express personal opinions, ideas or emotional states regarding any kind of topic. With the increasing amount of these type of data, finding a way to analyzing it has become a need for major companies, political parties or whatever organization based on its own customers’ feedback. This paper proposes a new case of study that has seen a limited assortment of similar proposals in the current state-of-art: in particular, we propose an innovative approach for analyzing both visual and textual features of Social Media images using Deep Convolutional Neural Networks (DCNNs), in order to collect more accurate results than the single analysis of both type can do alone. The deep learning approach estimates the overall sentiment of daily news-related pictures from social media based on both visual and textual clues. The proposed approach was applied and tested on a new public dataset with more than 9.000 annotated Instagram images. Experimental results confirmed the effectiveness of the approach, showing high values of accuracy.

Visual and textual sentiment analysis of daily news social media images by deep learning

Paolanti M.;Frontoni E.;
2019-01-01

Abstract

In recent years, following the exploding spread of Social Networking platforms, more and more people have started to share large quantities of data on Internet where they express personal opinions, ideas or emotional states regarding any kind of topic. With the increasing amount of these type of data, finding a way to analyzing it has become a need for major companies, political parties or whatever organization based on its own customers’ feedback. This paper proposes a new case of study that has seen a limited assortment of similar proposals in the current state-of-art: in particular, we propose an innovative approach for analyzing both visual and textual features of Social Media images using Deep Convolutional Neural Networks (DCNNs), in order to collect more accurate results than the single analysis of both type can do alone. The deep learning approach estimates the overall sentiment of daily news-related pictures from social media based on both visual and textual clues. The proposed approach was applied and tested on a new public dataset with more than 9.000 annotated Instagram images. Experimental results confirmed the effectiveness of the approach, showing high values of accuracy.
2019
978-3-030-30641-0
978-3-030-30642-7
File in questo prodotto:
File Dimensione Formato  
ICIAP_2019.pdf

solo utenti autorizzati

Tipologia: Licenza (contratto editoriale)
Licenza: Tutti i diritti riservati
Dimensione 63.86 MB
Formato Adobe PDF
63.86 MB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11393/291039
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 4
  • ???jsp.display-item.citation.isi??? 3
social impact