-
For a semiotic AI: Bridging computer vision and visual semiotics for computational observation of large scale facial image archives
Authors:
Lia Morra,
Antonio Santangelo,
Pietro Basci,
Luca Piano,
Fabio Garcea,
Fabrizio Lamberti,
Massimo Leone
Abstract:
Social networks are creating a digital world in which the cognitive, emotional, and pragmatic value of the imagery of human faces and bodies is arguably changing. However, researchers in the digital humanities are often ill-equipped to study these phenomena at scale. This work presents FRESCO (Face Representation in E-Societies through Computational Observation), a framework designed to explore th…
▽ More
Social networks are creating a digital world in which the cognitive, emotional, and pragmatic value of the imagery of human faces and bodies is arguably changing. However, researchers in the digital humanities are often ill-equipped to study these phenomena at scale. This work presents FRESCO (Face Representation in E-Societies through Computational Observation), a framework designed to explore the socio-cultural implications of images on social media platforms at scale. FRESCO deconstructs images into numerical and categorical variables using state-of-the-art computer vision techniques, aligning with the principles of visual semiotics. The framework analyzes images across three levels: the plastic level, encompassing fundamental visual features like lines and colors; the figurative level, representing specific entities or concepts; and the enunciation level, which focuses particularly on constructing the point of view of the spectator and observer. These levels are analyzed to discern deeper narrative layers within the imagery. Experimental validation confirms the reliability and utility of FRESCO, and we assess its consistency and precision across two public datasets. Subsequently, we introduce the FRESCO score, a metric derived from the framework's output that serves as a reliable measure of similarity in image content.
△ Less
Submitted 3 July, 2024;
originally announced July 2024.
-
Sleep Apnea and Respiratory Anomaly Detection from a Wearable Band and Oxygen Saturation
Authors:
Wolfgang Ganglberger,
Abigail A. Bucklin,
Ryan A. Tesh,
Madalena Da Silva Cardoso,
Haoqi Sun,
Michael J. Leone,
Luis Paixao,
Ezhil Panneerselvam,
Elissa M. Ye,
B. Taylor Thompson,
Oluwaseun Akeju,
David Kuller,
Robert J. Thomas,
M. Brandon Westover
Abstract:
Objective: Sleep related respiratory abnormalities are typically detected using polysomnography. There is a need in general medicine and critical care for a more convenient method to automatically detect sleep apnea from a simple, easy-to-wear device. The objective is to automatically detect abnormal respiration and estimate the Apnea-Hypopnea-Index (AHI) with a wearable respiratory device, compar…
▽ More
Objective: Sleep related respiratory abnormalities are typically detected using polysomnography. There is a need in general medicine and critical care for a more convenient method to automatically detect sleep apnea from a simple, easy-to-wear device. The objective is to automatically detect abnormal respiration and estimate the Apnea-Hypopnea-Index (AHI) with a wearable respiratory device, compared to an SpO2 signal or polysomnography using a large (n = 412) dataset serving as ground truth. Methods: Simultaneously recorded polysomnographic (PSG) and wearable respiratory effort data were used to train and evaluate models in a cross-validation fashion. Time domain and complexity features were extracted, important features were identified, and a random forest model employed to detect events and predict AHI. Four models were trained: one each using the respiratory features only, a feature from the SpO2 (%)-signal only, and two additional models that use the respiratory features and the SpO2 (%)-feature, one allowing a time lag of 30 seconds between the two signals. Results: Event-based classification resulted in areas under the receiver operating characteristic curves of 0.94, 0.86, 0.82, and areas under the precision-recall curves of 0.48, 0.32, 0.51 for the models using respiration and SpO2, respiration-only, and SpO2-only respectively. Correlation between expert-labelled and predicted AHI was 0.96, 0.78, and 0.93, respectively. Conclusions: A wearable respiratory effort signal with or without SpO2 predicted AHI accurately. Given the large dataset and rigorous testing design, we expect our models are generalizable to evaluating respiration in a variety of environments, such as at home and in critical care.
△ Less
Submitted 23 February, 2021;
originally announced February 2021.
-
Multiscale socio-ecological networks in the age of information
Authors:
Maxime Lenormand,
Sandra Luque,
Johannes Langemeyer,
Patrizia Tenerelli,
Grazia Zulian,
Inge Aalders,
Serban Chivulescu,
Pedro Clemente,
Jan Dick,
Jiska van Dijk,
Michiel van Eupen,
Relu C. Giuca,
Leena Kopperoinen,
Eszter Lellei-Kovács,
Michael Leone,
Juraj Lieskovský,
Uta Schirpke,
Alison C. Smith,
Ulrike Tappeiner,
Helen Woods
Abstract:
Interactions between people and ecological systems, through leisure or tourism activities, form a complex socio-ecological spatial network. The analysis of the benefits people derive from their interactions with nature -- also referred to as cultural ecosystem services (CES) -- enables a better understanding of these socio-ecological systems. In the age of information, the increasing availability…
▽ More
Interactions between people and ecological systems, through leisure or tourism activities, form a complex socio-ecological spatial network. The analysis of the benefits people derive from their interactions with nature -- also referred to as cultural ecosystem services (CES) -- enables a better understanding of these socio-ecological systems. In the age of information, the increasing availability of large social media databases enables a better understanding of complex socio-ecological interactions at an unprecedented spatio-temporal resolution. Within this context, we model and analyze these interactions based on information extracted from geotagged photographs embedded into a multiscale socio-ecological network. We apply this approach to 16 case study sites in Europe using a social media database (Flickr) containing more than 150,000 validated and classified photographs. After evaluating the representativeness of the network, we investigate the impact of visitors' origin on the distribution of socio-ecological interactions at different scales. First at a global scale, we develop a spatial measure of attractiveness and use this to identify four groups of sites. Then, at a local scale, we explore how the distance traveled by the users to reach a site affects the way they interact with this site in space and time. The approach developed here, integrating social media data into a network-based framework, offers a new way of visualizing and modeling interactions between humans and landscapes. Results provide valuable insights for understanding relationships between social demands for CES and the places of their realization, thus allowing for the development of more efficient conservation and planning strategies.
△ Less
Submitted 2 November, 2018; v1 submitted 2 May, 2018;
originally announced May 2018.
-
Hiding solutions in random satisfiability problems: A statistical mechanics approach
Authors:
W. Barthel,
A. K. Hartmann,
M. Leone,
F. Ricci-Tersenghi,
M. Weigt,
R. Zecchina
Abstract:
A major problem in evaluating stochastic local search algorithms for NP-complete problems is the need for a systematic generation of hard test instances having previously known properties of the optimal solutions. On the basis of statistical mechanics results, we propose random generators of hard and satisfiable instances for the 3-satisfiability problem (3SAT). The design of the hardest problem…
▽ More
A major problem in evaluating stochastic local search algorithms for NP-complete problems is the need for a systematic generation of hard test instances having previously known properties of the optimal solutions. On the basis of statistical mechanics results, we propose random generators of hard and satisfiable instances for the 3-satisfiability problem (3SAT). The design of the hardest problem instances is based on the existence of a first order ferromagnetic phase transition and the glassy nature of excited states. The analytical predictions are corroborated by numerical results obtained from complete as well as stochastic local algorithms.
△ Less
Submitted 27 March, 2002; v1 submitted 9 November, 2001;
originally announced November 2001.
-
Exact solutions for diluted spin glasses and optimization problems
Authors:
S. Franz,
M. Leone,
F. Ricci-Tersenghi,
R. Zecchina
Abstract:
We study the low temperature properties of p-spin glass models with finite connectivity and of some optimization problems. Using a one-step functional replica symmetry breaking Ansatz we can solve exactly the saddle-point equations for graphs with uniform connectivity. The resulting ground state energy is in perfect agreement with numerical simulations. For fluctuating connectivity graphs, the s…
▽ More
We study the low temperature properties of p-spin glass models with finite connectivity and of some optimization problems. Using a one-step functional replica symmetry breaking Ansatz we can solve exactly the saddle-point equations for graphs with uniform connectivity. The resulting ground state energy is in perfect agreement with numerical simulations. For fluctuating connectivity graphs, the same Ansatz can be used in a variational way: For p-spin models (known as p-XOR-SAT in computer science) it provides the exact configurational entropy together with the dynamical and static critical connectivities (for p=3, γ_d=0.818 and γ_s=0.918 resp.), whereas for hard optimization problems like 3-SAT or Bicoloring it provides new upper bounds for their critical thresholds (γ_c^{var}=4.396 and γ_c^{var}=2.149 resp.).
△ Less
Submitted 15 August, 2001; v1 submitted 15 March, 2001;
originally announced March 2001.
