-
The Visual Experience Dataset: Over 200 Recorded Hours of Integrated Eye Movement, Odometry, and Egocentric Video
Authors:
Michelle R. Greene,
Benjamin J. Balas,
Mark D. Lescroart,
Paul R. MacNeilage,
Jennifer A. Hart,
Kamran Binaee,
Peter A. Hausamann,
Ronald Mezile,
Bharath Shankar,
Christian B. Sinnott,
Kaylie Capurro,
Savannah Halow,
Hunter Howe,
Mariam Josyula,
Annie Li,
Abraham Mieses,
Amina Mohamed,
Ilya Nudnou,
Ezra Parkhill,
Peter Riley,
Brett Schmidt,
Matthew W. Shinkle,
Wentao Si,
Brian Szekely,
Joaquin M. Torres
, et al. (1 additional authors not shown)
Abstract:
We introduce the Visual Experience Dataset (VEDB), a compilation of over 240 hours of egocentric video combined with gaze- and head-tracking data that offers an unprecedented view of the visual world as experienced by human observers. The dataset consists of 717 sessions, recorded by 58 observers ranging from 6-49 years old. This paper outlines the data collection, processing, and labeling protoco…
▽ More
We introduce the Visual Experience Dataset (VEDB), a compilation of over 240 hours of egocentric video combined with gaze- and head-tracking data that offers an unprecedented view of the visual world as experienced by human observers. The dataset consists of 717 sessions, recorded by 58 observers ranging from 6-49 years old. This paper outlines the data collection, processing, and labeling protocols undertaken to ensure a representative sample and discusses the potential sources of error or bias within the dataset. The VEDB's potential applications are vast, including improving gaze tracking methodologies, assessing spatiotemporal image statistics, and refining deep neural networks for scene and activity recognition. The VEDB is accessible through established open science platforms and is intended to be a living dataset with plans for expansion and community contributions. It is released with an emphasis on ethical considerations, such as participant privacy and the mitigation of potential biases. By providing a dataset grounded in real-world experiences and accompanied by extensive metadata and supporting code, the authors invite the research community to utilize and contribute to the VEDB, facilitating a richer understanding of visual perception and behavior in naturalistic settings.
△ Less
Submitted 13 August, 2024; v1 submitted 15 February, 2024;
originally announced April 2024.
-
Descriptive Complexity of Deterministic Polylogarithmic Time and Space
Authors:
Flavio Ferrarotti,
Senén González,
José María Turull Torres,
Jan Van den Bussche,
Jonni Virtema
Abstract:
We propose logical characterizations of problems solvable in deterministic polylogarithmic time (PolylogTime) and polylogarithmic space (PolylogSpace). We introduce a novel two-sorted logic that separates the elements of the input domain from the bit positions needed to address these elements. We prove that the inflationary and partial fixed point vartiants of this logic capture PolylogTime and Po…
▽ More
We propose logical characterizations of problems solvable in deterministic polylogarithmic time (PolylogTime) and polylogarithmic space (PolylogSpace). We introduce a novel two-sorted logic that separates the elements of the input domain from the bit positions needed to address these elements. We prove that the inflationary and partial fixed point vartiants of this logic capture PolylogTime and PolylogSpace, respectively. In the course of proving that our logic indeed captures PolylogTime on finite ordered structures, we introduce a variant of random-access Turing machines that can access the relations and functions of a structure directly. We investigate whether an explicit predicate for the ordering of the domain is needed in our PolylogTime logic. Finally, we present the open problem of finding an exact characterization of order-invariant queries in PolylogTime.
△ Less
Submitted 1 December, 2019; v1 submitted 8 March, 2019;
originally announced March 2019.
-
Towards an ASM thesis for reflective sequential algorithms
Authors:
Flavio Ferrarotti,
Loredana Tec,
Jose Maria Turull Torres
Abstract:
Starting from Gurevich's thesis for sequential algorithms (the so-called "sequential ASM thesis"), we propose a characterization of the behaviour of sequential algorithms enriched with reflection. That is, we present a set of postulates which we conjecture capture the fundamental properties of reflective sequential algorithms (RSAs). Then we look at the plausibility of an ASM thesis for the class…
▽ More
Starting from Gurevich's thesis for sequential algorithms (the so-called "sequential ASM thesis"), we propose a characterization of the behaviour of sequential algorithms enriched with reflection. That is, we present a set of postulates which we conjecture capture the fundamental properties of reflective sequential algorithms (RSAs). Then we look at the plausibility of an ASM thesis for the class of RSAs, defining a model of abstract state machine (which we call reflective ASM) that we conjecture captures the class of RSAs as defined by our postulates.
△ Less
Submitted 30 May, 2017;
originally announced May 2017.
-
Expressing Properties in Second and Third Order Logic: Hypercube Graphs and SATQBF
Authors:
F. Ferrarotti,
W. Ren,
J. M. Turull Torres
Abstract:
It follows from the famous Fagin's theorem that all problems in NP are expressible in existential second-order logic (ESO), and vice versa. Indeed, there are well-known ESO characterizations of NP-complete problems such as 3-colorability, Hamiltonicity and clique. Furthermore, the ESO sentences that characterize those problems are simple and elegant. However, there are also NP problems that do not…
▽ More
It follows from the famous Fagin's theorem that all problems in NP are expressible in existential second-order logic (ESO), and vice versa. Indeed, there are well-known ESO characterizations of NP-complete problems such as 3-colorability, Hamiltonicity and clique. Furthermore, the ESO sentences that characterize those problems are simple and elegant. However, there are also NP problems that do not seem to possess equally simple and elegant ESO characterizations. In this work, we are mainly interested in this latter class of problems. In particular, we characterize in second-order logic the class of hypercube graphs and the classes SATQBF_k of satisfiable quantified Boolean formulae with k alternations of quantifiers. We also provide detailed descriptions of the strategies followed to obtain the corresponding nontrivial second-order sentences. Finally, we sketch a third-order logic sentence that defines the class SATQBF = \bigcup_{k \geq 1} SATQBF_k. The sub-formulae used in the construction of these complex second- and third-order logic sentences, are good candidates to form part of a library of formulae. Same as libraries of frequently used functions simplify the writing of complex computer programs, a library of formulae could potentially simplify the writing of complex second- and third-order queries, minimizing the probability of error.
△ Less
Submitted 21 February, 2013;
originally announced February 2013.
