-
gaspery: Optimized Scheduling of Radial Velocity Follow-Up Observations for Active Host Stars
Authors:
Christopher Lam,
Megan Bedell,
Lily L. Zhao,
Arvind F. Gupta,
Sarah A. Ballard
Abstract:
Radial velocity (RV) follow-up is a critical complement of transiting exoplanet surveys like the Transiting Exoplanet Survey Satellite (TESS ), both for validating discoveries of exoplanets and measuring their masses. Stellar activity introduces challenges to interpreting these measurements because the noise from the host star, which is often correlated in time, can result in high RV uncertainty.…
▽ More
Radial velocity (RV) follow-up is a critical complement of transiting exoplanet surveys like the Transiting Exoplanet Survey Satellite (TESS ), both for validating discoveries of exoplanets and measuring their masses. Stellar activity introduces challenges to interpreting these measurements because the noise from the host star, which is often correlated in time, can result in high RV uncertainty. A robust understanding of stellar activity and how its timescales interact with the observing cadence can optimize limited RV resources. For this reason, in the era of over-subscribed, high-precision RV measurements, folding stellar activity timescales into the scheduling of observation campaigns is ideal. We present gaspery, an open-source code implementation to enable the optimization of RV observing strategies. Gaspery employs a generalized formulation of the Fisher Information for RV time series that also incorporates information about stellar correlated noise. We show that the information contained in an observing strategy can be significantly affected by beat frequencies between the orbital period of the planet, the stellar rotation period, and the observation epochs. We investigate how the follow-up observing strategy will affect the resulting radial velocity uncertainty, as a function of stellar properties such as the spot decay timescale and rotation period. We then describe two example use cases for gaspery: 1) calculating the minimum number of observations to reach an uncertainty tolerance in a correlated noise regime and 2) finding an optimal strategy given a fixed observing budget. Finally, we outline a prescription for selecting an observing strategy that is generalizable to different targets.
△ Less
Submitted 29 August, 2024;
originally announced August 2024.
-
Plausibility of Capture into High-Obliquity States for Exoplanets in the M Dwarf Habitable Zone
Authors:
Natalia M. Guerrero,
Sarah A. Ballard
Abstract:
For temperate exoplanets orbiting M dwarf hosts, the proximity of the habitable zone to the star necessitates careful consideration of tidal effects. Spin synchronization of the planetary orbital period and rotation period is a common assumption for habitable zone planets across the entire M spectral type. This predicted tidal locking has important implications for conditions on the surface. In th…
▽ More
For temperate exoplanets orbiting M dwarf hosts, the proximity of the habitable zone to the star necessitates careful consideration of tidal effects. Spin synchronization of the planetary orbital period and rotation period is a common assumption for habitable zone planets across the entire M spectral type. This predicted tidal locking has important implications for conditions on the surface. In this manuscript, we investigate the plausibility of capture into Cassini State 2 for a known sample of 280 multiplanet systems orbiting M dwarf hosts. This resonance of the spin precession and orbital precession frequencies is capable of exciting planets into stable nonzero rotational obliquities. A large axial tilt resulting from this predicted resonance capture can preclude synchronous rotation, inducing some version of "day" and "night." Considering each planetary pair and estimating the spin and orbital precession frequencies, we report that 75% of detected planets orbiting M dwarfs may be plausibly excited to a high obliquity over long timescales. This is consistent with similar findings for planets orbiting close-in to FGK dwarfs. However, it is only for M dwarf planets that the parameter space relevant for capture into Cassini State 2 overlaps with the stellar habitable zone. This effect is strongest for host stars with effective temperatures $T_{eff}<3000$ K, where more than half of planets with $T_{eq}<400$ K could possess non-zero obliquity due to residence in Cassini State 2. This overlap renders the potential capture into Cassini States extremely relevant to understanding the galaxy's most common temperate planets.
△ Less
Submitted 3 October, 2023;
originally announced October 2023.
-
Advancing Community Engaged Approaches to Identifying Structural Drivers of Racial Bias in Health Diagnostic Algorithms
Authors:
Jill A. Kuhlberg,
Irene Headen,
Ellis A. Ballard,
Donald Martin Jr.
Abstract:
Much attention and concern has been raised recently about bias and the use of machine learning algorithms in healthcare, especially as it relates to perpetuating racial discrimination and health disparities. Following an initial system dynamics workshop at the Data for Black Lives II conference hosted at MIT in January of 2019, a group of conference participants interested in building capabilities…
▽ More
Much attention and concern has been raised recently about bias and the use of machine learning algorithms in healthcare, especially as it relates to perpetuating racial discrimination and health disparities. Following an initial system dynamics workshop at the Data for Black Lives II conference hosted at MIT in January of 2019, a group of conference participants interested in building capabilities to use system dynamics to understand complex societal issues convened monthly to explore issues related to racial bias in AI and implications for health disparities through qualitative and simulation modeling. In this paper we present results and insights from the modeling process and highlight the importance of centering the discussion of data and healthcare on people and their experiences with healthcare and science, and recognizing the societal context where the algorithm is operating. Collective memory of community trauma, through deaths attributed to poor healthcare, and negative experiences with healthcare are endogenous drivers of seeking treatment and experiencing effective care, which impact the availability and quality of data for algorithms. These drivers have drastically disparate initial conditions for different racial groups and point to limited impact of focusing solely on improving diagnostic algorithms for achieving better health outcomes for some groups.
△ Less
Submitted 22 May, 2023;
originally announced May 2023.
-
Single Flux Quantum-Based Digital Control of Superconducting Qubits in a Multi-Chip Module
Authors:
Chuan-Hong Liu,
Andrew Ballard,
David Olaya,
Daniel R. Schmidt,
John Biesecker,
Tammy Lucas,
Joel Ullom,
Shravan Patel,
Owen Rafferty,
Alexander Opremcak,
Kenneth Dodge,
Vito Iaia,
Tianna McBroom,
Jonathan L. Dubois,
Pete F. Hopkins,
Samuel P. Benz,
Britton L. T. Plourde,
Robert McDermott
Abstract:
The single flux quantum (SFQ) digital superconducting logic family has been proposed for the scalable control of next-generation superconducting qubit arrays. In the initial implementation, SFQ-based gate fidelity was limited by quasiparticle (QP) poisoning induced by the dissipative on-chip SFQ driver circuit. In this work, we introduce a multi-chip module architecture to suppress phonon-mediated…
▽ More
The single flux quantum (SFQ) digital superconducting logic family has been proposed for the scalable control of next-generation superconducting qubit arrays. In the initial implementation, SFQ-based gate fidelity was limited by quasiparticle (QP) poisoning induced by the dissipative on-chip SFQ driver circuit. In this work, we introduce a multi-chip module architecture to suppress phonon-mediated QP poisoning. Here, the SFQ elements and qubits are fabricated on separate chips that are joined with In bump bonds. We use interleaved randomized benchmarking to characterize the fidelity of SFQ-based gates, and we demonstrate an error per Clifford gate of 1.2(1)%, an order-of-magnitude reduction over the gate error achieved in the initial realization of SFQ-based qubit control. We use purity benchmarking to quantify the contribution of incoherent error at 0.96(2)%; we attribute this error to photon-mediated QP poisoning mediated by the resonant mm-wave antenna modes of the qubit and SFQ-qubit coupler. We anticipate that a straightforward redesign of the SFQ driver circuit to limit the bandwidth of the SFQ pulses will eliminate this source of infidelity, allowing SFQ-based gates with fidelity approaching theoretical limits, namely 99.9% for resonant sequences and 99.99% for more complex pulse sequences involving variable pulse-to-pulse separation.
△ Less
Submitted 13 January, 2023;
originally announced January 2023.
-
Phonon downconversion to suppress correlated errors in superconducting qubits
Authors:
V. Iaia,
J. Ku,
A. Ballard,
C. P. Larson,
E. Yelton,
C. H. Liu,
S. Patel,
R. McDermott,
B. L. T. Plourde
Abstract:
Quantum error correction can preserve quantum information in the presence of local errors, but correlated errors are fatal. For superconducting qubits, high-energy particle impacts from background radioactivity produce energetic phonons that travel throughout the substrate and create excitations above the superconducting ground state, known as quasiparticles, which can poison all qubits on the chi…
▽ More
Quantum error correction can preserve quantum information in the presence of local errors, but correlated errors are fatal. For superconducting qubits, high-energy particle impacts from background radioactivity produce energetic phonons that travel throughout the substrate and create excitations above the superconducting ground state, known as quasiparticles, which can poison all qubits on the chip. We use normal metal reservoirs on the chip back side to downconvert phonons to low energies where they can no longer poison qubits. We introduce a pump-probe scheme involving controlled injection of pair-breaking phonons into the qubit chips. We examine quasiparticle poisoning on chips with and without back-side metallization and demonstrate a reduction in the flux of pair-breaking phonons by over a factor of 20. We use a Ramsey interferometer scheme to simultaneously monitor quasiparticle parity on three qubits for each chip and observe a two-order of magnitude reduction in correlated poisoning due to background radiation.
△ Less
Submitted 2 November, 2022; v1 submitted 13 March, 2022;
originally announced March 2022.
-
Quasiparticle Poisoning of Superconducting Qubits from Resonant Absorption of Pair-breaking Photons
Authors:
Chuan-Hong Liu,
David C. Harrison,
Shravan Patel,
Christopher D. Wilen,
Owen Rafferty,
Abigail Shearrow,
Andrew Ballard,
Vito Iaia,
Jaseung Ku,
Britton L. T. Plourde,
Robert McDermott
Abstract:
The ideal superconductor provides a pristine environment for the delicate states of a quantum computer: because there is an energy gap to excitations, there are no spurious modes with which the qubits can interact, causing irreversible decay of the quantum state. As a practical matter, however, there exists a high density of excitations out of the superconducting ground state even at ultralow temp…
▽ More
The ideal superconductor provides a pristine environment for the delicate states of a quantum computer: because there is an energy gap to excitations, there are no spurious modes with which the qubits can interact, causing irreversible decay of the quantum state. As a practical matter, however, there exists a high density of excitations out of the superconducting ground state even at ultralow temperature; these are known as quasiparticles. Observed quasiparticle densities are of order 1~$μ$m$^{-3}$, tens of orders of magnitude larger than the equilibrium density expected from theory. Nonequilibrium quasiparticles extract energy from the qubit mode and induce discrete changes in qubit offset charge, a potential source of dephasing. Here we show that a dominant mechanism for quasiparticle poisoning in superconducting qubits is direct absorption of high-energy photons at the qubit junction. We use a Josephson junction-based photon source to controllably dose qubit circuits with millimeter-wave radiation, and we use an interferometric quantum gate sequence to reconstruct the charge parity on the qubit island. We find that the structure of the qubit itself acts as a resonant antenna for millimeter-wave radiation, providing an efficient path for photons to generate quasiparticle excitations. A deep understanding of this physics will pave the way to realization of next-generation superconducting qubits that are robust against quasiparticle poisoning and could enable a new class of quantum sensors for dark matter detection.
△ Less
Submitted 13 March, 2022;
originally announced March 2022.
-
Normalizing flows for atomic solids
Authors:
Peter Wirnsberger,
George Papamakarios,
Borja Ibarz,
Sébastien Racanière,
Andrew J. Ballard,
Alexander Pritzel,
Charles Blundell
Abstract:
We present a machine-learning approach, based on normalizing flows, for modelling atomic solids. Our model transforms an analytically tractable base distribution into the target solid without requiring ground-truth samples for training. We report Helmholtz free energy estimates for cubic and hexagonal ice modelled as monatomic water as well as for a truncated and shifted Lennard-Jones system, and…
▽ More
We present a machine-learning approach, based on normalizing flows, for modelling atomic solids. Our model transforms an analytically tractable base distribution into the target solid without requiring ground-truth samples for training. We report Helmholtz free energy estimates for cubic and hexagonal ice modelled as monatomic water as well as for a truncated and shifted Lennard-Jones system, and find them to be in excellent agreement with literature values and with estimates from established baseline methods. We further investigate structural properties and show that the model samples are nearly indistinguishable from the ones obtained with molecular dynamics. Our results thus demonstrate that normalizing flows can provide high-quality samples and free energy estimates without the need for multi-staging.
△ Less
Submitted 28 April, 2022; v1 submitted 16 November, 2021;
originally announced November 2021.
-
Rapid training of deep neural networks without skip connections or normalization layers using Deep Kernel Shaping
Authors:
James Martens,
Andy Ballard,
Guillaume Desjardins,
Grzegorz Swirszcz,
Valentin Dalibard,
Jascha Sohl-Dickstein,
Samuel S. Schoenholz
Abstract:
Using an extended and formalized version of the Q/C map analysis of Poole et al. (2016), along with Neural Tangent Kernel theory, we identify the main pathologies present in deep networks that prevent them from training fast and generalizing to unseen data, and show how these can be avoided by carefully controlling the "shape" of the network's initialization-time kernel function. We then develop a…
▽ More
Using an extended and formalized version of the Q/C map analysis of Poole et al. (2016), along with Neural Tangent Kernel theory, we identify the main pathologies present in deep networks that prevent them from training fast and generalizing to unseen data, and show how these can be avoided by carefully controlling the "shape" of the network's initialization-time kernel function. We then develop a method called Deep Kernel Shaping (DKS), which accomplishes this using a combination of precise parameter initialization, activation function transformations, and small architectural tweaks, all of which preserve the model class. In our experiments we show that DKS enables SGD training of residual networks without normalization layers on Imagenet and CIFAR-10 classification tasks at speeds comparable to standard ResNetV2 and Wide-ResNet models, with only a small decrease in generalization performance. And when using K-FAC as the optimizer, we achieve similar results for networks without skip connections. Our results apply for a large variety of activation functions, including those which traditionally perform very badly, such as the logistic sigmoid. In addition to DKS, we contribute a detailed analysis of skip connections, normalization layers, special activation functions like RELU and SELU, and various initialization schemes, explaining their effectiveness as alternative (and ultimately incomplete) ways of "shaping" the network's initialization-time kernel.
△ Less
Submitted 4 October, 2021;
originally announced October 2021.
-
Structure in the Event-by-Event Energy-Dependent Neutron-Gamma Multiplicity Correlations in $^{252}\text{Cf}$(sf)
Authors:
Stefano Marin,
Mustapha Stephan Okar,
Eoin P. Sansevero,
Isabel E. Hernandez,
Catherine A. Ballard,
Ramona Vogt,
Jørgen Randrup,
Patrick Talou,
Amy E. Lovell,
Ionel Stetcu,
Olivier Serot,
Olivier Litaize,
Abdelhazize Chebboubi,
Shaun D. Clarke,
Vladimir A. Protopopescu,
Sara A. Pozzi
Abstract:
The emission of neutrons and gamma rays by fission fragments reveal important information about the properties of fragments immediately following scission. The initial fragment properties, correlations between fragments, and emission competition give rise to correlations in neutron-gamma emission. Neutron-gamma correlations are important in nonproliferation applications because the characterizatio…
▽ More
The emission of neutrons and gamma rays by fission fragments reveal important information about the properties of fragments immediately following scission. The initial fragment properties, correlations between fragments, and emission competition give rise to correlations in neutron-gamma emission. Neutron-gamma correlations are important in nonproliferation applications because the characterization of fissionable samples relies on the identification of signatures in the measured radiation. Furthermore, recent theoretical and experimental advances have proposed to explain the mechanism of angular momentum generation in fission. In this paper, we present a novel analysis method of neutrons and gamma rays emitted by fission fragments that allows us to discern structure in the observed correlations. We have analyzed data collected on \ce{^{252}Cf}(sf) at the Chi-Nu array at the Los Alamos Neutron Science Center. Through our analysis of the energy-differential neutron-gamma multiplicity covariance, we have observed enhanced neutron-gamma correlations, corresponding to rotational band gamma-ray transitions, at gamma-ray energies of $0.7$ and $1.2$ MeV. To shed light on the origin of this structure, we compare the experimental data with the predictions of three model calculations. The origin of the observed correlation structure is understood in terms of a positive spin-energy correlation in the generation of angular momentum in fission.
△ Less
Submitted 14 April, 2021; v1 submitted 13 April, 2021;
originally announced April 2021.
-
Targeted free energy estimation via learned mappings
Authors:
Peter Wirnsberger,
Andrew J. Ballard,
George Papamakarios,
Stuart Abercrombie,
Sébastien Racanière,
Alexander Pritzel,
Danilo Jimenez Rezende,
Charles Blundell
Abstract:
Free energy perturbation (FEP) was proposed by Zwanzig more than six decades ago as a method to estimate free energy differences, and has since inspired a huge body of related methods that use it as an integral building block. Being an importance sampling based estimator, however, FEP suffers from a severe limitation: the requirement of sufficient overlap between distributions. One strategy to mit…
▽ More
Free energy perturbation (FEP) was proposed by Zwanzig more than six decades ago as a method to estimate free energy differences, and has since inspired a huge body of related methods that use it as an integral building block. Being an importance sampling based estimator, however, FEP suffers from a severe limitation: the requirement of sufficient overlap between distributions. One strategy to mitigate this problem, called Targeted Free Energy Perturbation, uses a high-dimensional mapping in configuration space to increase overlap of the underlying distributions. Despite its potential, this method has attracted only limited attention due to the formidable challenge of formulating a tractable mapping. Here, we cast Targeted FEP as a machine learning problem in which the mapping is parameterized as a neural network that is optimized so as to increase overlap. We develop a new model architecture that respects permutational and periodic symmetries often encountered in atomistic simulations and test our method on a fully-periodic solvation system. We demonstrate that our method leads to a substantial variance reduction in free energy estimates when compared against baselines, without requiring any additional data.
△ Less
Submitted 18 August, 2020; v1 submitted 12 February, 2020;
originally announced February 2020.
-
Unsupervised Doodling and Painting with Improved SPIRAL
Authors:
John F. J. Mellor,
Eunbyung Park,
Yaroslav Ganin,
Igor Babuschkin,
Tejas Kulkarni,
Dan Rosenbaum,
Andy Ballard,
Theophane Weber,
Oriol Vinyals,
S. M. Ali Eslami
Abstract:
We investigate using reinforcement learning agents as generative models of images (extending arXiv:1804.01118). A generative agent controls a simulated painting environment, and is trained with rewards provided by a discriminator network simultaneously trained to assess the realism of the agent's samples, either unconditional or reconstructions. Compared to prior work, we make a number of improvem…
▽ More
We investigate using reinforcement learning agents as generative models of images (extending arXiv:1804.01118). A generative agent controls a simulated painting environment, and is trained with rewards provided by a discriminator network simultaneously trained to assess the realism of the agent's samples, either unconditional or reconstructions. Compared to prior work, we make a number of improvements to the architectures of the agents and discriminators that lead to intriguing and at times surprising results. We find that when sufficiently constrained, generative agents can learn to produce images with a degree of visual abstraction, despite having only ever seen real photographs (no human brush strokes). And given enough time with the painting environment, they can produce images with considerable realism. These results show that, under the right circumstances, some aspects of human drawing can emerge from simulated embodiment, without the need for external supervision, imitation or social cues. Finally, we note the framework's potential for use in creative applications.
△ Less
Submitted 2 October, 2019;
originally announced October 2019.
-
Relational inductive biases, deep learning, and graph networks
Authors:
Peter W. Battaglia,
Jessica B. Hamrick,
Victor Bapst,
Alvaro Sanchez-Gonzalez,
Vinicius Zambaldi,
Mateusz Malinowski,
Andrea Tacchetti,
David Raposo,
Adam Santoro,
Ryan Faulkner,
Caglar Gulcehre,
Francis Song,
Andrew Ballard,
Justin Gilmer,
George Dahl,
Ashish Vaswani,
Kelsey Allen,
Charles Nash,
Victoria Langston,
Chris Dyer,
Nicolas Heess,
Daan Wierstra,
Pushmeet Kohli,
Matt Botvinick,
Oriol Vinyals
, et al. (2 additional authors not shown)
Abstract:
Artificial intelligence (AI) has undergone a renaissance recently, making major progress in key domains such as vision, language, control, and decision-making. This has been due, in part, to cheap data and cheap compute resources, which have fit the natural strengths of deep learning. However, many defining characteristics of human intelligence, which developed under much different pressures, rema…
▽ More
Artificial intelligence (AI) has undergone a renaissance recently, making major progress in key domains such as vision, language, control, and decision-making. This has been due, in part, to cheap data and cheap compute resources, which have fit the natural strengths of deep learning. However, many defining characteristics of human intelligence, which developed under much different pressures, remain out of reach for current approaches. In particular, generalizing beyond one's experiences--a hallmark of human intelligence from infancy--remains a formidable challenge for modern AI.
The following is part position paper, part review, and part unification. We argue that combinatorial generalization must be a top priority for AI to achieve human-like abilities, and that structured representations and computations are key to realizing this objective. Just as biology uses nature and nurture cooperatively, we reject the false choice between "hand-engineering" and "end-to-end" learning, and instead advocate for an approach which benefits from their complementary strengths. We explore how using relational inductive biases within deep learning architectures can facilitate learning about entities, relations, and rules for composing them. We present a new building block for the AI toolkit with a strong relational inductive bias--the graph network--which generalizes and extends various approaches for neural networks that operate on graphs, and provides a straightforward interface for manipulating structured knowledge and producing structured behaviors. We discuss how graph networks can support relational reasoning and combinatorial generalization, laying the foundation for more sophisticated, interpretable, and flexible patterns of reasoning. As a companion to this paper, we have released an open-source software library for building graph networks, with demonstrations of how to use them in practice.
△ Less
Submitted 17 October, 2018; v1 submitted 4 June, 2018;
originally announced June 2018.
-
Metacontrol for Adaptive Imagination-Based Optimization
Authors:
Jessica B. Hamrick,
Andrew J. Ballard,
Razvan Pascanu,
Oriol Vinyals,
Nicolas Heess,
Peter W. Battaglia
Abstract:
Many machine learning systems are built to solve the hardest examples of a particular task, which often makes them large and expensive to run---especially with respect to the easier examples, which might require much less computation. For an agent with a limited computational budget, this "one-size-fits-all" approach may result in the agent wasting valuable computation on easy examples, while not…
▽ More
Many machine learning systems are built to solve the hardest examples of a particular task, which often makes them large and expensive to run---especially with respect to the easier examples, which might require much less computation. For an agent with a limited computational budget, this "one-size-fits-all" approach may result in the agent wasting valuable computation on easy examples, while not spending enough on hard examples. Rather than learning a single, fixed policy for solving all instances of a task, we introduce a metacontroller which learns to optimize a sequence of "imagined" internal simulations over predictive models of the world in order to construct a more informed, and more economical, solution. The metacontroller component is a model-free reinforcement learning agent, which decides both how many iterations of the optimization procedure to run, as well as which model to consult on each iteration. The models (which we call "experts") can be state transition models, action-value functions, or any other mechanism that provides information useful for solving the task, and can be learned on-policy or off-policy in parallel with the metacontroller. When the metacontroller, controller, and experts were trained with "interaction networks" (Battaglia et al., 2016) as expert models, our approach was able to solve a challenging decision-making problem under complex non-linear dynamics. The metacontroller learned to adapt the amount of computation it performed to the difficulty of the task, and learned how to choose which experts to consult by factoring in both their reliability and individual computational resource costs. This allowed the metacontroller to achieve a lower overall cost (task loss plus computational cost) than more traditional fixed policy approaches. These results demonstrate that our approach is a powerful framework for using rich forward models for efficient model-based reinforcement learning.
△ Less
Submitted 7 May, 2017;
originally announced May 2017.
-
Perspective: Energy Landscapes for Machine Learning
Authors:
Andrew J. Ballard,
Ritankar Das,
Stefano Martiniani,
Dhagash Mehta,
Levent Sagun,
Jacob D. Stevenson,
David J. Wales
Abstract:
Machine learning techniques are being increasingly used as flexible non-linear fitting and prediction tools in the physical sciences. Fitting functions that exhibit multiple solutions as local minima can be analysed in terms of the corresponding machine learning landscape. Methods to explore and visualise molecular potential energy landscapes can be applied to these machine learning landscapes to…
▽ More
Machine learning techniques are being increasingly used as flexible non-linear fitting and prediction tools in the physical sciences. Fitting functions that exhibit multiple solutions as local minima can be analysed in terms of the corresponding machine learning landscape. Methods to explore and visualise molecular potential energy landscapes can be applied to these machine learning landscapes to gain new insight into the solution space involved in training and the nature of the corresponding predictions. In particular, we can define quantities analogous to molecular structure, thermodynamics, and kinetics, and relate these emergent properties to the structure of the underlying landscape. This Perspective aims to describe these analogies with examples from recent applications, and suggest avenues for new interdisciplinary research.
△ Less
Submitted 22 March, 2017;
originally announced March 2017.
-
Learning to Navigate in Complex Environments
Authors:
Piotr Mirowski,
Razvan Pascanu,
Fabio Viola,
Hubert Soyer,
Andrew J. Ballard,
Andrea Banino,
Misha Denil,
Ross Goroshin,
Laurent Sifre,
Koray Kavukcuoglu,
Dharshan Kumaran,
Raia Hadsell
Abstract:
Learning to navigate in complex environments with dynamic elements is an important milestone in developing AI agents. In this work we formulate the navigation question as a reinforcement learning problem and show that data efficiency and task performance can be dramatically improved by relying on additional auxiliary tasks leveraging multimodal sensory inputs. In particular we consider jointly lea…
▽ More
Learning to navigate in complex environments with dynamic elements is an important milestone in developing AI agents. In this work we formulate the navigation question as a reinforcement learning problem and show that data efficiency and task performance can be dramatically improved by relying on additional auxiliary tasks leveraging multimodal sensory inputs. In particular we consider jointly learning the goal-driven reinforcement learning problem with auxiliary depth prediction and loop closure classification tasks. This approach can learn to navigate from raw sensory input in complicated 3D mazes, approaching human-level performance even under conditions where the goal location changes frequently. We provide detailed analysis of the agent behaviour, its ability to localise, and its network activity dynamics, showing that the agent implicitly learns key navigation abilities.
△ Less
Submitted 13 January, 2017; v1 submitted 11 November, 2016;
originally announced November 2016.
-
Regimes of correlated hopping via a two-site interacting chain
Authors:
A. D. Ballard,
M. E. Raikh
Abstract:
Inelastic transport of electrons through a two-impurity chain is studied theoretically with account of intersite Coulomb interaction, U. Both limits of ohmic transport (at low bias) and strongly non-ohmic transport (at high bias) are considered. We demonstrate that correlations, induced by a finite U, in conjunction with conventional Hubbard correlations, give rise to a distinct transport regime…
▽ More
Inelastic transport of electrons through a two-impurity chain is studied theoretically with account of intersite Coulomb interaction, U. Both limits of ohmic transport (at low bias) and strongly non-ohmic transport (at high bias) are considered. We demonstrate that correlations, induced by a finite U, in conjunction with conventional Hubbard correlations, give rise to a distinct transport regime, with current governed by two-electron hops. This regime realizes when a single-electron hop onto the chain and a single-electron hop out of the chain are both ``blocked'' due to the finite U, so that conventional correlated sequential transport is impossible. The regime of two-electron hops manifests itself in the form of an additional step in the current-voltage characteristics, I(V).
△ Less
Submitted 24 October, 2006; v1 submitted 6 February, 2006;
originally announced February 2006.