Showing 1–23 of 23 results for author: Harley, T

Scaling Instructable Agents Across Many Simulated Worlds

Authors: SIMA Team, Maria Abi Raad, Arun Ahuja, Catarina Barros, Frederic Besse, Andrew Bolt, Adrian Bolton, Bethanie Brownfield, Gavin Buttimore, Max Cant, Sarah Chakera, Stephanie C. Y. Chan, Jeff Clune, Adrian Collister, Vikki Copeman, Alex Cullum, Ishita Dasgupta, Dario de Cesare, Julia Di Trapani, Yani Donchev, Emma Dunleavy, Martin Engelcke, Ryan Faulkner, Frankie Garcia, Charles Gbadamosi , et al. (68 additional authors not shown)

Abstract: Building embodied AI systems that can follow arbitrary language instructions in any 3D environment is a key challenge for creating general AI. Accomplishing this goal requires learning to ground language in perception and embodied actions, in order to accomplish complex tasks. The Scalable, Instructable, Multiworld Agent (SIMA) project tackles this by training agents to follow free-form instructio… ▽ More Building embodied AI systems that can follow arbitrary language instructions in any 3D environment is a key challenge for creating general AI. Accomplishing this goal requires learning to ground language in perception and embodied actions, in order to accomplish complex tasks. The Scalable, Instructable, Multiworld Agent (SIMA) project tackles this by training agents to follow free-form instructions across a diverse range of virtual 3D environments, including curated research environments as well as open-ended, commercial video games. Our goal is to develop an instructable agent that can accomplish anything a human can do in any simulated 3D environment. Our approach focuses on language-driven generality while imposing minimal assumptions. Our agents interact with environments in real-time using a generic, human-like interface: the inputs are image observations and language instructions and the outputs are keyboard-and-mouse actions. This general approach is challenging, but it allows agents to ground language across many visually complex and semantically rich environments while also allowing us to readily run agents in new environments. In this paper we describe our motivation and goal, the initial progress we have made, and promising preliminary results on several diverse research environments and a variety of commercial video games. △ Less

Submitted 17 April, 2024; v1 submitted 13 March, 2024; originally announced April 2024.

Creating Multimodal Interactive Agents with Imitation and Self-Supervised Learning

Authors: DeepMind Interactive Agents Team, Josh Abramson, Arun Ahuja, Arthur Brussee, Federico Carnevale, Mary Cassin, Felix Fischer, Petko Georgiev, Alex Goldin, Mansi Gupta, Tim Harley, Felix Hill, Peter C Humphreys, Alden Hung, Jessica Landon, Timothy Lillicrap, Hamza Merzic, Alistair Muldal, Adam Santoro, Guy Scully, Tamara von Glehn, Greg Wayne, Nathaniel Wong, Chen Yan, Rui Zhu

Abstract: A common vision from science fiction is that robots will one day inhabit our physical spaces, sense the world as we do, assist our physical labours, and communicate with us through natural language. Here we study how to design artificial agents that can interact naturally with humans using the simplification of a virtual environment. We show that imitation learning of human-human interactions in a… ▽ More A common vision from science fiction is that robots will one day inhabit our physical spaces, sense the world as we do, assist our physical labours, and communicate with us through natural language. Here we study how to design artificial agents that can interact naturally with humans using the simplification of a virtual environment. We show that imitation learning of human-human interactions in a simulated world, in conjunction with self-supervised learning, is sufficient to produce a multimodal interactive agent, which we call MIA, that successfully interacts with non-adversarial humans 75% of the time. We further identify architectural and algorithmic techniques that improve performance, such as hierarchical action selection. Altogether, our results demonstrate that imitation of multi-modal, real-time human behaviour may provide a straightforward and surprisingly effective means of imbuing agents with a rich behavioural prior from which agents might then be fine-tuned for specific purposes, thus laying a foundation for training capable agents for interactive robots or digital assistants. A video of MIA's behaviour may be found at https://youtu.be/ZFgRhviF7mY △ Less

Submitted 2 February, 2022; v1 submitted 7 December, 2021; originally announced December 2021.

Imitating Interactive Intelligence

Authors: Josh Abramson, Arun Ahuja, Iain Barr, Arthur Brussee, Federico Carnevale, Mary Cassin, Rachita Chhaparia, Stephen Clark, Bogdan Damoc, Andrew Dudzik, Petko Georgiev, Aurelia Guy, Tim Harley, Felix Hill, Alden Hung, Zachary Kenton, Jessica Landon, Timothy Lillicrap, Kory Mathewson, Soňa Mokrá, Alistair Muldal, Adam Santoro, Nikolay Savinov, Vikrant Varma, Greg Wayne , et al. (4 additional authors not shown)

Abstract: A common vision from science fiction is that robots will one day inhabit our physical spaces, sense the world as we do, assist our physical labours, and communicate with us through natural language. Here we study how to design artificial agents that can interact naturally with humans using the simplification of a virtual environment. This setting nevertheless integrates a number of the central cha… ▽ More A common vision from science fiction is that robots will one day inhabit our physical spaces, sense the world as we do, assist our physical labours, and communicate with us through natural language. Here we study how to design artificial agents that can interact naturally with humans using the simplification of a virtual environment. This setting nevertheless integrates a number of the central challenges of artificial intelligence (AI) research: complex visual perception and goal-directed physical control, grounded language comprehension and production, and multi-agent social interaction. To build agents that can robustly interact with humans, we would ideally train them while they interact with humans. However, this is presently impractical. Therefore, we approximate the role of the human with another learned agent, and use ideas from inverse reinforcement learning to reduce the disparities between human-human and agent-agent interactive behaviour. Rigorously evaluating our agents poses a great challenge, so we develop a variety of behavioural tests, including evaluation by humans who watch videos of agents or interact directly with them. These evaluations convincingly demonstrate that interactive training and auxiliary losses improve agent behaviour beyond what is achieved by supervised learning of actions alone. Further, we demonstrate that agent capabilities generalise beyond literal experiences in the dataset. Finally, we train evaluation models whose ratings of agents agree well with human judgement, thus permitting the evaluation of new agent models without additional effort. Taken together, our results in this virtual environment provide evidence that large-scale human behavioural imitation is a promising tool to create intelligent, interactive agents, and the challenge of reliably evaluating such agents is possible to surmount. △ Less

Submitted 20 January, 2021; v1 submitted 10 December, 2020; originally announced December 2020.

Human Instruction-Following with Deep Reinforcement Learning via Transfer-Learning from Text

Authors: Felix Hill, Sona Mokra, Nathaniel Wong, Tim Harley

Abstract: Recent work has described neural-network-based agents that are trained with reinforcement learning (RL) to execute language-like commands in simulated worlds, as a step towards an intelligent agent or robot that can be instructed by human users. However, the optimisation of multi-goal motor policies via deep RL from scratch requires many episodes of experience. Consequently, instruction-following… ▽ More Recent work has described neural-network-based agents that are trained with reinforcement learning (RL) to execute language-like commands in simulated worlds, as a step towards an intelligent agent or robot that can be instructed by human users. However, the optimisation of multi-goal motor policies via deep RL from scratch requires many episodes of experience. Consequently, instruction-following with deep RL typically involves language generated from templates (by an environment simulator), which does not reflect the varied or ambiguous expressions of real users. Here, we propose a conceptually simple method for training instruction-following agents with deep RL that are robust to natural human instructions. By applying our method with a state-of-the-art pre-trained text-based language model (BERT), on tasks requiring agents to identify and position everyday objects relative to other objects in a naturalistic 3D simulated room, we demonstrate substantially-above-chance zero-shot transfer from synthetic template commands to natural instructions given by humans. Our approach is a general recipe for training any deep RL-based system to interface with human users, and bridges the gap between two research directions of notable recent success: agent-centric motor behavior and text-based representation learning. △ Less

Submitted 19 May, 2020; originally announced May 2020.

A Generalized Framework for Population Based Training

Authors: Ang Li, Aleksandra Spyra, Sagi Perel, Valentin Dalibard, Max Jaderberg, Chenjie Gu, David Budden, Tim Harley, Pramod Gupta

Abstract: Population Based Training (PBT) is a recent approach that jointly optimizes neural network weights and hyperparameters which periodically copies weights of the best performers and mutates hyperparameters during training. Previous PBT implementations have been synchronized glass-box systems. We propose a general, black-box PBT framework that distributes many asynchronous "trials" (a small number of… ▽ More Population Based Training (PBT) is a recent approach that jointly optimizes neural network weights and hyperparameters which periodically copies weights of the best performers and mutates hyperparameters during training. Previous PBT implementations have been synchronized glass-box systems. We propose a general, black-box PBT framework that distributes many asynchronous "trials" (a small number of training steps with warm-starting) across a cluster, coordinated by the PBT controller. The black-box design does not make assumptions on model architectures, loss functions or training procedures. Our system supports dynamic hyperparameter schedules to optimize both differentiable and non-differentiable metrics. We apply our system to train a state-of-the-art WaveNet generative model for human voice synthesis. We show that our PBT system achieves better accuracy, less sensitivity and faster convergence compared to existing methods, given the same computational resource. △ Less

Submitted 5 February, 2019; originally announced February 2019.

Comments: 9 pages

Dynamic Control Flow in Large-Scale Machine Learning

Authors: Yuan Yu, Martín Abadi, Paul Barham, Eugene Brevdo, Mike Burrows, Andy Davis, Jeff Dean, Sanjay Ghemawat, Tim Harley, Peter Hawkins, Michael Isard, Manjunath Kudlur, Rajat Monga, Derek Murray, Xiaoqiang Zheng

Abstract: Many recent machine learning models rely on fine-grained dynamic control flow for training and inference. In particular, models based on recurrent neural networks and on reinforcement learning depend on recurrence relations, data-dependent conditional execution, and other features that call for dynamic control flow. These applications benefit from the ability to make rapid control-flow decisions a… ▽ More Many recent machine learning models rely on fine-grained dynamic control flow for training and inference. In particular, models based on recurrent neural networks and on reinforcement learning depend on recurrence relations, data-dependent conditional execution, and other features that call for dynamic control flow. These applications benefit from the ability to make rapid control-flow decisions across a set of computing devices in a distributed system. For performance, scalability, and expressiveness, a machine learning system must support dynamic control flow in distributed and heterogeneous environments. This paper presents a programming model for distributed machine learning that supports dynamic control flow. We describe the design of the programming model, and its implementation in TensorFlow, a distributed machine learning system. Our approach extends the use of dataflow graphs to represent machine learning models, offering several distinctive features. First, the branches of conditionals and bodies of loops can be partitioned across many machines to run on a set of heterogeneous devices, including CPUs, GPUs, and custom ASICs. Second, programs written in our model support automatic differentiation and distributed gradient computations, which are necessary for training machine learning models that use control flow. Third, our choice of non-strict semantics enables multiple loop iterations to execute in parallel across machines, and to overlap compute and I/O operations. We have done our work in the context of TensorFlow, and it has been used extensively in research and production. We evaluate it using several real-world applications, and demonstrate its performance and scalability. △ Less

Submitted 4 May, 2018; originally announced May 2018.

Comments: Appeared in EuroSys 2018. 14 pages, 16 figures

Journal ref: EuroSys 2018: Thirteenth EuroSys Conference, April 23-26, 2018, Porto, Portugal. ACM, New York, NY, USA

Unsupervised Predictive Memory in a Goal-Directed Agent

Authors: Greg Wayne, Chia-Chun Hung, David Amos, Mehdi Mirza, Arun Ahuja, Agnieszka Grabska-Barwinska, Jack Rae, Piotr Mirowski, Joel Z. Leibo, Adam Santoro, Mevlana Gemici, Malcolm Reynolds, Tim Harley, Josh Abramson, Shakir Mohamed, Danilo Rezende, David Saxton, Adam Cain, Chloe Hillier, David Silver, Koray Kavukcuoglu, Matt Botvinick, Demis Hassabis, Timothy Lillicrap

Abstract: Animals execute goal-directed behaviours despite the limited range and scope of their sensors. To cope, they explore environments and store memories maintaining estimates of important information that is not presently available. Recently, progress has been made with artificial intelligence (AI) agents that learn to perform tasks from sensory input, even at a human level, by merging reinforcement l… ▽ More Animals execute goal-directed behaviours despite the limited range and scope of their sensors. To cope, they explore environments and store memories maintaining estimates of important information that is not presently available. Recently, progress has been made with artificial intelligence (AI) agents that learn to perform tasks from sensory input, even at a human level, by merging reinforcement learning (RL) algorithms with deep neural networks, and the excitement surrounding these results has led to the pursuit of related ideas as explanations of non-human animal learning. However, we demonstrate that contemporary RL algorithms struggle to solve simple tasks when enough information is concealed from the sensors of the agent, a property called "partial observability". An obvious requirement for handling partially observed tasks is access to extensive memory, but we show memory is not enough; it is critical that the right information be stored in the right format. We develop a model, the Memory, RL, and Inference Network (MERLIN), in which memory formation is guided by a process of predictive modeling. MERLIN facilitates the solution of tasks in 3D virtual reality environments for which partial observability is severe and memories must be maintained over long durations. Our model demonstrates a single learning agent architecture that can solve canonical behavioural tasks in psychology and neurobiology without strong simplifying assumptions about the dimensionality of sensory input or the duration of experiences. △ Less

Submitted 28 March, 2018; originally announced March 2018.

IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures

Authors: Lasse Espeholt, Hubert Soyer, Remi Munos, Karen Simonyan, Volodymir Mnih, Tom Ward, Yotam Doron, Vlad Firoiu, Tim Harley, Iain Dunning, Shane Legg, Koray Kavukcuoglu

Abstract: In this work we aim to solve a large collection of tasks using a single reinforcement learning agent with a single set of parameters. A key challenge is to handle the increased amount of data and extended training time. We have developed a new distributed agent IMPALA (Importance Weighted Actor-Learner Architecture) that not only uses resources more efficiently in single-machine training but also… ▽ More In this work we aim to solve a large collection of tasks using a single reinforcement learning agent with a single set of parameters. A key challenge is to handle the increased amount of data and extended training time. We have developed a new distributed agent IMPALA (Importance Weighted Actor-Learner Architecture) that not only uses resources more efficiently in single-machine training but also scales to thousands of machines without sacrificing data efficiency or resource utilisation. We achieve stable learning at high throughput by combining decoupled acting and learning with a novel off-policy correction method called V-trace. We demonstrate the effectiveness of IMPALA for multi-task reinforcement learning on DMLab-30 (a set of 30 tasks from the DeepMind Lab environment (Beattie et al., 2016)) and Atari-57 (all available Atari games in Arcade Learning Environment (Bellemare et al., 2013a)). Our results show that IMPALA is able to achieve better performance than previous agents with less data, and crucially exhibits positive transfer between tasks as a result of its multi-task approach. △ Less

Submitted 28 June, 2018; v1 submitted 5 February, 2018; originally announced February 2018.

The Predictron: End-To-End Learning and Planning

Authors: David Silver, Hado van Hasselt, Matteo Hessel, Tom Schaul, Arthur Guez, Tim Harley, Gabriel Dulac-Arnold, David Reichert, Neil Rabinowitz, Andre Barreto, Thomas Degris

Abstract: One of the key challenges of artificial intelligence is to learn models that are effective in the context of planning. In this document we introduce the predictron architecture. The predictron consists of a fully abstract model, represented by a Markov reward process, that can be rolled forward multiple "imagined" planning steps. Each forward pass of the predictron accumulates internal rewards and… ▽ More One of the key challenges of artificial intelligence is to learn models that are effective in the context of planning. In this document we introduce the predictron architecture. The predictron consists of a fully abstract model, represented by a Markov reward process, that can be rolled forward multiple "imagined" planning steps. Each forward pass of the predictron accumulates internal rewards and values over multiple planning depths. The predictron is trained end-to-end so as to make these accumulated values accurately approximate the true value function. We applied the predictron to procedurally generated random mazes and a simulator for the game of pool. The predictron yielded significantly more accurate predictions than conventional deep neural network architectures. △ Less

Submitted 20 July, 2017; v1 submitted 28 December, 2016; originally announced December 2016.

Comments: Camera-ready version, ICML 2017, with supplement

Scaling Memory-Augmented Neural Networks with Sparse Reads and Writes

Authors: Jack W Rae, Jonathan J Hunt, Tim Harley, Ivo Danihelka, Andrew Senior, Greg Wayne, Alex Graves, Timothy P Lillicrap

Abstract: Neural networks augmented with external memory have the ability to learn algorithmic solutions to complex tasks. These models appear promising for applications such as language modeling and machine translation. However, they scale poorly in both space and time as the amount of memory grows --- limiting their applicability to real-world domains. Here, we present an end-to-end differentiable memory… ▽ More Neural networks augmented with external memory have the ability to learn algorithmic solutions to complex tasks. These models appear promising for applications such as language modeling and machine translation. However, they scale poorly in both space and time as the amount of memory grows --- limiting their applicability to real-world domains. Here, we present an end-to-end differentiable memory access scheme, which we call Sparse Access Memory (SAM), that retains the representational power of the original approaches whilst training efficiently with very large memories. We show that SAM achieves asymptotic lower bounds in space and time complexity, and find that an implementation runs $1,\!000\times$ faster and with $3,\!000\times$ less physical memory than non-sparse models. SAM learns with comparable data efficiency to existing models on a range of synthetic tasks and one-shot Omniglot character recognition, and can scale to tasks requiring $100,\!000$s of time steps and memories. As well, we show how our approach can be adapted for models that maintain temporal associations between memories, as with the recently introduced Differentiable Neural Computer. △ Less

Submitted 27 October, 2016; originally announced October 2016.

Comments: in 30th Conference on Neural Information Processing Systems (NIPS 2016), Barcelona, Spain

Asynchronous Methods for Deep Reinforcement Learning

Authors: Volodymyr Mnih, Adrià Puigdomènech Badia, Mehdi Mirza, Alex Graves, Timothy P. Lillicrap, Tim Harley, David Silver, Koray Kavukcuoglu

Abstract: We propose a conceptually simple and lightweight framework for deep reinforcement learning that uses asynchronous gradient descent for optimization of deep neural network controllers. We present asynchronous variants of four standard reinforcement learning algorithms and show that parallel actor-learners have a stabilizing effect on training allowing all four methods to successfully train neural n… ▽ More We propose a conceptually simple and lightweight framework for deep reinforcement learning that uses asynchronous gradient descent for optimization of deep neural network controllers. We present asynchronous variants of four standard reinforcement learning algorithms and show that parallel actor-learners have a stabilizing effect on training allowing all four methods to successfully train neural network controllers. The best performing method, an asynchronous variant of actor-critic, surpasses the current state-of-the-art on the Atari domain while training for half the time on a single multi-core CPU instead of a GPU. Furthermore, we show that asynchronous actor-critic succeeds on a wide variety of continuous motor control problems as well as on a new task of navigating random 3D mazes using a visual input. △ Less

Submitted 16 June, 2016; v1 submitted 4 February, 2016; originally announced February 2016.

Journal ref: ICML 2016

Fast Approximate Quadratic Programming for Large (Brain) Graph Matching

Authors: Joshua T. Vogelstein, John M. Conroy, Vince Lyzinski, Louis J. Podrazik, Steven G. Kratzer, Eric T. Harley, Donniell E. Fishkind, R. Jacob Vogelstein, Carey E. Priebe

Abstract: Quadratic assignment problems (QAPs) arise in a wide variety of domains, ranging from operations research to graph theory to computer vision to neuroscience. In the age of big data, graph valued data is becoming more prominent, and with it, a desire to run algorithms on ever larger graphs. Because QAP is NP-hard, exact algorithms are intractable. Approximate algorithms necessarily employ an accura… ▽ More Quadratic assignment problems (QAPs) arise in a wide variety of domains, ranging from operations research to graph theory to computer vision to neuroscience. In the age of big data, graph valued data is becoming more prominent, and with it, a desire to run algorithms on ever larger graphs. Because QAP is NP-hard, exact algorithms are intractable. Approximate algorithms necessarily employ an accuracy/efficiency trade-off. We developed a fast approximate quadratic assignment algorithm (FAQ). FAQ finds a local optima in (worst case) time cubic in the number of vertices, similar to other approximate QAP algorithms. We demonstrate empirically that our algorithm is faster and achieves a lower objective value on over 80% of the suite of QAP benchmarks, compared with the previous state-of-the-art. Applying the algorithms to our motivating example, matching C. elegans connectomes (brain-graphs), we find that FAQ achieves the optimal performance in record time, whereas none of the others even find the optimum. △ Less

Submitted 13 September, 2014; v1 submitted 22 December, 2011; originally announced December 2011.

Comments: 17 pages, 5 figures, 2 tables

Spin-orbit fields in asymmetric (001) quantum wells

Authors: P. S. Eldridge, J. Hübner, S. Oertel, R. T. Harley, M. Henini, M. Oestreich

Abstract: We measure simultaneously the in-plane electron g-factor and spin relaxation rate in a series of undoped inversion-asymmetric (001)-oriented GaAs/AlGaAs quantum wells by spin-quantum beat spectroscopy. In combination the two quantities reveal the absolute values of both the Rashba and the Dresselhaus coefficients and prove that the Rashba coefficient can be negligibly small despite huge conduction… ▽ More We measure simultaneously the in-plane electron g-factor and spin relaxation rate in a series of undoped inversion-asymmetric (001)-oriented GaAs/AlGaAs quantum wells by spin-quantum beat spectroscopy. In combination the two quantities reveal the absolute values of both the Rashba and the Dresselhaus coefficients and prove that the Rashba coefficient can be negligibly small despite huge conduction band potential gradients which break the inversion symmetry. The negligible Rashba coefficient is a consequence of the 'isomorphism' of conduction and valence band potentials in quantum systems where the asymmetry is solely produced by alloy variations. △ Less

Submitted 11 October, 2010; originally announced October 2010.

Journal ref: Phys. Rev. B 83, 041301(R) (2011)

Increased color conversion efficiency in hybrid light emitting diodes utilizing non-radiative energy transfer

Authors: S. Chanyawadee, P. G. Lagoudakis, R. T. Harley, M. D. B. Charlton, D. V. Talapin, S. Lin

Abstract: We fabricate a highly efficient colour conversion light emitting diode consisting of surface-patterned blue emitters and semiconductor colloidal nanocrystal quantum dots (NQDs). Electrically injected carriers in the blue emitter (donor) are efficiently transferred to the NQDs (acceptor) via nonradiative energy transfer in addition to conventional radiative energy transfer. The existence of nonra… ▽ More We fabricate a highly efficient colour conversion light emitting diode consisting of surface-patterned blue emitters and semiconductor colloidal nanocrystal quantum dots (NQDs). Electrically injected carriers in the blue emitter (donor) are efficiently transferred to the NQDs (acceptor) via nonradiative energy transfer in addition to conventional radiative energy transfer. The existence of nonradiative energy transfer is verified by the simultaneous observation of increased donor emission decay rate, the transient transfer of carriers at the acceptor and a 2-fold enhancement of the NQD electroluminescence. △ Less

Submitted 29 July, 2009; originally announced July 2009.

Absence of the Rashba effect in undoped asymmetric quantum wells

Authors: P. S. Eldridge, W. J. H Leyland, J. D. Mar, P. G. Lagoudakis, R. Winkler, O. Z. Karimov, M. Henini, D Taylor, R. T. Phillips, R T Harley

Abstract: To an electron moving in free space an electric field appears as a magnetic field which interacts with and can reorient the electron spin. In semiconductor quantum wells this spin-orbit interaction seems to offer the possibility of gate-voltage control in spintronic devices but, as the electrons are subject to both ion-core and macroscopic structural potentials, this over-simple picture has lead… ▽ More To an electron moving in free space an electric field appears as a magnetic field which interacts with and can reorient the electron spin. In semiconductor quantum wells this spin-orbit interaction seems to offer the possibility of gate-voltage control in spintronic devices but, as the electrons are subject to both ion-core and macroscopic structural potentials, this over-simple picture has lead to intense debate. For example, an externally applied field acting on the envelope of the electron wavefunction determined by the macroscopic potential, underestimates the experimentally observed spin-orbit field by many orders of magnitude while the Ehrenfest theorem suggests that it should actually be zero. Here we challenge, both experimentally and theoretically, the widely held belief that any inversion asymmetry of the macroscopic potential, not only electric field, will produce a significant spin-orbit field for electrons. This conclusion has far-reaching consequences for the design of spintronic devices while illuminating important fundamental physics. △ Less

Submitted 30 July, 2008; originally announced July 2008.

Comments: 7 pages, 5 figs

Journal ref: Physical Review B82 045317 (2010)

Energy-Dependent Electron-Electron Scattering and Spin Dynamics in a Two Dimensional Electron Gas

Authors: W. J. H. Leylanda, R. T. Harley, M. Henini, A. J. Shields, I. Farrer, D. A. Ritchie

Abstract: Measurements of spin dynamics of electrons in a degenerate two dimensional electron gas, where the Dyakonov-Perel mechanism is dominant, have been used to investigate the electron scattering time (tp*) as a function of energy near the Fermi energy. Close to the Fermi energy the spin evolution is oscillatory, indicating a quasi-collision-free regime of spin dynamics. As the energy is increased a… ▽ More Measurements of spin dynamics of electrons in a degenerate two dimensional electron gas, where the Dyakonov-Perel mechanism is dominant, have been used to investigate the electron scattering time (tp*) as a function of energy near the Fermi energy. Close to the Fermi energy the spin evolution is oscillatory, indicating a quasi-collision-free regime of spin dynamics. As the energy is increased a transition to exponential, collision-dominated, spin decay occurs. The frequency and the value of tp* are extracted using a Monte Carlo simulation method. At the Fermi energy tp* is very close to the ensemble momentum relaxation time (tp) obtained from the electron mobility. For higher energies tp* falls quadratically, consistent with theoretical expectations for the onset of electron-electron scattering which is inhibited by the Pauli principle at the Fermi energy. △ Less

Submitted 8 March, 2008; originally announced March 2008.

Comments: 9 pages 3 figures

Non-radiative exciton energy transfer in hybrid organic-inorganic heterostructures

Authors: S. Chanyawadee, P. G. Lagoudakis, R. T. Harley, D. G. Lidzey, M. Henini

Abstract: Non-radiative optical energy transfer from a GaAs quantum well to a thin overlayer of an infrared organic semiconductor dye is unambiguously demonstrated. The dynamics of exciton transfer are studied in the time-domain using pump-probe spectroscopy at the donor site and fluorescence spectroscopy at the acceptor site. The effect is observed as simultaneous increase of the population decay rate at… ▽ More Non-radiative optical energy transfer from a GaAs quantum well to a thin overlayer of an infrared organic semiconductor dye is unambiguously demonstrated. The dynamics of exciton transfer are studied in the time-domain using pump-probe spectroscopy at the donor site and fluorescence spectroscopy at the acceptor site. The effect is observed as simultaneous increase of the population decay rate at the donor and of the rise time of optical emission at the acceptor sites. The hybrid configuration under investigation provides an alternative non-radiative, non-contact pumping route to electrical carrier injection that overcomes the losses imposed by the associated low carrier mobility of organic emitters. △ Less

Submitted 16 November, 2007; originally announced November 2007.

Temperature Dependence of Rashba Spin-orbit Coupling in Quantum Wells

Authors: P. S. Eldridge, W. J. H. Leyland, P. G. Lagoudakis, O. Z. Karimov, M. Henini, D. Taylor, R. T. Phillips, R. T. Harley

Abstract: We perform an all-optical spin-dynamic measurement of the Rashba spin-orbit interaction in (110)-oriented GaAs/AlGaAs quantum wells. The crystallographic direction of quantum confinement allows us to disentangle the contributions to spin-orbit coupling from the structural inversion asymmetry (Rashba term) and the bulk inversion asymmetry. We observe an unexpected temperature dependence of the Ra… ▽ More We perform an all-optical spin-dynamic measurement of the Rashba spin-orbit interaction in (110)-oriented GaAs/AlGaAs quantum wells. The crystallographic direction of quantum confinement allows us to disentangle the contributions to spin-orbit coupling from the structural inversion asymmetry (Rashba term) and the bulk inversion asymmetry. We observe an unexpected temperature dependence of the Rashba spin-orbit interaction strength that signifies the importance of the usually neglected higher-order terms of the Rashba coupling. △ Less

Submitted 30 July, 2007; originally announced July 2007.

Oscillatory D'yakonov-Perel' spin dynamics in two dimensional electron gases

Authors: W. J. H. Leyland, R. T. Harley, M. Henini, D. Taylor, A. J. Shields, I. Farrer, D. A. Ritchie

Abstract: Optical pump-probe measurements of spin-dynamics at temperatures down to 1.5K are described for a series of (001)-oriented GaAs/AlGaAs quantum well samples containing high mobility two-dimensional electron gases (2DEGs). For well widths ranging from 5 nm to 20 nm and 2DEG sheet densities from 1.75x1011cm-2 to 3.5x1011cm-2 the evolution of a small injected spin population is found to be a damped… ▽ More Optical pump-probe measurements of spin-dynamics at temperatures down to 1.5K are described for a series of (001)-oriented GaAs/AlGaAs quantum well samples containing high mobility two-dimensional electron gases (2DEGs). For well widths ranging from 5 nm to 20 nm and 2DEG sheet densities from 1.75x1011cm-2 to 3.5x1011cm-2 the evolution of a small injected spin population is found to be a damped oscillation rather than exponential relaxation, consistent with the quasi-collision-free regime of D'yakonov-Perel spin dynamics. A Monte Carlo simulation method is used to extract the spin-orbit-induced electron spin precession frequency |W(kF)| and electron momentum scattering time tp* at the Fermi wavevector. The spin decay time passes through a minimum at a temperature corresponding to the transition from collision-free to collision-dominated regimes and tp* is found to be close to the ensemble momentum scattering time tp obtained from Hall measurements of electron mobility. The values of |W(kF)| give the Dresselhaus (BIA) coefficient of spin-orbit interaction as a function of electron confinement energy in the quantum show, qualitatively, the behaviour expected from k.p theory. △ Less

Submitted 27 July, 2007; originally announced July 2007.

Enhanced spin relaxation time due to electron-electron scattering in semiconductors

Authors: W. J. H. Leyland, G. H. John, R. T. Harley, M. M. Glazov, E. L. Ivchenko, D. A. Ritchie, A. J. Shields, M. Henini

Abstract: We present a detailed experimental and theoretical analysis of the spin dynamics of two-dimensional electron gases (2DEGs) in a series of n-doped GaAs/AlGaAs quantum wells. Picosecond-resolution polarized pump-probe reflection techniques were applied in order to study in detail the temperature-, concentration- and quantum-well-width- dependencies of the spin relaxation rate of a small photoexcit… ▽ More We present a detailed experimental and theoretical analysis of the spin dynamics of two-dimensional electron gases (2DEGs) in a series of n-doped GaAs/AlGaAs quantum wells. Picosecond-resolution polarized pump-probe reflection techniques were applied in order to study in detail the temperature-, concentration- and quantum-well-width- dependencies of the spin relaxation rate of a small photoexcited electron population. A rapid enhancement of the spin life-time with temperature up to a maximum near the Fermi temperature of the 2DEG was demonstrated experimentally. These observations are consistent with the D'yakonov-Perel' spin relaxation mechanism controlled by electron-electron collisions. The experimental results and theoretical predictions for the spin relaxation times are in good quantitative agreement. △ Less

Submitted 21 October, 2006; originally announced October 2006.

Comments: 8 pages, 5 figures

High temperature gate control of quantum well spin memory

Authors: O. Z. Karimov, G. H. John, R. T. Harley, W. H. Lau, M. E. Flatte, M. Henini, R. Airey

Abstract: Time-resolved optical measurements in (110)-oriented GaAs/AlGaAs quantum wells show a ten-fold increase of the spin-relaxation rate as a function of applied electric field from 20 to 80 kV cm-1 at 170 K and indicate a similar variation at 300 K, in agreement with calculations based on the Rashba effect. Spin relaxation is almost field-independent below 20 kV cm-1 reflecting quantum well interfac… ▽ More Time-resolved optical measurements in (110)-oriented GaAs/AlGaAs quantum wells show a ten-fold increase of the spin-relaxation rate as a function of applied electric field from 20 to 80 kV cm-1 at 170 K and indicate a similar variation at 300 K, in agreement with calculations based on the Rashba effect. Spin relaxation is almost field-independent below 20 kV cm-1 reflecting quantum well interface asymmetry. The results indicate the achievability of voltage-gateable spin-memory time longer than 3 ns simultaneously with high electron mobility. △ Less

Submitted 16 May, 2003; originally announced May 2003.

Comments: 4 pages, 4 EPS figures, REVTeX

D'yakonov-Perel' spin relaxation under electron-electron collisions in n-type QWs

Authors: M. M. Glazov, E. L. Ivchenko, M. A. Brand, O. Z. Karimov, R. T. Harley

Abstract: The D'yakonov-Perel' spin relaxation mechanism in n-doped GaAs/AlGaAs quantum wells (QWs) has been studied both theoretically and experimentally. The temperature dependence of the spin relaxation time has been calculated for arbitrary degeneracy of the 2D electron gas. The comparison between theory and experiment shows that, in high-mobility n-doped QWs, the studied spin decoherence is controlle… ▽ More The D'yakonov-Perel' spin relaxation mechanism in n-doped GaAs/AlGaAs quantum wells (QWs) has been studied both theoretically and experimentally. The temperature dependence of the spin relaxation time has been calculated for arbitrary degeneracy of the 2D electron gas. The comparison between theory and experiment shows that, in high-mobility n-doped QWs, the studied spin decoherence is controlled by electron-electron collisions. △ Less

Submitted 12 May, 2003; originally announced May 2003.

Comments: 3 pages, 1 figure, accepted to Proc. Int. Symp. "Nanostructures: Physics and Technology" (St-Petersburg, Russia, 2003)

Dynamic Nuclear Overhauser Shifts in Larmor beats from a quantum well

Authors: A. Malinowski, R. T. Harley

Abstract: The significance of nuclear spin polarisation in time-resolved optical studies of III-V semiconductors is addressed. Electron Larmor beats in pump-probe reflectivity from a GaAs/AlGaAs quantum well show Overhauser shift of 0.7 T due to accumulated nuclear polarisation <I>/I=0.065. This leads to precision values of electron g-factor, elucidates nuclear spin pumping and diffusion mechanisms in qua… ▽ More The significance of nuclear spin polarisation in time-resolved optical studies of III-V semiconductors is addressed. Electron Larmor beats in pump-probe reflectivity from a GaAs/AlGaAs quantum well show Overhauser shift of 0.7 T due to accumulated nuclear polarisation <I>/I=0.065. This leads to precision values of electron g-factor, elucidates nuclear spin pumping and diffusion mechanisms in quantum wells and informs discussion of implications for spin-electronics and transport. △ Less

Submitted 28 October, 1999; originally announced October 1999.

Comments: 9 pages, 2 figures