Showing 1–50 of 145 results for author: Barrett, D

An extrapolation method for polarizability assessments of ion-based optical clocks

Authors: K. J. Arnold, M. D. Barrett

Abstract: We present a numerical method for extrapolating polarizability measurements to dc as done in the assessment of blackbody radiation shifts for ion-based clocks. The method explicitly accounts for the frequency dependence of relevant atomic transitions without introducing an ad hoc modelling function. It incorporates \emph{a priori} atomic structure calculations, which allows measurements to be augm… ▽ More We present a numerical method for extrapolating polarizability measurements to dc as done in the assessment of blackbody radiation shifts for ion-based clocks. The method explicitly accounts for the frequency dependence of relevant atomic transitions without introducing an ad hoc modelling function. It incorporates \emph{a priori} atomic structure calculations, which allows measurements to be augmented by calculations if there is insufficient data to make a purely measurement based estimate. The method also provides indicators of inconsistencies between theory and experiment or inadequacies of the data for making an extrapolation. We use results from Al$^+$, Lu$^+$, and Yb$^+$ to illustrate features of the method. △ Less

Submitted 2 September, 2024; originally announced September 2024.

Comments: 8 pages, 1 figure

Cauchy transforms and Szegő projections in dual Hardy spaces: inequalities and Möbius invariance

Authors: David E. Barrett, Luke D. Edholm

Abstract: Dual pairs of interior and exterior Hardy spaces associated to a simple closed Lipschitz planar curve are considered, leading to a Möbius invariant function bounding the norm of the Cauchy transform $\bf{C}$ from below. This function is shown to satisfy strong rigidity properties and is closely connected via the Berezin transform to the square of the Kerzman-Stein operator. Explicit example calcul… ▽ More Dual pairs of interior and exterior Hardy spaces associated to a simple closed Lipschitz planar curve are considered, leading to a Möbius invariant function bounding the norm of the Cauchy transform $\bf{C}$ from below. This function is shown to satisfy strong rigidity properties and is closely connected via the Berezin transform to the square of the Kerzman-Stein operator. Explicit example calculations are presented. For ellipses, a new asymptotically sharp lower bound on the norm of $\bf{C}$ is produced. △ Less

Submitted 17 July, 2024; originally announced July 2024.

Comments: 28 pages, 3 figures

MSC Class: 30C40 (Primary); 30H10; 30E20; 32A25; 46E22 (Secondary)

Memory-Enhanced Neural Solvers for Efficient Adaptation in Combinatorial Optimization

Authors: Felix Chalumeau, Refiloe Shabe, Noah de Nicola, Arnu Pretorius, Thomas D. Barrett, Nathan Grinsztajn

Abstract: Combinatorial Optimization is crucial to numerous real-world applications, yet still presents challenges due to its (NP-)hard nature. Amongst existing approaches, heuristics often offer the best trade-off between quality and scalability, making them suitable for industrial use. While Reinforcement Learning (RL) offers a flexible framework for designing heuristics, its adoption over handcrafted heu… ▽ More Combinatorial Optimization is crucial to numerous real-world applications, yet still presents challenges due to its (NP-)hard nature. Amongst existing approaches, heuristics often offer the best trade-off between quality and scalability, making them suitable for industrial use. While Reinforcement Learning (RL) offers a flexible framework for designing heuristics, its adoption over handcrafted heuristics remains incomplete within industrial solvers. Existing learned methods still lack the ability to adapt to specific instances and fully leverage the available computational budget. The current best methods either rely on a collection of pre-trained policies, or on data-inefficient fine-tuning; hence failing to fully utilize newly available information within the constraints of the budget. In response, we present MEMENTO, an RL approach that leverages memory to improve the adaptation of neural solvers at inference time. MEMENTO enables updating the action distribution dynamically based on the outcome of previous decisions. We validate its effectiveness on benchmark problems, in particular Traveling Salesman and Capacitated Vehicle Routing, demonstrating it can successfully be combined with standard methods to boost their performance under a given budget, both in and out-of-distribution, improving their performance on all 12 evaluated tasks. △ Less

Submitted 24 June, 2024; originally announced June 2024.

Learning the Language of Protein Structure

Authors: Benoit Gaujac, Jérémie Donà, Liviu Copoiu, Timothy Atkinson, Thomas Pierrot, Thomas D. Barrett

Abstract: Representation learning and \emph{de novo} generation of proteins are pivotal computational biology tasks. Whilst natural language processing (NLP) techniques have proven highly effective for protein sequence modelling, structure modelling presents a complex challenge, primarily due to its continuous and three-dimensional nature. Motivated by this discrepancy, we introduce an approach using a vect… ▽ More Representation learning and \emph{de novo} generation of proteins are pivotal computational biology tasks. Whilst natural language processing (NLP) techniques have proven highly effective for protein sequence modelling, structure modelling presents a complex challenge, primarily due to its continuous and three-dimensional nature. Motivated by this discrepancy, we introduce an approach using a vector-quantized autoencoder that effectively tokenizes protein structures into discrete representations. This method transforms the continuous, complex space of protein structures into a manageable, discrete format with a codebook ranging from 4096 to 64000 tokens, achieving high-fidelity reconstructions with backbone root mean square deviations (RMSD) of approximately 1-5 Å. To demonstrate the efficacy of our learned representations, we show that a simple GPT model trained on our codebooks can generate novel, diverse, and designable protein structures. Our approach not only provides representations of protein structure, but also mitigates the challenges of disparate modal representations and sets a foundation for seamless, multi-modal integration, enhancing the capabilities of computational methods in protein design. △ Less

Submitted 24 May, 2024; originally announced May 2024.

Advancing Multimodal Medical Capabilities of Gemini

Authors: Lin Yang, Shawn Xu, Andrew Sellergren, Timo Kohlberger, Yuchen Zhou, Ira Ktena, Atilla Kiraly, Faruk Ahmed, Farhad Hormozdiari, Tiam Jaroensri, Eric Wang, Ellery Wulczyn, Fayaz Jamil, Theo Guidroz, Chuck Lau, Siyuan Qiao, Yun Liu, Akshay Goel, Kendall Park, Arnav Agharwal, Nick George, Yang Wang, Ryutaro Tanno, David G. T. Barrett, Wei-Hung Weng , et al. (22 additional authors not shown)

Abstract: Many clinical tasks require an understanding of specialized data, such as medical images and genomics, which is not typically found in general-purpose large multimodal models. Building upon Gemini's multimodal models, we develop several models within the new Med-Gemini family that inherit core capabilities of Gemini and are optimized for medical use via fine-tuning with 2D and 3D radiology, histop… ▽ More Many clinical tasks require an understanding of specialized data, such as medical images and genomics, which is not typically found in general-purpose large multimodal models. Building upon Gemini's multimodal models, we develop several models within the new Med-Gemini family that inherit core capabilities of Gemini and are optimized for medical use via fine-tuning with 2D and 3D radiology, histopathology, ophthalmology, dermatology and genomic data. Med-Gemini-2D sets a new standard for AI-based chest X-ray (CXR) report generation based on expert evaluation, exceeding previous best results across two separate datasets by an absolute margin of 1% and 12%, where 57% and 96% of AI reports on normal cases, and 43% and 65% on abnormal cases, are evaluated as "equivalent or better" than the original radiologists' reports. We demonstrate the first ever large multimodal model-based report generation for 3D computed tomography (CT) volumes using Med-Gemini-3D, with 53% of AI reports considered clinically acceptable, although additional research is needed to meet expert radiologist reporting quality. Beyond report generation, Med-Gemini-2D surpasses the previous best performance in CXR visual question answering (VQA) and performs well in CXR classification and radiology VQA, exceeding SoTA or baselines on 17 of 20 tasks. In histopathology, ophthalmology, and dermatology image classification, Med-Gemini-2D surpasses baselines across 18 out of 20 tasks and approaches task-specific model performance. Beyond imaging, Med-Gemini-Polygenic outperforms the standard linear polygenic risk score-based approach for disease risk prediction and generalizes to genetically correlated diseases for which it has never been trained. Although further development and evaluation are necessary in the safety-critical medical domain, our results highlight the potential of Med-Gemini across a wide range of medical tasks. △ Less

Submitted 6 May, 2024; originally announced May 2024.

Capabilities of Gemini Models in Medicine

Authors: Khaled Saab, Tao Tu, Wei-Hung Weng, Ryutaro Tanno, David Stutz, Ellery Wulczyn, Fan Zhang, Tim Strother, Chunjong Park, Elahe Vedadi, Juanma Zambrano Chaves, Szu-Yeu Hu, Mike Schaekermann, Aishwarya Kamath, Yong Cheng, David G. T. Barrett, Cathy Cheung, Basil Mustafa, Anil Palepu, Daniel McDuff, Le Hou, Tomer Golany, Luyang Liu, Jean-baptiste Alayrac, Neil Houlsby , et al. (42 additional authors not shown)

Abstract: Excellence in a wide variety of medical applications poses considerable challenges for AI, requiring advanced reasoning, access to up-to-date medical knowledge and understanding of complex multimodal data. Gemini models, with strong general capabilities in multimodal and long-context reasoning, offer exciting possibilities in medicine. Building on these core strengths of Gemini, we introduce Med-G… ▽ More Excellence in a wide variety of medical applications poses considerable challenges for AI, requiring advanced reasoning, access to up-to-date medical knowledge and understanding of complex multimodal data. Gemini models, with strong general capabilities in multimodal and long-context reasoning, offer exciting possibilities in medicine. Building on these core strengths of Gemini, we introduce Med-Gemini, a family of highly capable multimodal models that are specialized in medicine with the ability to seamlessly use web search, and that can be efficiently tailored to novel modalities using custom encoders. We evaluate Med-Gemini on 14 medical benchmarks, establishing new state-of-the-art (SoTA) performance on 10 of them, and surpass the GPT-4 model family on every benchmark where a direct comparison is viable, often by a wide margin. On the popular MedQA (USMLE) benchmark, our best-performing Med-Gemini model achieves SoTA performance of 91.1% accuracy, using a novel uncertainty-guided search strategy. On 7 multimodal benchmarks including NEJM Image Challenges and MMMU (health & medicine), Med-Gemini improves over GPT-4V by an average relative margin of 44.5%. We demonstrate the effectiveness of Med-Gemini's long-context capabilities through SoTA performance on a needle-in-a-haystack retrieval task from long de-identified health records and medical video question answering, surpassing prior bespoke methods using only in-context learning. Finally, Med-Gemini's performance suggests real-world utility by surpassing human experts on tasks such as medical text summarization, alongside demonstrations of promising potential for multimodal medical dialogue, medical research and education. Taken together, our results offer compelling evidence for Med-Gemini's potential, although further rigorous evaluation will be crucial before real-world deployment in this safety-critical domain. △ Less

Submitted 1 May, 2024; v1 submitted 29 April, 2024; originally announced April 2024.

Validating a lutetium frequency reference

Authors: Kyle J. Arnold, Scott Bustabad, Qin Qichen, Zhao Zhang, Qi Zhao, Murray D. Barrett

Abstract: We review our progress in developing a frequency reference with singly ionized lutetium and give estimates of the levels of inaccuracy we expect to achieve in the near future with both the $^1S_0\leftrightarrow{}^3D_1$ and $^1S_0\leftrightarrow{}^3D_2$ transitions. Based on established experimental results, we show that inaccuracies at the low $10^{-19}$ level are readily achievable for the… ▽ More We review our progress in developing a frequency reference with singly ionized lutetium and give estimates of the levels of inaccuracy we expect to achieve in the near future with both the $^1S_0\leftrightarrow{}^3D_1$ and $^1S_0\leftrightarrow{}^3D_2$ transitions. Based on established experimental results, we show that inaccuracies at the low $10^{-19}$ level are readily achievable for the $^1S_0\leftrightarrow{}^3D_1$ transition, and the frequency ratio between the two transitions is limited almost entirely by the BBR shift. We argue that the frequency ratio measured within the one apparatus provides a well-defined metric to compare and establish the performance of remotely located systems. For the measurement of an in situ frequency ratio, relativistic shifts drop out and both transitions experience the same electromagnetic environment. Consequently, the uncertainty budget for the ratio is practically identical to the uncertainty budgets for the individual transitions. If the ratios for two or more systems disagree we can be certain at least one of the clock assessments is incorrect. If they agree, subsequent comparisons on one transition would only differ by relativistic effects. Since motional effects are easily assessed and typically small for a heavy ion, only the differential gravitational red-shift will significantly contribute and this can be confirmed by comparison on the second transition. △ Less

Submitted 25 April, 2024; originally announced April 2024.

Comments: 10 pages

Enhanced micromotion compensation using a phase modulated light field

Authors: K. J. Arnold, N. Jayjong, M. L. D. Kang, Qin Qichen, Zhao Zhang, Qi Zhao, M. D. Barrett

Abstract: We investigate sideband spectroscopy of a trapped ion using a probe laser phase modulated at the trap drive frequency. The enhanced sensitivity of our technique over traditional sideband spectroscopy allows us to detect stray fields of $0.01\,\mathrm{V/m}$ on a timescale of a few minutes and detect differential phases of $5\,μ\mathrm{rad}$ between applied ac potentials. We also demonstrate the abi… ▽ More We investigate sideband spectroscopy of a trapped ion using a probe laser phase modulated at the trap drive frequency. The enhanced sensitivity of our technique over traditional sideband spectroscopy allows us to detect stray fields of $0.01\,\mathrm{V/m}$ on a timescale of a few minutes and detect differential phases of $5\,μ\mathrm{rad}$ between applied ac potentials. We also demonstrate the ability suppress Doppler shifts from excess motion to well below the limit imposed by the intrinsic motion of the ion in the vibrational ground-state. The technique we introduce can be readily implemented in any ion trap system that utilizes sideband spectroscopy for micromotion compensation and can be seamlessly integrated into experiments in a fully automated way △ Less

Submitted 28 February, 2024; originally announced February 2024.

Comments: 5 pages, 4 figures, and Supplemental

Consensus, dissensus and synergy between clinicians and specialist foundation models in radiology report generation

Authors: Ryutaro Tanno, David G. T. Barrett, Andrew Sellergren, Sumedh Ghaisas, Sumanth Dathathri, Abigail See, Johannes Welbl, Karan Singhal, Shekoofeh Azizi, Tao Tu, Mike Schaekermann, Rhys May, Roy Lee, SiWai Man, Zahra Ahmed, Sara Mahdavi, Yossi Matias, Joelle Barral, Ali Eslami, Danielle Belgrave, Vivek Natarajan, Shravya Shetty, Pushmeet Kohli, Po-Sen Huang, Alan Karthikesalingam , et al. (1 additional authors not shown)

Abstract: Radiology reports are an instrumental part of modern medicine, informing key clinical decisions such as diagnosis and treatment. The worldwide shortage of radiologists, however, restricts access to expert care and imposes heavy workloads, contributing to avoidable errors and delays in report delivery. While recent progress in automated report generation with vision-language models offer clear pote… ▽ More Radiology reports are an instrumental part of modern medicine, informing key clinical decisions such as diagnosis and treatment. The worldwide shortage of radiologists, however, restricts access to expert care and imposes heavy workloads, contributing to avoidable errors and delays in report delivery. While recent progress in automated report generation with vision-language models offer clear potential in ameliorating the situation, the path to real-world adoption has been stymied by the challenge of evaluating the clinical quality of AI-generated reports. In this study, we build a state-of-the-art report generation system for chest radiographs, $\textit{Flamingo-CXR}$, by fine-tuning a well-known vision-language foundation model on radiology data. To evaluate the quality of the AI-generated reports, a group of 16 certified radiologists provide detailed evaluations of AI-generated and human written reports for chest X-rays from an intensive care setting in the United States and an inpatient setting in India. At least one radiologist (out of two per case) preferred the AI report to the ground truth report in over 60$\%$ of cases for both datasets. Amongst the subset of AI-generated reports that contain errors, the most frequently cited reasons were related to the location and finding, whereas for human written reports, most mistakes were related to severity and finding. This disparity suggested potential complementarity between our AI system and human experts, prompting us to develop an assistive scenario in which Flamingo-CXR generates a first-draft report, which is subsequently revised by a clinician. This is the first demonstration of clinician-AI collaboration for report writing, and the resultant reports are assessed to be equivalent or preferred by at least one radiologist to reports written by experts alone in 80$\%$ of in-patient cases and 60$\%$ of intensive care cases. △ Less

Submitted 20 December, 2023; v1 submitted 30 November, 2023; originally announced November 2023.

Should we be going MAD? A Look at Multi-Agent Debate Strategies for LLMs

Authors: Andries Smit, Paul Duckworth, Nathan Grinsztajn, Thomas D. Barrett, Arnu Pretorius

Abstract: Recent advancements in large language models (LLMs) underscore their potential for responding to inquiries in various domains. However, ensuring that generative agents provide accurate and reliable answers remains an ongoing challenge. In this context, multi-agent debate (MAD) has emerged as a promising strategy for enhancing the truthfulness of LLMs. We benchmark a range of debating and prompting… ▽ More Recent advancements in large language models (LLMs) underscore their potential for responding to inquiries in various domains. However, ensuring that generative agents provide accurate and reliable answers remains an ongoing challenge. In this context, multi-agent debate (MAD) has emerged as a promising strategy for enhancing the truthfulness of LLMs. We benchmark a range of debating and prompting strategies to explore the trade-offs between cost, time, and accuracy. Importantly, we find that multi-agent debating systems, in their current form, do not reliably outperform other proposed prompting strategies, such as self-consistency and ensembling using multiple reasoning paths. However, when performing hyperparameter tuning, several MAD systems, such as Multi-Persona, perform better. This suggests that MAD protocols might not be inherently worse than other approaches, but that they are more sensitive to different hyperparameter settings and difficult to optimize. We build on these results to offer insights into improving debating strategies, such as adjusting agent agreement levels, which can significantly enhance performance and even surpass all other non-debate protocols we evaluated. We provide an open-source repository to the community with several state-of-the-art protocols together with evaluation scripts to benchmark across popular research datasets. △ Less

Submitted 18 July, 2024; v1 submitted 29 November, 2023; originally announced November 2023.

Comments: 2 pages, 13 figures

Combinatorial Optimization with Policy Adaptation using Latent Space Search

Authors: Felix Chalumeau, Shikha Surana, Clement Bonnet, Nathan Grinsztajn, Arnu Pretorius, Alexandre Laterre, Thomas D. Barrett

Abstract: Combinatorial Optimization underpins many real-world applications and yet, designing performant algorithms to solve these complex, typically NP-hard, problems remains a significant research challenge. Reinforcement Learning (RL) provides a versatile framework for designing heuristics across a broad spectrum of problem domains. However, despite notable progress, RL has not yet supplanted industrial… ▽ More Combinatorial Optimization underpins many real-world applications and yet, designing performant algorithms to solve these complex, typically NP-hard, problems remains a significant research challenge. Reinforcement Learning (RL) provides a versatile framework for designing heuristics across a broad spectrum of problem domains. However, despite notable progress, RL has not yet supplanted industrial solvers as the go-to solution. Current approaches emphasize pre-training heuristics that construct solutions but often rely on search procedures with limited variance, such as stochastically sampling numerous solutions from a single policy or employing computationally expensive fine-tuning of the policy on individual problem instances. Building on the intuition that performant search at inference time should be anticipated during pre-training, we propose COMPASS, a novel RL approach that parameterizes a distribution of diverse and specialized policies conditioned on a continuous latent space. We evaluate COMPASS across three canonical problems - Travelling Salesman, Capacitated Vehicle Routing, and Job-Shop Scheduling - and demonstrate that our search strategy (i) outperforms state-of-the-art approaches on 11 standard benchmarking tasks and (ii) generalizes better, surpassing all other approaches on a set of 18 procedurally transformed instance distributions. △ Less

Submitted 28 May, 2024; v1 submitted 13 November, 2023; originally announced November 2023.

Comments: Fix typo in formula and add a reference

Dream Content Discovery from Reddit with an Unsupervised Mixed-Method Approach

Authors: Anubhab Das, Sanja Šćepanović, Luca Maria Aiello, Remington Mallett, Deirdre Barrett, Daniele Quercia

Abstract: Dreaming is a fundamental but not fully understood part of human experience that can shed light on our thought patterns. Traditional dream analysis practices, while popular and aided by over 130 unique scales and rating systems, have limitations. Mostly based on retrospective surveys or lab studies, they struggle to be applied on a large scale or to show the importance and connections between diff… ▽ More Dreaming is a fundamental but not fully understood part of human experience that can shed light on our thought patterns. Traditional dream analysis practices, while popular and aided by over 130 unique scales and rating systems, have limitations. Mostly based on retrospective surveys or lab studies, they struggle to be applied on a large scale or to show the importance and connections between different dream themes. To overcome these issues, we developed a new, data-driven mixed-method approach for identifying topics in free-form dream reports through natural language processing. We tested this method on 44,213 dream reports from Reddit's r/Dreams subreddit, where we found 217 topics, grouped into 22 larger themes: the most extensive collection of dream topics to date. We validated our topics by comparing it to the widely-used Hall and van de Castle scale. Going beyond traditional scales, our method can find unique patterns in different dream types (like nightmares or recurring dreams), understand topic importance and connections, and observe changes in collective dream experiences over time and around major events, like the COVID-19 pandemic and the recent Russo-Ukrainian war. We envision that the applications of our method will provide valuable insights into the intricate nature of dreaming. △ Less

Submitted 9 July, 2023; originally announced July 2023.

Comments: 20 pages, 6 figures, 4 tables, 4 pages of supplementary information

ACM Class: H.4.0; K.4.0

Bursts of polarised single photons from atom-cavity sources

Authors: Jan Ole Ernst, Juan-Rafael Alvarez, Thomas D. Barrett, Axel Kuhn

Abstract: Photonic qubits play an instrumental role in the development of advanced quantum technologies, including quantum networking, boson sampling and measurement based quantum computing. A promising framework for the deterministic production of indistinguishable single photons is an atomic emitter coupled to a single mode of a high finesse optical cavity. Polarisation control is an important cornerstone… ▽ More Photonic qubits play an instrumental role in the development of advanced quantum technologies, including quantum networking, boson sampling and measurement based quantum computing. A promising framework for the deterministic production of indistinguishable single photons is an atomic emitter coupled to a single mode of a high finesse optical cavity. Polarisation control is an important cornerstone, particularly when the polarisation defines the state of a quantum bit. Here, we propose a scheme for producing bursts of polarised single photons by coupling a generalised atomic emitter to an optical cavity, exploiting a particular choice of quantisation axis. In connection with two re-preparation methods, simulations predict 10-photon bursts coincidence count rates on the order of 1 kHz with single 87Rb atoms trapped in a state of the art optical cavity. This paves the way for novel n-photon experiments with atom-cavity sources. △ Less

Submitted 25 August, 2023; v1 submitted 8 May, 2023; originally announced May 2023.

Journal ref: Journal of Physics B: Atomic, Molecular and Optical Physics, Volume 56, Number 20, 2023

DiscoGen: Learning to Discover Gene Regulatory Networks

Authors: Nan Rosemary Ke, Sara-Jane Dunn, Jorg Bornschein, Silvia Chiappa, Melanie Rey, Jean-Baptiste Lespiau, Albin Cassirer, Jane Wang, Theophane Weber, David Barrett, Matthew Botvinick, Anirudh Goyal, Mike Mozer, Danilo Rezende

Abstract: Accurately inferring Gene Regulatory Networks (GRNs) is a critical and challenging task in biology. GRNs model the activatory and inhibitory interactions between genes and are inherently causal in nature. To accurately identify GRNs, perturbational data is required. However, most GRN discovery methods only operate on observational data. Recent advances in neural network-based causal discovery meth… ▽ More Accurately inferring Gene Regulatory Networks (GRNs) is a critical and challenging task in biology. GRNs model the activatory and inhibitory interactions between genes and are inherently causal in nature. To accurately identify GRNs, perturbational data is required. However, most GRN discovery methods only operate on observational data. Recent advances in neural network-based causal discovery methods have significantly improved causal discovery, including handling interventional data, improvements in performance and scalability. However, applying state-of-the-art (SOTA) causal discovery methods in biology poses challenges, such as noisy data and a large number of samples. Thus, adapting the causal discovery methods is necessary to handle these challenges. In this paper, we introduce DiscoGen, a neural network-based GRN discovery method that can denoise gene expression measurements and handle interventional data. We demonstrate that our model outperforms SOTA neural network-based causal discovery methods. △ Less

Submitted 12 April, 2023; originally announced April 2023.

$^{176}$Lu$^+$ clock comparison at the $10^{-18}$ level via correlation spectroscopy

Authors: Zhang Zhiqiang, Kyle J. Arnold, Rattakorn Kaewuam, M. D. Barrett

Abstract: We experimentally demonstrate agreement between two $^{176}$Lu$^+$ frequency references using correlation spectroscopy. From a comparison at different magnetic fields, we obtain a quadratic Zeeman coefficient of $-4.89264(88)\,\mathrm{Hz/mT^2}$, which gives a corresponding fractional frequency uncertainty contribution of just $2.5\times 10^{-20}$ for comparisons at typical operating fields of 0.1\… ▽ More We experimentally demonstrate agreement between two $^{176}$Lu$^+$ frequency references using correlation spectroscopy. From a comparison at different magnetic fields, we obtain a quadratic Zeeman coefficient of $-4.89264(88)\,\mathrm{Hz/mT^2}$, which gives a corresponding fractional frequency uncertainty contribution of just $2.5\times 10^{-20}$ for comparisons at typical operating fields of 0.1\,mT. A subsequent comparison with both systems at 0.1\,mT, demonstrates a fractional frequency difference of $(-2.0\pm(3.7)_\mathrm{stat}\pm(0.9)_\mathrm{sys})\times10^{-18}$, where `stat' and `sys' indicate statistical and systematic uncertainty, respectively. △ Less

Submitted 8 December, 2022; originally announced December 2022.

Comments: Main text: 6 pages and 3 figures, Supplemental: 12 pages and 6 figs

Winner Takes It All: Training Performant RL Populations for Combinatorial Optimization

Authors: Nathan Grinsztajn, Daniel Furelos-Blanco, Shikha Surana, Clément Bonnet, Thomas D. Barrett

Abstract: Applying reinforcement learning (RL) to combinatorial optimization problems is attractive as it removes the need for expert knowledge or pre-solved instances. However, it is unrealistic to expect an agent to solve these (often NP-)hard problems in a single shot at inference due to their inherent complexity. Thus, leading approaches often implement additional search strategies, from stochastic samp… ▽ More Applying reinforcement learning (RL) to combinatorial optimization problems is attractive as it removes the need for expert knowledge or pre-solved instances. However, it is unrealistic to expect an agent to solve these (often NP-)hard problems in a single shot at inference due to their inherent complexity. Thus, leading approaches often implement additional search strategies, from stochastic sampling and beam search to explicit fine-tuning. In this paper, we argue for the benefits of learning a population of complementary policies, which can be simultaneously rolled out at inference. To this end, we introduce Poppy, a simple training procedure for populations. Instead of relying on a predefined or hand-crafted notion of diversity, Poppy induces an unsupervised specialization targeted solely at maximizing the performance of the population. We show that Poppy produces a set of complementary policies, and obtains state-of-the-art RL results on four popular NP-hard problems: traveling salesman, capacitated vehicle routing, 0-1 knapsack, and job-shop scheduling. △ Less

Submitted 13 November, 2023; v1 submitted 7 October, 2022; originally announced October 2022.

Why neural networks find simple solutions: the many regularizers of geometric complexity

Authors: Benoit Dherin, Michael Munn, Mihaela Rosca, David G. T. Barrett

Abstract: In many contexts, simpler models are preferable to more complex models and the control of this model complexity is the goal for many methods in machine learning such as regularization, hyperparameter tuning and architecture design. In deep learning, it has been difficult to understand the underlying mechanisms of complexity control, since many traditional measures are not naturally suitable for de… ▽ More In many contexts, simpler models are preferable to more complex models and the control of this model complexity is the goal for many methods in machine learning such as regularization, hyperparameter tuning and architecture design. In deep learning, it has been difficult to understand the underlying mechanisms of complexity control, since many traditional measures are not naturally suitable for deep neural networks. Here we develop the notion of geometric complexity, which is a measure of the variability of the model function, computed using a discrete Dirichlet energy. Using a combination of theoretical arguments and empirical results, we show that many common training heuristics such as parameter norm regularization, spectral norm regularization, flatness regularization, implicit gradient regularization, noise regularization and the choice of parameter initialization all act to control geometric complexity, providing a unifying framework in which to characterize the behavior of deep learning models. △ Less

Submitted 23 December, 2022; v1 submitted 26 September, 2022; originally announced September 2022.

Comments: Accepted as a NeurIPS 2022 paper

Universally Expressive Communication in Multi-Agent Reinforcement Learning

Authors: Matthew Morris, Thomas D. Barrett, Arnu Pretorius

Abstract: Allowing agents to share information through communication is crucial for solving complex tasks in multi-agent reinforcement learning. In this work, we consider the question of whether a given communication protocol can express an arbitrary policy. By observing that many existing protocols can be viewed as instances of graph neural networks (GNNs), we demonstrate the equivalence of joint action se… ▽ More Allowing agents to share information through communication is crucial for solving complex tasks in multi-agent reinforcement learning. In this work, we consider the question of whether a given communication protocol can express an arbitrary policy. By observing that many existing protocols can be viewed as instances of graph neural networks (GNNs), we demonstrate the equivalence of joint action selection to node labelling. With standard GNN approaches provably limited in their expressive capacity, we draw from existing GNN literature and consider augmenting agent observations with: (1) unique agent IDs and (2) random noise. We provide a theoretical analysis as to how these approaches yield universally expressive communication, and also prove them capable of targeting arbitrary sets of actions for identical agents. Empirically, these augmentations are found to improve performance on tasks where expressive communication is required, whilst, in general, the optimal communication protocol is found to be task-dependent. △ Less

Submitted 13 January, 2023; v1 submitted 14 June, 2022; originally announced June 2022.

Comments: Published in NeurIPS 2022

MSC Class: 68T07; 68T42; 68R10 (Primary) 68T20; 05C15 (Secondary) ACM Class: I.2.11; I.2.6; I.2.8

Reinforcement Learning for Branch-and-Bound Optimisation using Retrospective Trajectories

Authors: Christopher W. F. Parsonson, Alexandre Laterre, Thomas D. Barrett

Abstract: Combinatorial optimisation problems framed as mixed integer linear programmes (MILPs) are ubiquitous across a range of real-world applications. The canonical branch-and-bound algorithm seeks to exactly solve MILPs by constructing a search tree of increasingly constrained sub-problems. In practice, its solving time performance is dependent on heuristics, such as the choice of the next variable to c… ▽ More Combinatorial optimisation problems framed as mixed integer linear programmes (MILPs) are ubiquitous across a range of real-world applications. The canonical branch-and-bound algorithm seeks to exactly solve MILPs by constructing a search tree of increasingly constrained sub-problems. In practice, its solving time performance is dependent on heuristics, such as the choice of the next variable to constrain ('branching'). Recently, machine learning (ML) has emerged as a promising paradigm for branching. However, prior works have struggled to apply reinforcement learning (RL), citing sparse rewards, difficult exploration, and partial observability as significant challenges. Instead, leading ML methodologies resort to approximating high quality handcrafted heuristics with imitation learning (IL), which precludes the discovery of novel policies and requires expensive data labelling. In this work, we propose retro branching; a simple yet effective approach to RL for branching. By retrospectively deconstructing the search tree into multiple paths each contained within a sub-tree, we enable the agent to learn from shorter trajectories with more predictable next states. In experiments on four combinatorial tasks, our approach enables learning-to-branch without any expert guidance or pre-training. We outperform the current state-of-the-art RL branching algorithm by 3-5x and come within 20% of the best IL method's performance on MILPs with 500 constraints and 1000 variables, with ablations verifying that our retrospectively constructed trajectories are essential to achieving these results. △ Less

Submitted 5 December, 2022; v1 submitted 28 May, 2022; originally announced May 2022.

Comments: Accepted to AAAI'23: Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence

Journal ref: AAAI'23: Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, 2023

Learning to Solve Combinatorial Graph Partitioning Problems via Efficient Exploration

Authors: Thomas D. Barrett, Christopher W. F. Parsonson, Alexandre Laterre

Abstract: From logistics to the natural sciences, combinatorial optimisation on graphs underpins numerous real-world applications. Reinforcement learning (RL) has shown particular promise in this setting as it can adapt to specific problem structures and does not require pre-solved instances for these, often NP-hard, problems. However, state-of-the-art (SOTA) approaches typically suffer from severe scalabil… ▽ More From logistics to the natural sciences, combinatorial optimisation on graphs underpins numerous real-world applications. Reinforcement learning (RL) has shown particular promise in this setting as it can adapt to specific problem structures and does not require pre-solved instances for these, often NP-hard, problems. However, state-of-the-art (SOTA) approaches typically suffer from severe scalability issues, primarily due to their reliance on expensive graph neural networks (GNNs) at each decision step. We introduce ECORD; a novel RL algorithm that alleviates this expense by restricting the GNN to a single pre-processing step, before entering a fast-acting exploratory phase directed by a recurrent unit. Experimentally, ECORD achieves a new SOTA for RL algorithms on the Maximum Cut problem, whilst also providing orders of magnitude improvement in speed and scalability. Compared to the nearest competitor, ECORD reduces the optimality gap by up to 73% on 500 vertex graphs with a decreased wall-clock time. Moreover, ECORD retains strong performance when generalising to larger graphs with up to 10000 vertices. △ Less

Submitted 27 May, 2022; originally announced May 2022.

Investigating the low-flux states in six Intermediate Polars

Authors: Ava E. Covington, Aarran W. Shaw, Koji Mukai, Colin Littlefield, Craig O. Heinke, Richard M. Plotkin, Doug Barrett, James Boardman, David Boyd, Stephen M. Brincat, Rolf Carstens, Donald F. Collins, Lewis M. Cook, Walter R. Cooney, David Cejudo Fernández, Sjoerd Dufoer, Shawn Dvorak, Charles Galdies, William Goff, Franz-Josef Hambsch, Steve Johnston, Jim Jones, Kenneth Menzies, Libert A. G. Monard, Etienne Morelle , et al. (8 additional authors not shown)

Abstract: We present optical photometry of six intermediate polars that exhibit transitions to a low-flux state. For four of these systems, DW Cnc, V515 And, V1223 Sgr and RX J2133.7+5107, we are able to perform timing analysis in and out of the low states. We find that, for DW Cnc and V515 And, the dominant periodicities in the light curves change as the flux decreases, indicating a change in the sources'… ▽ More We present optical photometry of six intermediate polars that exhibit transitions to a low-flux state. For four of these systems, DW Cnc, V515 And, V1223 Sgr and RX J2133.7+5107, we are able to perform timing analysis in and out of the low states. We find that, for DW Cnc and V515 And, the dominant periodicities in the light curves change as the flux decreases, indicating a change in the sources' accretion properties as they transition to the low state. For V1223 Sgr we find that the variability is almost completely quenched at the lowest flux, but do not find evidence for a changing accretion geometry. For RX J2133.7+5107, the temporal properties do not change in the low state, but we do see a period of enhanced accretion that is coincident with increased variability on the beat frequency, which we do not associate with a change in the accretion mechanisms in the system. △ Less

Submitted 18 February, 2022; v1 submitted 16 February, 2022; originally announced February 2022.

Comments: 19 pages, 10 figures, accepted for publication in ApJ. The authors recommend downloading the PDF of this paper, as it takes a while to render online

Epidemic Dreams: Dreaming about health during the COVID-19 pandemic

Authors: Sanja Šćepanović, Luca Maria Aiello, Deirdre Barrett, Daniele Quercia

Abstract: The continuity hypothesis of dreams suggests that the content of dreams is continuous with the dreamer's waking experiences. Given the unprecedented nature of the experiences during COVID-19, we studied the continuity hypothesis in the context of the pandemic. We implemented a deep-learning algorithm that can extract mentions of medical conditions from text and applied it to two datasets collected… ▽ More The continuity hypothesis of dreams suggests that the content of dreams is continuous with the dreamer's waking experiences. Given the unprecedented nature of the experiences during COVID-19, we studied the continuity hypothesis in the context of the pandemic. We implemented a deep-learning algorithm that can extract mentions of medical conditions from text and applied it to two datasets collected during the pandemic: 2,888 dream reports (dreaming life experiences), and 57M tweets mentioning the pandemic (waking life experiences). The health expressions common to both sets were typical COVID-19 symptoms (e.g., cough, fever, and anxiety), suggesting that dreams reflected people's real-world experiences. The health expressions that distinguished the two sets reflected differences in thought processes: expressions in waking life reflected a linear and logical thought process and, as such, described realistic symptoms or related disorders (e.g., nasal pain, SARS, H1N1); those in dreaming life reflected a thought process closer to the visual and emotional spheres and, as such, described either conditions unrelated to the virus (e.g., maggots, deformities, snakebites), or conditions of surreal nature (e.g., teeth falling out, body crumbling into sand). Our results confirm that dream reports represent an understudied yet valuable source of people's health experiences in the real world. △ Less

Submitted 2 February, 2022; originally announced February 2022.

The Geometric Occam's Razor Implicit in Deep Learning

Authors: Benoit Dherin, Michael Munn, David G. T. Barrett

Abstract: In over-parameterized deep neural networks there can be many possible parameter configurations that fit the training data exactly. However, the properties of these interpolating solutions are poorly understood. We argue that over-parameterized neural networks trained with stochastic gradient descent are subject to a Geometric Occam's Razor; that is, these networks are implicitly regularized by the… ▽ More In over-parameterized deep neural networks there can be many possible parameter configurations that fit the training data exactly. However, the properties of these interpolating solutions are poorly understood. We argue that over-parameterized neural networks trained with stochastic gradient descent are subject to a Geometric Occam's Razor; that is, these networks are implicitly regularized by the geometric model complexity. For one-dimensional regression, the geometric model complexity is simply given by the arc length of the function. For higher-dimensional settings, the geometric model complexity depends on the Dirichlet energy of the function. We explore the relationship between this Geometric Occam's Razor, the Dirichlet energy and other known forms of implicit regularization. Finally, for ResNets trained on CIFAR-10, we observe that Dirichlet energy measurements are consistent with the action of this implicit Geometric Occam's Razor. △ Less

Submitted 30 November, 2021; v1 submitted 29 November, 2021; originally announced November 2021.

Comments: Accepted as a NeurIPS 2021 workshop paper (OPT2021)

High frequency behavior of the Leray transform: model hypersurfaces and projective duality

Authors: David E. Barrett, Luke D. Edholm

Abstract: The Leray transform $\bf{L}$ is studied on a family $M_γ$ of unbounded hypersurfaces in two complex dimensions. For a large class of measures, we obtain necessary and sufficient conditions for the $L^2$-boundedness of $\bf{L}$, along with an exact spectral description of $\bf{L}^*\bf{L}$. This yields both the norm and high-frequency norm of $\bf{L}$, the latter giving an affirmative answer to an u… ▽ More The Leray transform $\bf{L}$ is studied on a family $M_γ$ of unbounded hypersurfaces in two complex dimensions. For a large class of measures, we obtain necessary and sufficient conditions for the $L^2$-boundedness of $\bf{L}$, along with an exact spectral description of $\bf{L}^*\bf{L}$. This yields both the norm and high-frequency norm of $\bf{L}$, the latter giving an affirmative answer to an unbounded analogue of an open conjecture relating the essential norm of $\bf{L}$ to a projective invariant on a bounded hypersurface. $\bf{L}$ is also shown to play a central role in bridging the function theoretic and projective geometric notions of duality. Our work leads to the construction of projectively invariant Hardy spaces on the $M_γ$, along with the realization of their duals as invariant Hardy spaces on the dual hypersurfaces. △ Less

Submitted 16 March, 2022; v1 submitted 27 November, 2021; originally announced November 2021.

Comments: 54 pages

MSC Class: 32A26 (Primary); 32F17; 32A25; 32V05; 42A38 (Secondary)

Autoregressive neural-network wavefunctions for ab initio quantum chemistry

Authors: Thomas D. Barrett, Aleksei Malyshev, A. I. Lvovsky

Abstract: In recent years, neural network quantum states (NNQS) have emerged as powerful tools for the study of quantum many-body systems. Electronic structure calculations are one such canonical many-body problem that have attracted significant research efforts spanning multiple decades, whilst only recently being attempted with NNQS. However, the complex non-local interactions and high sample complexity a… ▽ More In recent years, neural network quantum states (NNQS) have emerged as powerful tools for the study of quantum many-body systems. Electronic structure calculations are one such canonical many-body problem that have attracted significant research efforts spanning multiple decades, whilst only recently being attempted with NNQS. However, the complex non-local interactions and high sample complexity are significant challenges that call for bespoke solutions. Here, we parameterise the electronic wavefunction with a novel autoregressive neural network (ARN) that permits highly efficient and scalable sampling, whilst also embedding physical priors reflecting the structure of molecular systems without sacrificing expressibility. This allows us to perform electronic structure calculations on molecules with up to 30 spin-orbitals -- at least an order of magnitude more Slater determinants than previous applications of conventional NNQS -- and we find that our ansatz can outperform the de-facto gold-standard coupled cluster methods even in the presence of strong quantum correlations. With a highly expressive neural network for which sampling is no longer a computational bottleneck, we conclude that the barriers to further scaling are not associated with the wavefunction ansatz itself, but rather are inherent to any variational Monte Carlo approach. △ Less

Submitted 25 January, 2022; v1 submitted 26 September, 2021; originally announced September 2021.

Comments: 8 pages, plus Methods and Supplementary Information

Sums of CR and projective dual CR functions

Authors: David E. Barrett, Dusty E. Grundmeier

Abstract: A smooth, strongly $\mathbb{C}$-convex, real hypersurface $S$ in $\mathbb{CP}^n$ admits a projective dual CR structure in addition to the standard CR structure. Given a smooth function $u$ on $S$, we provide characterizations for when $u$ can be decomposed as a sum of a CR function and a dual CR function. Following work of Lee on pluriharmonic boundary values, we provide a characterization using d… ▽ More A smooth, strongly $\mathbb{C}$-convex, real hypersurface $S$ in $\mathbb{CP}^n$ admits a projective dual CR structure in addition to the standard CR structure. Given a smooth function $u$ on $S$, we provide characterizations for when $u$ can be decomposed as a sum of a CR function and a dual CR function. Following work of Lee on pluriharmonic boundary values, we provide a characterization using differential forms. We further provide a characterization using tangential vector fields in the style of Audibert and Bedford. △ Less

Submitted 2 September, 2021; originally announced September 2021.

Comments: 19 pages. To appear in Pure and Applied Mathematics Quarterly

MSC Class: 32V10

How to administer an antidote to Schrödinger's cat

Authors: Juan-Rafael Álvarez, Mark IJspeert, Oliver Barter, Ben Yuen, Thomas D. Barrett, Dustin Stuart, Jerome Dilley, Annemarie Holleczek, Axel Kuhn

Abstract: In his 1935 Gedankenexperiment, Erwin Schrödinger imagined a poisonous substance which has a 50% probability of being released, based on the decay of a radioactive atom. As such, the life of the cat and the state of the poison become entangled, and the fate of the cat is determined upon opening the box. We present an experimental technique that keeps the cat alive on any account. This method relie… ▽ More In his 1935 Gedankenexperiment, Erwin Schrödinger imagined a poisonous substance which has a 50% probability of being released, based on the decay of a radioactive atom. As such, the life of the cat and the state of the poison become entangled, and the fate of the cat is determined upon opening the box. We present an experimental technique that keeps the cat alive on any account. This method relies on the time-resolved Hong-Ou-Mandel effect: two long, identical photons impinging on a beam splitter always bunch in either of the outputs. Interpreting the first photon detection as the state of the poison, the second photon is identified as the state of the cat. Even after the collapse of the first photon's state, we show their fates are intertwined through quantum interference. We demonstrate this by a sudden phase change between the inputs, administered conditionally on the outcome of the first detection, which steers the second photon to a pre-defined output and ensures that the cat is always observed alive. △ Less

Submitted 17 June, 2021; originally announced June 2021.

Comments: 7 pages, 4 figures, including supplementary material with 4 pages and 4 figures

Discretization Drift in Two-Player Games

Authors: Mihaela Rosca, Yan Wu, Benoit Dherin, David G. T. Barrett

Abstract: Gradient-based methods for two-player games produce rich dynamics that can solve challenging problems, yet can be difficult to stabilize and understand. Part of this complexity originates from the discrete update steps given by simultaneous or alternating gradient descent, which causes each player to drift away from the continuous gradient flow -- a phenomenon we call discretization drift. Using b… ▽ More Gradient-based methods for two-player games produce rich dynamics that can solve challenging problems, yet can be difficult to stabilize and understand. Part of this complexity originates from the discrete update steps given by simultaneous or alternating gradient descent, which causes each player to drift away from the continuous gradient flow -- a phenomenon we call discretization drift. Using backward error analysis, we derive modified continuous dynamical systems that closely follow the discrete dynamics. These modified dynamics provide an insight into the notorious challenges associated with zero-sum games, including Generative Adversarial Networks. In particular, we identify distinct components of the discretization drift that can alter performance and in some cases destabilize the game. Finally, quantifying discretization drift allows us to identify regularizers that explicitly cancel harmful forms of drift or strengthen beneficial forms of drift, and thus improve performance of GAN training. △ Less

Submitted 1 July, 2021; v1 submitted 28 May, 2021; originally announced May 2021.

On the Origin of Implicit Regularization in Stochastic Gradient Descent

Authors: Samuel L. Smith, Benoit Dherin, David G. T. Barrett, Soham De

Abstract: For infinitesimal learning rates, stochastic gradient descent (SGD) follows the path of gradient flow on the full batch loss function. However moderately large learning rates can achieve higher test accuracies, and this generalization benefit is not explained by convergence bounds, since the learning rate which maximizes test accuracy is often larger than the learning rate which minimizes training… ▽ More For infinitesimal learning rates, stochastic gradient descent (SGD) follows the path of gradient flow on the full batch loss function. However moderately large learning rates can achieve higher test accuracies, and this generalization benefit is not explained by convergence bounds, since the learning rate which maximizes test accuracy is often larger than the learning rate which minimizes training loss. To interpret this phenomenon we prove that for SGD with random shuffling, the mean SGD iterate also stays close to the path of gradient flow if the learning rate is small and finite, but on a modified loss. This modified loss is composed of the original loss function and an implicit regularizer, which penalizes the norms of the minibatch gradients. Under mild assumptions, when the batch size is small the scale of the implicit regularization term is proportional to the ratio of the learning rate to the batch size. We verify empirically that explicitly including the implicit regularizer in the loss can enhance the test accuracy when the learning rate is small. △ Less

Submitted 28 January, 2021; originally announced January 2021.

Comments: Accepted as a conference paper at ICLR 2021

Fully reconfigurable coherent optical vector-matrix multiplication

Authors: James Spall, Xianxin Guo, Thomas D. Barrett, A. I. Lvovsky

Abstract: Optics is a promising platform in which to help realise the next generation of fast, parallel and energy-efficient computation. We demonstrate a reconfigurable free-space optical multiplier that is capable of over 3000 computations in parallel, using spatial light modulators with a pixel resolution of only 340x340. This enables vector-matrix multiplication and parallel vector-vector multiplication… ▽ More Optics is a promising platform in which to help realise the next generation of fast, parallel and energy-efficient computation. We demonstrate a reconfigurable free-space optical multiplier that is capable of over 3000 computations in parallel, using spatial light modulators with a pixel resolution of only 340x340. This enables vector-matrix multiplication and parallel vector-vector multiplication with vector size of up to 56. Our design is the first to simultaneously support optical implementation of reconfigurable, large-size and real-valued linear algebraic operations. Such an optical multiplier can serve as a building block of special-purpose optical processors such as optical neural networks and optical Ising machines. △ Less

Submitted 25 September, 2020; originally announced September 2020.

Comments: 4 pages, 4 figures

Journal ref: Optics Letters Vol. 45, Issue 20, pp. 5752-5755 (2020)

Implicit Gradient Regularization

Authors: David G. T. Barrett, Benoit Dherin

Abstract: Gradient descent can be surprisingly good at optimizing deep neural networks without overfitting and without explicit regularization. We find that the discrete steps of gradient descent implicitly regularize models by penalizing gradient descent trajectories that have large loss gradients. We call this Implicit Gradient Regularization (IGR) and we use backward error analysis to calculate the size… ▽ More Gradient descent can be surprisingly good at optimizing deep neural networks without overfitting and without explicit regularization. We find that the discrete steps of gradient descent implicitly regularize models by penalizing gradient descent trajectories that have large loss gradients. We call this Implicit Gradient Regularization (IGR) and we use backward error analysis to calculate the size of this regularization. We confirm empirically that implicit gradient regularization biases gradient descent toward flat minima, where test errors are small and solutions are robust to noisy parameter perturbations. Furthermore, we demonstrate that the implicit gradient regularization term can be used as an explicit regularizer, allowing us to control this gradient regularization directly. More broadly, our work indicates that backward error analysis is a useful theoretical approach to the perennial question of how learning rate, model size, and parameter regularization interact to determine the properties of overparameterized models optimized with gradient descent. △ Less

Submitted 18 July, 2022; v1 submitted 23 September, 2020; originally announced September 2020.

Comments: Correction to formula A.14 in Appendix A.1 and update to the acknowledgments

Journal ref: Published as a conference paper at ICLR 2021

Hyperfine-mediated effects in a Lu$^+$ optical clock

Authors: Zhiqiang Zhang, K. J. Arnold, R. Kaewuam, M. S. Safronova, M. D. Barrett

Abstract: We consider hyperfine-mediated effects for clock transitions in $^{176}$Lu$^+$. Mixing of fine structure levels due to the hyperfine interaction bring about modifications to Landé $g$-factors and the quadrupole moment for a given state. Explicit expressions are derived for both $g$-factor and quadrupole corrections, for which leading order terms arise from the nuclear magnetic dipole coupling. Hig… ▽ More We consider hyperfine-mediated effects for clock transitions in $^{176}$Lu$^+$. Mixing of fine structure levels due to the hyperfine interaction bring about modifications to Landé $g$-factors and the quadrupole moment for a given state. Explicit expressions are derived for both $g$-factor and quadrupole corrections, for which leading order terms arise from the nuclear magnetic dipole coupling. High accuracy measurements of the $g$-factors for the $^1S_0$ and $^3D_1$ hyperfine levels are carried out, which provide an experimental determination of the leading order correction terms. △ Less

Submitted 7 September, 2020; originally announced September 2020.

Comments: 9 pages 3 figures

Precision measurement of the $^3D_1$ and $^3D_2$ quadrupole moments in Lu$^+$

Authors: R. Kaewuam, T. R. Tan, Zhiqiang Zhang, K. J. Arnold, M. S. Safronova, M. D. Barrett

Abstract: Precision measurements of the Lu$^+$ $^3D_1$ and $^3D_2$ quadrupole moments have been carried out giving $Θ(^3D_1)=0.63862(74)\,e a_0^2$ and $Θ(^3D_2)=0.8602(14)\,e a_0^2$, respectively. The measurements utilize the differential shift between ions in a multi-ion crystal so that effects of external field gradients do not contribute leaving only the well defined Coulomb interaction. At this level of… ▽ More Precision measurements of the Lu$^+$ $^3D_1$ and $^3D_2$ quadrupole moments have been carried out giving $Θ(^3D_1)=0.63862(74)\,e a_0^2$ and $Θ(^3D_2)=0.8602(14)\,e a_0^2$, respectively. The measurements utilize the differential shift between ions in a multi-ion crystal so that effects of external field gradients do not contribute leaving only the well defined Coulomb interaction. At this level of precision, hyperfine-mediated corrections will likely be important. △ Less

Submitted 24 August, 2020; originally announced August 2020.

Comments: 6 pages, 2 figures

Journal ref: Phys. Rev. A 102, 042819 (2020)

Atomistic simulations of the interaction of basal dislocations with MgZn$_2$ precipitates in Mg alloys

Authors: G. Esteban-Manzanares, R. Alizadeh, I. Papadimitriou, D. Dickel, C. D. Barrett, J. LLorca

Abstract: The interaction between Mg edge basal dislocations and rod-shaped $β_1'$-MgZn$_2$ precipitates was studied by atomistic simulations using a new interatomic potential. The atomistic model was carefully built taking into account the experimental information about the orientation relationship between the matrix and the precipitate to ensure minimum energy interfaces. It was found that the dislocation… ▽ More The interaction between Mg edge basal dislocations and rod-shaped $β_1'$-MgZn$_2$ precipitates was studied by atomistic simulations using a new interatomic potential. The atomistic model was carefully built taking into account the experimental information about the orientation relationship between the matrix and the precipitate to ensure minimum energy interfaces. It was found that the dislocations initially overcame the precipitate by the formation of an Orowan loop that penetrated in the precipitate. The precipitate was finally sheared after several Orowan loops were piled-up. The number of loops necessary to shear the precipitate decreased as precipitate cross-section decreased and the temperature increased but was independent of the precipitate spacing. Precipitate shearing did not take place along well-defined crystallographic planes but it was triggered by the accumulation of the elastic energy in the precipitate which finally led to formation of an amorphous layer below and above the slip plane of the basal dislocations. The kink induced in the precipitate by this mechanism was in good agreement with transmission electron microscopy observations. △ Less

Submitted 9 May, 2020; originally announced May 2020.

Journal ref: Materials Science & Engineering A 788, 139555, 2020

Branching fractions for $P_{3/2}$ decays in Ba$^+$

Authors: Zhiqiang Zhang, K. J. Arnold, S. R. Chanu, R. Kaewuam, M. S. Safronova, M. D. Barrett

Abstract: Branching fractions for decays from the $P_{3/2}$ level in $^{138}$Ba$^+$ have been measured with a single laser-cooled ion. Decay probabilities to $S_{1/2}$, $D_{3/2}$ and $D_{5/2}$ are determined to be $0.741716(71)$, $0.028031(23)$ and $0.230253(61)$, respectively, which are an order of magnitude improvement over previous results. Our methodology only involves optical pumping and state detectio… ▽ More Branching fractions for decays from the $P_{3/2}$ level in $^{138}$Ba$^+$ have been measured with a single laser-cooled ion. Decay probabilities to $S_{1/2}$, $D_{3/2}$ and $D_{5/2}$ are determined to be $0.741716(71)$, $0.028031(23)$ and $0.230253(61)$, respectively, which are an order of magnitude improvement over previous results. Our methodology only involves optical pumping and state detection, and is hence relatively free of systematic effects. Measurements are carried out in two different ways to check for consistency. Our analysis also includes a measurement of the $D_{5/2}$ lifetime, for which we obtain 30.14(40)\,s. △ Less

Submitted 4 March, 2020; originally announced March 2020.

Comments: 9 pages, 7 figures

Journal ref: Phys. Rev. A 101, 062515 (2020)

Learning Group Structure and Disentangled Representations of Dynamical Environments

Authors: Robin Quessard, Thomas D. Barrett, William R. Clements

Abstract: Learning disentangled representations is a key step towards effectively discovering and modelling the underlying structure of environments. In the natural sciences, physics has found great success by describing the universe in terms of symmetry preserving transformations. Inspired by this formalism, we propose a framework, built upon the theory of group representation, for learning representations… ▽ More Learning disentangled representations is a key step towards effectively discovering and modelling the underlying structure of environments. In the natural sciences, physics has found great success by describing the universe in terms of symmetry preserving transformations. Inspired by this formalism, we propose a framework, built upon the theory of group representation, for learning representations of a dynamical environment structured around the transformations that generate its evolution. Experimentally, we learn the structure of explicitly symmetric environments without supervision from observational data generated by sequential interactions. We further introduce an intuitive disentanglement regularisation to ensure the interpretability of the learnt representations. We show that our method enables accurate long-horizon predictions, and demonstrate a correlation between the quality of predictions and disentanglement in the latent space. △ Less

Submitted 25 October, 2020; v1 submitted 17 February, 2020; originally announced February 2020.

Comments: Accepted to NeurIPS 2020

Backpropagation through nonlinear units for all-optical training of neural networks

Authors: Xianxin Guo, Thomas D. Barrett, Zhiming M. Wang, A. I. Lvovsky

Abstract: Backpropagation through nonlinear neurons is an outstanding challenge to the field of optical neural networks and the major conceptual barrier to all-optical training schemes. Each neuron is required to exhibit a directionally dependent response to propagating optical signals, with the backwards response conditioned on the forward signal, which is highly non-trivial to implement optically. We prop… ▽ More Backpropagation through nonlinear neurons is an outstanding challenge to the field of optical neural networks and the major conceptual barrier to all-optical training schemes. Each neuron is required to exhibit a directionally dependent response to propagating optical signals, with the backwards response conditioned on the forward signal, which is highly non-trivial to implement optically. We propose a practical and surprisingly simple solution that uses saturable absorption to provide the network nonlinearity. We find that the backward propagating gradients required to train the network can be approximated in a pump-probe scheme that requires only passive optical elements. Simulations show that, with readily obtainable optical depths, our approach can achieve equivalent performance to state-of-the-art computational networks on image classification benchmarks, even in deep networks with multiple sequential gradient approximations. This scheme is compatible with leading optical neural network proposals and therefore provides a feasible path towards end-to-end optical training. △ Less

Submitted 8 October, 2020; v1 submitted 23 December, 2019; originally announced December 2019.

Comments: Error fixed in Fig.1

Journal ref: Photonics Research 9, B71-B80 (2021)

Magic wavelength of the $^{138}$Ba$^+$ $6s\;{}^2S_{1/2}-5d\;{}^2D_{5/2}$ clock transition

Authors: S. R. Chanu, V. P. W. Koh, K. J. Arnold, R. Kaewuam, T. R. Tan, Zhiqiang Zhang, M. S. Safronova, M. D. Barrett

Abstract: The zero crossing of the dynamic differential scalar polarizability of the $S_{1/2}-D_{5/2}$ clock transition in $^{138}$Ba$^+$ has been determined to be $459.1614(28)\,$THz. Together with previously determined matrix elements and branching ratios, this tightly constrains the dynamic differential scalar polarizability of the clock transition over a large wavelength range ($\gtrsim 700\,$nm). In pa… ▽ More The zero crossing of the dynamic differential scalar polarizability of the $S_{1/2}-D_{5/2}$ clock transition in $^{138}$Ba$^+$ has been determined to be $459.1614(28)\,$THz. Together with previously determined matrix elements and branching ratios, this tightly constrains the dynamic differential scalar polarizability of the clock transition over a large wavelength range ($\gtrsim 700\,$nm). In particular it allows an estimate of the blackbody radiation shift of the clock transition at room temperature. △ Less

Submitted 4 March, 2020; v1 submitted 21 October, 2019; originally announced October 2019.

Comments: 4 pages, 2 figures. Updated based on new branching ratio measurements

Journal ref: Phys. Rev. A 101, 042507 (2020)

Hyperfine averaging by dynamic decoupling in a multi-ion lutetium clock

Authors: R. Kaewuam, T. R. Tan, K. J. Arnold, S. R. Chanu, Zhiqiang Zhang, M. D. Barrett

Abstract: We propose and experimentally demonstrate a scheme which effects hyperfine averaging during a Ramsey interrogation of a clock transition. The method eliminates the need to average over multiple optical transitions, reduces the sensitivity of the clock to its environment, and reduces inhomogeneous broadening in a multi-ion clock. The method is compatible with auto-balanced Ramsey spectroscopy, whic… ▽ More We propose and experimentally demonstrate a scheme which effects hyperfine averaging during a Ramsey interrogation of a clock transition. The method eliminates the need to average over multiple optical transitions, reduces the sensitivity of the clock to its environment, and reduces inhomogeneous broadening in a multi-ion clock. The method is compatible with auto-balanced Ramsey spectroscopy, which facilitates elimination of residual shifts due to imperfect implementation and ac Stark shifts from the optical probe. We demonstrate the scheme using correlation spectroscopy of the $^1S_0$-to-$^3D_1$ clock transition in a three-ion Lu+ clock. From the demonstration we are able to provide a measurement of the $^3D_1$ quadrupole moment, $Θ(^3D_1)=0.634(9)ea_0^2$. △ Less

Submitted 11 October, 2019; originally announced October 2019.

Comments: 5 pages, 2 figures

Journal ref: Phys. Rev. Lett. 124, 083202 (2020)

Projective-umbilic points of circular real hypersurfaces in $\mathbb C^2$

Authors: David E. Barrett, Dusty E. Grundmeier

Abstract: We show that the boundary of any bounded strongly pseudoconvex complete circular domain in $\mathbb C^2$ must contain points that are exceptionally tangent to a projective image of the unit sphere. We show that the boundary of any bounded strongly pseudoconvex complete circular domain in $\mathbb C^2$ must contain points that are exceptionally tangent to a projective image of the unit sphere. △ Less

Submitted 5 March, 2020; v1 submitted 20 September, 2019; originally announced September 2019.

Comments: Some additional material

MSC Class: 32V99

Exploratory Combinatorial Optimization with Reinforcement Learning

Authors: Thomas D. Barrett, William R. Clements, Jakob N. Foerster, A. I. Lvovsky

Abstract: Many real-world problems can be reduced to combinatorial optimization on a graph, where the subset or ordering of vertices that maximize some objective function must be found. With such tasks often NP-hard and analytically intractable, reinforcement learning (RL) has shown promise as a framework with which efficient heuristic methods to tackle these problems can be learned. Previous works construc… ▽ More Many real-world problems can be reduced to combinatorial optimization on a graph, where the subset or ordering of vertices that maximize some objective function must be found. With such tasks often NP-hard and analytically intractable, reinforcement learning (RL) has shown promise as a framework with which efficient heuristic methods to tackle these problems can be learned. Previous works construct the solution subset incrementally, adding one element at a time, however, the irreversible nature of this approach prevents the agent from revising its earlier decisions, which may be necessary given the complexity of the optimization task. We instead propose that the agent should seek to continuously improve the solution by learning to explore at test time. Our approach of exploratory combinatorial optimization (ECO-DQN) is, in principle, applicable to any combinatorial problem that can be defined on a graph. Experimentally, we show our method to produce state-of-the-art RL performance on the Maximum Cut problem. Moreover, because ECO-DQN can start from any arbitrary configuration, it can be combined with other search methods to further improve performance, which we demonstrate using a simple random search. △ Less

Submitted 31 January, 2020; v1 submitted 9 September, 2019; originally announced September 2019.

Comments: In Proceedings of the 34th National Conference on Artificial Intelligence, AAAI 2020

Journal ref: Proceedings of Thirty-fourth AAAI conference on artificial intelligence, 3243-3250 (2020)

Precision measurements on the $^{138}$Ba$^+$ $6s^2S_{1/2}-5d^2D_{5/2}$ clock transition

Authors: Kyle J. Arnold, Rattakorn Kaewuam, Sapam R. Chanu, Ting Rei Tan, Zhiqiang Zhang, Murray D. Barrett

Abstract: Measurement of the $^{138}$Ba$^+$ ${}^2S_{1/2} - {}^2D_{5/2}$ clock transition frequency and $D_{5/2}$ Landé $g_J$ factor are reported. The clock transition frequency $ν_{\mathrm{Ba}^+}=170\,126\,432\,449\,333.31\pm(0.39)_\mathrm{stat}\pm(0.29)_\mathrm{sys}\,$Hz, is obtained with accuracy limited by the frequency calibration of the maser used as a reference oscillator. The Landé $g_J$-factor for t… ▽ More Measurement of the $^{138}$Ba$^+$ ${}^2S_{1/2} - {}^2D_{5/2}$ clock transition frequency and $D_{5/2}$ Landé $g_J$ factor are reported. The clock transition frequency $ν_{\mathrm{Ba}^+}=170\,126\,432\,449\,333.31\pm(0.39)_\mathrm{stat}\pm(0.29)_\mathrm{sys}\,$Hz, is obtained with accuracy limited by the frequency calibration of the maser used as a reference oscillator. The Landé $g_J$-factor for the ${}^2D_{5/2}$ level is determined to be $g_{D}=1.200\,367\,39(24)$, which is a 30-fold improvement on previous measurements. The $g$-factor measurements are corrected for an ac-magnetic field from trap-drive-induced currents in the electrodes, and data taken over a range of magnetic fields underscores the importance of accounting for this systematic. △ Less

Submitted 11 March, 2020; v1 submitted 21 June, 2019; originally announced June 2019.

Comments: 5 pages, 4 figures, plus 3 page Supplemental Material

Journal ref: Phys. Rev. Lett. 124, 193001 (2020)

An Explicitly Relational Neural Network Architecture

Authors: Murray Shanahan, Kyriacos Nikiforou, Antonia Creswell, Christos Kaplanis, David Barrett, Marta Garnelo

Abstract: With a view to bridging the gap between deep learning and symbolic AI, we present a novel end-to-end neural network architecture that learns to form propositional representations with an explicitly relational structure from raw pixel data. In order to evaluate and analyse the architecture, we introduce a family of simple visual relational reasoning tasks of varying complexity. We show that the pro… ▽ More With a view to bridging the gap between deep learning and symbolic AI, we present a novel end-to-end neural network architecture that learns to form propositional representations with an explicitly relational structure from raw pixel data. In order to evaluate and analyse the architecture, we introduce a family of simple visual relational reasoning tasks of varying complexity. We show that the proposed architecture, when pre-trained on a curriculum of such tasks, learns to generate reusable representations that better facilitate subsequent learning on previously unseen tasks when compared to a number of baseline architectures. The workings of a successfully trained model are visualised to shed some light on how the architecture functions. △ Less

Submitted 23 June, 2020; v1 submitted 24 May, 2019; originally announced May 2019.

Comments: In Proceedings ICML 2020

Measurements of the branching ratios for $6P_{1/2}$ decays in $^{138}$Ba$^+$

Authors: K. J. Arnold, S. R. Chanu, R. Kaewuam, T. R. Tan, L. Yeo, Zhiqiang Zhang, M. S. Safronova, M. D. Barrett

Abstract: Measurement of the branching ratios for $6P_{1/2}$ decays to $6S_{1/2}$ and $5D_{3/2}$ in $^{138}$Ba$^+$ are reported with the decay probability from $6P_{1/2}$ to $5D_{3/2}$ measured to be $p=0.268177\pm(37)_\mathrm{stat}-(20)_\mathrm{sys}$. This result differs from a recent report by $12σ$. A detailed account of systematics is given and the likely source of the discrepancy is identified. The new… ▽ More Measurement of the branching ratios for $6P_{1/2}$ decays to $6S_{1/2}$ and $5D_{3/2}$ in $^{138}$Ba$^+$ are reported with the decay probability from $6P_{1/2}$ to $5D_{3/2}$ measured to be $p=0.268177\pm(37)_\mathrm{stat}-(20)_\mathrm{sys}$. This result differs from a recent report by $12σ$. A detailed account of systematics is given and the likely source of the discrepancy is identified. The new value of the branching ratio is combined with a previous experimental results to give a new estimate of $τ=7.855(10)\,\mathrm{ns}$ for the $6P_{1/2}$ lifetime. In addition, ratios of matrix elements calculated from theory are combined with experimental results to provide improved theoretical estimates of the $6P_{3/2}$ lifetime and the associated matrix elements. △ Less

Submitted 21 October, 2019; v1 submitted 16 May, 2019; originally announced May 2019.

Comments: 12 pages, 7 figure, updated corrected a few minor typos

Journal ref: Phys. Rev. A 100, 032503 (2019)

Polarizability assessments of ion-based optical clocks

Authors: M. D. Barrett, K. J. Arnold, M. S. Safronova

Abstract: It is shown that the dynamic differential scalar polarisability of the $S_{1/2}-D_{5/2}$ transition in $^{138}$Ba$^+$ can be determined to an inaccuracy below $0.5\%$ across a wide wavelength range ($λ>700\,\mathrm{nm}$). This can be achieved using measurements for which accurate determination of laser intensity is not required, and most of the required measurements are already in the literature.… ▽ More It is shown that the dynamic differential scalar polarisability of the $S_{1/2}-D_{5/2}$ transition in $^{138}$Ba$^+$ can be determined to an inaccuracy below $0.5\%$ across a wide wavelength range ($λ>700\,\mathrm{nm}$). This can be achieved using measurements for which accurate determination of laser intensity is not required, and most of the required measurements are already in the literature. Measurement of a laser-induced ac-stark shift of the clock transition would then provide an \emph{in situ} measurement of the laser's intensity to the same $0.5\%$ level of inaccuracy, which is not easily achieved by other means. This would allow accurate polarisability measurements for clock transitions in other ions, through comparison with $^{138}$Ba$^+$. The approach would be equally applicable to Sr$^+$ and Ca$^+$, with the latter being immediately applicable to Al$^+$/Ca$^+$ quantum logic clocks. △ Less

Submitted 11 October, 2019; v1 submitted 13 May, 2019; originally announced May 2019.

Comments: 5 pages and two figures

Journal ref: Phys. Rev. A 100, 043418 (2019)

Suppressing inhomogeneous broadening in a lutetium multi-ion optical clock

Authors: Ting Rei Tan, Rattakorn Kaewuam, Kyle J. Arnold, Sapam R. Chanu, Zhiqiang Zhang, Marianna Safronova, Murray D. Barrett

Abstract: We demonstrate precision measurement and control of inhomogeneous broadening in a multi-ion clock consisting of three $^{176}$Lu$^+$ ions. Microwave spectroscopy between hyperfine states in the $^3D_1$ level is used to characterise differential systematic shifts between ions, most notably those associated with the electric quadrupole moment. By appropriate alignment of the magnetic field, we demon… ▽ More We demonstrate precision measurement and control of inhomogeneous broadening in a multi-ion clock consisting of three $^{176}$Lu$^+$ ions. Microwave spectroscopy between hyperfine states in the $^3D_1$ level is used to characterise differential systematic shifts between ions, most notably those associated with the electric quadrupole moment. By appropriate alignment of the magnetic field, we demonstrate suppression of these effects to the $\sim 10^{-17}$ level relative to the $^1S_0\leftrightarrow{}^3D_1$ optical transition frequency. Correlation spectroscopy on the optical transition demonstrates the feasibility of a 10s Ramsey interrogation in the three ion configuration with a corresponding projection noise limited stability of $σ(τ)=8.2\times 10^{-17}/\sqrtτ$ △ Less

Submitted 9 May, 2019; originally announced May 2019.

Comments: 4 pages, 3 figures

Journal ref: Phys. Rev. Lett. 123, 063201 (2019)

Is coding a relevant metaphor for building AI? A commentary on "Is coding a relevant metaphor for the brain?", by Romain Brette

Authors: Adam Santoro, Felix Hill, David Barrett, David Raposo, Matthew Botvinick, Timothy Lillicrap

Abstract: Brette contends that the neural coding metaphor is an invalid basis for theories of what the brain does. Here, we argue that it is an insufficient guide for building an artificial intelligence that learns to accomplish short- and long-term goals in a complex, changing environment. Brette contends that the neural coding metaphor is an invalid basis for theories of what the brain does. Here, we argue that it is an insufficient guide for building an artificial intelligence that learns to accomplish short- and long-term goals in a complex, changing environment. △ Less

Submitted 18 April, 2019; originally announced April 2019.

Pushing Purcell-enhancement beyond its limits

Authors: Thomas D. Barrett, Thomas H. Doherty, Axel Kuhn

Abstract: Purcell-enhanced emission from a coupled emitter-cavity system is a fundamental manifestation of cavity quantum electrodynamics. Starting from a theoretical description we derive a scheme for photon emission from an emitter coupled to a birefringent cavity that exceeds hitherto anticipated limitations. Based on a recent study and experimental investigation of the intra-cavity coupling of orthogona… ▽ More Purcell-enhanced emission from a coupled emitter-cavity system is a fundamental manifestation of cavity quantum electrodynamics. Starting from a theoretical description we derive a scheme for photon emission from an emitter coupled to a birefringent cavity that exceeds hitherto anticipated limitations. Based on a recent study and experimental investigation of the intra-cavity coupling of orthogonal polarisation modes in birefringent cavities, we now decouple the emitter and the photon prior to emission from the cavity mode. Effectively, this is "hiding" the emitter from the photon in the cavity to suppress re-excitation, increasing the overall emission through the cavity mirrors. In doing so we show that tailored cavity birefringence can offer significant advantages and that these are practically achievable within the bounds of present-day technology. It is found that birefringence can mitigate the tradeoff between stronger emitter-cavity coupling and efficient photon extraction. This allows for longer cavities to be constructed without a loss of performance -- a significant result for applications where dielectric mirrors interfere with any trapping fields confining the emitter. We then generalise our model to consider a variety of equivalent schemes. For instance, detuning a pair of ground states in a three-level emitter coupled to a cavity in a Lambda-system is shown to provide the same enhancement, and it can be combined with a birefringent cavity to further increase performance. Additionally, it is found that when directly connecting multiple ground states of the emitter to form a chain of coupled states, the extraction efficiency approaches its fundamental upper limit. The principles proposed in this work can be applied in multiple ways to any emitter-cavity system, paving the way to surpassing the traditional limits of such systems with technologies that exist today. △ Less

Submitted 29 March, 2020; v1 submitted 20 March, 2019; originally announced March 2019.

Comments: 8 pages, 8 figures plus 3 page appendix

Learning to Make Analogies by Contrasting Abstract Relational Structure

Authors: Felix Hill, Adam Santoro, David G. T. Barrett, Ari S. Morcos, Timothy Lillicrap

Abstract: Analogical reasoning has been a principal focus of various waves of AI research. Analogy is particularly challenging for machines because it requires relational structures to be represented such that they can be flexibly applied across diverse domains of experience. Here, we study how analogical reasoning can be induced in neural networks that learn to perceive and reason about raw visual data. We… ▽ More Analogical reasoning has been a principal focus of various waves of AI research. Analogy is particularly challenging for machines because it requires relational structures to be represented such that they can be flexibly applied across diverse domains of experience. Here, we study how analogical reasoning can be induced in neural networks that learn to perceive and reason about raw visual data. We find that the critical factor for inducing such a capacity is not an elaborate architecture, but rather, careful attention to the choice of data and the manner in which it is presented to the model. The most robust capacity for analogical reasoning is induced when networks learn analogies by contrasting abstract relational structures in their input domains, a training method that uses only the input data to force models to learn about important abstract features. Using this technique we demonstrate capacities for complex, visual and symbolic analogy making and generalisation in even the simplest neural network architectures. △ Less

Submitted 31 January, 2019; originally announced February 2019.

Spectroscopy of the $^1S_0$-to-$^1D_2$ clock transition in $^{176}$Lu$^+$

Authors: R. Kaewuam, T. R. Tan, K. J. Arnold, M. D. Barrett

Abstract: High precision spectroscopy of the $^1S_0$-to-${^1}D_2$ clock transition of $^{176}$Lu is reported. Measurements are performed with Hertz level precision with the accuracy of the hyperfine-averaged frequency limited by the calibration of an active hydrogen maser to the SI definition of the second via a GPS link. The measurements also provide accurate determination of the $^1D_2$ hyperfine structur… ▽ More High precision spectroscopy of the $^1S_0$-to-${^1}D_2$ clock transition of $^{176}$Lu is reported. Measurements are performed with Hertz level precision with the accuracy of the hyperfine-averaged frequency limited by the calibration of an active hydrogen maser to the SI definition of the second via a GPS link. The measurements also provide accurate determination of the $^1D_2$ hyperfine structure. Hyperfine structure constants associated with the magnetic octupole and electric hexadecapole moments of the nucleus are considered, which includes a derivation of correction terms from third-order perturbation theory. △ Less

Submitted 14 January, 2019; originally announced January 2019.

Comments: 8 pages, 3 figures

Journal ref: Phys. Rev. A 99, 022514 (2019)