Showing 1–50 of 399 results for author: Roberts, S

Deep Learning for Options Trading: An End-To-End Approach

Authors: Wee Ling Tan, Stephen Roberts, Stefan Zohren

Abstract: We introduce a novel approach to options trading strategies using a highly scalable and data-driven machine learning algorithm. In contrast to traditional approaches that often require specifications of underlying market dynamics or assumptions on an option pricing model, our models depart fundamentally from the need for these prerequisites, directly learning non-trivial mappings from market data… ▽ More We introduce a novel approach to options trading strategies using a highly scalable and data-driven machine learning algorithm. In contrast to traditional approaches that often require specifications of underlying market dynamics or assumptions on an option pricing model, our models depart fundamentally from the need for these prerequisites, directly learning non-trivial mappings from market data to optimal trading signals. Backtesting on more than a decade of option contracts for equities listed on the S&P 100, we demonstrate that deep learning models trained according to our end-to-end approach exhibit significant improvements in risk-adjusted performance over existing rules-based trading strategies. We find that incorporating turnover regularization into the models leads to further performance enhancements at prohibitively high levels of transaction costs. △ Less

Submitted 31 July, 2024; originally announced July 2024.

The Human Factor in AI Red Teaming: Perspectives from Social and Collaborative Computing

Authors: Alice Qian Zhang, Ryland Shaw, Jacy Reese Anthis, Ashlee Milton, Emily Tseng, Jina Suh, Lama Ahmad, Ram Shankar Siva Kumar, Julian Posada, Benjamin Shestakofsky, Sarah T. Roberts, Mary L. Gray

Abstract: Rapid progress in general-purpose AI has sparked significant interest in "red teaming," a practice of adversarial testing originating in military and cybersecurity applications. AI red teaming raises many questions about the human factor, such as how red teamers are selected, biases and blindspots in how tests are conducted, and harmful content's psychological effects on red teamers. A growing bod… ▽ More Rapid progress in general-purpose AI has sparked significant interest in "red teaming," a practice of adversarial testing originating in military and cybersecurity applications. AI red teaming raises many questions about the human factor, such as how red teamers are selected, biases and blindspots in how tests are conducted, and harmful content's psychological effects on red teamers. A growing body of HCI and CSCW literature examines related practices-including data labeling, content moderation, and algorithmic auditing. However, few, if any, have investigated red teaming itself. This workshop seeks to consider the conceptual and empirical challenges associated with this practice, often rendered opaque by non-disclosure agreements. Future studies may explore topics ranging from fairness to mental health and other areas of potential harm. We aim to facilitate a community of researchers and practitioners who can begin to meet these challenges with creativity, innovation, and thoughtful reflection. △ Less

Submitted 10 July, 2024; originally announced July 2024.

Comments: Workshop proposal accepted to CSCW 2024

A Structure-Preserving Domain Decomposition Method for Data-Driven Modeling

Authors: Shuai Jiang, Jonas Actor, Scott Roberts, Nathaniel Trask

Abstract: We present a domain decomposition strategy for developing structure-preserving finite element discretizations from data when exact governing equations are unknown. On subdomains, trainable Whitney form elements are used to identify structure-preserving models from data, providing a Dirichlet-to-Neumann map which may be used to globally construct a mortar method. The reduced-order local elements ma… ▽ More We present a domain decomposition strategy for developing structure-preserving finite element discretizations from data when exact governing equations are unknown. On subdomains, trainable Whitney form elements are used to identify structure-preserving models from data, providing a Dirichlet-to-Neumann map which may be used to globally construct a mortar method. The reduced-order local elements may be trained offline to reproduce high-fidelity Dirichlet data in cases where first principles model derivation is either intractable, unknown, or computationally prohibitive. In such cases, particular care must be taken to preserve structure on both local and mortar levels without knowledge of the governing equations, as well as to ensure well-posedness and stability of the resulting monolithic data-driven system. This strategy provides a flexible means of both scaling to large systems and treating complex geometries, and is particularly attractive for multiscale problems with complex microstructure geometry. While consistency is traditionally obtained in finite element methods via quasi-optimality results and the Bramble-Hilbert lemma as the local element diameter $h\rightarrow0$, our analysis establishes notions of accuracy and stability for finite h with accuracy coming from matching data. Numerical experiments and analysis establish properties for $H(\operatorname{div})$ problems in small data limits ($\mathcal{O}(1)$ reference solutions). △ Less

Submitted 8 June, 2024; originally announced June 2024.

Comments: 38 pages, 18 figures

IR Spectroscopy of Carboxylate-Passivated Semiconducting Nanocrystals: Simulation and Experiment

Authors: Jakub K. Sowa, Danielle M. Cadena, Arshad Mehmood, Benjamin G. Levine, Sean T. Roberts, Peter J. Rossky

Abstract: Surfaces of colloidal nanocrystals are frequently passivated with carboxylate ligands which exert significant effects on their optoelectronic properties and chemical stability. Experimentally, binding geometries of such ligands are typically investigated using vibrational spectroscopy, but the interpretation of the IR signal is usually not trivial. Here, using machine-learning (ML) algorithms trai… ▽ More Surfaces of colloidal nanocrystals are frequently passivated with carboxylate ligands which exert significant effects on their optoelectronic properties and chemical stability. Experimentally, binding geometries of such ligands are typically investigated using vibrational spectroscopy, but the interpretation of the IR signal is usually not trivial. Here, using machine-learning (ML) algorithms trained on DFT data, we simulate an IR spectrum of a lead-rich PbS nanocrystal passivated with butyrate ligands. We obtain a good agreement with the experimental signal and demonstrate that the observed line shape stems from a very wide range of `tilted-bridge'-type geometries and does not indicate a coexistence of `bridging' and `chelating' binding modes as has been previously assumed. This work illustrates limitations of empirical spectrum assignment and demonstrates the effectiveness of ML-driven molecular dynamics simulations in reproducing IR spectra of nanoscopic systems. △ Less

Submitted 27 March, 2024; originally announced March 2024.

Comments: Submitted. SI available on request

Journal ref: J. Phys. Chem. C 2024, 128, 21, 8724-8731

Optimized Model Selection for Estimating Treatment Effects from Costly Simulations of the US Opioid Epidemic

Authors: Abdulrahman A. Ahmed, M. Amin Rahimian, Mark S. Roberts

Abstract: Agent-based simulation with a synthetic population can help us compare different treatment conditions while keeping everything else constant within the same population (i.e., as digital twins). Such population-scale simulations require large computational power (i.e., CPU resources) to get accurate estimates for treatment effects. We can use meta models of the simulation results to circumvent the… ▽ More Agent-based simulation with a synthetic population can help us compare different treatment conditions while keeping everything else constant within the same population (i.e., as digital twins). Such population-scale simulations require large computational power (i.e., CPU resources) to get accurate estimates for treatment effects. We can use meta models of the simulation results to circumvent the need to simulate every treatment condition. Selecting the best estimating model at a given sample size (number of simulation runs) is a crucial problem. Depending on the sample size, the ability of the method to estimate accurately can change significantly. In this paper, we discuss different methods to explore what model works best at a specific sample size. In addition to the empirical results, we provide a mathematical analysis of the MSE equation and how its components decide which model to select and why a specific method behaves that way in a range of sample sizes. The analysis showed why the direction estimation method is better than model-based methods in larger sample sizes and how the between-group variation and the within-group variation affect the MSE equation. △ Less

Submitted 23 March, 2024; originally announced March 2024.

Comments: To be presented in 2024 Annual Simulation Conference (ANNSIM'24)

A 350-MHz Green Bank Telescope Survey of Unassociated Fermi LAT Sources: Discovery and Timing of Ten Millisecond Pulsars

Authors: P. Bangale, B. Bhattacharyya, F. Camilo, C. J. Clark, I. Cognard, M. E. DeCesar, E. C. Ferrara, P. Gentile, L. Guillemot, J. W. T. Hessels, T. J. Johnson, M. Kerr, M. A. McLaughlin, L. Nieder, S. M. Ransom, P. S. Ray, M. S. E. Roberts, J. Roy, S. Sanpa-Arsa, G. Theureau, M. T. Wolff

Abstract: We have searched for radio pulsations towards 49 Fermi Large Area Telescope (LAT) 1FGL Catalog $γ$-ray sources using the Green Bank Telescope at 350 MHz. We detected 18 millisecond pulsars (MSPs) in blind searches of the data; 10 of these were discoveries unique to our survey. Sixteen are binaries, with eight having short orbital periods $P_B < 1$ day. No radio pulsations from young pulsars were d… ▽ More We have searched for radio pulsations towards 49 Fermi Large Area Telescope (LAT) 1FGL Catalog $γ$-ray sources using the Green Bank Telescope at 350 MHz. We detected 18 millisecond pulsars (MSPs) in blind searches of the data; 10 of these were discoveries unique to our survey. Sixteen are binaries, with eight having short orbital periods $P_B < 1$ day. No radio pulsations from young pulsars were detected, although three targets are coincident with apparently radio-quiet $γ$-ray pulsars discovered in LAT data. Here, we give an overview of the survey and present radio and $γ$-ray timing results for the 10 MSPs discovered. These include the only isolated MSP discovered in our survey and six short-$P_B$ binary MSPs. Of these, three have very low-mass companions ($M_c$ $\ll$ 0.1M$_{\odot}$) and hence belong to the class of black widow pulsars. Two have more massive, non-degenerate companions with extensive radio eclipses and orbitally modulated X-ray emission consistent with the redback class. Significant $γ$-ray pulsations have been detected from nine of the discoveries. This survey and similar efforts suggest that the majority of Galactic $γ$-ray sources at high Galactic latitudes are either MSPs or relatively nearby non-recycled pulsars, with the latter having on average a much smaller radio/$γ$-ray beaming ratio as compared to MSPs. It also confirms that past surveys suffered from an observational bias against finding short-$P_B$ MSP systems. △ Less

Submitted 14 February, 2024; originally announced February 2024.

Comments: Accepted for publication in ApJ (25 pages, 15 figues, 4 tables)

Journal ref: ApJ, Vol 966, 20 pp. (2024)

Strongly stable dual-pairing summation by parts finite difference schemes for the vector invariant nonlinear shallow water equations -- I: Numerical scheme and validation on the plane

Authors: Justin Kin Jun Hew, Kenneth Duru, Stephen Roberts, Christopher Zoppou, Kieran Ricardo

Abstract: We present an energy/entropy stable and high order accurate finite difference method for solving the nonlinear (rotating) shallow water equations (SWE) in vector invariant form using the newly developed dual-pairing and dispersion-relation preserving summation-by-parts finite difference operators. We derive new well-posed boundary conditions for the SWE in one space dimension, formulated in terms… ▽ More We present an energy/entropy stable and high order accurate finite difference method for solving the nonlinear (rotating) shallow water equations (SWE) in vector invariant form using the newly developed dual-pairing and dispersion-relation preserving summation-by-parts finite difference operators. We derive new well-posed boundary conditions for the SWE in one space dimension, formulated in terms of fluxes and applicable to linear and nonlinear SWEs. For the nonlinear SWE, entropy stability ensures the boundedness of numerical solution but does not guarantee convergence. Adequate amount of numerical dissipation is necessary to control high frequency errors which could negatively impact accuracy in the numerical simulations. Using the dual-pairing summation by parts framework, we derive high order accurate and nonlinear hyper-viscosity operator which dissipates entropy and enstrophy. The hyper-viscosity operator effectively minimises oscillations from shocks and discontinuities, and eliminates high frequency grid-scale errors. The numerical method is most suitable for the simulations of subcritical flows typically observed in atmospheric and geostrophic flow problems. We prove a priori error estimates for the semi-discrete approximations of both linear and nonlinear SWE. Convergence, accuracy, and well-balanced properties are verified via the method of manufactured solutions and canonical test problems such as the dam break and lake at rest. Numerical simulations in two-dimensions are presented which include the rotating and merging vortex problem and barotropic shear instability, with fully developed turbulence. △ Less

Submitted 8 April, 2024; v1 submitted 19 October, 2023; originally announced October 2023.

Comments: 37 pages, 14 figures, comments are welcome

Few-Shot Learning Patterns in Financial Time-Series for Trend-Following Strategies

Authors: Kieran Wood, Samuel Kessler, Stephen J. Roberts, Stefan Zohren

Abstract: Forecasting models for systematic trading strategies do not adapt quickly when financial market conditions rapidly change, as was seen in the advent of the COVID-19 pandemic in 2020, causing many forecasting models to take loss-making positions. To deal with such situations, we propose a novel time-series trend-following forecaster that can quickly adapt to new market conditions, referred to as re… ▽ More Forecasting models for systematic trading strategies do not adapt quickly when financial market conditions rapidly change, as was seen in the advent of the COVID-19 pandemic in 2020, causing many forecasting models to take loss-making positions. To deal with such situations, we propose a novel time-series trend-following forecaster that can quickly adapt to new market conditions, referred to as regimes. We leverage recent developments from the deep learning community and use few-shot learning. We propose the Cross Attentive Time-Series Trend Network -- X-Trend -- which takes positions attending over a context set of financial time-series regimes. X-Trend transfers trends from similar patterns in the context set to make forecasts, then subsequently takes positions for a new distinct target regime. By quickly adapting to new financial regimes, X-Trend increases Sharpe ratio by 18.9% over a neural forecaster and 10-fold over a conventional Time-series Momentum strategy during the turbulent market period from 2018 to 2023. Our strategy recovers twice as quickly from the COVID-19 drawdown compared to the neural-forecaster. X-Trend can also take zero-shot positions on novel unseen financial assets obtaining a 5-fold Sharpe ratio increase versus a neural time-series trend forecaster over the same period. Furthermore, the cross-attention mechanism allows us to interpret the relationship between forecasts and patterns in the context set. △ Less

Submitted 28 March, 2024; v1 submitted 16 October, 2023; originally announced October 2023.

Comments: minor edits

Lipschitz Interpolation: Non-parametric Convergence under Bounded Stochastic Noise

Authors: Julien Walden Huang, Stephen Roberts, Jan-Peter Calliess

Abstract: This paper examines the asymptotic convergence properties of Lipschitz interpolation methods within the context of bounded stochastic noise. In the first part of the paper, we establish probabilistic consistency guarantees of the classical approach in a general setting and derive upper bounds on the uniform convergence rates. These bounds align with well-established optimal rates of non-parametric… ▽ More This paper examines the asymptotic convergence properties of Lipschitz interpolation methods within the context of bounded stochastic noise. In the first part of the paper, we establish probabilistic consistency guarantees of the classical approach in a general setting and derive upper bounds on the uniform convergence rates. These bounds align with well-established optimal rates of non-parametric regression obtained in related settings and provide new precise upper bounds on the non-parametric regression problem under bounded noise assumptions. Practically, they can serve as a theoretical tool for comparing Lipschitz interpolation to alternative non-parametric regression methods, providing a condition on the behaviour of the noise at the boundary of its support which indicates when Lipschitz interpolation should be expected to asymptotically outperform or underperform other approaches. In the second part, we expand upon these results to include asymptotic guarantees for online learning of dynamics in discrete-time stochastic systems and illustrate their utility in deriving closed-loop stability guarantees of a simple controller. We also explore applications where the main assumption of prior knowledge of the Lipschitz constant is removed by adopting the LACKI framework (Calliess et al. (2020)) and deriving general asymptotic consistency. △ Less

Submitted 10 October, 2023; originally announced October 2023.

Comments: Preprint

Explicit Runge Kutta Methods that Alleviate Order Reduction

Authors: Abhijit Biswas, David I. Ketcheson, Steven Roberts, Benjamin Seibold, David Shirokoff

Abstract: Explicit Runge--Kutta (RK) methods are susceptible to a reduction in the observed order of convergence when applied to initial-boundary value problem with time-dependent boundary conditions. We study conditions on explicit RK methods that guarantee high-order convergence for linear problems; we refer to these conditions as weak stage order conditions. We prove a general relationship between the me… ▽ More Explicit Runge--Kutta (RK) methods are susceptible to a reduction in the observed order of convergence when applied to initial-boundary value problem with time-dependent boundary conditions. We study conditions on explicit RK methods that guarantee high-order convergence for linear problems; we refer to these conditions as weak stage order conditions. We prove a general relationship between the method's order, weak stage order, and number of stages. We derive explicit RK methods with high weak stage order and demonstrate, through numerical tests, that they avoid the order reduction phenomenon up to any order for linear problems and up to order three for nonlinear problems. △ Less

Submitted 4 October, 2023; v1 submitted 4 October, 2023; originally announced October 2023.

MSC Class: 65L04; 65L20; 65M12

On well-posed boundary conditions and energy stable finite volume method for the linear shallow water wave equation

Authors: Rudi Prihandoko, Kenneth Duru, Stephen Roberts, Christopher Zoppou

Abstract: We derive and analyse well-posed boundary conditions for the linear shallow water wave equation. The analysis is based on the energy method and it identifies the number, location and form of the boundary conditions so that the initial boundary value problem is well-posed. A finite volume method is developed based on the summation-by-parts framework with the boundary conditions implemented weakly u… ▽ More We derive and analyse well-posed boundary conditions for the linear shallow water wave equation. The analysis is based on the energy method and it identifies the number, location and form of the boundary conditions so that the initial boundary value problem is well-posed. A finite volume method is developed based on the summation-by-parts framework with the boundary conditions implemented weakly using penalties. Stability is proven by deriving a discrete energy estimate analogous to the continuous estimate. The continuous and discrete analysis covers all flow regimes. Numerical experiments are presented verifying the analysis. △ Less

Submitted 27 September, 2023; originally announced September 2023.

Comments: 23 pages, 4 figures

MSC Class: 65M12 (Primary); 65M08 (Secondary) ACM Class: G.1.8

In Consideration of Indigenous Data Sovereignty: Data Mining as a Colonial Practice

Authors: Jennafer Shae Roberts, Laura N Montoya

Abstract: Data mining reproduces colonialism, and Indigenous voices are being left out of the development of technology that relies on data, such as artificial intelligence. This research stresses the need for the inclusion of Indigenous Data Sovereignty and centers on the importance of Indigenous rights over their own data. Inclusion is necessary in order to integrate Indigenous knowledge into the design,… ▽ More Data mining reproduces colonialism, and Indigenous voices are being left out of the development of technology that relies on data, such as artificial intelligence. This research stresses the need for the inclusion of Indigenous Data Sovereignty and centers on the importance of Indigenous rights over their own data. Inclusion is necessary in order to integrate Indigenous knowledge into the design, development, and implementation of data-reliant technology. To support this hypothesis and address the problem, the CARE Principles for Indigenous Data Governance (Collective Benefit, Authority to Control, Responsibility, and Ethics) are applied. We cover how the colonial practices of data mining do not align with Indigenous convictions. The included case studies highlight connections to Indigenous rights in relation to the protection of data and environmental ecosystems, thus establishing how data governance can serve both the people and the Earth. By applying the CARE Principles to the issues that arise from data mining and neocolonialism, our goal is to provide a framework that can be used in technological development. The theory is that this could reflect outwards to promote data sovereignty generally and create new relationships between people and data that are ethical as opposed to driven by speed and profit. △ Less

Submitted 18 September, 2023; originally announced September 2023.

Comments: 12 pages, 1 Figure, Future Technologies Conference (FTC) 2023. arXiv admin note: substantial text overlap with arXiv:2208.04700

Projected Task-Specific Layers for Multi-Task Reinforcement Learning

Authors: Josselin Somerville Roberts, Julia Di

Abstract: Multi-task reinforcement learning could enable robots to scale across a wide variety of manipulation tasks in homes and workplaces. However, generalizing from one task to another and mitigating negative task interference still remains a challenge. Addressing this challenge by successfully sharing information across tasks will depend on how well the structure underlying the tasks is captured. In th… ▽ More Multi-task reinforcement learning could enable robots to scale across a wide variety of manipulation tasks in homes and workplaces. However, generalizing from one task to another and mitigating negative task interference still remains a challenge. Addressing this challenge by successfully sharing information across tasks will depend on how well the structure underlying the tasks is captured. In this work, we introduce our new architecture, Projected Task-Specific Layers (PTSL), that leverages a common policy with dense task-specific corrections through task-specific layers to better express shared and variable task information. We then show that our model outperforms the state of the art on the MT10 and MT50 benchmarks of Meta-World consisting of 10 and 50 goal-conditioned tasks for a Sawyer arm. △ Less

Submitted 6 March, 2024; v1 submitted 15 September, 2023; originally announced September 2023.

Journal ref: ICRA 2024

A Skeleton-based Approach For Rock Crack Detection Towards A Climbing Robot Application

Authors: Josselin Somerville Roberts, Paul-Emile Giacomelli, Yoni Gozlan, Julia Di

Abstract: Conventional wheeled robots are unable to traverse scientifically interesting, but dangerous, cave environments. Multi-limbed climbing robot designs, such as ReachBot, are able to grasp irregular surface features and execute climbing motions to overcome obstacles, given suitable grasp locations. To support grasp site identification, we present a method for detecting rock cracks and edges, the SKel… ▽ More Conventional wheeled robots are unable to traverse scientifically interesting, but dangerous, cave environments. Multi-limbed climbing robot designs, such as ReachBot, are able to grasp irregular surface features and execute climbing motions to overcome obstacles, given suitable grasp locations. To support grasp site identification, we present a method for detecting rock cracks and edges, the SKeleton Intersection Loss (SKIL). SKIL is a loss designed for thin object segmentation that leverages the skeleton of the label. A dataset of rock face images was collected, manually annotated, and augmented with generated data. A new group of metrics, LineAcc, has been proposed for thin object segmentation such that the impact of the object width on the score is minimized. In addition, the metric is less sensitive to translation which can often lead to a score of zero when computing classical metrics such as Dice on thin objects. Our fine-tuned models outperform previous methods on similar thin object segmentation tasks such as blood vessel segmentation and show promise for integration onto a robotic system. △ Less

Submitted 6 November, 2023; v1 submitted 10 September, 2023; originally announced September 2023.

Journal ref: IEEE IRC 2023

On statistical arbitrage under a conditional factor model of equity returns

Authors: Trent Spears, Stefan Zohren, Stephen Roberts

Abstract: We consider a conditional factor model for a multivariate portfolio of United States equities in the context of analysing a statistical arbitrage trading strategy. A state space framework underlies the factor model whereby asset returns are assumed to be a noisy observation of a linear combination of factor values and latent factor risk premia. Filter and state prediction estimates for the risk pr… ▽ More We consider a conditional factor model for a multivariate portfolio of United States equities in the context of analysing a statistical arbitrage trading strategy. A state space framework underlies the factor model whereby asset returns are assumed to be a noisy observation of a linear combination of factor values and latent factor risk premia. Filter and state prediction estimates for the risk premia are retrieved in an online way. Such estimates induce filtered asset returns that can be compared to measurement observations, with large deviations representing candidate mean reversion trades. Further, in that the risk premia are modelled as time-varying quantities, non-stationarity in returns is de facto captured. We study an empirical trading strategy respectful of transaction costs, and demonstrate performance over a long history of 29 years, for both a linear and a non-linear state space model. Our results show that the model is competitive relative to the results of other methods, including simple benchmarks and other cutting-edge approaches as published in the literature. Also of note, while strategy performance degradation is noticed through time -- especially for the most recent years -- the strategy continues to offer compelling economics, and has scope for further advancement. △ Less

Submitted 5 September, 2023; originally announced September 2023.

Estimating Treatment Effects Using Costly Simulation Samples from a Population-Scale Model of Opioid Use Disorder

Authors: Abdulrahman A. Ahmed, M. Amin Rahimian, Mark S. Roberts

Abstract: Large-scale models require substantial computational resources for analysis and studying treatment conditions. Specifically, estimating treatment effects using simulations may require a lot of infeasible resources to allocate at every treatment condition. Therefore, it is essential to develop efficient methods to allocate computational resources for estimating treatment effects. Agent-based simula… ▽ More Large-scale models require substantial computational resources for analysis and studying treatment conditions. Specifically, estimating treatment effects using simulations may require a lot of infeasible resources to allocate at every treatment condition. Therefore, it is essential to develop efficient methods to allocate computational resources for estimating treatment effects. Agent-based simulation allows us to generate highly realistic simulation samples. FRED (A Framework for Reconstructing Epidemiological Dynamics) is an agent-based modeling system with a geospatial perspective using a synthetic population constructed based on the U.S. census data. Given its synthetic population, FRED simulations present a baseline for comparable results from different treatment conditions and treatment conditions. In this paper, we show three other methods for estimating treatment effects. In the first method, we resort to brute-force allocation, where all treatment conditions have an equal number of samples with a relatively large number of simulation runs. In the second method, we try to reduce the number of simulation runs by customizing individual samples required for each treatment effect based on the width of confidence intervals around the mean estimates. In the third method, we use a regression model, which allows us to learn across the treatment conditions such that simulation samples allocated for a treatment condition will help better estimate treatment effects in other conditions. We show that the regression-based methods result in a comparable estimate of treatment effects with less computational resources. The reduced variability and faster convergence of model-based estimates come at the cost of increased bias, and the bias-variance trade-off can be controlled by adjusting the number of model parameters (e.g., including higher-order interaction terms in the regression model). △ Less

Submitted 24 August, 2023; originally announced August 2023.

Comments: To be presented in IEEE International Conference on Biomedical and Health Informatics 2023, repository link: https://github.com/abdulrahmanfci/intervention-estimation

Learning to Learn Financial Networks for Optimising Momentum Strategies

Authors: Xingyue Pu, Stefan Zohren, Stephen Roberts, Xiaowen Dong

Abstract: Network momentum provides a novel type of risk premium, which exploits the interconnections among assets in a financial network to predict future returns. However, the current process of constructing financial networks relies heavily on expensive databases and financial expertise, limiting accessibility for small-sized and academic institutions. Furthermore, the traditional approach treats network… ▽ More Network momentum provides a novel type of risk premium, which exploits the interconnections among assets in a financial network to predict future returns. However, the current process of constructing financial networks relies heavily on expensive databases and financial expertise, limiting accessibility for small-sized and academic institutions. Furthermore, the traditional approach treats network construction and portfolio optimisation as separate tasks, potentially hindering optimal portfolio performance. To address these challenges, we propose L2GMOM, an end-to-end machine learning framework that simultaneously learns financial networks and optimises trading signals for network momentum strategies. The model of L2GMOM is a neural network with a highly interpretable forward propagation architecture, which is derived from algorithm unrolling. The L2GMOM is flexible and can be trained with diverse loss functions for portfolio performance, e.g. the negative Sharpe ratio. Backtesting on 64 continuous future contracts demonstrates a significant improvement in portfolio profitability and risk control, with a Sharpe ratio of 1.74 across a 20-year period. △ Less

Submitted 23 August, 2023; originally announced August 2023.

Comments: 9 pages

Network Momentum across Asset Classes

Authors: Xingyue Pu, Stephen Roberts, Xiaowen Dong, Stefan Zohren

Abstract: We investigate the concept of network momentum, a novel trading signal derived from momentum spillover across assets. Initially observed within the confines of pairwise economic and fundamental ties, such as the stock-bond connection of the same company and stocks linked through supply-demand chains, momentum spillover implies a propagation of momentum risk premium from one asset to another. The s… ▽ More We investigate the concept of network momentum, a novel trading signal derived from momentum spillover across assets. Initially observed within the confines of pairwise economic and fundamental ties, such as the stock-bond connection of the same company and stocks linked through supply-demand chains, momentum spillover implies a propagation of momentum risk premium from one asset to another. The similarity of momentum risk premium, exemplified by co-movement patterns, has been spotted across multiple asset classes including commodities, equities, bonds and currencies. However, studying the network effect of momentum spillover across these classes has been challenging due to a lack of readily available common characteristics or economic ties beyond the company level. In this paper, we explore the interconnections of momentum features across a diverse range of 64 continuous future contracts spanning these four classes. We utilise a linear and interpretable graph learning model with minimal assumptions to reveal the intricacies of the momentum spillover network. By leveraging the learned networks, we construct a network momentum strategy that exhibits a Sharpe ratio of 1.5 and an annual return of 22%, after volatility scaling, from 2000 to 2022. This paper pioneers the examination of momentum spillover across multiple asset classes using only pricing data, presents a multi-asset investment strategy based on network momentum, and underscores the effectiveness of this strategy through robust empirical analysis. △ Less

Submitted 22 August, 2023; originally announced August 2023.

Comments: 27 pages

Fault-tolerant complexes

Authors: Hector Bombin, Chris Dawson, Terry Farrelly, Yehua Liu, Naomi Nickerson, Mihir Pant, Fernando Pastawski, Sam Roberts

Abstract: Fault-tolerant complexes describe surface-code fault-tolerant protocols from a single geometric object. We first introduce fusion complexes that define a general family of fusion-based quantum computing (FBQC) fault-tolerant quantum protocols based on surface codes. We show that any 3-dimensional cell complex where each edge has four incident faces gives a valid fusion complex. This construction e… ▽ More Fault-tolerant complexes describe surface-code fault-tolerant protocols from a single geometric object. We first introduce fusion complexes that define a general family of fusion-based quantum computing (FBQC) fault-tolerant quantum protocols based on surface codes. We show that any 3-dimensional cell complex where each edge has four incident faces gives a valid fusion complex. This construction enables an automated search for fault tolerance schemes, allowing us to identify 627 examples within a moderate search time. We implement this using the open-source software tool Gavrog and present threshold results for a variety of schemes, finding fusion networks with higher erasure and Pauli thresholds than those existing in the literature. We then define more general structures we call fault-tolerant complexes that provide a homological description of fault tolerance from a large family of low-level error models, which include circuit-based computation, floquet-based computation, and FBQC with multi-qubit measurements. This extends the applicability of homological descriptions of fault tolerance, and enables the generation of many new schemes which have not been previously identified. We also define families of fault-tolerant complexes for color codes and 3d single-shot subsystem codes, which enables similar constructive methods, and we present several new examples of each. △ Less

Submitted 15 August, 2023; originally announced August 2023.

The Glamorisation of Unpaid Labour: AI and its Influencers

Authors: Nana Mgbechikwere Nwachukwu, Jennafer Shae Roberts, Laura N Montoya

Abstract: To harness the true potential of Artificial Intelligence (AI) for societal betterment, we need to move away from prioritising corporate interests which exploit Global South workers in the digital age. The unpaid labour and societal harms which are generated by Digital Value Networks (DVNs) disproportionately affect workers in Africa, Latin America, and India and need to be regulated. In this resea… ▽ More To harness the true potential of Artificial Intelligence (AI) for societal betterment, we need to move away from prioritising corporate interests which exploit Global South workers in the digital age. The unpaid labour and societal harms which are generated by Digital Value Networks (DVNs) disproportionately affect workers in Africa, Latin America, and India and need to be regulated. In this research, we discuss unethical practices to automate Human Intelligence Tasks (HITs) through gig work platforms and the capitalisation of data collection utilising influencers in social media. These are important areas of study in worker and user data practices, where ethical AI could be impactful. We provide suggestions for a path forward focused on responsible AI development. △ Less

Submitted 15 September, 2023; v1 submitted 31 July, 2023; originally announced August 2023.

Comments: 4 pages, 2 pages of references, Deep Learning Indaba 2023 Short Paper

Inferring epidemic dynamics using Gaussian process emulation of agent-based simulations

Authors: Abdulrahman A. Ahmed, M. Amin Rahimian, Mark S. Roberts

Abstract: Computational models help decision makers understand epidemic dynamics to optimize public health interventions. Agent-based simulation of disease spread in synthetic populations allows us to compare and contrast different effects across identical populations or to investigate the effect of interventions keeping every other factor constant between ``digital twins''. FRED (A Framework for Reconstruc… ▽ More Computational models help decision makers understand epidemic dynamics to optimize public health interventions. Agent-based simulation of disease spread in synthetic populations allows us to compare and contrast different effects across identical populations or to investigate the effect of interventions keeping every other factor constant between ``digital twins''. FRED (A Framework for Reconstructing Epidemiological Dynamics) is an agent-based modeling system with a geo-spatial perspective using a synthetic population that is constructed based on the U.S. census data. In this paper, we show how Gaussian process regression can be used on FRED-synthesized data to infer the differing spatial dispersion of the epidemic dynamics for two disease conditions that start from the same initial conditions and spread among identical populations. Our results showcase the utility of agent-based simulation frameworks such as FRED for inferring differences between conditions where controlling for all confounding factors for such comparisons is next to impossible without synthetic data. △ Less

Submitted 11 September, 2023; v1 submitted 22 July, 2023; originally announced July 2023.

Comments: To be presented in Winter Simulation Conference 2023, repository link: https://github.com/abdulrahmanfci/gpr-abm

The instabilities of large learning rate training: a loss landscape view

Authors: Lawrence Wang, Stephen Roberts

Abstract: Modern neural networks are undeniably successful. Numerous works study how the curvature of loss landscapes can affect the quality of solutions. In this work we study the loss landscape by considering the Hessian matrix during network training with large learning rates - an attractive regime that is (in)famously unstable. We characterise the instabilities of gradient descent, and we observe the st… ▽ More Modern neural networks are undeniably successful. Numerous works study how the curvature of loss landscapes can affect the quality of solutions. In this work we study the loss landscape by considering the Hessian matrix during network training with large learning rates - an attractive regime that is (in)famously unstable. We characterise the instabilities of gradient descent, and we observe the striking phenomena of \textit{landscape flattening} and \textit{landscape shift}, both of which are intimately connected to the instabilities of training. △ Less

Submitted 21 July, 2023; originally announced July 2023.

Comments: arXiv admin note: text overlap with arXiv:2305.18490

Leveraging Mixed Precision in Exponential Time Integration Methods

Authors: Cody J. Balos, Steven Roberts, David J. Gardner

Abstract: The machine learning explosion has created a prominent trend in modern computer hardware towards low precision floating-point operations. In response, there have been growing efforts to use low and mixed precision in general scientific computing. One important area that has received limited exploration is time-integration methods, which are used for solving differential equations that are ubiquito… ▽ More The machine learning explosion has created a prominent trend in modern computer hardware towards low precision floating-point operations. In response, there have been growing efforts to use low and mixed precision in general scientific computing. One important area that has received limited exploration is time-integration methods, which are used for solving differential equations that are ubiquitous in science and engineering applications. In this work, we develop two new approaches for leveraging mixed precision in exponential time integration methods. The first approach is based on a reformulation of the exponential Rosenbrock--Euler method allowing for low precision computations in matrix exponentials independent of the particular algorithm for matrix exponentiation. The second approach is based on an inexact and incomplete Arnoldi procedure in Krylov approximation methods for computing matrix exponentials and is agnostic to the chosen integration method. We show that both approaches improve accuracy compared to using purely low precision and offer better efficiency than using only double precision when solving an advection-diffusion-reaction partial differential equation. △ Less

Submitted 18 July, 2023; originally announced July 2023.

Report number: LLNL-PROC-851497 MSC Class: 65; 34 ACM Class: G.1.7; G.4

Journal ref: 2023 IEEE High Performance Extreme Computing Conference (HPEC)

Deep Inception Networks: A General End-to-End Framework for Multi-asset Quantitative Strategies

Authors: Tom Liu, Stephen Roberts, Stefan Zohren

Abstract: We introduce Deep Inception Networks (DINs), a family of Deep Learning models that provide a general framework for end-to-end systematic trading strategies. DINs extract time series (TS) and cross sectional (CS) features directly from daily price returns. This removes the need for handcrafted features, and allows the model to learn from TS and CS information simultaneously. DINs benefit from a ful… ▽ More We introduce Deep Inception Networks (DINs), a family of Deep Learning models that provide a general framework for end-to-end systematic trading strategies. DINs extract time series (TS) and cross sectional (CS) features directly from daily price returns. This removes the need for handcrafted features, and allows the model to learn from TS and CS information simultaneously. DINs benefit from a fully data-driven approach to feature extraction, whilst avoiding overfitting. Extending prior work on Deep Momentum Networks, DIN models directly output position sizes that optimise Sharpe ratio, but for the entire portfolio instead of individual assets. We propose a novel loss term to balance turnover regularisation against increased systemic risk from high correlation to the overall market. Using futures data, we show that DIN models outperform traditional TS and CS benchmarks, are robust to a range of transaction costs and perform consistently across random seeds. To balance the general nature of DIN models, we provide examples of how attention and Variable Selection Networks can aid the interpretability of investment decisions. These model-specific methods are particularly useful when the dimensionality of the input is high and variable importance fluctuates dynamically over time. Finally, we compare the performance of DIN models on other asset classes, and show how the space of potential features can be customised. △ Less

Submitted 7 July, 2023; originally announced July 2023.

Comments: 17 pages, 12 figures

G-TRACER: Expected Sharpness Optimization

Authors: John Williams, Stephen Roberts

Abstract: We propose a new regularization scheme for the optimization of deep learning architectures, G-TRACER ("Geometric TRACE Ratio"), which promotes generalization by seeking flat minima, and has a sound theoretical basis as an approximation to a natural-gradient descent based optimization of a generalized Bayes objective. By augmenting the loss function with a TRACER, curvature-regularized optimizers (… ▽ More We propose a new regularization scheme for the optimization of deep learning architectures, G-TRACER ("Geometric TRACE Ratio"), which promotes generalization by seeking flat minima, and has a sound theoretical basis as an approximation to a natural-gradient descent based optimization of a generalized Bayes objective. By augmenting the loss function with a TRACER, curvature-regularized optimizers (eg SGD-TRACER and Adam-TRACER) are simple to implement as modifications to existing optimizers and don't require extensive tuning. We show that the method converges to a neighborhood (depending on the regularization strength) of a local minimum of the unregularized objective, and demonstrate competitive performance on a number of benchmark computer vision and NLP datasets, with a particular focus on challenging low signal-to-noise ratio problems. △ Less

Submitted 24 June, 2023; originally announced June 2023.

Comments: 16 pages, 2 figures

MSC Class: 62-08

Sub-Meter Tree Height Mapping of California using Aerial Images and LiDAR-Informed U-Net Model

Authors: Fabien H Wagner, Sophia Roberts, Alison L Ritz, Griffin Carter, Ricardo Dalagnol, Samuel Favrichon, Mayumi CM Hirye, Martin Brandt, Philipe Ciais, Sassan Saatchi

Abstract: Tree canopy height is one of the most important indicators of forest biomass, productivity, and species diversity, but it is challenging to measure accurately from the ground and from space. Here, we used a U-Net model adapted for regression to map the canopy height of all trees in the state of California with very high-resolution aerial imagery (60 cm) from the USDA-NAIP program. The U-Net model… ▽ More Tree canopy height is one of the most important indicators of forest biomass, productivity, and species diversity, but it is challenging to measure accurately from the ground and from space. Here, we used a U-Net model adapted for regression to map the canopy height of all trees in the state of California with very high-resolution aerial imagery (60 cm) from the USDA-NAIP program. The U-Net model was trained using canopy height models computed from aerial LiDAR data as a reference, along with corresponding RGB-NIR NAIP images collected in 2020. We evaluated the performance of the deep-learning model using 42 independent 1 km$^2$ sites across various forest types and landscape variations in California. Our predictions of tree heights exhibited a mean error of 2.9 m and showed relatively low systematic bias across the entire range of tree heights present in California. In 2020, trees taller than 5 m covered ~ 19.3% of California. Our model successfully estimated canopy heights up to 50 m without saturation, outperforming existing canopy height products from global models. The approach we used allowed for the reconstruction of the three-dimensional structure of individual trees as observed from nadir-looking optical airborne imagery, suggesting a relatively robust estimation and mapping capability, even in the presence of image distortion. These findings demonstrate the potential of large-scale mapping and monitoring of tree height, as well as potential biomass estimation, using NAIP imagery. △ Less

Submitted 2 June, 2023; originally announced June 2023.

Comments: 29 pages, 9 figures, submitted to Remote Sensing in Ecology and Conservation (RSEC)

MSC Class: 92-08 ACM Class: I.4.9; I.5.4

SANE: The phases of gradient descent through Sharpness Adjusted Number of Effective parameters

Authors: Lawrence Wang, Stephen J. Roberts

Abstract: Modern neural networks are undeniably successful. Numerous studies have investigated how the curvature of loss landscapes can affect the quality of solutions. In this work we consider the Hessian matrix during network training. We reiterate the connection between the number of "well-determined" or "effective" parameters and the generalisation performance of neural nets, and we demonstrate its use… ▽ More Modern neural networks are undeniably successful. Numerous studies have investigated how the curvature of loss landscapes can affect the quality of solutions. In this work we consider the Hessian matrix during network training. We reiterate the connection between the number of "well-determined" or "effective" parameters and the generalisation performance of neural nets, and we demonstrate its use as a tool for model comparison. By considering the local curvature, we propose Sharpness Adjusted Number of Effective parameters (SANE), a measure of effective dimensionality for the quality of solutions. We show that SANE is robust to large learning rates, which represent learning regimes that are attractive but (in)famously unstable. We provide evidence and characterise the Hessian shifts across "loss basins" at large learning rates. Finally, extending our analysis to deeper neural networks, we provide an approximation to the full-network Hessian, exploiting the natural ordering of neural weights, and use this approximation to provide extensive empirical evidence for our claims. △ Less

Submitted 29 May, 2023; originally announced May 2023.

The Rhythms of Transient Relationships: Allocating time between weekdays and weekends

Authors: Valentín Vergara Hidd, Mailun Zhang, Simone Centellegher, Sam G. B. Roberts, Bruno Lepri, Eduardo López

Abstract: A fundamental question of any new relationship is, will it last? Transient relationships, recently defined by the authors, are an ideal type of social tie to explore this question: these relationships are characterized by distinguishable starting and ending temporal points, linking the question of tie longevity to relationship finite lifetime. In this study, we use mobile phone data sets from the… ▽ More A fundamental question of any new relationship is, will it last? Transient relationships, recently defined by the authors, are an ideal type of social tie to explore this question: these relationships are characterized by distinguishable starting and ending temporal points, linking the question of tie longevity to relationship finite lifetime. In this study, we use mobile phone data sets from the UK and Italy to analyze the weekly allocation of time invested in maintaining transient relationships. We find that more relationships are created during weekdays, with a greater proportion of them receiving more contact during these days of the week in the long term. The smaller group of relationships that receive more phone calls during the weekend tend to remain active for more time. We uncover a sorting process by which some ties are moved from weekdays to weekends and vice versa, mostly in the first half of the relationship. This process also carries more information about the ultimate lifetime of a tie than the part of the week when the relationship started, which suggests an early evaluation period that leads to a decision on how to allocate time to different types of transient ties. △ Less

Submitted 28 August, 2023; v1 submitted 24 May, 2023; originally announced May 2023.

Comments: 15 pages, 4 figures. Submitted for review at Royal Society Open Science R1

RAAD: LIGHT-1 CubeSat's Payload for the Detection of Terrestrial Gamma-Ray Flashes

Authors: A. Di Giovanni, F. Arneodo, A. Al Qasim, H. Alblooshi, F. AlKhouri, L. Alkindi, A. AlMannei, M. L. Benabderrahmane, G. Bruno, V. Conicella, O. Fawwaz, G. Franchi, S. Kalos, P. Oikonomou, L. Perillo, C. Pittori, M. S. Roberts, R. Torres

Abstract: The Rapid Acquisition Atmospheric Detector (RAAD), onboard the LIGHT-1 3U CubeSat, detects photons between hard X-rays and soft gamma-rays, in order to identify and characterize Terrestrial Gamma Ray Flashes (TGFs). Three detector configurations are tested, making use of Cerium Bromide and Lanthanum BromoChloride scintillating crystals coupled to photomultiplier tubes or Multi-Pixel Photon Counter… ▽ More The Rapid Acquisition Atmospheric Detector (RAAD), onboard the LIGHT-1 3U CubeSat, detects photons between hard X-rays and soft gamma-rays, in order to identify and characterize Terrestrial Gamma Ray Flashes (TGFs). Three detector configurations are tested, making use of Cerium Bromide and Lanthanum BromoChloride scintillating crystals coupled to photomultiplier tubes or Multi-Pixel Photon Counters, in order to identify the optimal combination for TGF detection. High timing resolution, a short trigger window, and the short decay time of its electronics allow RAAD to perform accurate measurements of prompt, transient events. Here we describe the overview of the detection concept, the development of the front-end acquisition electronics, as well as the ground testing and simulation the payload underwent prior to its launch on December 21st, 2021. We further present an analysis of the detector's in-orbit system behavior and some preliminary results. △ Less

Submitted 16 August, 2023; v1 submitted 9 May, 2023; originally announced May 2023.

Comments: 19 pages, 15 figures

Well-posed boundary conditions and energy stable discontinuous Galerkin spectral element method for the linearized Serre equations

Authors: Kenny Wiratama, Kenneth Duru, Stephen Roberts, Christopher Zoppou

Abstract: We derive well-posed boundary conditions for the linearized Serre equations in one spatial dimension by utilizing the energy method. An energy stable and conservative discontinuous Galerkin spectral element method with simple upwind numerical fluxes is proposed for solving the initial boundary value problem. We derive discrete energy estimates for the numerical approximation and prove a priori err… ▽ More We derive well-posed boundary conditions for the linearized Serre equations in one spatial dimension by utilizing the energy method. An energy stable and conservative discontinuous Galerkin spectral element method with simple upwind numerical fluxes is proposed for solving the initial boundary value problem. We derive discrete energy estimates for the numerical approximation and prove a priori error estimates in the energy norm. Detailed numerical examples are provided to verify the theoretical analysis and show convergence of numerical errors. △ Less

Submitted 25 April, 2023; v1 submitted 20 March, 2023; originally announced March 2023.

MSC Class: 65M12; 65M70; 65M15; 65M60

Unifying flavors of fault tolerance with the ZX calculus

Authors: Hector Bombin, Daniel Litinski, Naomi Nickerson, Fernando Pastawski, Sam Roberts

Abstract: There are several models of quantum computation which exhibit shared fundamental fault-tolerance properties. This article makes commonalities explicit by presenting these different models in a unifying framework based on the ZX calculus. We focus on models of topological fault tolerance - specifically surface codes - including circuit-based, measurement-based and fusion-based quantum computation,… ▽ More There are several models of quantum computation which exhibit shared fundamental fault-tolerance properties. This article makes commonalities explicit by presenting these different models in a unifying framework based on the ZX calculus. We focus on models of topological fault tolerance - specifically surface codes - including circuit-based, measurement-based and fusion-based quantum computation, as well as the recently introduced model of Floquet codes. We find that all of these models can be viewed as different flavors of the same underlying stabilizer fault-tolerance structure, and sustain this through a set of local equivalence transformations which allow mapping between flavors. We anticipate that this unifying perspective will pave the way to transferring progress among the different views of stabilizer fault-tolerance and help researchers familiar with one model easily understand others. △ Less

Submitted 12 June, 2024; v1 submitted 15 March, 2023; originally announced March 2023.

Comments: Accepted in Quantum, 16 pages, 13 figures, V2: updated bibliography links, minor corrections

Journal ref: Quantum 8, 1379 (2024)

Modular decoding: parallelizable real-time decoding for quantum computers

Authors: Héctor Bombín, Chris Dawson, Ye-Hua Liu, Naomi Nickerson, Fernando Pastawski, Sam Roberts

Abstract: Universal fault-tolerant quantum computation will require real-time decoding algorithms capable of quickly extracting logical outcomes from the stream of data generated by noisy quantum hardware. We propose modular decoding, an approach capable of addressing this challenge with minimal additional communication and without sacrificing decoding accuracy. We introduce the edge-vertex decomposition, a… ▽ More Universal fault-tolerant quantum computation will require real-time decoding algorithms capable of quickly extracting logical outcomes from the stream of data generated by noisy quantum hardware. We propose modular decoding, an approach capable of addressing this challenge with minimal additional communication and without sacrificing decoding accuracy. We introduce the edge-vertex decomposition, a concrete instance of modular decoding for lattice-surgery style fault-tolerant blocks which is remarkably effective. This decomposition of the global decoding problem into sub-tasks mirrors the logical-block-network structure of a fault-tolerant quantum circuit. We identify the buffering condition as a key requirement controlling decoder quality; it demands a sufficiently large separation (buffer) between a correction committed by a decoding sub-task and the data unavailable to it. We prove that the fault distance of the protocol is preserved if the buffering condition is satisfied. Finally, we implement edge-vertex modular decoding and apply it on a variety of quantum circuits, including the Clifford component of the 15-to-1 magic-state distillation protocol. Monte Carlo simulations on a range of buffer sizes provide quantitative evidence that buffers are both necessary and sufficient to guarantee decoder accuracy. Our results show that modular decoding meets all the practical requirements necessary to support real-world fault-tolerant quantum computers. △ Less

Submitted 8 March, 2023; originally announced March 2023.

Comments: 21+2 pages, 14 figures, comments welcome

Spatio-Temporal Momentum: Jointly Learning Time-Series and Cross-Sectional Strategies

Authors: Wee Ling Tan, Stephen Roberts, Stefan Zohren

Abstract: We introduce Spatio-Temporal Momentum strategies, a class of models that unify both time-series and cross-sectional momentum strategies by trading assets based on their cross-sectional momentum features over time. While both time-series and cross-sectional momentum strategies are designed to systematically capture momentum risk premia, these strategies are regarded as distinct implementations and… ▽ More We introduce Spatio-Temporal Momentum strategies, a class of models that unify both time-series and cross-sectional momentum strategies by trading assets based on their cross-sectional momentum features over time. While both time-series and cross-sectional momentum strategies are designed to systematically capture momentum risk premia, these strategies are regarded as distinct implementations and do not consider the concurrent relationship and predictability between temporal and cross-sectional momentum features of different assets. We model spatio-temporal momentum with neural networks of varying complexities and demonstrate that a simple neural network with only a single fully connected layer learns to simultaneously generate trading signals for all assets in a portfolio by incorporating both their time-series and cross-sectional momentum features. Backtesting on portfolios of 46 actively-traded US equities and 12 equity index futures contracts, we demonstrate that the model is able to retain its performance over benchmarks in the presence of high transaction costs of up to 5-10 basis points. In particular, we find that the model when coupled with least absolute shrinkage and turnover regularization results in the best performance over various transaction cost scenarios. △ Less

Submitted 20 February, 2023; originally announced February 2023.

Journal ref: The Journal of Financial Data Science, Summer 2023

Assessing Parameterized Geometric Models of Woven Composites using Image-Based Simulations

Authors: Collin W. Foster, Lincoln N. Collins, Francesco Panerai, Scott A. Roberts

Abstract: Mesoscale simulations of woven composites using parameterized analytical geometries offer a way to connect constituent material properties and their geometric arrangement to effective composite properties and performance. However, the reality of as-manufactured materials often differs from the ideal, both in terms of tow geometry and manufacturing heterogeneity. As such, resultant composite proper… ▽ More Mesoscale simulations of woven composites using parameterized analytical geometries offer a way to connect constituent material properties and their geometric arrangement to effective composite properties and performance. However, the reality of as-manufactured materials often differs from the ideal, both in terms of tow geometry and manufacturing heterogeneity. As such, resultant composite properties may differ from analytical predictions and exhibit significant local variations within a material. We employ mesoscale finite element method simulations to compare idealized analytical and as-manufactured woven composite materials and study the sensitivity of their effective properties to the mesoscale geometry. Three-dimensional geometries are reconstructed from X-ray computed tomography, image segmentation is performed using deep learning methods, and local fiber orientation is obtained using the structure tensor calculated from image scans. Suitable approximations to composite properties, using analytical unit cell calculations and effective media theory, are assessed. Our findings show that an analytical geometry and sub-unit cell geometry provide reasonable predictions for the effective thermal properties of a multi-layer production composite. △ Less

Submitted 19 February, 2023; originally announced February 2023.

Performance of the wavelength-shifting fiber upgrade for the Mu2e cosmic-ray veto detector

Authors: M. Solt, D. Coveyou, E. C. Dukes, R. C. Group, Y. Oksuzian, S. Roberts

Abstract: The Cosmic-Ray Veto detector for the muon-to-electron conversion experiment at Fermilab consists of four plastic scintillating counter layers read out by silicon photo-multipliers through embedded wavelength-shifting fibers. In order to increase the light yield in the most critical regions of the Cosmic-Ray Veto detector for improved background rejection, a 1.8 mm diameter fiber is being used in m… ▽ More The Cosmic-Ray Veto detector for the muon-to-electron conversion experiment at Fermilab consists of four plastic scintillating counter layers read out by silicon photo-multipliers through embedded wavelength-shifting fibers. In order to increase the light yield in the most critical regions of the Cosmic-Ray Veto detector for improved background rejection, a 1.8 mm diameter fiber is being used in many of the detector's critical modules instead of the previously planned 1.4 mm diameter fiber. This paper reports the testing procedure and light properties of thirty-four 1.8 mm fiber spools, with measurements performed using a custom-built scanner. We compare these new results with previously published data from the 1.4 mm diameter fiber used for regions of the cosmic-ray veto where the increased light yield is not required. In addition, measurements of fiber aging were performed. △ Less

Submitted 14 April, 2023; v1 submitted 17 February, 2023; originally announced February 2023.

Comments: Formatted bibliography and defined some acronyms

View fusion vis-à-vis a Bayesian interpretation of Black-Litterman for portfolio allocation

Authors: Trent Spears, Stefan Zohren, Stephen Roberts

Abstract: The Black-Litterman model extends the framework of the Markowitz Modern Portfolio Theory to incorporate investor views. We consider a case where multiple view estimates, including uncertainties, are given for the same underlying subset of assets at a point in time. This motivates our consideration of data fusion techniques for combining information from multiple sources. In particular, we consider… ▽ More The Black-Litterman model extends the framework of the Markowitz Modern Portfolio Theory to incorporate investor views. We consider a case where multiple view estimates, including uncertainties, are given for the same underlying subset of assets at a point in time. This motivates our consideration of data fusion techniques for combining information from multiple sources. In particular, we consider consistency-based methods that yield fused view and uncertainty pairs; such methods are not common to the quantitative finance literature. We show a relevant, modern case of incorporating machine learning model-derived view and uncertainty estimates, and the impact on portfolio allocation, with an example subsuming Arbitrage Pricing Theory. Hence we show the value of the Black-Litterman model in combination with information fusion and artificial intelligence-grounded prediction methods. △ Less

Submitted 31 January, 2023; originally announced January 2023.

Comments: 25 pages, 5 figures

Neutron star mass estimates from gamma-ray eclipses in spider millisecond pulsar binaries

Authors: C. J. Clark, M. Kerr, E. D. Barr, B. Bhattacharyya, R. P. Breton, P. Bruel, F. Camilo, W. Chen, I. Cognard, H. T. Cromartie, J. Deneva, V. S. Dhillon, L. Guillemot, M. R. Kennedy, M. Kramer, A. G. Lyne, D. Mata Sánchez, L. Nieder, C. Phillips, S. M. Ransom, P. S. Ray, M. S. E. Roberts, J. Roy, D. A. Smith, R. Spiewak , et al. (4 additional authors not shown)

Abstract: Reliable neutron star mass measurements are key to determining the equation-of-state of cold nuclear matter, but these are rare. "Black Widows" and "Redbacks" are compact binaries consisting of millisecond pulsars and semi-degenerate companion stars. Spectroscopy of the optically bright companions can determine their radial velocities, providing inclination-dependent pulsar mass estimates. While i… ▽ More Reliable neutron star mass measurements are key to determining the equation-of-state of cold nuclear matter, but these are rare. "Black Widows" and "Redbacks" are compact binaries consisting of millisecond pulsars and semi-degenerate companion stars. Spectroscopy of the optically bright companions can determine their radial velocities, providing inclination-dependent pulsar mass estimates. While inclinations can be inferred from subtle features in optical light curves, such estimates may be systematically biased due to incomplete heating models and poorly-understood variability. Using data from the Fermi Large Area Telescope, we have searched for gamma-ray eclipses from 49 spider systems, discovering significant eclipses in 7 systems, including the prototypical black widow PSR B1957$+$20. Gamma-ray eclipses require direct occultation of the pulsar by the companion, and so the detection, or significant exclusion, of a gamma-ray eclipse strictly limits the binary inclination angle, providing new robust, model-independent pulsar mass constraints. For PSR B1957$+$20, the eclipse implies a much lighter pulsar ($M_{\rm psr} = 1.81 \pm 0.07\,M_{\odot}$) than inferred from optical light curve modelling. △ Less

Submitted 26 January, 2023; originally announced January 2023.

Comments: 31 pages, 4 figures, includes supplementary tables; published in Nature Astronomy

Ultra-Low-Loss Silicon Nitride Photonics Based on Deposited Films Compatible with Foundries

Authors: Xingchen Ji, Yoshitomo Okawachi, Andres Gil-Molina, Mateus Corato-Zanarella, Samantha Roberts, Alexander L. Gaeta, Michal Lipson

Abstract: The fabrication processes of silicon nitride photonic devices used in foundries require low temperature deposition, which typically leads to high propagation losses. Here, we show that propagation loss as low as 0.42 dB/cm can be achieved using foundry compatible processes by solely reducing waveguide surface roughness. By post-processing the fabricated devices using rapid thermal anneal (RTA) and… ▽ More The fabrication processes of silicon nitride photonic devices used in foundries require low temperature deposition, which typically leads to high propagation losses. Here, we show that propagation loss as low as 0.42 dB/cm can be achieved using foundry compatible processes by solely reducing waveguide surface roughness. By post-processing the fabricated devices using rapid thermal anneal (RTA) and furnace anneal, we achieve propagation losses down to 0.28 dB/cm and 0.06 dB/cm, respectively. These low losses are comparable to the conventional devices using high temperature, high-stress low-pressure chemical vapor deposition (LPCVD) films. We also tune the dispersion of the devices, and proved that these devices can be used for linear and nonlinear applications. Low threshold parametric oscillation, broadband frequency combs and narrow-linewidth laser are demonstrated. Our work demonstrates the feasibility of scalable photonic systems based on foundries. △ Less

Submitted 8 January, 2023; originally announced January 2023.

Journal ref: Laser & Photonics Reviews (2022)

On Sequential Bayesian Inference for Continual Learning

Authors: Samuel Kessler, Adam Cobb, Tim G. J. Rudner, Stefan Zohren, Stephen J. Roberts

Abstract: Sequential Bayesian inference can be used for continual learning to prevent catastrophic forgetting of past tasks and provide an informative prior when learning new tasks. We revisit sequential Bayesian inference and test whether having access to the true posterior is guaranteed to prevent catastrophic forgetting in Bayesian neural networks. To do this we perform sequential Bayesian inference usin… ▽ More Sequential Bayesian inference can be used for continual learning to prevent catastrophic forgetting of past tasks and provide an informative prior when learning new tasks. We revisit sequential Bayesian inference and test whether having access to the true posterior is guaranteed to prevent catastrophic forgetting in Bayesian neural networks. To do this we perform sequential Bayesian inference using Hamiltonian Monte Carlo. We propagate the posterior as a prior for new tasks by fitting a density estimator on Hamiltonian Monte Carlo samples. We find that this approach fails to prevent catastrophic forgetting demonstrating the difficulty in performing sequential Bayesian inference in neural networks. From there we study simple analytical examples of sequential Bayesian inference and CL and highlight the issue of model misspecification which can lead to sub-optimal continual learning performance despite exact inference. Furthermore, we discuss how task data imbalances can cause forgetting. From these limitations, we argue that we need probabilistic models of the continual learning generative process rather than relying on sequential Bayesian inference over Bayesian neural network weights. In this vein, we also propose a simple baseline called Prototypical Bayesian Continual Learning, which is competitive with state-of-the-art Bayesian continual learning methods on class incremental continual learning vision benchmarks. △ Less

Submitted 9 July, 2023; v1 submitted 4 January, 2023; originally announced January 2023.

Comments: Published in Entropy, 24 pages, 14 figures

Implicit-Explicit Multirate Infinitesimal Stage-Restart Methods

Authors: Alex C. Fish, Daniel R. Reynolds, Steven B. Roberts

Abstract: Implicit-Explicit (IMEX) methods are flexible numerical time integration methods which solve an initial-value problem (IVP) that is partitioned into stiff and nonstiff processes with the goal of lower computational costs than a purely implicit or explicit approach. A complementary form of flexible IVP solvers are multirate infinitesimal methods for problems partitioned into fast- and slow-changing… ▽ More Implicit-Explicit (IMEX) methods are flexible numerical time integration methods which solve an initial-value problem (IVP) that is partitioned into stiff and nonstiff processes with the goal of lower computational costs than a purely implicit or explicit approach. A complementary form of flexible IVP solvers are multirate infinitesimal methods for problems partitioned into fast- and slow-changing dynamics, that solve a multirate IVP by evolving a sequence of ``fast'' IVPs using any suitably accurate algorithm. This article introduces a new class of high-order implicit-explicit multirate methods that are designed for multirate IVPs in which the slow-changing dynamics are further partitioned in an IMEX fashion. This new class, which we call implicit-explicit multirate stage-restart (IMEX-MRI-SR), both improves upon the previous implicit-explicit multirate generalized-structure additive Runge Kutta (IMEX-MRI-GARK) methods, and extends multirate exponential Runge Kutta (MERK) methods into the IMEX context. We leverage GARK theory to derive conditions guaranteeing orders of accuracy up to four. We provide second-, third-, and fourth-order accurate example methods and perform numerical simulations demonstrating convergence rates and computational performance in both fixed-step and adaptive-step settings. △ Less

Submitted 2 January, 2023; originally announced January 2023.

MSC Class: 65L20; 65L05; 65L06

Statistical Design and Analysis for Robust Machine Learning: A Case Study from COVID-19

Authors: Davide Pigoli, Kieran Baker, Jobie Budd, Lorraine Butler, Harry Coppock, Sabrina Egglestone, Steven G. Gilmour, Chris Holmes, David Hurley, Radka Jersakova, Ivan Kiskin, Vasiliki Koutra, Jonathon Mellor, George Nicholson, Joe Packham, Selina Patel, Richard Payne, Stephen J. Roberts, Björn W. Schuller, Ana Tendero-Cañadas, Tracey Thornley, Alexander Titcomb

Abstract: Since early in the coronavirus disease 2019 (COVID-19) pandemic, there has been interest in using artificial intelligence methods to predict COVID-19 infection status based on vocal audio signals, for example cough recordings. However, existing studies have limitations in terms of data collection and of the assessment of the performances of the proposed predictive models. This paper rigorously ass… ▽ More Since early in the coronavirus disease 2019 (COVID-19) pandemic, there has been interest in using artificial intelligence methods to predict COVID-19 infection status based on vocal audio signals, for example cough recordings. However, existing studies have limitations in terms of data collection and of the assessment of the performances of the proposed predictive models. This paper rigorously assesses state-of-the-art machine learning techniques used to predict COVID-19 infection status based on vocal audio signals, using a dataset collected by the UK Health Security Agency. This dataset includes acoustic recordings and extensive study participant meta-data. We provide guidelines on testing the performance of methods to classify COVID-19 infection status based on acoustic features and we discuss how these can be extended more generally to the development and assessment of predictive methods based on public health datasets. △ Less

Submitted 27 February, 2023; v1 submitted 15 December, 2022; originally announced December 2022.

Audio-based AI classifiers show no evidence of improved COVID-19 screening over simple symptoms checkers

Authors: Harry Coppock, George Nicholson, Ivan Kiskin, Vasiliki Koutra, Kieran Baker, Jobie Budd, Richard Payne, Emma Karoune, David Hurley, Alexander Titcomb, Sabrina Egglestone, Ana Tendero Cañadas, Lorraine Butler, Radka Jersakova, Jonathon Mellor, Selina Patel, Tracey Thornley, Peter Diggle, Sylvia Richardson, Josef Packham, Björn W. Schuller, Davide Pigoli, Steven Gilmour, Stephen Roberts, Chris Holmes

Abstract: Recent work has reported that AI classifiers trained on audio recordings can accurately predict severe acute respiratory syndrome coronavirus 2 (SARSCoV2) infection status. Here, we undertake a large scale study of audio-based deep learning classifiers, as part of the UK governments pandemic response. We collect and analyse a dataset of audio recordings from 67,842 individuals with linked metadata… ▽ More Recent work has reported that AI classifiers trained on audio recordings can accurately predict severe acute respiratory syndrome coronavirus 2 (SARSCoV2) infection status. Here, we undertake a large scale study of audio-based deep learning classifiers, as part of the UK governments pandemic response. We collect and analyse a dataset of audio recordings from 67,842 individuals with linked metadata, including reverse transcription polymerase chain reaction (PCR) test outcomes, of whom 23,514 tested positive for SARS CoV 2. Subjects were recruited via the UK governments National Health Service Test-and-Trace programme and the REal-time Assessment of Community Transmission (REACT) randomised surveillance survey. In an unadjusted analysis of our dataset AI classifiers predict SARS-CoV-2 infection status with high accuracy (Receiver Operating Characteristic Area Under the Curve (ROCAUC) 0.846 [0.838, 0.854]) consistent with the findings of previous studies. However, after matching on measured confounders, such as age, gender, and self reported symptoms, our classifiers performance is much weaker (ROC-AUC 0.619 [0.594, 0.644]). Upon quantifying the utility of audio based classifiers in practical settings, we find them to be outperformed by simple predictive scores based on user reported symptoms. △ Less

Submitted 2 March, 2023; v1 submitted 15 December, 2022; originally announced December 2022.

A large-scale and PCR-referenced vocal audio dataset for COVID-19

Authors: Jobie Budd, Kieran Baker, Emma Karoune, Harry Coppock, Selina Patel, Ana Tendero Cañadas, Alexander Titcomb, Richard Payne, David Hurley, Sabrina Egglestone, Lorraine Butler, Jonathon Mellor, George Nicholson, Ivan Kiskin, Vasiliki Koutra, Radka Jersakova, Rachel A. McKendry, Peter Diggle, Sylvia Richardson, Björn W. Schuller, Steven Gilmour, Davide Pigoli, Stephen Roberts, Josef Packham, Tracey Thornley , et al. (1 additional authors not shown)

Abstract: The UK COVID-19 Vocal Audio Dataset is designed for the training and evaluation of machine learning models that classify SARS-CoV-2 infection status or associated respiratory symptoms using vocal audio. The UK Health Security Agency recruited voluntary participants through the national Test and Trace programme and the REACT-1 survey in England from March 2021 to March 2022, during dominant transmi… ▽ More The UK COVID-19 Vocal Audio Dataset is designed for the training and evaluation of machine learning models that classify SARS-CoV-2 infection status or associated respiratory symptoms using vocal audio. The UK Health Security Agency recruited voluntary participants through the national Test and Trace programme and the REACT-1 survey in England from March 2021 to March 2022, during dominant transmission of the Alpha and Delta SARS-CoV-2 variants and some Omicron variant sublineages. Audio recordings of volitional coughs, exhalations, and speech were collected in the 'Speak up to help beat coronavirus' digital survey alongside demographic, self-reported symptom and respiratory condition data, and linked to SARS-CoV-2 test results. The UK COVID-19 Vocal Audio Dataset represents the largest collection of SARS-CoV-2 PCR-referenced audio recordings to date. PCR results were linked to 70,794 of 72,999 participants and 24,155 of 25,776 positive cases. Respiratory symptoms were reported by 45.62% of participants. This dataset has additional potential uses for bioacoustics research, with 11.30% participants reporting asthma, and 27.20% with linked influenza PCR test results. △ Less

Submitted 3 November, 2023; v1 submitted 15 December, 2022; originally announced December 2022.

Comments: 39 pages, 4 figures

Fault-tolerant Post-Selection for Low Overhead Magic State Preparation

Authors: Héctor Bombín, Mihir Pant, Sam Roberts, Karthik I. Seetharam

Abstract: We introduce a framework for fault-tolerant post-selection (FTPS) of fault-tolerant codes and channels -- such as those based on surface-codes -- using soft-information metrics based on visible syndrome and erasure information. We introduce several metrics for ranking configurations of syndromes and erasures. In particular, we introduce the \emph{logical gap} (and variants thereof) as a powerful s… ▽ More We introduce a framework for fault-tolerant post-selection (FTPS) of fault-tolerant codes and channels -- such as those based on surface-codes -- using soft-information metrics based on visible syndrome and erasure information. We introduce several metrics for ranking configurations of syndromes and erasures. In particular, we introduce the \emph{logical gap} (and variants thereof) as a powerful soft-information metric for predicting logical error rates of fault-tolerant channels based on topological error-correcting codes. The logical gap is roughly the unsigned weight difference between inequivalent logical corrections and is adaptable to any tailored noise model or decoder. We deploy this framework to prepare high-quality surface code magic states with low overhead under a model of independent and identically distributed (\emph{i.i.d.}) Pauli and erasure errors. Post-selection strategies based on the logical gap can suppress the encoding error rate of a magic state preparation channel to the level of the physical error rate with low overhead. For example, when operating at $60\%$ the bulk threshold of the corresponding surface code, an overall reduction of the encoding error rate by a factor of $15$ is achievable with a relative overhead factor of ${< 2}$ (approximately $23$ times less than that of simple syndrome-counting rules). We analyze a schematic buffer architecture for implementing post-selection rules on magic state factories in the context of magic state distillation. The FTPS framework can be utilized for mitigating errors in more general fault-tolerant logical channels. △ Less

Submitted 1 December, 2022; originally announced December 2022.

Comments: 10+7 pages, 13 figures, comments welcome

Journal ref: PRX Quantum 5, 010302 (2024)

The Effectiveness of World Models for Continual Reinforcement Learning

Authors: Samuel Kessler, Mateusz Ostaszewski, Michał Bortkiewicz, Mateusz Żarski, Maciej Wołczyk, Jack Parker-Holder, Stephen J. Roberts, Piotr Miłoś

Abstract: World models power some of the most efficient reinforcement learning algorithms. In this work, we showcase that they can be harnessed for continual learning - a situation when the agent faces changing environments. World models typically employ a replay buffer for training, which can be naturally extended to continual learning. We systematically study how different selective experience replay meth… ▽ More World models power some of the most efficient reinforcement learning algorithms. In this work, we showcase that they can be harnessed for continual learning - a situation when the agent faces changing environments. World models typically employ a replay buffer for training, which can be naturally extended to continual learning. We systematically study how different selective experience replay methods affect performance, forgetting, and transfer. We also provide recommendations regarding various modeling options for using world models. The best set of choices is called Continual-Dreamer, it is task-agnostic and utilizes the world model for continual exploration. Continual-Dreamer is sample efficient and outperforms state-of-the-art task-agnostic continual reinforcement learning methods on Minigrid and Minihack benchmarks. △ Less

Submitted 12 July, 2023; v1 submitted 29 November, 2022; originally announced November 2022.

Comments: Accepted at CoLLAs 2023, 21 pages, 15 figures

High-Resolution Radio Study of the Dragonfly Nebula

Authors: Ruolan Jin, C. -Y. Ng, Mallory S. E. Roberts, Kwan-Lok Li

Abstract: The Dragonfly Nebula (G75.2$+$0.1) powered by the young pulsar J2021$+$3651 is a rare pulsar wind nebula (PWN) that shows double tori and polar jets enclosed by a bow-shock structure in X-rays. We present new radio observations of this source taken with the Very Large Array (VLA) at 6 GHz. The radio PWN has an overall size about two times as large as the X-ray counterpart, consisting of a bright m… ▽ More The Dragonfly Nebula (G75.2$+$0.1) powered by the young pulsar J2021$+$3651 is a rare pulsar wind nebula (PWN) that shows double tori and polar jets enclosed by a bow-shock structure in X-rays. We present new radio observations of this source taken with the Very Large Array (VLA) at 6 GHz. The radio PWN has an overall size about two times as large as the X-ray counterpart, consisting of a bright main body region in the southwest, a narrow and fainter bridge region in the northeast, and a dark gap in between. The nebula shows a radio spectrum much softer than that of a typical PWN. This could be resulting from compression by the ram pressure as the system travels mildly supersonically in the interstellar medium (ISM). Our polarization maps reveal a highly ordered and complex $B$-field structure. This can be explained by a toroidal field distorted by the pulsar motion. △ Less

Submitted 18 November, 2022; originally announced November 2022.

Comments: 12 pages, 11 figures; submitted to ApJ

Learning General World Models in a Handful of Reward-Free Deployments

Authors: Yingchen Xu, Jack Parker-Holder, Aldo Pacchiano, Philip J. Ball, Oleh Rybkin, Stephen J. Roberts, Tim Rocktäschel, Edward Grefenstette

Abstract: Building generally capable agents is a grand challenge for deep reinforcement learning (RL). To approach this challenge practically, we outline two key desiderata: 1) to facilitate generalization, exploration should be task agnostic; 2) to facilitate scalability, exploration policies should collect large quantities of data without costly centralized retraining. Combining these two properties, we i… ▽ More Building generally capable agents is a grand challenge for deep reinforcement learning (RL). To approach this challenge practically, we outline two key desiderata: 1) to facilitate generalization, exploration should be task agnostic; 2) to facilitate scalability, exploration policies should collect large quantities of data without costly centralized retraining. Combining these two properties, we introduce the reward-free deployment efficiency setting, a new paradigm for RL research. We then present CASCADE, a novel approach for self-supervised exploration in this new setting. CASCADE seeks to learn a world model by collecting data with a population of agents, using an information theoretic objective inspired by Bayesian Active Learning. CASCADE achieves this by specifically maximizing the diversity of trajectories sampled by the population through a novel cascading objective. We provide theoretical intuition for CASCADE which we show in a tabular setting improves upon naïve approaches that do not account for population diversity. We then demonstrate that CASCADE collects diverse task-agnostic datasets and learns agents that generalize zero-shot to novel, unseen downstream tasks on Atari, MiniGrid, Crafter and the DM Control Suite. Code and videos are available at https://ycxuyingchen.github.io/cascade/ △ Less

Submitted 23 October, 2022; originally announced October 2022.

Comments: To be published at NeurIPS 2022. Code and videos available at https://ycxuyingchen.github.io/cascade/

Transfer Ranking in Finance: Applications to Cross-Sectional Momentum with Data Scarcity

Authors: Daniel Poh, Stephen Roberts, Stefan Zohren

Abstract: Cross-sectional strategies are a classical and popular trading style, with recent high performing variants incorporating sophisticated neural architectures. While these strategies have been applied successfully to data-rich settings involving mature assets with long histories, deploying them on instruments with limited samples generally produce over-fitted models with degraded performance. In this… ▽ More Cross-sectional strategies are a classical and popular trading style, with recent high performing variants incorporating sophisticated neural architectures. While these strategies have been applied successfully to data-rich settings involving mature assets with long histories, deploying them on instruments with limited samples generally produce over-fitted models with degraded performance. In this paper, we introduce Fused Encoder Networks -- a novel and hybrid parameter-sharing transfer ranking model. The model fuses information extracted using an encoder-attention module operated on a source dataset with a similar but separate module focused on a smaller target dataset of interest. This mitigates the issue of models with poor generalisability that are a consequence of training on scarce target data. Additionally, the self-attention mechanism enables interactions among instruments to be accounted for, not just at the loss level during model training, but also at inference time. Focusing on momentum applied to the top ten cryptocurrencies by market capitalisation as a demonstrative use-case, the Fused Encoder Networks outperforms the reference benchmarks on most performance measures, delivering a three-fold boost in the Sharpe ratio over classical momentum as well as an improvement of approximately 50% against the best benchmark model without transaction costs. It continues outperforming baselines even after accounting for the high transaction costs associated with trading cryptocurrencies. △ Less

Submitted 21 February, 2023; v1 submitted 21 August, 2022; originally announced August 2022.

Comments: 18 pages, 12 figures

Decolonisation, Global Data Law, and Indigenous Data Sovereignty

Authors: Jennafer Shae Roberts, Laura N Montoya

Abstract: This research examines the impact of digital neo-colonialism on the Global South and encourages the development of legal and economic incentives to protect Indigenous cultures globally. Data governance is discussed in an evolutionary context while focusing on data sharing and data mining. Case studies that exemplify the need to steer global data law towards protecting the earth, while addressing i… ▽ More This research examines the impact of digital neo-colonialism on the Global South and encourages the development of legal and economic incentives to protect Indigenous cultures globally. Data governance is discussed in an evolutionary context while focusing on data sharing and data mining. Case studies that exemplify the need to steer global data law towards protecting the earth, while addressing issues of data access, privacy, rights, and colonialism in the global South are explored. The case studies highlight connections to indigenous people's rights, in regard to the protection of environmental ecosystems, thus establishing how data law can serve the earth from an autochthonous lens. This framework examines histories shaped by colonialism and suggests how data governance could be used to create healthier balances of power. △ Less

Submitted 28 July, 2022; originally announced August 2022.

Comments: 16 pages, 1 table

Stabilizing Off-Policy Deep Reinforcement Learning from Pixels

Authors: Edoardo Cetin, Philip J. Ball, Steve Roberts, Oya Celiktutan

Abstract: Off-policy reinforcement learning (RL) from pixel observations is notoriously unstable. As a result, many successful algorithms must combine different domain-specific practices and auxiliary losses to learn meaningful behaviors in complex environments. In this work, we provide novel analysis demonstrating that these instabilities arise from performing temporal-difference learning with a convolutio… ▽ More Off-policy reinforcement learning (RL) from pixel observations is notoriously unstable. As a result, many successful algorithms must combine different domain-specific practices and auxiliary losses to learn meaningful behaviors in complex environments. In this work, we provide novel analysis demonstrating that these instabilities arise from performing temporal-difference learning with a convolutional encoder and low-magnitude rewards. We show that this new visual deadly triad causes unstable training and premature convergence to degenerate solutions, a phenomenon we name catastrophic self-overfitting. Based on our analysis, we propose A-LIX, a method providing adaptive regularization to the encoder's gradients that explicitly prevents the occurrence of catastrophic self-overfitting using a dual objective. By applying A-LIX, we significantly outperform the prior state-of-the-art on the DeepMind Control and Atari 100k benchmarks without any data augmentation or auxiliary losses. △ Less

Submitted 3 July, 2022; originally announced July 2022.

Comments: Short presentation at ICML 2022