Showing 1–25 of 25 results for author: Fernando, C

Analisis de la incidencia de la inversion extranjera directa y la inversion nacional, en el crecimiento economico de Chile

Authors: Alvear Guzman Katherine, Campozano Buele Jenner, Duran Canarte Paulette, Holguin Cedeno Roger, Mejia Crespin Fernando

Abstract: The research aims to assess the impact of foreign direct investment (FDI) and domestic investment on Chile's economic growth. By elucidating the relationship between FDI and domestic investment, the study contributes valuable insights for economic policy formulation and future investments. The findings hold significance in shaping Chile's international perception as an investment destination, pote… ▽ More The research aims to assess the impact of foreign direct investment (FDI) and domestic investment on Chile's economic growth. By elucidating the relationship between FDI and domestic investment, the study contributes valuable insights for economic policy formulation and future investments. The findings hold significance in shaping Chile's international perception as an investment destination, potentially influencing its standing in the global economic landscape. Demonstrating that FDI is a significant driver of economic growth could enhance confidence among foreign investors. The project's importance lies in contributing to economic knowledge and guiding strategic decisions for sustainable economic growth in Chile. Understanding the interplay of FDI and domestic investment allows for a balanced approach, promoting stable economic development and mitigating issues like excessive reliance on foreign investment. The study highlights the theory of internationalization as a conceptual framework for understanding the motives and strategies of multinational companies investing abroad. Leveraging data from sources like the Central Bank of Chile, the research analyzes variables such as Chile's economic growth (GDP), FDI, and domestic investment. The hypothesis posits a significant long-term causal relationship between FDI, National Investment (NI), and Chile's Economic Growth (GDP). Statistical analysis using the Eviews 6 software tool confirms that attracting foreign investments and promoting internal investment are imperative for sustainable economic growth in Chile. △ Less

Submitted 13 November, 2023; originally announced January 2024.

Comments: in Spanish language

Incremento del precio de los combustibles y su incidencia en los productos de la canasta basica del canton el triunfo, provincia del guayas

Authors: Alvear Guzman Katherine, Campozano Buele Jenner, Duran Canarte Paulette, Holguin Cedeno Roger, Mejia Crespin Fernando

Abstract: The objective of this research was to analyze the impact of the increase in the price of fuels and its incidence on the products of the basic basket of the El Triunfo, the province of Guayas. In the present study, the non-experimental quantitative method was used. The study population was limited to the families of the town, seeking to determine how their level of consumption was impacted after th… ▽ More The objective of this research was to analyze the impact of the increase in the price of fuels and its incidence on the products of the basic basket of the El Triunfo, the province of Guayas. In the present study, the non-experimental quantitative method was used. The study population was limited to the families of the town, seeking to determine how their level of consumption was impacted after the increase in fuels. Just 95 people were randomly taken. The study instrument that was used was surveys, with a focus on the purchasing power of families with respect to the basic basket after the increase in fuel prices. The results were processed through Cronbach's Alpha and reflected in pie charts. The independent and dependent variable that make up our study, were related through a simple linear regression, to determine if they correlate with each other. Keywords: Fuels, Basic basket, Linear regression, Subsidies, Inflation △ Less

Submitted 13 November, 2023; originally announced January 2024.

Comments: in Spanish language

Gemini: A Family of Highly Capable Multimodal Models

Authors: Gemini Team, Rohan Anil, Sebastian Borgeaud, Jean-Baptiste Alayrac, Jiahui Yu, Radu Soricut, Johan Schalkwyk, Andrew M. Dai, Anja Hauth, Katie Millican, David Silver, Melvin Johnson, Ioannis Antonoglou, Julian Schrittwieser, Amelia Glaese, Jilin Chen, Emily Pitler, Timothy Lillicrap, Angeliki Lazaridou, Orhan Firat, James Molloy, Michael Isard, Paul R. Barham, Tom Hennigan, Benjamin Lee , et al. (1325 additional authors not shown)

Abstract: This report introduces a new family of multimodal models, Gemini, that exhibit remarkable capabilities across image, audio, video, and text understanding. The Gemini family consists of Ultra, Pro, and Nano sizes, suitable for applications ranging from complex reasoning tasks to on-device memory-constrained use-cases. Evaluation on a broad range of benchmarks shows that our most-capable Gemini Ultr… ▽ More This report introduces a new family of multimodal models, Gemini, that exhibit remarkable capabilities across image, audio, video, and text understanding. The Gemini family consists of Ultra, Pro, and Nano sizes, suitable for applications ranging from complex reasoning tasks to on-device memory-constrained use-cases. Evaluation on a broad range of benchmarks shows that our most-capable Gemini Ultra model advances the state of the art in 30 of 32 of these benchmarks - notably being the first model to achieve human-expert performance on the well-studied exam benchmark MMLU, and improving the state of the art in every one of the 20 multimodal benchmarks we examined. We believe that the new capabilities of the Gemini family in cross-modal reasoning and language understanding will enable a wide variety of use cases. We discuss our approach toward post-training and deploying Gemini models responsibly to users through services including Gemini, Gemini Advanced, Google AI Studio, and Cloud Vertex AI. △ Less

Submitted 17 June, 2024; v1 submitted 18 December, 2023; originally announced December 2023.

Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolution

Authors: Chrisantha Fernando, Dylan Banarse, Henryk Michalewski, Simon Osindero, Tim Rocktäschel

Abstract: Popular prompt strategies like Chain-of-Thought Prompting can dramatically improve the reasoning abilities of Large Language Models (LLMs) in various domains. However, such hand-crafted prompt-strategies are often sub-optimal. In this paper, we present Promptbreeder, a general-purpose self-referential self-improvement mechanism that evolves and adapts prompts for a given domain. Driven by an LLM,… ▽ More Popular prompt strategies like Chain-of-Thought Prompting can dramatically improve the reasoning abilities of Large Language Models (LLMs) in various domains. However, such hand-crafted prompt-strategies are often sub-optimal. In this paper, we present Promptbreeder, a general-purpose self-referential self-improvement mechanism that evolves and adapts prompts for a given domain. Driven by an LLM, Promptbreeder mutates a population of task-prompts, and subsequently evaluates them for fitness on a training set. Crucially, the mutation of these task-prompts is governed by mutation-prompts that the LLM generates and improves throughout evolution in a self-referential way. That is, Promptbreeder is not just improving task-prompts, but it is also improving the mutationprompts that improve these task-prompts. Promptbreeder outperforms state-of-the-art prompt strategies such as Chain-of-Thought and Plan-and-Solve Prompting on commonly used arithmetic and commonsense reasoning benchmarks. Furthermore, Promptbreeder is able to evolve intricate task-prompts for the challenging problem of hate speech classification. △ Less

Submitted 28 September, 2023; originally announced September 2023.

Emulating Expert Insight: A Robust Strategy for Optimal Experimental Design

Authors: Matthew R. Carbone, Hyeong Jin Kim, Chandima Fernando, Shinjae Yoo, Daniel Olds, Howie Joress, Brian DeCost, Bruce Ravel, Yugang Zhang, Phillip M. Maffettone

Abstract: The challenge of optimal design of experiments (DOE) pervades materials science, physics, chemistry, and biology. Bayesian optimization has been used to address this challenge in vast sample spaces, although it requires framing experimental campaigns through the lens of maximizing some observable. This framing is insufficient for epistemic research goals that seek to comprehensively analyze a samp… ▽ More The challenge of optimal design of experiments (DOE) pervades materials science, physics, chemistry, and biology. Bayesian optimization has been used to address this challenge in vast sample spaces, although it requires framing experimental campaigns through the lens of maximizing some observable. This framing is insufficient for epistemic research goals that seek to comprehensively analyze a sample space, without an explicit scalar objective (e.g., the characterization of a wafer or sample library). In this work, we propose a flexible formulation of scientific value that recasts a dataset of input conditions and higher-dimensional observable data into a continuous, scalar metric. Intuitively, the scientific value function measures where observables change significantly, emulating the perspective of experts driving an experiment, and can be used in collaborative analysis tools or as an objective for optimization techniques. We demonstrate this technique by exploring simulated phase boundaries from different observables, autonomously driving a variable temperature measurement of a ferroelectric material, and providing feedback from a nanoparticle synthesis campaign. The method is seamlessly compatible with existing optimization tools, can be extended to multi-modal and multi-fidelity experiments, and can integrate existing models of an experimental system. Because of its flexibility, it can be deployed in a range of experimental settings for autonomous or accelerated experiments. △ Less

Submitted 25 July, 2023; originally announced July 2023.

End-to-end Manipulator Calligraphy Planning via Variational Imitation Learning

Authors: Fangping Xie, Pierre Le Meur, Charith Fernando

Abstract: Planning from demonstrations has shown promising results with the advances of deep neural networks. One of the most popular real-world applications is automated handwriting using a robotic manipulator. Classically it is simplified as a two-dimension problem. This representation is suitable for elementary drawings, but it is not sufficient for Japanese calligraphy or complex work of art where the o… ▽ More Planning from demonstrations has shown promising results with the advances of deep neural networks. One of the most popular real-world applications is automated handwriting using a robotic manipulator. Classically it is simplified as a two-dimension problem. This representation is suitable for elementary drawings, but it is not sufficient for Japanese calligraphy or complex work of art where the orientation of a pen is part of the user expression. In this study, we focus on automated planning of Japanese calligraphy using a three-dimension representation of the trajectory as well as the rotation of the pen tip, and propose a novel deep imitation learning neural network that learns from expert demonstrations through a combination of images and pose data. The network consists of a combination of variational auto-encoder, bi-directional LSTM, and Multi-Layer Perceptron (MLP). Experiments are conducted in a progressive way, and results demonstrate that the proposed approach is successful in completion of tasks for real-world robots, overcoming the distribution shift problem in imitation learning. The source code and dataset will be public. △ Less

Submitted 5 April, 2023; originally announced April 2023.

Comments: 5 pages, 4 figures

CLIP-CLOP: CLIP-Guided Collage and Photomontage

Authors: Piotr Mirowski, Dylan Banarse, Mateusz Malinowski, Simon Osindero, Chrisantha Fernando

Abstract: The unabated mystique of large-scale neural networks, such as the CLIP dual image-and-text encoder, popularized automatically generated art. Increasingly more sophisticated generators enhanced the artworks' realism and visual appearance, and creative prompt engineering enabled stylistic expression. Guided by an artist-in-the-loop ideal, we design a gradient-based generator to produce collages. It… ▽ More The unabated mystique of large-scale neural networks, such as the CLIP dual image-and-text encoder, popularized automatically generated art. Increasingly more sophisticated generators enhanced the artworks' realism and visual appearance, and creative prompt engineering enabled stylistic expression. Guided by an artist-in-the-loop ideal, we design a gradient-based generator to produce collages. It requires the human artist to curate libraries of image patches and to describe (with prompts) the whole image composition, with the option to manually adjust the patches' positions during generation, thereby allowing humans to reclaim some control of the process and achieve greater creative freedom. We explore the aesthetic potentials of high-resolution collages, and provide an open-source Google Colab as an artistic tool. △ Less

Submitted 24 July, 2022; v1 submitted 6 May, 2022; originally announced May 2022.

Comments: 5 pages, 7 figures, published at the International Conference on Computational Creativity (ICCC) 2022 as Short Paper: Demo

Intrinsic quantum correlations for Gaussian localized Dirac cat states in phase space

Authors: Caio Fernando e Silva, Alex E. Bernardini

Abstract: Following the information-based approach to Dirac spinors under a constant magnetic field, the phase-space representation of symmetric and anti-symmetric localized Dirac cat states is obtained. The intrinsic entanglement profile implied by the Dirac Hamiltonian is then investigated so as to shed a light on quantum states as carriers of qubits correlated by phase-space variables. Corresponding to t… ▽ More Following the information-based approach to Dirac spinors under a constant magnetic field, the phase-space representation of symmetric and anti-symmetric localized Dirac cat states is obtained. The intrinsic entanglement profile implied by the Dirac Hamiltonian is then investigated so as to shed a light on quantum states as carriers of qubits correlated by phase-space variables. Corresponding to the superposition of Gaussian states, cat states exhibit non-trivial elementary information dynamics which include the interplay between intrinsic entanglement and quantum superposition as reported by the corresponding Dirac archetypes. Despite the involved time-evolution as non-stationary states, the Wigner function constrains the elementary information quantifiers according to a robust framework which can be consistently used for quantifying the time-dependent $SU(2) \otimes SU(2)$ (spin projection and intrinsic parity) correlation profile of phase-space localized Dirac spinor states. Our results show that the Dirac Wigner functions for cat states -- described in terms of generalized Laguerre polynomials -- exhibit an almost maximized timely persistent mutual information profile which is engendered by either classical- or quantum-like spin-parity correlations, depending on the magnetic field intensity. △ Less

Submitted 3 November, 2021; originally announced November 2021.

Comments: 36 pages, 8 figures

Generative Art Using Neural Visual Grammars and Dual Encoders

Authors: Chrisantha Fernando, S. M. Ali Eslami, Jean-Baptiste Alayrac, Piotr Mirowski, Dylan Banarse, Simon Osindero

Abstract: Whilst there are perhaps only a few scientific methods, there seem to be almost as many artistic methods as there are artists. Artistic processes appear to inhabit the highest order of open-endedness. To begin to understand some of the processes of art making it is helpful to try to automate them even partially. In this paper, a novel algorithm for producing generative art is described which allow… ▽ More Whilst there are perhaps only a few scientific methods, there seem to be almost as many artistic methods as there are artists. Artistic processes appear to inhabit the highest order of open-endedness. To begin to understand some of the processes of art making it is helpful to try to automate them even partially. In this paper, a novel algorithm for producing generative art is described which allows a user to input a text string, and which in a creative response to this string, outputs an image which interprets that string. It does so by evolving images using a hierarchical neural Lindenmeyer system, and evaluating these images along the way using an image text dual encoder trained on billions of images and their associated text from the internet. In doing so we have access to and control over an instance of an artistic process, allowing analysis of which aspects of the artistic process become the task of the algorithm, and which elements remain the responsibility of the artist. △ Less

Submitted 3 May, 2021; v1 submitted 1 May, 2021; originally announced May 2021.

From Language Games to Drawing Games

Authors: Chrisantha Fernando, Daria Zenkova, Stanislav Nikolov, Simon Osindero

Abstract: We attempt to automate various artistic processes by inventing a set of drawing games, analogous to the approach taken by emergent language research in inventing communication games. A critical difference is that drawing games demand much less effort from the receiver than do language games. Artists must work with pre-trained viewers who spend little time learning artist specific representational… ▽ More We attempt to automate various artistic processes by inventing a set of drawing games, analogous to the approach taken by emergent language research in inventing communication games. A critical difference is that drawing games demand much less effort from the receiver than do language games. Artists must work with pre-trained viewers who spend little time learning artist specific representational conventions, but who instead have a pre-trained visual system optimized for behaviour in the world by understanding to varying extents the environment's visual affordances. After considering various kinds of drawing game we present some preliminary experiments which have generated images by closing the generative-critical loop. △ Less

Submitted 10 December, 2020; v1 submitted 6 October, 2020; originally announced October 2020.

Classical and statistical limits of the quantum singular oscillator

Authors: Caio Fernando e Silva, Alex E. Bernardini

Abstract: The classical boundaries of the quantum singular oscillator (SO) is addressed under Weyl-Wigner phase-space and Bohmian mechanics frameworks as to comparatively evaluate phase-space and configuration space quantum trajectories as well as to compute distorting quantum fluctuations. For an engendered pure state \textit{quasi}-gaussian Wigner function that recovers the classical time evolution (at ph… ▽ More The classical boundaries of the quantum singular oscillator (SO) is addressed under Weyl-Wigner phase-space and Bohmian mechanics frameworks as to comparatively evaluate phase-space and configuration space quantum trajectories as well as to compute distorting quantum fluctuations. For an engendered pure state \textit{quasi}-gaussian Wigner function that recovers the classical time evolution (at phase and configuration spaces), Bohmian trajectories are analytically obtained as to show how the SO energy and anharmonicity parameters drive the quantum regime through the so-called quantum force, which quantitatively distorts the recovered classical behavior. Extending the discussion of classical-quantum limits to a quantum statistical ensemble, the thermalized Wigner function and the corresponding Wigner currents are computed as to show how the temperature dependence affects the local quantum fluctuations. Considering that the level of quantum mixing is quantified by the quantum purity, the loss of information is quantified in terms of the temperature effects. Despite having contrasting phase-space flow profiles, two inequivalent quantum systems, namely the singular and the harmonic oscillators, besides reproducing stable classical limits, are shown to be statistically equivalent at thermal equilibrium, a fact that raises the SO non-linear system to a very particular category of quantum systems. △ Less

Submitted 10 July, 2020; originally announced July 2020.

Comments: 6 figures, 31 pages

Journal ref: Physica A: Statistical Mechanics and its Applications, 124915 (2020)

Offline handwritten mathematical symbol recognition utilising deep learning

Authors: Azadeh Nazemi, Niloofar Tavakolian, Donal Fitzpatrick, Chandrik a Fernando, Ching Y. Suen

Abstract: This paper describes an approach for offline recognition of handwritten mathematical symbols. The process of symbol recognition in this paper includes symbol segmentation and accurate classification for over 300 classes. Many multidimensional mathematical symbols need both horizontal and vertical projection to be segmented. However, some symbols do not permit to be projected and stop segmentation,… ▽ More This paper describes an approach for offline recognition of handwritten mathematical symbols. The process of symbol recognition in this paper includes symbol segmentation and accurate classification for over 300 classes. Many multidimensional mathematical symbols need both horizontal and vertical projection to be segmented. However, some symbols do not permit to be projected and stop segmentation, such as the root symbol. Besides, many mathematical symbols are structurally similar, specifically in handwritten such as 0 and null. There are more than 300 Mathematical symbols. Therefore, designing an accurate classifier for more than 300 classes is required. This paper initially addresses the issue regarding segmentation using Simple Linear Iterative Clustering (SLIC). Experimental results indicate that the accuracy of the designed kNN classifier is 84% for salient, 57% Histogram of Oriented Gradient (HOG), 53% for Linear Binary Pattern (LBP) and finally 43% for pixel intensity of raw image for 66 classes. 87 classes using modified LeNet represents 90% accuracy. Finally, for 101 classes, SqueezeNet ac △ Less

Submitted 16 October, 2019; originally announced October 2019.

ACM Class: I.4.6; I.5.4

Effect of PEG binder on gas sensitivity of ferric oxide films synthesized by spin coating and doctor blade methods

Authors: P. Samarasekara, M. S. P. K. Gunasinghe, P. G. D. C. K. Karunarathna, H. T. D. S. Madusanka, C. A. N. Fernando

Abstract: Ferric oxide (Fe2O3) thin films were fabricated on amorphous nonconductive and FTO conductive glass substrates starting from iron acetate nanoparticles by the doctor blade and the spin coating techniques. Thin films of Fe2O3 with and without the PEG binder were investigated. Films were subsequently annealed at 500 0C in air for 1 hour to crystallize the phase Fe2O3. The structural and chemical pro… ▽ More Ferric oxide (Fe2O3) thin films were fabricated on amorphous nonconductive and FTO conductive glass substrates starting from iron acetate nanoparticles by the doctor blade and the spin coating techniques. Thin films of Fe2O3 with and without the PEG binder were investigated. Films were subsequently annealed at 500 0C in air for 1 hour to crystallize the phase Fe2O3. The structural and chemical properties of Fe2O3 thin films were determined using XRD and FTIR. According to XRD, the single phase of Fe2O3 crystallized in the thin film after annealing. The optical band gap of synthesized Fe2O3 thin films were determined by UV-Visible spectrums. Gas sensitivity, respond time and recovery time of Fe2O3 thin films were measured in 1000ppm of CO2 gas using AUTO LAB. Thin films synthesized by the doctor blade method were thicker and more uniform than the thin films prepared by the spin coating technique. Gas sensitivity of Fe2O3 films synthesized by the doctor blade method is slightly higher than that of the films fabricated by the spin coating technique. Fe2O3 films with the PEG binder posses a higher gas sensitivity, lower respond time and lower recovery time compared to films without PEG binder. After adding the PEG binder, the optical band gap of Fe2O3 thin films reduces. The reduction of the activation energy is the reason for the improvement of the gas sensitivity after adding the PEG. However, the peak positions of FTIR do not indicate any significant change due to the adding of the PEG. Adding the binder increased the gas sensitivity of iron oxide by 15.44%. Both FTIR and UV-Visible data confirm the formation of Fe2O3 in the thin film. △ Less

Submitted 22 November, 2018; originally announced November 2018.

Comments: 17 pages, 5 figures, 2 tables

Evolving intrinsic motivations for altruistic behavior

Authors: Jane X. Wang, Edward Hughes, Chrisantha Fernando, Wojciech M. Czarnecki, Edgar A. Duenez-Guzman, Joel Z. Leibo

Abstract: Multi-agent cooperation is an important feature of the natural world. Many tasks involve individual incentives that are misaligned with the common good, yet a wide range of organisms from bacteria to insects and humans are able to overcome their differences and collaborate. Therefore, the emergence of cooperative behavior amongst self-interested individuals is an important question for the fields… ▽ More Multi-agent cooperation is an important feature of the natural world. Many tasks involve individual incentives that are misaligned with the common good, yet a wide range of organisms from bacteria to insects and humans are able to overcome their differences and collaborate. Therefore, the emergence of cooperative behavior amongst self-interested individuals is an important question for the fields of multi-agent reinforcement learning (MARL) and evolutionary theory. Here, we study a particular class of multi-agent problems called intertemporal social dilemmas (ISDs), where the conflict between the individual and the group is particularly sharp. By combining MARL with appropriately structured natural selection, we demonstrate that individual inductive biases for cooperation can be learned in a model-free way. To achieve this, we introduce an innovative modular architecture for deep reinforcement learning agents which supports multi-level selection. We present results in two challenging environments, and interpret these in the context of cultural and ecological evolution. △ Less

Submitted 11 March, 2019; v1 submitted 14 November, 2018; originally announced November 2018.

Comments: 10 pages, 6 figures. In Proc. of the 18th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2019)

Meta-Learning by the Baldwin Effect

Authors: Chrisantha Thomas Fernando, Jakub Sygnowski, Simon Osindero, Jane Wang, Tom Schaul, Denis Teplyashin, Pablo Sprechmann, Alexander Pritzel, Andrei A. Rusu

Abstract: The scope of the Baldwin effect was recently called into question by two papers that closely examined the seminal work of Hinton and Nowlan. To this date there has been no demonstration of its necessity in empirically challenging tasks. Here we show that the Baldwin effect is capable of evolving few-shot supervised and reinforcement learning mechanisms, by shaping the hyperparameters and the initi… ▽ More The scope of the Baldwin effect was recently called into question by two papers that closely examined the seminal work of Hinton and Nowlan. To this date there has been no demonstration of its necessity in empirically challenging tasks. Here we show that the Baldwin effect is capable of evolving few-shot supervised and reinforcement learning mechanisms, by shaping the hyperparameters and the initial parameters of deep learning algorithms. Furthermore it can genetically accommodate strong learning biases on the same set of problems as a recent machine learning algorithm called MAML "Model Agnostic Meta-Learning" which uses second-order gradients instead of evolution to learn a set of reference parameters (initial weights) that can allow rapid adaptation to tasks sampled from a distribution. Whilst in simple cases MAML is more data efficient than the Baldwin effect, the Baldwin effect is more general in that it does not require gradients to be backpropagated to the reference parameters or hyperparameters, and permits effectively any number of gradient updates in the inner loop. The Baldwin effect learns strong learning dependent biases, rather than purely genetically accommodating fixed behaviours in a learning independent manner. △ Less

Submitted 22 June, 2018; v1 submitted 6 June, 2018; originally announced June 2018.

Characterization of spin coated Zn doped cupric oxide thin films

Authors: P. Samarasekara, P. G. D. C. K. Karunarathna, H. P. Weeramuni, C. A. N. Fernando

Abstract: Thin films of Zn2+ doped cupric oxide (CuO) were synthesized using spin coating technique starting from a solution with Cu and Zn. The speed of spin coating and time duration were varied to fabricate a film with required uniform thickness. Samples were subsequently annealed in air at different annealing temperatures to crystallize the phase of CuO. Doping concentration of Zn2+ was varied up to wei… ▽ More Thin films of Zn2+ doped cupric oxide (CuO) were synthesized using spin coating technique starting from a solution with Cu and Zn. The speed of spin coating and time duration were varied to fabricate a film with required uniform thickness. Samples were subsequently annealed in air at different annealing temperatures to crystallize the phase of CuO. Doping concentration of Zn2+ was varied up to weight percentage of 10%. Structural properties of samples were determined using X-ray diffraction technique. Particle size, dislocation density and strain at different doping concentrations were determined using XRD patterns. Optical properties were measured by means of UV/Vis spectrometer. Optical band gap of CuO could be tailored by doping a trace amount of Zn2+. The optical band gap decreases with increase of particle size. The particle size, dislocation density, strain and optical band gap have a turning point close to the doping concentration of 6%. △ Less

Submitted 4 February, 2018; originally announced February 2018.

Comments: 12 pages, 5 figure, 2 tables

Third order perturbed modified Heisenberg Hamiltonian of fcc structured ferromagnetic films with seventy spin layers

Authors: P. Samarasekara, N. U. S. Yapa, C. A. N. Fernando

Abstract: Magnetic properties of fcc structured ferromagnetic films with the number of spin layers up to seventy was described using third order perturbed Heisenberg Hamiltonian. The variation of magnetic easy direction, magnetic energies in easy and hard directions, magnetic anisotropy energy and the angle between easy and hard directions was investigated by varying the number of spin layers. Spin exchange… ▽ More Magnetic properties of fcc structured ferromagnetic films with the number of spin layers up to seventy was described using third order perturbed Heisenberg Hamiltonian. The variation of magnetic easy direction, magnetic energies in easy and hard directions, magnetic anisotropy energy and the angle between easy and hard directions was investigated by varying the number of spin layers. Spin exchange interaction, magnetic dipole interaction, second and fourth order magnetic anisotropies, in and out of plane applied magnetic fields, demagnetization factor and stress induced anisotropy were considered in the model. Because magnetic dipole interaction and demagnetization factor represent microscopic and macroscopic properties of the sample, respectively, both these terms were incorporated in our theoretical model. Although our model is a semi-classical model, some discrete variations of angle of easy axis were observed. Our theoretical data qualitatively agree with experimental data of Fe and Ni ferromagnetic films. △ Less

Submitted 4 December, 2017; originally announced December 2017.

Comments: 18 pages, 4 figures, 1 table. arXiv admin note: text overlap with arXiv:1708.02996

Population Based Training of Neural Networks

Authors: Max Jaderberg, Valentin Dalibard, Simon Osindero, Wojciech M. Czarnecki, Jeff Donahue, Ali Razavi, Oriol Vinyals, Tim Green, Iain Dunning, Karen Simonyan, Chrisantha Fernando, Koray Kavukcuoglu

Abstract: Neural networks dominate the modern machine learning landscape, but their training and success still suffer from sensitivity to empirical choices of hyperparameters such as model architecture, loss function, and optimisation algorithm. In this work we present \emph{Population Based Training (PBT)}, a simple asynchronous optimisation algorithm which effectively utilises a fixed computational budget… ▽ More Neural networks dominate the modern machine learning landscape, but their training and success still suffer from sensitivity to empirical choices of hyperparameters such as model architecture, loss function, and optimisation algorithm. In this work we present \emph{Population Based Training (PBT)}, a simple asynchronous optimisation algorithm which effectively utilises a fixed computational budget to jointly optimise a population of models and their hyperparameters to maximise performance. Importantly, PBT discovers a schedule of hyperparameter settings rather than following the generally sub-optimal strategy of trying to find a single fixed set to use for the whole course of training. With just a small modification to a typical distributed hyperparameter training framework, our method allows robust and reliable training of models. We demonstrate the effectiveness of PBT on deep reinforcement learning problems, showing faster wall-clock convergence and higher final performance of agents by optimising over a suite of hyperparameters. In addition, we show the same method can be applied to supervised learning for machine translation, where PBT is used to maximise the BLEU score directly, and also to training of Generative Adversarial Networks to maximise the Inception score of generated images. In all cases PBT results in the automatic discovery of hyperparameter schedules and model selection which results in stable training and better final performance. △ Less

Submitted 28 November, 2017; v1 submitted 27 November, 2017; originally announced November 2017.

Hierarchical Representations for Efficient Architecture Search

Authors: Hanxiao Liu, Karen Simonyan, Oriol Vinyals, Chrisantha Fernando, Koray Kavukcuoglu

Abstract: We explore efficient neural architecture search methods and show that a simple yet powerful evolutionary algorithm can discover new architectures with excellent performance. Our approach combines a novel hierarchical genetic representation scheme that imitates the modularized design pattern commonly adopted by human experts, and an expressive search space that supports complex topologies. Our algo… ▽ More We explore efficient neural architecture search methods and show that a simple yet powerful evolutionary algorithm can discover new architectures with excellent performance. Our approach combines a novel hierarchical genetic representation scheme that imitates the modularized design pattern commonly adopted by human experts, and an expressive search space that supports complex topologies. Our algorithm efficiently discovers architectures that outperform a large number of manually designed models for image classification, obtaining top-1 error of 3.6% on CIFAR-10 and 20.3% when transferred to ImageNet, which is competitive with the best existing neural architecture search approaches. We also present results using random search, achieving 0.3% less top-1 accuracy on CIFAR-10 and 0.1% less on ImageNet whilst reducing the search time from 36 hours down to 1 hour. △ Less

Submitted 22 February, 2018; v1 submitted 1 November, 2017; originally announced November 2017.

Comments: Accepted as a conference paper at ICLR 2018

PathNet: Evolution Channels Gradient Descent in Super Neural Networks

Authors: Chrisantha Fernando, Dylan Banarse, Charles Blundell, Yori Zwols, David Ha, Andrei A. Rusu, Alexander Pritzel, Daan Wierstra

Abstract: For artificial general intelligence (AGI) it would be efficient if multiple users trained the same giant neural network, permitting parameter reuse, without catastrophic forgetting. PathNet is a first step in this direction. It is a neural network algorithm that uses agents embedded in the neural network whose task is to discover which parts of the network to re-use for new tasks. Agents are pathw… ▽ More For artificial general intelligence (AGI) it would be efficient if multiple users trained the same giant neural network, permitting parameter reuse, without catastrophic forgetting. PathNet is a first step in this direction. It is a neural network algorithm that uses agents embedded in the neural network whose task is to discover which parts of the network to re-use for new tasks. Agents are pathways (views) through the network which determine the subset of parameters that are used and updated by the forwards and backwards passes of the backpropogation algorithm. During learning, a tournament selection genetic algorithm is used to select pathways through the neural network for replication and mutation. Pathway fitness is the performance of that pathway measured according to a cost function. We demonstrate successful transfer learning; fixing the parameters along a path learned on task A and re-evolving a new population of paths for task B, allows task B to be learned faster than it could be learned from scratch or after fine-tuning. Paths evolved on task B re-use parts of the optimal path evolved on task A. Positive transfer was demonstrated for binary MNIST, CIFAR, and SVHN supervised learning classification tasks, and a set of Atari and Labyrinth reinforcement learning tasks, suggesting PathNets have general applicability for neural network training. Finally, PathNet also significantly improves the robustness to hyperparameter choices of a parallel asynchronous reinforcement learning algorithm (A3C). △ Less

Submitted 30 January, 2017; originally announced January 2017.

Convolution by Evolution: Differentiable Pattern Producing Networks

Authors: Chrisantha Fernando, Dylan Banarse, Malcolm Reynolds, Frederic Besse, David Pfau, Max Jaderberg, Marc Lanctot, Daan Wierstra

Abstract: In this work we introduce a differentiable version of the Compositional Pattern Producing Network, called the DPPN. Unlike a standard CPPN, the topology of a DPPN is evolved but the weights are learned. A Lamarckian algorithm, that combines evolution and learning, produces DPPNs to reconstruct an image. Our main result is that DPPNs can be evolved/trained to compress the weights of a denoising aut… ▽ More In this work we introduce a differentiable version of the Compositional Pattern Producing Network, called the DPPN. Unlike a standard CPPN, the topology of a DPPN is evolved but the weights are learned. A Lamarckian algorithm, that combines evolution and learning, produces DPPNs to reconstruct an image. Our main result is that DPPNs can be evolved/trained to compress the weights of a denoising autoencoder from 157684 to roughly 200 parameters, while achieving a reconstruction accuracy comparable to a fully connected network with more than two orders of magnitude more parameters. The regularization ability of the DPPN allows it to rediscover (approximate) convolutional network architectures embedded within a fully connected architecture. Such convolutional architectures are the current state of the art for many computer vision applications, so it is satisfying that DPPNs are capable of discovering this structure rather than having to build it in by design. DPPNs exhibit better generalization when tested on the Omniglot dataset after being trained on MNIST, than directly encoded fully connected autoencoders. DPPNs are therefore a new framework for integrating learning and evolution. △ Less

Submitted 8 June, 2016; originally announced June 2016.

Learning to Generate Genotypes with Neural Networks

Authors: Alexander W. Churchill, Siddharth Sigtia, Chrisantha Fernando

Abstract: Neural networks and evolutionary computation have a rich intertwined history. They most commonly appear together when an evolutionary algorithm optimises the parameters and topology of a neural network for reinforcement learning problems, or when a neural network is applied as a surrogate fitness function to aid the evolutionary optimisation of expensive fitness functions. In this paper we take a… ▽ More Neural networks and evolutionary computation have a rich intertwined history. They most commonly appear together when an evolutionary algorithm optimises the parameters and topology of a neural network for reinforcement learning problems, or when a neural network is applied as a surrogate fitness function to aid the evolutionary optimisation of expensive fitness functions. In this paper we take a different approach, asking the question of whether a neural network can be used to provide a mutation distribution for an evolutionary algorithm, and what advantages this approach may offer? Two modern neural network models are investigated, a Denoising Autoencoder modified to produce stochastic outputs and the Neural Autoregressive Distribution Estimator. Results show that the neural network approach to learning genotypes is able to solve many difficult discrete problems, such as MaxSat and HIFF, and regularly outperforms other evolutionary techniques. △ Less

Submitted 14 April, 2016; originally announced April 2016.

A Denoising Autoencoder that Guides Stochastic Search

Authors: Alexander W. Churchill, Siddharth Sigtia, Chrisantha Fernando

Abstract: An algorithm is described that adaptively learns a non-linear mutation distribution. It works by training a denoising autoencoder (DA) online at each generation of a genetic algorithm to reconstruct a slowly decaying memory of the best genotypes so far. A compressed hidden layer forces the autoencoder to learn hidden features in the training set that can be used to accelerate search on novel probl… ▽ More An algorithm is described that adaptively learns a non-linear mutation distribution. It works by training a denoising autoencoder (DA) online at each generation of a genetic algorithm to reconstruct a slowly decaying memory of the best genotypes so far. A compressed hidden layer forces the autoencoder to learn hidden features in the training set that can be used to accelerate search on novel problems with similar structure. Its output neurons define a probability distribution that we sample from to produce offspring solutions. The algorithm outperforms a canonical genetic algorithm on several combinatorial optimisation problems, e.g. multidimensional 0/1 knapsack problem, MAXSAT, HIFF, and on parameter optimisation problems, e.g. Rastrigin and Rosenbrock functions. △ Less

Submitted 6 April, 2014; originally announced April 2014.

Comments: Submitted to Parallel Problem Solving from Nature 2014

Design for a Darwinian Brain: Part 2. Cognitive Architecture

Authors: Chrisantha Fernando, Vera Vasas

Abstract: The accumulation of adaptations in an open-ended manner during lifetime learning is a holy grail in reinforcement learning, intrinsic motivation, artificial curiosity, and developmental robotics. We present a specification for a cognitive architecture that is capable of specifying an unlimited range of behaviors. We then give examples of how it can stochastically explore an interesting space of ad… ▽ More The accumulation of adaptations in an open-ended manner during lifetime learning is a holy grail in reinforcement learning, intrinsic motivation, artificial curiosity, and developmental robotics. We present a specification for a cognitive architecture that is capable of specifying an unlimited range of behaviors. We then give examples of how it can stochastically explore an interesting space of adjacent possible behaviors. There are two main novelties; the first is a proper definition of the fitness of self-generated games such that interesting games are expected to evolve. The second is a modular and evolvable behavior language that has systematicity, productivity, and compositionality, i.e. it is a physical symbol system. A part of the architecture has already been implemented on a humanoid robot. △ Less

Submitted 28 March, 2013; originally announced March 2013.

Comments: Submitted as Part 2 to Living Machines 2013, Natural History Museum, London. Code available on github as it is being developed to implement the cognitive architecture above, here... https://github.com/ctf20/DarwinianNeurodynamics

Design for a Darwinian Brain: Part 1. Philosophy and Neuroscience

Authors: Chrisantha Fernando

Abstract: Physical symbol systems are needed for open-ended cognition. A good way to understand physical symbol systems is by comparison of thought to chemistry. Both have systematicity, productivity and compositionality. The state of the art in cognitive architectures for open-ended cognition is critically assessed. I conclude that a cognitive architecture that evolves symbol structures in the brain is a p… ▽ More Physical symbol systems are needed for open-ended cognition. A good way to understand physical symbol systems is by comparison of thought to chemistry. Both have systematicity, productivity and compositionality. The state of the art in cognitive architectures for open-ended cognition is critically assessed. I conclude that a cognitive architecture that evolves symbol structures in the brain is a promising candidate to explain open-ended cognition. Part 2 of the paper presents such a cognitive architecture. △ Less

Submitted 28 March, 2013; originally announced March 2013.

Comments: Darwinian Neurodynamics. Submitted as a two part paper to Living Machines 2013 Natural History Museum, London