Showing 1–3 of 3 results for author: Beckmann, K

Measurement of the Crystallization and Phase Transition of Niobium Dioxide Thin-Films for Neuromorphic Computing Applications Using a Tube Furnace Optical Transmission System

Authors: Zachary R. Robinson, Karsten Beckmann, James Michels, Vincent Daviero, Elizabeth A. Street, Fiona Lorenzen, Matthew C. Sullivan, Nathaniel Cady, Alexander Kozen, Marc Currie

Abstract: Significant research has focused on low-power stochastic devices built from memristive materials. These devices foster neuromorphic approaches to computational efficiency enhancement in merged biomimetic and CMOS architectures due to their ability to phase transition from a dielectric to a metal at an increased temperature. Niobium dioxide has a volatile memristive phase change that occurs $\sim$8… ▽ More Significant research has focused on low-power stochastic devices built from memristive materials. These devices foster neuromorphic approaches to computational efficiency enhancement in merged biomimetic and CMOS architectures due to their ability to phase transition from a dielectric to a metal at an increased temperature. Niobium dioxide has a volatile memristive phase change that occurs $\sim$800$^\circ$C~that makes it an ideal candidate for future neuromorphic electronics. A straightforward optical system has been developed on a horizontal tube furnace for \emph{in situ} spectral measurements as an as-grown \NbtOf\ film is annealed and ultimately crystallizes as \NbOt. The system measures the changing spectral transmissivity of \NbtOf\ as it undergoes both reduction and crystallization processes. We were also able to measure the transition from metallic-to-non-metallic \NbOt\ during the cooldown phase, which is shown to occur about 100$^\circ$C~ lower on a sapphire substrate than fused silica. After annealing, the material properties of the \NbtOf\ and \NbOt\ were assessed via X-ray photoelectron spectroscopy, X-ray diffraction, and 4-point resistivity, confirming that we have made crystalline \NbOt. △ Less

Submitted 11 July, 2024; v1 submitted 19 June, 2024; originally announced June 2024.

Cellular Memristive-Output Reservoir (CMOR)

Authors: Wilkie Olin-Ammentorp, Karsten Beckmann, Nathaniel C. Cady

Abstract: Reservoir computing is a subfield of machine learning in which a complex system, or 'reservoir,' uses complex internal dynamics to non-linearly project an input into a higher-dimensional space. A single trainable output layer then inspects this high-dimensional space for features relevant to perform the given task, such as a classification. Initially, reservoirs were often constructed from recurre… ▽ More Reservoir computing is a subfield of machine learning in which a complex system, or 'reservoir,' uses complex internal dynamics to non-linearly project an input into a higher-dimensional space. A single trainable output layer then inspects this high-dimensional space for features relevant to perform the given task, such as a classification. Initially, reservoirs were often constructed from recurrent neural networks, but reservoirs constructed from many different elements have been demonstrated. Elementary cellular automata (CA) are one such system which have recently been demonstrated as a powerful and efficient basis which can be used to construct a reservoir. To investigate the feasibility and performance of a monolithic reservoir computing circuit with a fully integrated, programmable read-out layer, we designed, fabricated, and tested a full-custom reservoir computing circuit. This design, the cellular memristive-output reservoir (CMOR), is implemented in 65-nm CMOS technology with integrated front-end-of-the-line (FEOL) resistive random-access memory (ReRAM) used to construct a trainable output layer. We detail the design of this system and present electrical test results verifying its operation and capability to carry out non-linear classifications. △ Less

Submitted 14 June, 2019; originally announced June 2019.

Stochasticity and Robustness in Spiking Neural Networks

Authors: Wilkie Olin-Ammentorp, Karsten Beckmann, Catherine D. Schuman, James S. Plank, Nathaniel C. Cady

Abstract: Artificial neural networks normally require precise weights to operate, despite their origins in biological systems, which can be highly variable and noisy. When implementing artificial networks which utilize analog 'synaptic' devices to encode weights, however, inherent limits are placed on the accuracy and precision with which these values can be encoded. In this work, we investigate the effects… ▽ More Artificial neural networks normally require precise weights to operate, despite their origins in biological systems, which can be highly variable and noisy. When implementing artificial networks which utilize analog 'synaptic' devices to encode weights, however, inherent limits are placed on the accuracy and precision with which these values can be encoded. In this work, we investigate the effects that inaccurate synapses have on spiking neurons and spiking neural networks. Starting with a mathematical analysis of integrate-and-fire (IF) neurons, including different non-idealities (such as leakage and channel noise), we demonstrate that noise can be used to make the behavior of IF neurons more robust to synaptic inaccuracy. We then train spiking networks which utilize IF neurons with and without noise and leakage, and experimentally confirm that the noisy networks are more robust. Lastly, we show that a noisy network can tolerate the inaccuracy expected when hafnium-oxide based resistive random-access memory is used to encode synaptic weights. △ Less

Submitted 6 June, 2019; originally announced June 2019.