Zum Hauptinhalt springen

Showing 1–13 of 13 results for author: McMahon, P L

Searching in archive cs. Search in all archives.
.
  1. arXiv:2406.03372  [pdf, other

    physics.app-ph cs.LG

    Training of Physical Neural Networks

    Authors: Ali Momeni, Babak Rahmani, Benjamin Scellier, Logan G. Wright, Peter L. McMahon, Clara C. Wanjura, Yuhang Li, Anas Skalli, Natalia G. Berloff, Tatsuhiro Onodera, Ilker Oguz, Francesco Morichetti, Philipp del Hougne, Manuel Le Gallo, Abu Sebastian, Azalia Mirhoseini, Cheng Zhang, Danijela Marković, Daniel Brunner, Christophe Moser, Sylvain Gigan, Florian Marquardt, Aydogan Ozcan, Julie Grollier, Andrea J. Liu , et al. (3 additional authors not shown)

    Abstract: Physical neural networks (PNNs) are a class of neural-like networks that leverage the properties of physical systems to perform computation. While PNNs are so far a niche research area with small-scale laboratory demonstrations, they are arguably one of the most underappreciated important opportunities in modern AI. Could we train AI models 1000x larger than current ones? Could we do this and also… ▽ More

    Submitted 5 June, 2024; originally announced June 2024.

    Comments: 29 pages, 4 figures

  2. arXiv:2402.17750  [pdf, other

    physics.optics cs.ET cs.LG

    Scaling on-chip photonic neural processors using arbitrarily programmable wave propagation

    Authors: Tatsuhiro Onodera, Martin M. Stein, Benjamin A. Ash, Mandar M. Sohoni, Melissa Bosch, Ryotatsu Yanagimoto, Marc Jankowski, Timothy P. McKenna, Tianyu Wang, Gennady Shvets, Maxim R. Shcherbakov, Logan G. Wright, Peter L. McMahon

    Abstract: On-chip photonic processors for neural networks have potential benefits in both speed and energy efficiency but have not yet reached the scale at which they can outperform electronic processors. The dominant paradigm for designing on-chip photonics is to make networks of relatively bulky discrete components connected by one-dimensional waveguides. A far more compact alternative is to avoid explici… ▽ More

    Submitted 27 February, 2024; originally announced February 2024.

  3. arXiv:2310.18335  [pdf, other

    cs.ET cs.NE q-bio.NC

    The hardware is the software

    Authors: Jeremie Laydevant, Logan G. Wright, Tianyu Wang, Peter L. McMahon

    Abstract: Human brains and bodies are not hardware running software: the hardware is the software. We reason that because the microscopic physics of artificial-intelligence hardware and of human biological "hardware" is distinct, neuromorphic engineers need to be cautious (and yet also creative) in how we take inspiration from biological intelligence. We should focus primarily on principles and design ideas… ▽ More

    Submitted 20 October, 2023; originally announced October 2023.

  4. arXiv:2308.00088  [pdf, other

    physics.optics cs.ET cs.NE physics.app-ph quant-ph

    The physics of optical computing

    Authors: Peter L. McMahon

    Abstract: There has been a resurgence of interest in optical computing over the past decade, both in academia and in industry, with much of the excitement centered around special-purpose optical computers for neural-network processing. Optical computing has been a topic of periodic study for over 50 years, including for neural networks three decades ago, and a wide variety of optical-computing schemes and a… ▽ More

    Submitted 31 July, 2023; originally announced August 2023.

    Comments: 31 pages; 11 figures

    Journal ref: Nature Reviews Physics (2023)

  5. arXiv:2307.15712  [pdf, other

    physics.optics cs.ET cs.LG cs.NE quant-ph

    Quantum-noise-limited optical neural networks operating at a few quanta per activation

    Authors: Shi-Yuan Ma, Tianyu Wang, Jérémie Laydevant, Logan G. Wright, Peter L. McMahon

    Abstract: Analog physical neural networks, which hold promise for improved energy efficiency and speed compared to digital electronic neural networks, are nevertheless typically operated in a relatively high-power regime so that the signal-to-noise ratio (SNR) is large (>10). What happens if an analog system is instead operated in an ultra-low-power regime, in which the behavior of the system becomes highly… ▽ More

    Submitted 28 July, 2023; originally announced July 2023.

    Comments: 55 pages, 27 figures

  6. arXiv:2302.10360  [pdf, other

    cs.ET cs.LG cs.NE physics.app-ph physics.optics

    Optical Transformers

    Authors: Maxwell G. Anderson, Shi-Yuan Ma, Tianyu Wang, Logan G. Wright, Peter L. McMahon

    Abstract: The rapidly increasing size of deep-learning models has caused renewed and growing interest in alternatives to digital computers to dramatically reduce the energy cost of running state-of-the-art neural networks. Optical matrix-vector multipliers are best suited to performing computations with very large operands, which suggests that large Transformer models could be a good target for optical comp… ▽ More

    Submitted 20 February, 2023; originally announced February 2023.

    Comments: 27 pages, 13 figures

    Journal ref: Transactions on Machine Learning Research, 03/2024, https://openreview.net/forum?id=Xxw0edFFQC

  7. arXiv:2301.06727  [pdf

    cs.ET physics.app-ph

    Roadmap for Unconventional Computing with Nanotechnology

    Authors: Giovanni Finocchio, Jean Anne C. Incorvia, Joseph S. Friedman, Qu Yang, Anna Giordano, Julie Grollier, Hyunsoo Yang, Florin Ciubotaru, Andrii Chumak, Azad J. Naeemi, Sorin D. Cotofana, Riccardo Tomasello, Christos Panagopoulos, Mario Carpentieri, Peng Lin, Gang Pan, J. Joshua Yang, Aida Todri-Sanial, Gabriele Boschetto, Kremena Makasheva, Vinod K. Sangwan, Amit Ranjan Trivedi, Mark C. Hersam, Kerem Y. Camsari, Peter L. McMahon , et al. (26 additional authors not shown)

    Abstract: In the "Beyond Moore's Law" era, with increasing edge intelligence, domain-specific computing embracing unconventional approaches will become increasingly prevalent. At the same time, adopting a variety of nanotechnologies will offer benefits in energy cost, computational speed, reduced footprint, cyber resilience, and processing power. The time is ripe for a roadmap for unconventional computing w… ▽ More

    Submitted 27 February, 2024; v1 submitted 17 January, 2023; originally announced January 2023.

    Comments: 80 pages accepted in Nano Futures

    Journal ref: Nano Futures (2024)

  8. arXiv:2207.14293  [pdf, other

    physics.optics cs.ET cs.LG

    Image sensing with multilayer, nonlinear optical neural networks

    Authors: Tianyu Wang, Mandar M. Sohoni, Logan G. Wright, Martin M. Stein, Shi-Yuan Ma, Tatsuhiro Onodera, Maxwell G. Anderson, Peter L. McMahon

    Abstract: Optical imaging is commonly used for both scientific and technological applications across industry and academia. In image sensing, a measurement, such as of an object's position, is performed by computational analysis of a digitized image. An emerging image-sensing paradigm breaks this delineation between data collection and analysis by designing optical components to perform not imaging, but enc… ▽ More

    Submitted 27 July, 2022; originally announced July 2022.

    Journal ref: Nat. Photon. 18, 1-8 (2023)

  9. arXiv:2112.03235  [pdf, other

    cs.AI cs.CE cs.LG cs.MS

    Simulation Intelligence: Towards a New Generation of Scientific Methods

    Authors: Alexander Lavin, David Krakauer, Hector Zenil, Justin Gottschlich, Tim Mattson, Johann Brehmer, Anima Anandkumar, Sanjay Choudry, Kamil Rocki, Atılım Güneş Baydin, Carina Prunkl, Brooks Paige, Olexandr Isayev, Erik Peterson, Peter L. McMahon, Jakob Macke, Kyle Cranmer, Jiaxin Zhang, Haruko Wainwright, Adi Hanuka, Manuela Veloso, Samuel Assefa, Stephan Zheng, Avi Pfeffer

    Abstract: The original "Seven Motifs" set forth a roadmap of essential methods for the field of scientific computing, where a motif is an algorithmic method that captures a pattern of computation and data movement. We present the "Nine Motifs of Simulation Intelligence", a roadmap for the development and integration of the essential algorithms necessary for a merger of scientific computing, scientific simul… ▽ More

    Submitted 27 November, 2022; v1 submitted 6 December, 2021; originally announced December 2021.

  10. arXiv:2104.13467  [pdf, other

    physics.optics cs.ET cs.LG cs.NE

    An optical neural network using less than 1 photon per multiplication

    Authors: Tianyu Wang, Shi-Yuan Ma, Logan G. Wright, Tatsuhiro Onodera, Brian Richard, Peter L. McMahon

    Abstract: Deep learning has rapidly become a widespread tool in both scientific and commercial endeavors. Milestones of deep learning exceeding human performance have been achieved for a growing number of tasks over the past several years, across areas as diverse as game-playing, natural-language translation, and medical-image analysis. However, continued progress is increasingly hampered by the high energy… ▽ More

    Submitted 27 April, 2021; originally announced April 2021.

    Comments: 42 pages, 21 figures

    Journal ref: Nature Communications 13, 123 (2022)

  11. arXiv:2104.13386  [pdf, other

    cs.LG cond-mat.dis-nn cs.ET physics.optics

    Deep physical neural networks enabled by a backpropagation algorithm for arbitrary physical systems

    Authors: Logan G. Wright, Tatsuhiro Onodera, Martin M. Stein, Tianyu Wang, Darren T. Schachter, Zoey Hu, Peter L. McMahon

    Abstract: Deep neural networks have become a pervasive tool in science and engineering. However, modern deep neural networks' growing energy requirements now increasingly limit their scaling and broader use. We propose a radical alternative for implementing deep neural network models: Physical Neural Networks. We introduce a hybrid physical-digital algorithm called Physics-Aware Training to efficiently trai… ▽ More

    Submitted 27 April, 2021; originally announced April 2021.

    Journal ref: Nature 601, 549-555 (2022)

  12. Attention-based Quantum Tomography

    Authors: Peter Cha, Paul Ginsparg, Felix Wu, Juan Carrasquilla, Peter L. McMahon, Eun-Ah Kim

    Abstract: With rapid progress across platforms for quantum systems, the problem of many-body quantum state reconstruction for noisy quantum states becomes an important challenge. Recent works found promise in recasting the problem of quantum state reconstruction to learning the probability distribution of quantum state measurement vectors using generative neural network models. Here we propose the "Attentio… ▽ More

    Submitted 3 November, 2021; v1 submitted 22 June, 2020; originally announced June 2020.

    Journal ref: Mach. Learn.: Sci. Technol. 3 01LT01

  13. arXiv:1805.05217  [pdf, other

    quant-ph cs.ET physics.optics

    Experimental investigation of performance differences between Coherent Ising Machines and a quantum annealer

    Authors: Ryan Hamerly, Takahiro Inagaki, Peter L. McMahon, Davide Venturelli, Alireza Marandi, Tatsuhiro Onodera, Edwin Ng, Carsten Langrock, Kensuke Inaba, Toshimori Honjo, Koji Enbutsu, Takeshi Umeki, Ryoichi Kasahara, Shoko Utsunomiya, Satoshi Kako, Ken-ichi Kawarabayashi, Robert L. Byer, Martin M. Fejer, Hideo Mabuchi, Dirk Englund, Eleanor Rieffel, Hiroki Takesue, Yoshihisa Yamamoto

    Abstract: Physical annealing systems provide heuristic approaches to solving NP-hard Ising optimization problems. Here, we study the performance of two types of annealing machines--a commercially available quantum annealer built by D-Wave Systems, and measurement-feedback coherent Ising machines (CIMs) based on optical parametric oscillator networks--on two classes of problems, the Sherrington-Kirkpatrick (… ▽ More

    Submitted 24 May, 2019; v1 submitted 14 May, 2018; originally announced May 2018.

    Comments: 12 pages, 5 figures, 1 table (main text); 14 pages, 12 figures, 2 tables (supplementary)

    Journal ref: Sci. Adv. 5:eaau0823 (2019)