Showing 1–37 of 37 results for author: Razavi, A

Imagen 3

Authors: Imagen-Team-Google, :, Jason Baldridge, Jakob Bauer, Mukul Bhutani, Nicole Brichtova, Andrew Bunner, Kelvin Chan, Yichang Chen, Sander Dieleman, Yuqing Du, Zach Eaton-Rosen, Hongliang Fei, Nando de Freitas, Yilin Gao, Evgeny Gladchenko, Sergio Gómez Colmenarejo, Mandy Guo, Alex Haig, Will Hawkins, Hexiang Hu, Huilian Huang, Tobenna Peter Igwe, Christos Kaplanis, Siavash Khodadadeh , et al. (227 additional authors not shown)

Abstract: We introduce Imagen 3, a latent diffusion model that generates high quality images from text prompts. We describe our quality and responsibility evaluations. Imagen 3 is preferred over other state-of-the-art (SOTA) models at the time of evaluation. In addition, we discuss issues around safety and representation, as well as methods we used to minimize the potential harm of our models. We introduce Imagen 3, a latent diffusion model that generates high quality images from text prompts. We describe our quality and responsibility evaluations. Imagen 3 is preferred over other state-of-the-art (SOTA) models at the time of evaluation. In addition, we discuss issues around safety and representation, as well as methods we used to minimize the potential harm of our models. △ Less

Submitted 13 August, 2024; originally announced August 2024.

Normalizing flows for lattice gauge theory in arbitrary space-time dimension

Authors: Ryan Abbott, Michael S. Albergo, Aleksandar Botev, Denis Boyda, Kyle Cranmer, Daniel C. Hackett, Gurtej Kanwar, Alexander G. D. G. Matthews, Sébastien Racanière, Ali Razavi, Danilo J. Rezende, Fernando Romero-López, Phiala E. Shanahan, Julian M. Urban

Abstract: Applications of normalizing flows to the sampling of field configurations in lattice gauge theory have so far been explored almost exclusively in two space-time dimensions. We report new algorithmic developments of gauge-equivariant flow architectures facilitating the generalization to higher-dimensional lattice geometries. Specifically, we discuss masked autoregressive transformations with tracta… ▽ More Applications of normalizing flows to the sampling of field configurations in lattice gauge theory have so far been explored almost exclusively in two space-time dimensions. We report new algorithmic developments of gauge-equivariant flow architectures facilitating the generalization to higher-dimensional lattice geometries. Specifically, we discuss masked autoregressive transformations with tractable and unbiased Jacobian determinants, a key ingredient for scalable and asymptotically exact flow-based sampling algorithms. For concreteness, results from a proof-of-principle application to SU(3) lattice gauge theory in four space-time dimensions are reported. △ Less

Submitted 3 May, 2023; originally announced May 2023.

Aspects of scaling and scalability for flow-based sampling of lattice QCD

Authors: Ryan Abbott, Michael S. Albergo, Aleksandar Botev, Denis Boyda, Kyle Cranmer, Daniel C. Hackett, Alexander G. D. G. Matthews, Sébastien Racanière, Ali Razavi, Danilo J. Rezende, Fernando Romero-López, Phiala E. Shanahan, Julian M. Urban

Abstract: Recent applications of machine-learned normalizing flows to sampling in lattice field theory suggest that such methods may be able to mitigate critical slowing down and topological freezing. However, these demonstrations have been at the scale of toy models, and it remains to be determined whether they can be applied to state-of-the-art lattice quantum chromodynamics calculations. Assessing the vi… ▽ More Recent applications of machine-learned normalizing flows to sampling in lattice field theory suggest that such methods may be able to mitigate critical slowing down and topological freezing. However, these demonstrations have been at the scale of toy models, and it remains to be determined whether they can be applied to state-of-the-art lattice quantum chromodynamics calculations. Assessing the viability of sampling algorithms for lattice field theory at scale has traditionally been accomplished using simple cost scaling laws, but as we discuss in this work, their utility is limited for flow-based approaches. We conclude that flow-based approaches to sampling are better thought of as a broad family of algorithms with different scaling properties, and that scalability must be assessed experimentally. △ Less

Submitted 14 November, 2022; originally announced November 2022.

Comments: 22 pages, 8 figures

Report number: MIT-CTP/5496

Sampling QCD field configurations with gauge-equivariant flow models

Authors: Ryan Abbott, Michael S. Albergo, Aleksandar Botev, Denis Boyda, Kyle Cranmer, Daniel C. Hackett, Gurtej Kanwar, Alexander G. D. G. Matthews, Sébastien Racanière, Ali Razavi, Danilo J. Rezende, Fernando Romero-López, Phiala E. Shanahan, Julian M. Urban

Abstract: Machine learning methods based on normalizing flows have been shown to address important challenges, such as critical slowing-down and topological freezing, in the sampling of gauge field configurations in simple lattice field theories. A critical question is whether this success will translate to studies of QCD. This Proceedings presents a status update on advances in this area. In particular, it… ▽ More Machine learning methods based on normalizing flows have been shown to address important challenges, such as critical slowing-down and topological freezing, in the sampling of gauge field configurations in simple lattice field theories. A critical question is whether this success will translate to studies of QCD. This Proceedings presents a status update on advances in this area. In particular, it is illustrated how recently developed algorithmic components may be combined to construct flow-based sampling algorithms for QCD in four dimensions. The prospects and challenges for future use of this approach in at-scale applications are summarized. △ Less

Submitted 20 August, 2022; v1 submitted 7 August, 2022; originally announced August 2022.

Comments: Submitted as a proceedings to the 39th International Symposium on Lattice Field Theory (Lattice 2022)

Frequency-dependent Ultrasonic Stimulation of PNIPAM Microgels in Water

Authors: Atieh Razavi, Matthias Rutsch, Sonja Wismath, Mario Kupnik, Regine von Klitzing, Amin Rahimzadeh

Abstract: As a novel stimulus, we used high-frequency ultrasonic waves to provide the required energy for breaking hydrogen bonds between Poly(N-isopropylacrylamide) (PNIPAM) and water molecules while the solution temperature maintains below the volume phase transition temperature (VPTT=$$32^\circ C$$). Ultrasonic waves propagate through the solution and their energy will be absorbed due to the liquid visco… ▽ More As a novel stimulus, we used high-frequency ultrasonic waves to provide the required energy for breaking hydrogen bonds between Poly(N-isopropylacrylamide) (PNIPAM) and water molecules while the solution temperature maintains below the volume phase transition temperature (VPTT=$$32^\circ C$$). Ultrasonic waves propagate through the solution and their energy will be absorbed due to the liquid viscosity. The absorbed energy partially leads to the generation of a streaming flow and the rest will be spent to break the hydrogen bonds. Therefore, the microgels collapse and become insoluble in the water and agglomerate, resulting in turbidity. We used turbidity to quantify the ultrasound energy absorption and showed that the acousto-response of PNIPAM microgels is a temporal phenomenon that depends on the duration of the actuation. Increasing the solution concentration leads to a faster hydrogen bond breakage and turbidity evolution. Furthermore, the frequency of imposed waves is important and affects the stimulation kinetics of PNIPAM microgels. Increasing the frequency of actuation increases the speed of hydrogen bond breakage and thus turbidity evolution. This is due to the increase in ultrasound energy absorption by liquids at higher frequencies. △ Less

Submitted 14 November, 2023; v1 submitted 27 May, 2022; originally announced May 2022.

A Generalist Agent

Authors: Scott Reed, Konrad Zolna, Emilio Parisotto, Sergio Gomez Colmenarejo, Alexander Novikov, Gabriel Barth-Maron, Mai Gimenez, Yury Sulsky, Jackie Kay, Jost Tobias Springenberg, Tom Eccles, Jake Bruce, Ali Razavi, Ashley Edwards, Nicolas Heess, Yutian Chen, Raia Hadsell, Oriol Vinyals, Mahyar Bordbar, Nando de Freitas

Abstract: Inspired by progress in large-scale language modeling, we apply a similar approach towards building a single generalist agent beyond the realm of text outputs. The agent, which we refer to as Gato, works as a multi-modal, multi-task, multi-embodiment generalist policy. The same network with the same weights can play Atari, caption images, chat, stack blocks with a real robot arm and much more, dec… ▽ More Inspired by progress in large-scale language modeling, we apply a similar approach towards building a single generalist agent beyond the realm of text outputs. The agent, which we refer to as Gato, works as a multi-modal, multi-task, multi-embodiment generalist policy. The same network with the same weights can play Atari, caption images, chat, stack blocks with a real robot arm and much more, deciding based on its context whether to output text, joint torques, button presses, or other tokens. In this report we describe the model and the data, and document the current capabilities of Gato. △ Less

Submitted 11 November, 2022; v1 submitted 12 May, 2022; originally announced May 2022.

Comments: Published at TMLR, 42 pages

Journal ref: Transactions on Machine Learning Research, 11/2022, https://openreview.net/forum?id=1ikK0kHjvj

Visual Feature Encoding for GNNs on Road Networks

Authors: Oliver Stromann, Alireza Razavi, Michael Felsberg

Abstract: In this work, we present a novel approach to learning an encoding of visual features into graph neural networks with the application on road network data. We propose an architecture that combines state-of-the-art vision backbone networks with graph neural networks. More specifically, we perform a road type classification task on an Open Street Map road network through encoding of satellite imagery… ▽ More In this work, we present a novel approach to learning an encoding of visual features into graph neural networks with the application on road network data. We propose an architecture that combines state-of-the-art vision backbone networks with graph neural networks. More specifically, we perform a road type classification task on an Open Street Map road network through encoding of satellite imagery using various ResNet architectures. Our architecture further enables fine-tuning and a transfer-learning approach is evaluated by pretraining on the NWPU-RESISC45 image classification dataset for remote sensing and comparing them to purely ImageNet-pretrained ResNet models as visual feature encoders. The results show not only that the visual feature encoders are superior to low-level visual features, but also that the fine-tuning of the visual feature encoder to a general remote sensing dataset such as NWPU-RESISC45 can further improve the performance of a GNN on a machine learning task like road type classification. △ Less

Submitted 2 March, 2022; originally announced March 2022.

Learning to integrate vision data into road network data

Authors: Oliver Stromann, Alireza Razavi, Michael Felsberg

Abstract: Road networks are the core infrastructure for connected and autonomous vehicles, but creating meaningful representations for machine learning applications is a challenging task. In this work, we propose to integrate remote sensing vision data into road network data for improved embeddings with graph neural networks. We present a segmentation of road edges based on spatio-temporal road and traffic… ▽ More Road networks are the core infrastructure for connected and autonomous vehicles, but creating meaningful representations for machine learning applications is a challenging task. In this work, we propose to integrate remote sensing vision data into road network data for improved embeddings with graph neural networks. We present a segmentation of road edges based on spatio-temporal road and traffic characteristics, which allows to enrich the attribute set of road networks with visual features of satellite imagery and digital surface models. We show that both, the segmentation and the integration of vision data can increase performance on a road type classification task, and we achieve state-of-the-art performance on the OSM+DiDi Chuxing dataset on Chengdu, China. △ Less

Submitted 2 March, 2022; v1 submitted 20 December, 2021; originally announced December 2021.

Vector Quantized Models for Planning

Authors: Sherjil Ozair, Yazhe Li, Ali Razavi, Ioannis Antonoglou, Aäron van den Oord, Oriol Vinyals

Abstract: Recent developments in the field of model-based RL have proven successful in a range of environments, especially ones where planning is essential. However, such successes have been limited to deterministic fully-observed environments. We present a new approach that handles stochastic and partially-observable environments. Our key insight is to use discrete autoencoders to capture the multiple poss… ▽ More Recent developments in the field of model-based RL have proven successful in a range of environments, especially ones where planning is essential. However, such successes have been limited to deterministic fully-observed environments. We present a new approach that handles stochastic and partially-observable environments. Our key insight is to use discrete autoencoders to capture the multiple possible effects of an action in a stochastic environment. We use a stochastic variant of Monte Carlo tree search to plan over both the agent's actions and the discrete latent variables representing the environment's response. Our approach significantly outperforms an offline version of MuZero on a stochastic interpretation of chess where the opponent is considered part of the environment. We also show that our approach scales to DeepMind Lab, a first-person 3D environment with large visual observations and partial observability. △ Less

Submitted 10 June, 2021; v1 submitted 8 June, 2021; originally announced June 2021.

Comments: ICML 2021

Roadmap of spin-orbit torques

Authors: Qiming Shao, Peng Li, Luqiao Liu, Hyunsoo Yang, Shunsuke Fukami, Armin Razavi, Hao Wu, Kang L. Wang, Frank Freimuth, Yuriy Mokrousov, Mark D. Stiles, Satoru Emori, Axel Hoffmann, Johan Åkerman, Kaushik Roy, Jian-Ping Wang, See-Hun Yang, Kevin Garello, Wei Zhang

Abstract: Spin-orbit torque (SOT) is an emerging technology that enables the efficient manipulation of spintronic devices. The initial processes of interest in SOTs involved electric fields, spin-orbit coupling, conduction electron spins and magnetization. More recently interest has grown to include a variety of other processes that include phonons, magnons, or heat. Over the past decade, many materials hav… ▽ More Spin-orbit torque (SOT) is an emerging technology that enables the efficient manipulation of spintronic devices. The initial processes of interest in SOTs involved electric fields, spin-orbit coupling, conduction electron spins and magnetization. More recently interest has grown to include a variety of other processes that include phonons, magnons, or heat. Over the past decade, many materials have been explored to achieve a larger SOT efficiency. Recently, holistic design to maximize the performance of SOT devices has extended material research from a nonmagnetic layer to a magnetic layer. The rapid development of SOT has spurred a variety of SOT-based applications. In this Roadmap paper, we first review the theories of SOTs by introducing the various mechanisms thought to generate or control SOTs, such as the spin Hall effect, the Rashba-Edelstein effect, the orbital Hall effect, thermal gradients, magnons, and strain effects. Then, we discuss the materials that enable these effects, including metals, metallic alloys, topological insulators, two-dimensional materials, and complex oxides. We also discuss the important roles in SOT devices of different types of magnetic layers. Afterward, we discuss device applications utilizing SOTs. We discuss and compare three-terminal and two-terminal SOT-magnetoresistive random-access memories (MRAMs); we mention various schemes to eliminate the need for an external field. We provide technological application considerations for SOT-MRAM and give perspectives on SOT-based neuromorphic devices and circuits. In addition to SOT-MRAM, we present SOT-based spintronic terahertz generators, nano-oscillators, and domain wall and skyrmion racetrack memories. This paper aims to achieve a comprehensive review of SOT theory, materials, and applications, guiding future SOT development in both the academic and industrial sectors. △ Less

Submitted 6 May, 2021; v1 submitted 23 April, 2021; originally announced April 2021.

Comments: an invited paper in the "Advances in Magnetics" series

Commutator formulas for gradient Ricci shrinker and their application to linear stability

Authors: Mansour Mehrmohamadi, Asadollah Razavi

Abstract: In this paper we have found some commutator formulas between $div_{f},Δ_{f,L},div_{f}^\dagger,Δ_{f}$ on closed orientable $GRS^+$ metrics (Gradient Ricci Shrinker), then with them we have generalized a Theorem of Cao and Zhu about necessary condition for linear stability of a $GRS^+$. In this paper we have found some commutator formulas between $div_{f},Δ_{f,L},div_{f}^\dagger,Δ_{f}$ on closed orientable $GRS^+$ metrics (Gradient Ricci Shrinker), then with them we have generalized a Theorem of Cao and Zhu about necessary condition for linear stability of a $GRS^+$. △ Less

Submitted 16 April, 2021; originally announced April 2021.

Predicting Video with VQVAE

Authors: Jacob Walker, Ali Razavi, Aäron van den Oord

Abstract: In recent years, the task of video prediction-forecasting future video given past video frames-has attracted attention in the research community. In this paper we propose a novel approach to this problem with Vector Quantized Variational AutoEncoders (VQ-VAE). With VQ-VAE we compress high-resolution videos into a hierarchical set of multi-scale discrete latent variables. Compared to pixels, this c… ▽ More In recent years, the task of video prediction-forecasting future video given past video frames-has attracted attention in the research community. In this paper we propose a novel approach to this problem with Vector Quantized Variational AutoEncoders (VQ-VAE). With VQ-VAE we compress high-resolution videos into a hierarchical set of multi-scale discrete latent variables. Compared to pixels, this compressed latent space has dramatically reduced dimensionality, allowing us to apply scalable autoregressive generative models to predict video. In contrast to previous work that has largely emphasized highly constrained datasets, we focus on very diverse, large-scale datasets such as Kinetics-600. We predict video at a higher resolution on unconstrained videos, 256x256, than any other previous method to our knowledge. We further validate our approach against prior work via a crowdsourced human evaluation. △ Less

Submitted 2 March, 2021; originally announced March 2021.

Comments: 13 Pages

ACM Class: I.2.6; I.2.10

Entanglement Across Separate Silicon Dies in a Modular Superconducting Qubit Device

Authors: Alysson Gold, JP Paquette, Anna Stockklauser, Matthew J. Reagor, M. Sohaib Alam, Andrew Bestwick, Nicolas Didier, Ani Nersisyan, Feyza Oruc, Armin Razavi, Ben Scharmann, Eyob A. Sete, Biswajit Sur, Davide Venturelli, Cody James Winkleblack, Filip Wudarski, Mike Harburn, Chad Rigetti

Abstract: Assembling future large-scale quantum computers out of smaller, specialized modules promises to simplify a number of formidable science and engineering challenges. One of the primary challenges in developing a modular architecture is in engineering high fidelity, low-latency quantum interconnects between modules. Here we demonstrate a modular solid state architecture with deterministic inter-modul… ▽ More Assembling future large-scale quantum computers out of smaller, specialized modules promises to simplify a number of formidable science and engineering challenges. One of the primary challenges in developing a modular architecture is in engineering high fidelity, low-latency quantum interconnects between modules. Here we demonstrate a modular solid state architecture with deterministic inter-module coupling between four physically separate, interchangeable superconducting qubit integrated circuits, achieving two-qubit gate fidelities as high as 99.1$\pm0.5$\% and 98.3$\pm$0.3\% for iSWAP and CZ entangling gates, respectively. The quality of the inter-module entanglement is further confirmed by a demonstration of Bell-inequality violation for disjoint pairs of entangled qubits across the four separate silicon dies. Having proven out the fundamental building blocks, this work provides the technological foundations for a modular quantum processor: technology which will accelerate near-term experimental efforts and open up new paths to the fault-tolerant era for solid state qubit architectures. △ Less

Submitted 11 March, 2021; v1 submitted 25 February, 2021; originally announced February 2021.

Comments: 9 pages, 8 figures

Do Transformers Need Deep Long-Range Memory

Authors: Jack W. Rae, Ali Razavi

Abstract: Deep attention models have advanced the modelling of sequential data across many domains. For language modelling in particular, the Transformer-XL -- a Transformer augmented with a long-range memory of past activations -- has been shown to be state-of-the-art across a variety of well-studied benchmarks. The Transformer-XL incorporates a long-range memory at every layer of the network, which render… ▽ More Deep attention models have advanced the modelling of sequential data across many domains. For language modelling in particular, the Transformer-XL -- a Transformer augmented with a long-range memory of past activations -- has been shown to be state-of-the-art across a variety of well-studied benchmarks. The Transformer-XL incorporates a long-range memory at every layer of the network, which renders its state to be thousands of times larger than RNN predecessors. However it is unclear whether this is necessary. We perform a set of interventions to show that comparable performance can be obtained with 6X fewer long range memories and better performance can be obtained by limiting the range of attention in lower layers of the network. △ Less

Submitted 7 July, 2020; originally announced July 2020.

Comments: published at 58th Annual Meeting of the Association for Computational Linguistics. 6 pages, 4 figures, 1 table

Chiral symmetry breaking for deterministic switching of perpendicular magnetization by spin-orbit torque

Authors: Hao Wu, John Nance, Seyed Armin Razavi, David Lujan, Bingqian Dai, Yuxiang Liu, Haoran He, Baoshan Cui, Di Wu, Kin Wong, Kemal Sobotkiewich, Xiaoqin Li, Gregory P. Carman, Kang L. Wang

Abstract: Symmetry breaking is a characteristic to determine which branch of a bifurcation system follows upon crossing a critical point. Specifically, in spin-orbit torque (SOT) devices, a fundamental question arises: how to break the symmetry of the perpendicular magnetic moment by the in-plane spin polarization? Here, we show that the chiral symmetry breaking by the DMI can induce the deterministic SOT s… ▽ More Symmetry breaking is a characteristic to determine which branch of a bifurcation system follows upon crossing a critical point. Specifically, in spin-orbit torque (SOT) devices, a fundamental question arises: how to break the symmetry of the perpendicular magnetic moment by the in-plane spin polarization? Here, we show that the chiral symmetry breaking by the DMI can induce the deterministic SOT switching of the perpendicular magnetization. By introducing a gradient of saturation magnetization or magnetic anisotropy, non-collinear spin textures are formed by the gradient of effective SOT strength, and thus the chiral symmetry of the SOT-induced spin textures is broken by the DMI, resulting in the deterministic magnetization switching. We introduce a strategy to induce an out-of-plane (z) gradient of magnetic properties, as a practical solution for the wafer-scale manufacture of SOT devices. △ Less

Submitted 28 April, 2020; originally announced April 2020.

Comments: 16 pages, 4 figures

Classification of almost contact metric structures on three-dimensional non-unimodular Lie groups

Authors: Pejhman Vatandoost-Miandehi, A. Razavi

Abstract: In this paper, left-invariant almost contact metric structures on three-dimensional non-unimodular Lie groups are investigated. It is proved that for every Riemannian Lie group, there is one of these structures. In addition, left-invariant normal almost contact metric structures on three dimensional non-unimodular Lie groups are classified. In this paper, left-invariant almost contact metric structures on three-dimensional non-unimodular Lie groups are investigated. It is proved that for every Riemannian Lie group, there is one of these structures. In addition, left-invariant normal almost contact metric structures on three dimensional non-unimodular Lie groups are classified. △ Less

Submitted 11 February, 2020; originally announced February 2020.

Landmark2Vec: An Unsupervised Neural Network-Based Landmark Positioning Method

Authors: Alireza Razavi

Abstract: A Neural Network-based method for unsupervised landmarks map estimation from measurements taken from landmarks is introduced. The measurements needed for training the network are the signals observed/received from landmarks by an agent. The definition of landmarks, agent, and the measurements taken by agent from landmarks is rather broad here: landmarks can be visual objects, e.g., poles along a r… ▽ More A Neural Network-based method for unsupervised landmarks map estimation from measurements taken from landmarks is introduced. The measurements needed for training the network are the signals observed/received from landmarks by an agent. The definition of landmarks, agent, and the measurements taken by agent from landmarks is rather broad here: landmarks can be visual objects, e.g., poles along a road, with measurements being the size of landmark in a visual sensor mounted on a vehicle (agent), or they can be radio transmitters, e.g., WiFi access points inside a building, with measurements being the Received Signal Strength (RSS) heard from them by a mobile device carried by a person (agent). The goal of the map estimation is then to find the positions of landmarks up to a scale, rotation, and shift (i.e., the topological map of the landmarks). Assuming that there are $L$ landmarks, the measurements will be $L \times 1$ vectors collected over the area. A shallow network then will be trained to learn the map without any ground truth information. △ Less

Submitted 28 January, 2020; originally announced January 2020.

Picosecond spin-orbit torque switching of ferrimagnets

Authors: Hao Wu, Deniz Turan, Quanjun Pan, Guanjie Wu, Seyed Armin Razavi, Nezih Tolga Yardimci, Zongzhi Zhang, Mona Jarrahi, Kang L. Wang

Abstract: Spintronics provides an efficient platform for realizing non-volatile memory and logic devices. In these systems, data is stored in the magnetization of magnetic materials, and magnetization is switched in the writing process. In conventional spintronic devices, ferromagnetic materials are used which have a magnetization dynamics timescale of around the nanoseconds, setting a limit for the switchi… ▽ More Spintronics provides an efficient platform for realizing non-volatile memory and logic devices. In these systems, data is stored in the magnetization of magnetic materials, and magnetization is switched in the writing process. In conventional spintronic devices, ferromagnetic materials are used which have a magnetization dynamics timescale of around the nanoseconds, setting a limit for the switching speed. Increasing the magnetization switching speed has been one of the challenges in spintronic research. In this work we take advantage of the ultrafast magnetization dynamics in ferrimagnetic materials instead of ferromagnets, and we use femtosecond laser pulses and a photoconductive Auston switch to create picosecond current pulses for switching the ferrimagnet. By anomalous Hall and magneto-optic Kerr (MOKE) measurement, we demonstrate the robust picosecond SOT driven magnetization switching of ferrimagnetic GdFeCo. The time-resolved MOKE shows more than 50 GHz magnetic resonance frequency of GdFeCo, indicating faster than 20 ps spin dynamics and tens of picosecond SOT switching speed. Our work provides a promising route to realize picosecond operation speed for non-volatile magnetic memory and logic applications. △ Less

Submitted 20 December, 2019; originally announced December 2019.

Generating Diverse High-Fidelity Images with VQ-VAE-2

Authors: Ali Razavi, Aaron van den Oord, Oriol Vinyals

Abstract: We explore the use of Vector Quantized Variational AutoEncoder (VQ-VAE) models for large scale image generation. To this end, we scale and enhance the autoregressive priors used in VQ-VAE to generate synthetic samples of much higher coherence and fidelity than possible before. We use simple feed-forward encoder and decoder networks, making our model an attractive candidate for applications where t… ▽ More We explore the use of Vector Quantized Variational AutoEncoder (VQ-VAE) models for large scale image generation. To this end, we scale and enhance the autoregressive priors used in VQ-VAE to generate synthetic samples of much higher coherence and fidelity than possible before. We use simple feed-forward encoder and decoder networks, making our model an attractive candidate for applications where the encoding and/or decoding speed is critical. Additionally, VQ-VAE requires sampling an autoregressive model only in the compressed latent space, which is an order of magnitude faster than sampling in the pixel space, especially for large images. We demonstrate that a multi-scale hierarchical organization of VQ-VAE, augmented with powerful priors over the latent codes, is able to generate samples with quality that rivals that of state of the art Generative Adversarial Networks on multifaceted datasets such as ImageNet, while not suffering from GAN's known shortcomings such as mode collapse and lack of diversity. △ Less

Submitted 2 June, 2019; originally announced June 2019.

Data-Efficient Image Recognition with Contrastive Predictive Coding

Authors: Olivier J. Hénaff, Aravind Srinivas, Jeffrey De Fauw, Ali Razavi, Carl Doersch, S. M. Ali Eslami, Aaron van den Oord

Abstract: Human observers can learn to recognize new categories of images from a handful of examples, yet doing so with artificial ones remains an open challenge. We hypothesize that data-efficient recognition is enabled by representations which make the variability in natural signals more predictable. We therefore revisit and improve Contrastive Predictive Coding, an unsupervised objective for learning suc… ▽ More Human observers can learn to recognize new categories of images from a handful of examples, yet doing so with artificial ones remains an open challenge. We hypothesize that data-efficient recognition is enabled by representations which make the variability in natural signals more predictable. We therefore revisit and improve Contrastive Predictive Coding, an unsupervised objective for learning such representations. This new implementation produces features which support state-of-the-art linear classification accuracy on the ImageNet dataset. When used as input for non-linear classification with deep neural networks, this representation allows us to use 2-5x less labels than classifiers trained directly on image pixels. Finally, this unsupervised representation substantially improves transfer learning to object detection on the PASCAL VOC dataset, surpassing fully supervised pre-trained ImageNet classifiers. △ Less

Submitted 1 July, 2020; v1 submitted 22 May, 2019; originally announced May 2019.

Experimental creation and annihilation of nonvolatile magnetic skyrmions using voltage control of magnetic anisotropy without an external magnetic field

Authors: Dhritiman Bhattacharya, Seyed Armin Razavi, Hao Wu, Bingqian Dai, Kang L. Wang, Jayasimha Atulasimha

Abstract: In this work, we utilize voltage controlled magnetic anisotropy (VCMA) to manipulate magnetic skyrmions that are fixed in space. Memory devices based on this strategy can potentially be of smaller footprint and better energy efficiency than current-controlled motion-based skyrmionic devices. To demonstrate VCMA induced manipulation of skyrmions, we fabricate antiferromagnet/ferromagnet/oxide heter… ▽ More In this work, we utilize voltage controlled magnetic anisotropy (VCMA) to manipulate magnetic skyrmions that are fixed in space. Memory devices based on this strategy can potentially be of smaller footprint and better energy efficiency than current-controlled motion-based skyrmionic devices. To demonstrate VCMA induced manipulation of skyrmions, we fabricate antiferromagnet/ferromagnet/oxide heterostructure films where skyrmions can be stabilized without any external magnetic field due to the presence of exchange bias. These isolated skyrmions were annihilated by applying a voltage pulse that increased PMA. On the other hand, decreasing PMA promoted formation of more skyrmions. Furthermore, skyrmions can be created from chiral domains by increasing PMA of the system. To corroborate our experimental observations, we performed micromagnetic simulation. The proposed method could potentially lead to novel skyrmion-based memory devices. △ Less

Submitted 1 April, 2019; originally announced April 2019.

Preventing Posterior Collapse with delta-VAEs

Authors: Ali Razavi, Aäron van den Oord, Ben Poole, Oriol Vinyals

Abstract: Due to the phenomenon of "posterior collapse," current latent variable generative models pose a challenging design choice that either weakens the capacity of the decoder or requires augmenting the objective so it does not only maximize the likelihood of the data. In this paper, we propose an alternative that utilizes the most powerful generative models as decoders, whilst optimising the variationa… ▽ More Due to the phenomenon of "posterior collapse," current latent variable generative models pose a challenging design choice that either weakens the capacity of the decoder or requires augmenting the objective so it does not only maximize the likelihood of the data. In this paper, we propose an alternative that utilizes the most powerful generative models as decoders, whilst optimising the variational lower bound all while ensuring that the latent variables preserve and encode useful information. Our proposed $δ$-VAEs achieve this by constraining the variational family for the posterior to have a minimum distance to the prior. For sequential latent variable models, our approach resembles the classic representation learning approach of slow feature analysis. We demonstrate the efficacy of our approach at modeling text on LM1B and modeling images: learning representations, improving sample quality, and achieving state of the art log-likelihood on CIFAR-10 and ImageNet $32\times 32$. △ Less

Submitted 10 January, 2019; originally announced January 2019.

Hyperbolic Attention Networks

Authors: Caglar Gulcehre, Misha Denil, Mateusz Malinowski, Ali Razavi, Razvan Pascanu, Karl Moritz Hermann, Peter Battaglia, Victor Bapst, David Raposo, Adam Santoro, Nando de Freitas

Abstract: We introduce hyperbolic attention networks to endow neural networks with enough capacity to match the complexity of data with hierarchical and power-law structure. A few recent approaches have successfully demonstrated the benefits of imposing hyperbolic geometry on the parameters of shallow networks. We extend this line of work by imposing hyperbolic geometry on the activations of neural networks… ▽ More We introduce hyperbolic attention networks to endow neural networks with enough capacity to match the complexity of data with hierarchical and power-law structure. A few recent approaches have successfully demonstrated the benefits of imposing hyperbolic geometry on the parameters of shallow networks. We extend this line of work by imposing hyperbolic geometry on the activations of neural networks. This allows us to exploit hyperbolic geometry to reason about embeddings produced by deep networks. We achieve this by re-expressing the ubiquitous mechanism of soft attention in terms of operations defined for hyperboloid and Klein models. Our method shows improvements in terms of generalization on neural machine translation, learning on graphs and visual question answering tasks while keeping the neural representations compact. △ Less

Submitted 24 May, 2018; originally announced May 2018.

Design of a Planar Eleven Antenna for Optimal MIMO Performance as a Wideband Micro Base-station Antenna

Authors: Aidin Razavi, Wenjie Yu, Jian Yang, Andrés Alayón Glazunov

Abstract: A new low-profile planar Eleven antenna is designed for optimal MIMO performance as a wideband MIMO antenna for micro base-stations in future wireless communication systems. The design objective has been to optimize both the reflection coefficient at the input port of the antenna and the 1-bitstream and 2-bitstream MIMO efficiency of the antenna at the same time, in both the Rich Isotropic MultiPa… ▽ More A new low-profile planar Eleven antenna is designed for optimal MIMO performance as a wideband MIMO antenna for micro base-stations in future wireless communication systems. The design objective has been to optimize both the reflection coefficient at the input port of the antenna and the 1-bitstream and 2-bitstream MIMO efficiency of the antenna at the same time, in both the Rich Isotropic MultiPath (RIMP) and Random Line-of-Sight (Random-LOS) environments. The planar Eleven antenna can be operated in 2-, 4-, and 8-port modes with slight modifications. The optimization is performed using genetic algorithms. The effects of polarization deficiencies and antenna total embedded efficiency on the MIMO performance of the antenna are further studied. A prototype of the antenna has been fabricated and the design has been verified by measurements against the simulations. △ Less

Submitted 16 April, 2018; originally announced April 2018.

Comments: 7 pages, 15 figures, 15 references

Correlation between Dzyaloshinskii Moriya interaction and spin mixing conductance at antiferromagnet / ferromagnet interface

Authors: Xin Ma, Guoqiang Yu, Seyed A. Razavi, Liang Chang, Lei Deng, Zhaodong Chu, Congli He, Kang L. Wang, Xiaoqin Li

Abstract: The rich interaction phenomena at antiferromagnet (AFM)/ ferromagnet (FM) interfaces are key ingredients in AFM spintronics, where many underlying mechanisms remain unclear. Here we report a correlation observed between interfacial Dzyaloshinskii-Moriya interaction (DMI) Ds and effective spin mixing conductance g at IrMn/CoFeB interface. Both Ds and g are quantitatively determined with Brillouin l… ▽ More The rich interaction phenomena at antiferromagnet (AFM)/ ferromagnet (FM) interfaces are key ingredients in AFM spintronics, where many underlying mechanisms remain unclear. Here we report a correlation observed between interfacial Dzyaloshinskii-Moriya interaction (DMI) Ds and effective spin mixing conductance g at IrMn/CoFeB interface. Both Ds and g are quantitatively determined with Brillouin light scattering measurements, and increase with IrMn thickness in the range of 2.5~7.5 nm. Such correlation likely originates from the AFM-states-mediated spin-flip transitions in FM, which promote both interfacial DMI and spin pumping effect. Our findings provide deeper insight into the AFM-FM interfacial coupling for future spintronic design. △ Less

Submitted 19 July, 2018; v1 submitted 13 April, 2018; originally announced April 2018.

Journal ref: Phys. Rev. B 98, 104428 (2018)

Back-of-the-envelope evaluation of the prevalence of RIMP or LOS propagation as a function of frequency

Authors: Aidin Razavi, Andrés Alayón Glazunov, Rob Maaskant, Jian Yang

Abstract: The performance of 5G wireless communication systems, employing Massive-MIMO at millimeter-wave frequencies, is most likely measured only in Over-The-Air (OTA) setups. It is proposed to perform OTA measurements in two limiting environments of Rich Isotropic MultiPath (RIMP) and Random Line-of-Sight (Random-LOS) instead of a typical or representative channel. In the present paper, we present a back… ▽ More The performance of 5G wireless communication systems, employing Massive-MIMO at millimeter-wave frequencies, is most likely measured only in Over-The-Air (OTA) setups. It is proposed to perform OTA measurements in two limiting environments of Rich Isotropic MultiPath (RIMP) and Random Line-of-Sight (Random-LOS) instead of a typical or representative channel. In the present paper, we present a back-of-the envelope investigation of the impact of scattering on the frequency dependence of the signal fading statistics in the 500 MHz-100 GHz band. We introduce a simple model for a generic scattering environment by using randomly distributed resonant scatterers to investigate the impact of the size of the scattering environment, the scatterer density, and the number of scatterers on the signal variability in terms of the Rician K-factor as a function of frequency. The simplified model is also verified against full-wave simulation using the Method of Moments (MoM). △ Less

Submitted 12 April, 2018; originally announced April 2018.

Comments: 8 pages, 4 figures, 24 references

Angular sampling, Test Signal, and Near Field Aspects for Over-the-Air Total Radiated Power Assessment in Anechoic Chambers

Authors: Jonas Fridén, Aidin Razavi, Anders Stjernman

Abstract: 5th Generation Mobile Network Systems(5G systems) operating in milli-meter Wave (mmW) bands will employ base stations with integrated Active Antenna Systems (AASs) capable of beam-tracking using narrow beams obtained from array antennas encapsulated in a chip-like device. Regulatory limits for unwanted Radio Frequency (RF) emissions are currently set in terms of Total Radiated Power (TRP). As meas… ▽ More 5th Generation Mobile Network Systems(5G systems) operating in milli-meter Wave (mmW) bands will employ base stations with integrated Active Antenna Systems (AASs) capable of beam-tracking using narrow beams obtained from array antennas encapsulated in a chip-like device. Regulatory limits for unwanted Radio Frequency (RF) emissions are currently set in terms of Total Radiated Power (TRP). As measurements at the antenna connectors are not possible, Over-The-Air (OTA) methods for TRP of unwanted emissions are needed. The method investigated here uses power density measurements on a spherical surface in an anechoic chamber. Two major challenges with such a method are: need for large number of angular points, and search for worst case antenna configuration per frequency for electrically large devices at high frequencies. These challenges are addressed by investigating the impact of correlation, sparse sampling, and use of beam sweeping on the TRP estimate. Finally, it is investigated how and in which spatial regions near-field tangential electric field measurements can be used to assess TRP. △ Less

Submitted 3 April, 2018; v1 submitted 29 March, 2018; originally announced March 2018.

Comments: 14 pages, 21 figures, 3 tables, submitted to a journal

Population Based Training of Neural Networks

Authors: Max Jaderberg, Valentin Dalibard, Simon Osindero, Wojciech M. Czarnecki, Jeff Donahue, Ali Razavi, Oriol Vinyals, Tim Green, Iain Dunning, Karen Simonyan, Chrisantha Fernando, Koray Kavukcuoglu

Abstract: Neural networks dominate the modern machine learning landscape, but their training and success still suffer from sensitivity to empirical choices of hyperparameters such as model architecture, loss function, and optimisation algorithm. In this work we present \emph{Population Based Training (PBT)}, a simple asynchronous optimisation algorithm which effectively utilises a fixed computational budget… ▽ More Neural networks dominate the modern machine learning landscape, but their training and success still suffer from sensitivity to empirical choices of hyperparameters such as model architecture, loss function, and optimisation algorithm. In this work we present \emph{Population Based Training (PBT)}, a simple asynchronous optimisation algorithm which effectively utilises a fixed computational budget to jointly optimise a population of models and their hyperparameters to maximise performance. Importantly, PBT discovers a schedule of hyperparameter settings rather than following the generally sub-optimal strategy of trying to find a single fixed set to use for the whole course of training. With just a small modification to a typical distributed hyperparameter training framework, our method allows robust and reliable training of models. We demonstrate the effectiveness of PBT on deep reinforcement learning problems, showing faster wall-clock convergence and higher final performance of agents by optimising over a suite of hyperparameters. In addition, we show the same method can be applied to supervised learning for machine translation, where PBT is used to maximise the BLEU score directly, and also to training of Generative Adversarial Networks to maximise the Inception score of generated images. In all cases PBT results in the automatic discovery of hyperparameter schedules and model selection which results in stable training and better final performance. △ Less

Submitted 28 November, 2017; v1 submitted 27 November, 2017; originally announced November 2017.

Role of dimensional crossover on spin-orbit torque efficiency in magnetic insulator thin films

Authors: Qiming Shao, Chi Tang, Guoqiang Yu, Aryan Navabi, Hao Wu, Congli He, Junxue Li, Pramey Upadhyaya, Peng Zhang, Seyed Armin Razavi, Qing Lin He, Yawen Liu, Pei Yang, Se Kwon Kim, Cheng Zheng, Yizhou Liu, Lei Pan, Roger Lake, Xiufeng Han, Yaroslav Tserkovnyak, Jing Shi, Kang L. Wang

Abstract: Magnetic insulators (MIs) attract tremendous interest for spintronic applications due to low Gilbert damping and absence of Ohmic loss. Magnetic order of MIs can be manipulated and even switched by spin-orbit torques (SOTs) generated through spin Hall effect and Rashba-Edelstein effect in heavy metal/MI bilayers. SOTs on MIs are more intriguing than magnetic metals since SOTs cannot be transferred… ▽ More Magnetic insulators (MIs) attract tremendous interest for spintronic applications due to low Gilbert damping and absence of Ohmic loss. Magnetic order of MIs can be manipulated and even switched by spin-orbit torques (SOTs) generated through spin Hall effect and Rashba-Edelstein effect in heavy metal/MI bilayers. SOTs on MIs are more intriguing than magnetic metals since SOTs cannot be transferred to MIs through direct injection of electron spins. Understanding of SOTs on MIs remains elusive, especially how SOTs scale with the film thickness. Here, we observe the critical role of dimensionality on the SOT efficiency by systematically studying the MI layer thickness dependent SOT efficiency in tungsten/thulium iron garnet (W/TmIG) bilayers. We first show that the TmIG thin film evolves from two-dimensional to three-dimensional magnetic phase transitions as the thickness increases, due to the suppression of long-wavelength thermal fluctuation. Then, we report the significant enhancement of the measured SOT efficiency as the thickness increases. We attribute this effect to the increase of the magnetic moment density in concert with the suppression of thermal fluctuations. At last, we demonstrate the current-induced SOT switching in the W/TmIG bilayers with a TmIG thickness up to 15 nm. The switching current density is comparable with those of heavy metal/ferromagnetic metal cases. Our findings shed light on the understanding of SOTs in MIs, which is important for the future development of ultrathin MI-based low-power spintronics. △ Less

Submitted 29 January, 2018; v1 submitted 24 August, 2017; originally announced August 2017.

Dzyaloshinskii Moriya interaction across antiferromagnet / ferromagnet interface

Authors: Xin Ma, Guoqiang Yu, Seyed A. Razavi, Stephen S. Sasaki, Xiang Li, Kai Hao, Sarah H. Tolbert, Kang L. Wang, Xiaoqin Li

Abstract: The antiferromagnet (AFM) / ferromagnet (FM) interfaces are of central importance in recently developed pure electric or ultrafast control of FM spins, where the underlying mechanisms remain unresolved. Here we report the direct observation of Dzyaloshinskii Moriya interaction (DMI) across the AFM/FM interface of IrMn/CoFeB thin films. The interfacial DMI is quantitatively measured from the asymme… ▽ More The antiferromagnet (AFM) / ferromagnet (FM) interfaces are of central importance in recently developed pure electric or ultrafast control of FM spins, where the underlying mechanisms remain unresolved. Here we report the direct observation of Dzyaloshinskii Moriya interaction (DMI) across the AFM/FM interface of IrMn/CoFeB thin films. The interfacial DMI is quantitatively measured from the asymmetric spin wave dispersion in the FM layer using Brillouin light scattering. The DMI strength is enhanced by a factor of 7 with increasing IrMn layer thickness in the range of 1- 7.5 nm. Our findings provide deeper insight into the coupling at AFM/FM interface and may stimulate new device concepts utilizing chiral spin textures such as magnetic skyrmions in AFM/FM heterostructures. △ Less

Submitted 1 June, 2017; originally announced June 2017.

Journal ref: Phys. Rev. Lett. 119, 027202 (2017)

K-Means Fingerprint Clustering for Low-Complexity Floor Estimation in Indoor Mobile Localization

Authors: Alireza Razavi, Mikko Valkama, Elena-Simona Lohan

Abstract: Indoor localization in multi-floor buildings is an important research problem. Finding the correct floor, in a fast and efficient manner, in a shopping mall or an unknown university building can save the users' search time and can enable a myriad of Location Based Services in the future. One of the most widely spread techniques for floor estimation in multi-floor buildings is the fingerprinting-ba… ▽ More Indoor localization in multi-floor buildings is an important research problem. Finding the correct floor, in a fast and efficient manner, in a shopping mall or an unknown university building can save the users' search time and can enable a myriad of Location Based Services in the future. One of the most widely spread techniques for floor estimation in multi-floor buildings is the fingerprinting-based localization using Received Signal Strength (RSS) measurements coming from indoor networks, such as WLAN and BLE. The clear advantage of RSS-based floor estimation is its ease of implementation on a multitude of mobile devices at the Application Programming Interface (API) level, because RSS values are directly accessible through API interface. However, the downside of a fingerprinting approach, especially for large-scale floor estimation and positioning solutions, is their need to store and transmit a huge amount of fingerprinting data. The problem becomes more severe when the localization is intended to be done on mobile devices which have limited memory, power, and computational resources. An alternative floor estimation method, which has lower complexity and is faster than the fingerprinting is the Weighted Centroid Localization (WCL) method. The trade-off is however paid in terms of a lower accuracy than the one obtained with traditional fingerprinting with Nearest Neighbour (NN) estimates. In this paper a novel K-means-based method for floor estimation via fingerprint clustering of WiFi and various other positioning sensor outputs is introduced. Our method achieves a floor estimation accuracy close to the one with NN fingerprinting, while significantly improves the complexity and the speed of the floor detection algorithm. The decrease in the database size is achieved through storing and transmitting only the cluster heads (CH's) and their corresponding floor labels. △ Less

Submitted 24 September, 2015; v1 submitted 4 September, 2015; originally announced September 2015.

Comments: Accepted to IEEE Globecom 2015, Workshop on Localization and Tracking: Indoors, Outdoors and Emerging Networks

Compressive Detection of Random Subspace Signals

Authors: Alireza Razavi, Mikko Valkama, Danijela Cabric

Abstract: The problem of compressive detection of random subspace signals is studied. We consider signals modeled as $\mathbf{s} = \mathbf{H} \mathbf{x}$ where $\mathbf{H}$ is an $N \times K$ matrix with $K \le N$ and $\mathbf{x} \sim \mathcal{N}(\mathbf{0}_{K,1},σ_x^2 \mathbf{I}_K)$. We say that signal $\mathbf{s}$ lies in or leans toward a subspace if the largest eigenvalue of $\mathbf{H} \mathbf{H}^T$ is… ▽ More The problem of compressive detection of random subspace signals is studied. We consider signals modeled as $\mathbf{s} = \mathbf{H} \mathbf{x}$ where $\mathbf{H}$ is an $N \times K$ matrix with $K \le N$ and $\mathbf{x} \sim \mathcal{N}(\mathbf{0}_{K,1},σ_x^2 \mathbf{I}_K)$. We say that signal $\mathbf{s}$ lies in or leans toward a subspace if the largest eigenvalue of $\mathbf{H} \mathbf{H}^T$ is strictly greater than its smallest eigenvalue. We first design a measurement matrix $\mathbfΦ=[\mathbfΦ_s^T,\mathbfΦ_o^T]^T$ comprising of two sub-matrices $\mathbfΦ_s$ and $\mathbfΦ_o$ where $\mathbfΦ_s$ projects the signals to the strongest left-singular vectors, i.e., the left-singular vectors corresponding to the largest singular values, of subspace matrix $\mathbf{H}$ and $\mathbfΦ_o$ projects it to the weakest left-singular vectors. We then propose two detectors which work based on the difference in energies of the samples measured by two sub-matrices $\mathbfΦ_s$ and $\mathbfΦ_o$ and prove their optimality. Simplified versions of the proposed detectors for the case when the variance of noise is known are also provided. Furthermore, we study the performance of the detector when measurements are imprecise and show how imprecision can be compensated by employing more measurement devices. The problem is then re-formulated for the case when the signal lies in the union of a finite number of linear subspaces instead of a single linear subspace. Finally, we study the performance of the proposed methods by simulation examples. △ Less

Submitted 30 December, 2015; v1 submitted 10 July, 2015; originally announced July 2015.

Comments: 33 pages, 11 figures, Revised version

Compressive Identification of Active OFDM Subcarriers in Presence of Timing Offset

Authors: Alireza Razavi, Mikko Valkama, Danijela Cabric

Abstract: In this paper we study the problem of identifying active subcarriers in an OFDM signal from compressive measurements sampled at sub-Nyquist rate. The problem is of importance in Cognitive Radio systems when secondary users (SUs) are looking for available spectrum opportunities to communicate over them while sensing at Nyquist rate sampling can be costly or even impractical in case of very wide ban… ▽ More In this paper we study the problem of identifying active subcarriers in an OFDM signal from compressive measurements sampled at sub-Nyquist rate. The problem is of importance in Cognitive Radio systems when secondary users (SUs) are looking for available spectrum opportunities to communicate over them while sensing at Nyquist rate sampling can be costly or even impractical in case of very wide bandwidth. We first study the effect of timing offset and derive the necessary and sufficient conditions for signal recovery in the oracle-assisted case when the true active sub-carriers are assumed known. Then we propose an Orthogonal Matching Pursuit (OMP)-based joint sparse recovery method for identifying active subcarriers when the timing offset is known. Finally we extend the problem to the case of unknown timing offset and develop a joint dictionary learning and sparse approximation algorithm, where in the dictionary learning phase the timing offset is estimated and in the sparse approximation phase active subcarriers are identified. The obtained results demonstrate that active subcarrier identification can be carried out reliably, by using the developed framework. △ Less

Submitted 9 July, 2015; originally announced July 2015.

Comments: To appear in the proceedings of the IEEE Global Communications Conference (GLOBECOM) 2015

Covariance-Based OFDM Spectrum Sensing with Sub-Nyquist Samples

Authors: Alireza Razavi, Mikko Valkama, Danijela Cabric

Abstract: In this paper, we propose a feature-based method for spectrum sensing of OFDM signals from sub-Nyquist samples over a single band. We exploit the structure of the covariance matrix of OFDM signals to convert an underdetermined set of covariance-based equations to an overdetermined one. The statistical properties of sample covariance matrix are analyzed and then based on that an approximate General… ▽ More In this paper, we propose a feature-based method for spectrum sensing of OFDM signals from sub-Nyquist samples over a single band. We exploit the structure of the covariance matrix of OFDM signals to convert an underdetermined set of covariance-based equations to an overdetermined one. The statistical properties of sample covariance matrix are analyzed and then based on that an approximate Generalized Likelihood Ratio Test (GLRT) for detection of OFDM signals from sub-Nyquist samples is derived. The method is also extended to the frequency-selective channels. △ Less

Submitted 10 January, 2015; originally announced January 2015.

Comments: 30 pages, 5 figures

Journal ref: Signal Processing, Volume 109, April 2015, Pages 261-268

On Distance Function among Finite Set of Points

Authors: Hajar Ghahremani Gol, Asadollah Razavi, Farzad Didehva

Abstract: In practical purposes for some geometrical problems in computer science we have as information the coordinates of some finite points in surface instead of the whole body of a surface. The problem arised here is: "How to define a distance function in a finite space?" as we will show the appropriate function for this purpose is not a metric function. Here we try to define this distance function in o… ▽ More In practical purposes for some geometrical problems in computer science we have as information the coordinates of some finite points in surface instead of the whole body of a surface. The problem arised here is: "How to define a distance function in a finite space?" as we will show the appropriate function for this purpose is not a metric function. Here we try to define this distance function in order to apply it in further proposes, specially in the field setting of transportation theory and vehicle routing problem. More precisely in this paper we consider VRP problem for two dimensional manifolds in R3. △ Less

Submitted 28 March, 2012; originally announced March 2012.

MSC Class: 97PXX

Product and anti-Hermitian structures on the tangent space

Authors: E. Peyghan, A. Razavi, A. Heydari

Abstract: Noting that the complete lift of a Rimannian metric defined on a differentiable manifold is not 0-homogeneous on the fibers of the tangent bundle . In this paper we introduce a new lift which is 0-homogeneous. It determines on slit tangent bundle a pseudo-Riemannian metric, which depends only on the metric . We study some of the geometrical properties of this pseudo-Riemannian space and define t… ▽ More Noting that the complete lift of a Rimannian metric defined on a differentiable manifold is not 0-homogeneous on the fibers of the tangent bundle . In this paper we introduce a new lift which is 0-homogeneous. It determines on slit tangent bundle a pseudo-Riemannian metric, which depends only on the metric . We study some of the geometrical properties of this pseudo-Riemannian space and define the natural almost complex structure and natural almost product structure which preserve the property of homogeneity and find some new results. △ Less

Submitted 20 October, 2007; originally announced October 2007.

A symmetric Finsler space with Chern connection

Authors: Dariush Latifi, Asadollah Razavi

Abstract: We define a symmetry for a Finsler space with Chern connection and investigate its implementation and properties and find a relation between them and flag curvature. We define a symmetry for a Finsler space with Chern connection and investigate its implementation and properties and find a relation between them and flag curvature. △ Less

Submitted 24 June, 2007; originally announced June 2007.

MSC Class: 53C60; 53C35