Zum Hauptinhalt springen

Showing 1–31 of 31 results for author: Mehrabian, A

Searching in archive cs. Search in all archives.
.
  1. arXiv:2405.10725  [pdf, other

    cs.CL cs.IR

    INDUS: Effective and Efficient Language Models for Scientific Applications

    Authors: Bishwaranjan Bhattacharjee, Aashka Trivedi, Masayasu Muraoka, Muthukumaran Ramasubramanian, Takuma Udagawa, Iksha Gurung, Rong Zhang, Bharath Dandala, Rahul Ramachandran, Manil Maskey, Kaylin Bugbee, Mike Little, Elizabeth Fancher, Lauren Sanders, Sylvain Costes, Sergi Blanco-Cuaresma, Kelly Lockhart, Thomas Allen, Felix Grezes, Megan Ansdell, Alberto Accomazzi, Yousef El-Kurdi, Davis Wertheimer, Birgit Pfitzmann, Cesar Berrospi Ramis , et al. (9 additional authors not shown)

    Abstract: Large language models (LLMs) trained on general domain corpora showed remarkable results on natural language processing (NLP) tasks. However, previous research demonstrated LLMs trained using domain-focused corpora perform better on specialized tasks. Inspired by this pivotal insight, we developed INDUS, a comprehensive suite of LLMs tailored for the Earth science, biology, physics, heliophysics,… ▽ More

    Submitted 20 May, 2024; v1 submitted 17 May, 2024; originally announced May 2024.

  2. RL-Based Hyperparameter Selection for Spectrum Sensing With CNNs

    Authors: Amir Mehrabian, Maryam Sabbaghian, Halim Yanikomeroglu

    Abstract: Selection of hyperparameters in deep neural networks is a challenging problem due to the wide search space and emergence of various layers with specific hyperparameters. There exists an absence of consideration for the neural architecture selection of convolutional neural networks (CNNs) for spectrum sensing. Here, we develop a method using reinforcement learning and Q-learning to systematically s… ▽ More

    Submitted 29 January, 2024; originally announced January 2024.

    Journal ref: IEEE Transactions on Communications, Jan. 2024

  3. arXiv:2312.10027  [pdf, other

    cs.NI eess.SY

    Energy Sustainability in Dense Radio Access Networks via High Altitude Platform Stations

    Authors: Maryam Salamatmoghadasi, Amir Mehrabian, Halim Yanikomeroglu

    Abstract: The growing demand for radio access networks (RANs) driven by advanced wireless technology and the everincreasing mobile traffic, faces significant energy consumption challenges that threaten sustainability. To address this, an architecture referring to the vertical heterogeneous network (vHetNet) has recently been proposed. Our study seeks to enhance network operations in terms of energy efficien… ▽ More

    Submitted 15 December, 2023; originally announced December 2023.

  4. arXiv:2311.03583  [pdf, other

    cs.AI cs.DM cs.LG

    Finding Increasingly Large Extremal Graphs with AlphaZero and Tabu Search

    Authors: Abbas Mehrabian, Ankit Anand, Hyunjik Kim, Nicolas Sonnerat, Matej Balog, Gheorghe Comanici, Tudor Berariu, Andrew Lee, Anian Ruoss, Anna Bulanova, Daniel Toyama, Sam Blackwell, Bernardino Romera Paredes, Petar Veličković, Laurent Orseau, Joonkyung Lee, Anurag Murty Naredla, Doina Precup, Adam Zsolt Wagner

    Abstract: This work studies a central extremal graph theory problem inspired by a 1975 conjecture of Erdős, which aims to find graphs with a given size (number of nodes) that maximize the number of edges without having 3- or 4-cycles. We formulate this problem as a sequential decision-making problem and compare AlphaZero, a neural network-guided tree search, with tabu search, a heuristic local search method… ▽ More

    Submitted 29 July, 2024; v1 submitted 6 November, 2023; originally announced November 2023.

    Comments: To appear in the proceedings of IJCAI 2024. First three authors contributed equally, last two authors made equal senior contribution

  5. arXiv:2006.08533  [pdf, other

    cs.ET eess.SP

    A Design Methodology for Post-Moore's Law Accelerators: The Case of a Photonic Neuromorphic Processor

    Authors: Armin Mehrabian, Volker J. Sorger, Tarek El-Ghazawi

    Abstract: Over the past decade alternative technologies have gained momentum as conventional digital electronics continue to approach their limitations, due to the end of Moore's Law and Dennard Scaling. At the same time, we are facing new application challenges such as those due to the enormous increase in data. The attention, has therefore, shifted from homogeneous computing to specialized heterogeneous s… ▽ More

    Submitted 15 June, 2020; originally announced June 2020.

    Comments: 4 pages, 4 figures

    ACM Class: C.1.4; C.1.m; C.3; D.2.2; I.2; I.2.11; I.2.m; J.6

  6. arXiv:1910.04959  [pdf, ps, other

    cs.DS cs.LG

    Regret Bounds for Batched Bandits

    Authors: Hossein Esfandiari, Amin Karbasi, Abbas Mehrabian, Vahab Mirrokni

    Abstract: We present simple and efficient algorithms for the batched stochastic multi-armed bandit and batched stochastic linear bandit problems. We prove bounds for their expected regrets that improve over the best-known regret bounds for any number of batches. In particular, our algorithms in both settings achieve the optimal expected regrets by using only a logarithmic number of batches. We also study th… ▽ More

    Submitted 18 February, 2020; v1 submitted 10 October, 2019; originally announced October 2019.

  7. arXiv:1910.04928  [pdf, other

    cs.LG stat.ML

    Old Dog Learns New Tricks: Randomized UCB for Bandit Problems

    Authors: Sharan Vaswani, Abbas Mehrabian, Audrey Durand, Branislav Kveton

    Abstract: We propose $\tt RandUCB$, a bandit strategy that builds on theoretically derived confidence intervals similar to upper confidence bound (UCB) algorithms, but akin to Thompson sampling (TS), it uses randomization to trade off exploration and exploitation. In the $K$-armed bandit setting, we show that there are infinitely many variants of $\tt RandUCB$, all of which achieve the minimax-optimal… ▽ More

    Submitted 22 March, 2020; v1 submitted 10 October, 2019; originally announced October 2019.

    Comments: AISTATS 2020

  8. arXiv:1906.10487  [pdf, other

    cs.ET cs.DC cs.LG eess.SP

    A Winograd-based Integrated Photonics Accelerator for Convolutional Neural Networks

    Authors: Armin Mehrabian, Mario Miscuglio, Yousra Alkabani, Volker J. Sorger, Tarek El-Ghazawi

    Abstract: Neural Networks (NNs) have become the mainstream technology in the artificial intelligence (AI) renaissance over the past decade. Among different types of neural networks, convolutional neural networks (CNNs) have been widely adopted as they have achieved leading results in many fields such as computer vision and speech recognition. This success in part is due to the widespread availability of cap… ▽ More

    Submitted 4 December, 2019; v1 submitted 25 June, 2019; originally announced June 2019.

    Comments: 12 pages, photonics, artificial intelligence, convolutional neural networks, Winograd

    MSC Class: B.0; B.7; C.1; C.1.2; C.1.4; C.3; C.5; I.2; I.2.5; I.2.10; I.2.11; I.4; I.5; I.5.2; I.5.4; I.5.5; I.6; I.6.3 ACM Class: B.0; B.7; C.1; C.1.2; C.1.4; C.3; C.5; I.2; I.2.5; I.2.10; I.2.11; I.4; I.5; I.5.2; I.5.4; I.5.5; I.6; I.6.3

  9. arXiv:1902.01239  [pdf, other

    stat.ML cs.LG

    A Practical Algorithm for Multiplayer Bandits when Arm Means Vary Among Players

    Authors: Etienne Boursier, Emilie Kaufmann, Abbas Mehrabian, Vianney Perchet

    Abstract: We study a multiplayer stochastic multi-armed bandit problem in which players cannot communicate, and if two or more players pull the same arm, a collision occurs and the involved players receive zero reward. We consider the challenging heterogeneous setting, in which different arms may have different means for different players, and propose a new and efficient algorithm that combines the idea of… ▽ More

    Submitted 20 March, 2020; v1 submitted 4 February, 2019; originally announced February 2019.

    Comments: AISTATS2020

  10. arXiv:1808.08416  [pdf, ps, other

    cs.LG cs.GT stat.ML

    Multiplayer bandits without observing collision information

    Authors: Gabor Lugosi, Abbas Mehrabian

    Abstract: We study multiplayer stochastic multi-armed bandit problems in which the players cannot communicate and if two or more players pull the same arm, a collision occurs and the involved players receive zero reward. We consider two feedback models: a model in which the players can observe whether a collision has occurred and a more difficult setup when no collision information is available. We give the… ▽ More

    Submitted 4 April, 2021; v1 submitted 25 August, 2018; originally announced August 2018.

    Comments: To appear in Mathematics of Operations Research. 34 pages

    MSC Class: 68Q32

  11. arXiv:1807.08792  [pdf, other

    cs.ET cs.LG eess.SP

    PCNNA: A Photonic Convolutional Neural Network Accelerator

    Authors: Armin Mehrabian, Yousra Al-Kabani, Volker J Sorger, Tarek El-Ghazawi

    Abstract: Convolutional Neural Networks (CNN) have been the centerpiece of many applications including but not limited to computer vision, speech processing, and Natural Language Processing (NLP). However, the computationally expensive convolution operations impose many challenges to the performance and scalability of CNNs. In parallel, photonic systems, which are traditionally employed for data communicati… ▽ More

    Submitted 23 July, 2018; originally announced July 2018.

    Comments: 5 Pages, 6 Figures, IEEE SOCC 2018

  12. arXiv:1806.06887  [pdf, ps, other

    math.ST cs.LG

    The Minimax Learning Rates of Normal and Ising Undirected Graphical Models

    Authors: Luc Devroye, Abbas Mehrabian, Tommy Reddad

    Abstract: Let $G$ be an undirected graph with $m$ edges and $d$ vertices. We show that $d$-dimensional Ising models on $G$ can be learned from $n$ i.i.d. samples within expected total variation distance some constant factor of $\min\{1, \sqrt{(m + d)/n}\}$, and that this rate is optimal. We show that the same rate holds for the class of $d$-dimensional multivariate normal undirected graphical models with re… ▽ More

    Submitted 3 June, 2020; v1 submitted 18 June, 2018; originally announced June 2018.

    Comments: Accepted in the Electronic Journal of Statistics; 24 pages

    MSC Class: 62G07; 82B20

  13. arXiv:1801.04003  [pdf, ps, other

    math.ST cs.LG

    Some techniques in density estimation

    Authors: Hassan Ashtiani, Abbas Mehrabian

    Abstract: Density estimation is an interdisciplinary topic at the intersection of statistics, theoretical computer science and machine learning. We review some old and new techniques for bounding the sample complexity of estimating densities of continuous distributions, focusing on the class of mixtures of Gaussians and its subclasses. In particular, we review the main techniques used to prove the new sampl… ▽ More

    Submitted 22 February, 2018; v1 submitted 11 January, 2018; originally announced January 2018.

    Comments: 18 pages; new version includes tight results on mixtures of general Gaussians

  14. arXiv:1710.05209  [pdf, ps, other

    cs.LG math.ST

    Near-optimal Sample Complexity Bounds for Robust Learning of Gaussians Mixtures via Compression Schemes

    Authors: Hassan Ashtiani, Shai Ben-David, Nick Harvey, Christopher Liaw, Abbas Mehrabian, Yaniv Plan

    Abstract: We prove that $\tildeΘ(k d^2 / \varepsilon^2)$ samples are necessary and sufficient for learning a mixture of $k$ Gaussians in $\mathbb{R}^d$, up to error $\varepsilon$ in total variation distance. This improves both the known upper bounds and lower bounds for this problem. For mixtures of axis-aligned Gaussians, we show that $\tilde{O}(k d / \varepsilon^2)$ samples suffice, matching a known lower… ▽ More

    Submitted 21 July, 2020; v1 submitted 14 October, 2017; originally announced October 2017.

    Comments: To appear in Journal of the ACM. 46 pages. An extended abstract appeared in NeurIPS 2018. This version contains all the proofs, generalizes the results to agnostic learning, and improves the bounds by logarithmic factors

  15. arXiv:1708.06721  [pdf, other

    cs.OH

    D3NOC: Dynamic Data-Driven Network On Chip in Photonic Electronic Hybrids

    Authors: Armin Mehrabian, Shuai Sun, Vikram K. Narayana, Volker J. Sorger, Tarek El-Ghazawi

    Abstract: In this paper, we present a reconfigurable hybrid Photonic-Plasmonic Network-on-Chip (NoC) based on the Dynamic Data Driven Application System (DDDAS) paradigm. In DDDAS computations and measurements form a dynamic closed feedback loop in which they tune one another in response to changes in the environment. Our proposed system enables dynamic augmentation of a base electrical mesh topology with a… ▽ More

    Submitted 22 August, 2017; originally announced August 2017.

    Comments: 8 pages

  16. arXiv:1707.00083  [pdf, other

    math.PR cs.DM math.CO

    Notes on Growing a Tree in a Graph

    Authors: Luc Devroye, Vida Dujmović, Alan Frieze, Abbas Mehrabian, Pat Morin, Bruce Reed

    Abstract: We study the height of a spanning tree $T$ of a graph $G$ obtained by starting with a single vertex of $G$ and repeatedly selecting, uniformly at random, an edge of $G$ with exactly one endpoint in $T$ and adding this edge to $T$.

    Submitted 4 July, 2017; v1 submitted 30 June, 2017; originally announced July 2017.

    Comments: Updated grant acknowledgement

  17. arXiv:1706.09997  [pdf, other

    cs.DC math.PR

    Tight Load Balancing via Randomized Local Search

    Authors: Petra Berenbrink, Peter Kling, Christopher Liaw, Abbas Mehrabian

    Abstract: We consider the following balls-into-bins process with $n$ bins and $m$ balls: each ball is equipped with a mutually independent exponential clock of rate 1. Whenever a ball's clock rings, the ball samples a random bin and moves there if the number of balls in the sampled bin is smaller than in its current bin. This simple process models a typical load balancing problem where users (balls) seek a… ▽ More

    Submitted 29 June, 2017; originally announced June 2017.

    Comments: 24 pages, 3 figures, preliminary version appeared in proceedings of 2017 IEEE International Parallel and Distributed Processing Symposium (IPDPS'17)

  18. arXiv:1706.01596  [pdf, ps, other

    cs.LG

    Sample-Efficient Learning of Mixtures

    Authors: Hassan Ashtiani, Shai Ben-David, Abbas Mehrabian

    Abstract: We consider PAC learning of probability distributions (a.k.a. density estimation), where we are given an i.i.d. sample generated from an unknown target distribution, and want to output a distribution that is close to the target in total variation distance. Let $\mathcal F$ be an arbitrary class of probability distributions, and let $\mathcal{F}^k$ denote the class of $k$-mixtures of elements of… ▽ More

    Submitted 3 June, 2018; v1 submitted 5 June, 2017; originally announced June 2017.

    Comments: A bug from the previous version, which appeared in AAAI 2018 proceedings, is fixed. 18 pages

  19. arXiv:1704.00874  [pdf, ps, other

    math.PR cs.DC cs.SI

    The string of diamonds is nearly tight for rumour spreading

    Authors: Omer Angel, Abbas Mehrabian, Yuval Peres

    Abstract: For a rumour spreading protocol, the spread time is defined as the first time that everyone learns the rumour. We compare the synchronous push&pull rumour spreading protocol with its asynchronous variant, and show that for any $n$-vertex graph and any starting vertex, the ratio between their expected spread times is bounded by $O \left({n}^{1/3}{\log^{2/3} n}\right)$. This improves the… ▽ More

    Submitted 18 July, 2017; v1 submitted 4 April, 2017; originally announced April 2017.

    Comments: Will be presented at RANDOM'2017 conference. 14 pages, Theorem 2.5 added in this version

    ACM Class: C.2.1; G.2.2; G.3

    Journal ref: Combinator. Probab. Comp. 29 (2020) 190-199

  20. HyPPI NoC: Bringing Hybrid Plasmonics to an Opto-Electronic Network-on-Chip

    Authors: Vikram K. Narayana, Shuai Sun, Armin Mehrabian, Volker J. Sorger, Tarek El-Ghazawi

    Abstract: As we move towards an era of hundreds of cores, the research community has witnessed the emergence of opto-electronic network on-chip designs based on nanophotonics, in order to achieve higher network throughput, lower latencies, and lower dynamic power. However, traditional nanophotonics options face limitations such as large device footprints compared with electronics, higher static power due to… ▽ More

    Submitted 14 March, 2017; originally announced March 2017.

    Comments: 10 pages, 8 figures

    ACM Class: B.4.3; B.4.4; C.1.2

  21. arXiv:1703.02930  [pdf, other

    cs.LG

    Nearly-tight VC-dimension and pseudodimension bounds for piecewise linear neural networks

    Authors: Peter L. Bartlett, Nick Harvey, Chris Liaw, Abbas Mehrabian

    Abstract: We prove new upper and lower bounds on the VC-dimension of deep neural networks with the ReLU activation function. These bounds are tight for almost the entire range of parameters. Letting $W$ be the number of weights and $L$ be the number of layers, we prove that the VC-dimension is $O(W L \log(W))$, and provide examples with VC-dimension $Ω( W L \log(W/L) )$. This improves both the previously kn… ▽ More

    Submitted 15 October, 2017; v1 submitted 8 March, 2017; originally announced March 2017.

    Comments: Extended abstract appeared in COLT 2017; the upper bound was presented at the 2016 ACM Conference on Data Science. This version includes all the proofs and a refinement of the upper bound, Theorem 6. 16 pages, 2 figures

    Journal ref: Journal of Machine Learning Research 20 (2019) 1-17

  22. arXiv:1612.02486  [pdf

    cs.ET

    A Universal Multi-Hierarchy Figure-of-Merit for On-Chip Computing and Communications

    Authors: Shuai Sun, Vikram K. Narayana, Armin Mehrabian, Tarek El-Ghazawi, Volker J. Sorger

    Abstract: Continuing demands for increased compute efficiency and communication bandwidth have led to the development of novel interconnect technologies with the potential to outperform conventional electrical interconnects. With a plurality of interconnect technologies to include electronics, photonics, plasmonics, and hybrids thereof, the simple approach of counting on-chip devices to capture performance… ▽ More

    Submitted 7 December, 2016; originally announced December 2016.

    Comments: 10 pages

  23. arXiv:1608.01697  [pdf, other

    cs.SI math.CO

    Rumours spread slowly in a small world spatial network

    Authors: Jeannette Janssen, Abbas Mehrabian

    Abstract: Rumour spreading is a protocol for modelling the spread of information through a network via user-to-user interaction. The Spatial Preferred Attachment (SPA) model is a random graph model for complex networks: vertices are placed in a metric space, and the link probability depends on the metric distance between vertices, and on their degree. We show that the SPA model typically produces graphs tha… ▽ More

    Submitted 5 July, 2016; originally announced August 2016.

    Comments: 15 pages, preliminary version has appeared in WAW 2015

    MSC Class: 05C82; 05C80; 60D05; 90B15; 91D30

  24. arXiv:1603.00897  [pdf, ps, other

    math.PR cs.IT

    A simple tool for bounding the deviation of random matrices on geometric sets

    Authors: Christopher Liaw, Abbas Mehrabian, Yaniv Plan, Roman Vershynin

    Abstract: Let $A$ be an isotropic, sub-gaussian $m \times n$ matrix. We prove that the process $Z_x := \|Ax\|_2 - \sqrt m \|x\|_2$ has sub-gaussian increments. Using this, we show that for any bounded set $T \subseteq \mathbb{R}^n$, the deviation of $\|Ax\|_2$ around its mean is uniformly bounded by the Gaussian complexity of $T$. We also prove a local version of this theorem, which allows for unbounded set… ▽ More

    Submitted 7 June, 2016; v1 submitted 2 March, 2016; originally announced March 2016.

    Comments: 16 pages. Minor corrections

    MSC Class: 60B20 (primary); 60D05; 94A12

  25. arXiv:1411.0948  [pdf, ps, other

    cs.DC math.PR

    On the push&pull protocol for rumour spreading

    Authors: Huseyin Acan, Andrea Collevecchio, Abbas Mehrabian, Nick Wormald

    Abstract: The asynchronous push&pull protocol, a randomized distributed algorithm for spreading a rumour in a graph $G$, works as follows. Independent Poisson clocks of rate 1 are associated with the vertices of $G$. Initially, one vertex of $G$ knows the rumour. Whenever the clock of a vertex $x$ rings, it calls a random neighbour $y$: if $x$ knows the rumour and $y$ does not, then $x$ tells $y$ the rumour… ▽ More

    Submitted 15 September, 2015; v1 submitted 4 November, 2014; originally announced November 2014.

    Comments: 25 pages

  26. arXiv:1410.8175  [pdf, ps, other

    cs.SI math.CO

    Randomized Rumor Spreading in Poorly Connected Small-World Networks

    Authors: Abbas Mehrabian, Ali Pourmiri

    Abstract: Push-Pull is a well-studied round-robin rumor spreading protocol defined as follows: initially a node knows a rumor and wants to spread it to all nodes in a network quickly. In each round, every informed node sends the rumor to a random neighbor, and every uninformed node contacts a random neighbor and gets the rumor from her if she knows it. We analyze this protocol on random $k$-trees, a class o… ▽ More

    Submitted 29 October, 2014; originally announced October 2014.

    Comments: 28 pages, preliminary version appeared in DISC 2014

  27. arXiv:1410.6397  [pdf, ps, other

    cs.DM cs.SI math.CO

    Justifying the small-world phenomenon via random recursive trees

    Authors: Abbas Mehrabian

    Abstract: We present a new technique for proving logarithmic upper bounds for diameters of evolving random graph models, which is based on defining a coupling between random graphs and variants of random recursive trees. The advantage of the technique is three-fold: it is quite simple and provides short proofs, it is applicable to a broad variety of models including those incorporating preferential attachme… ▽ More

    Submitted 23 October, 2014; originally announced October 2014.

    Comments: 30 pages

  28. arXiv:1404.7189  [pdf, ps, other

    cs.DM math.PR

    It's a Small World for Random Surfers

    Authors: Abbas Mehrabian, Nick Wormald

    Abstract: We prove logarithmic upper bounds for the diameters of the random-surfer Webgraph model and the PageRank-based selection Webgraph model, confirming the small world phenomenon holds for them. In the special case when the generated graph is a tree, we provide close lower and upper bounds for the diameters of both models.

    Submitted 28 April, 2014; originally announced April 2014.

    Comments: 36 pages, 1 figure

  29. On the Stretch Factor of Randomly Embedded Random Graphs

    Authors: Abbas Mehrabian, Nick Wormald

    Abstract: We consider a random graph G(n,p) whose vertex set V has been randomly embedded in the unit square and whose edges are given weight equal to the geometric distance between their end vertices. Then each pair {u,v} of vertices have a distance in the weighted graph, and a Euclidean distance. The stretch factor of the embedded graph is defined as the maximum ratio of these two distances, over all u,v… ▽ More

    Submitted 28 May, 2012; originally announced May 2012.

    Comments: 12 pages

    Journal ref: Discrete & Computational Geometry: Volume 49, Issue 3 (2013), Page 647-658

  30. On a Bounded Budget Network Creation Game

    Authors: Shayan Ehsani, Saber Shokat Fadaee, MohammadAmin Fazli, Abbas Mehrabian, Sina Sadeghian Sadeghabad, MohammadAli Safari, Morteza Saghafian

    Abstract: We consider a network creation game in which each player (vertex) has a fixed budget to establish links to other players. In our model, each link has unit price and each agent tries to minimize its cost, which is either its local diameter or its total distance to other players in the (undirected) underlying graph of the created network. Two versions of the game are studied: in the MAX version, the… ▽ More

    Submitted 10 June, 2012; v1 submitted 2 November, 2011; originally announced November 2011.

    Comments: 28 pages, 3 figures, preliminary version appeared in SPAA'11

    ACM Class: F.2.2; G.2.2

    Journal ref: ACM Transactions on Algorithms (2015), 11(4), article 34

  31. arXiv:1008.4210  [pdf, ps, other

    math.CO cs.DM

    Cops and Robber Game with a Fast Robber on Interval, Chordal, and Planar Graphs

    Authors: Abbas Mehrabian

    Abstract: We consider a variant of the Cops and Robber game, introduced by Fomin, Golovach, Kratochvil, in which the robber has unbounded speed, i.e. can take any path from her vertex in her turn, but she is not allowed to pass through a vertex occupied by a cop. We study this game on interval graphs, chordal graphs, planar graphs, and hypercube graphs. Let c_{\infty}(G) denote the number of cops needed to… ▽ More

    Submitted 16 April, 2011; v1 submitted 25 August, 2010; originally announced August 2010.

    Comments: 23 pages