-
A Simulated Experiment to Explore Robotic Dialogue Strategies for People with Dementia
Authors:
Fengpei Yuan,
Amir Sadovnik,
Ran Zhang,
Devin Casenhiser,
Eun Jin Paek,
Si On Yoon,
Xiaopeng Zhao
Abstract:
People with Alzheimer's disease and related dementias (ADRD) often show the problem of repetitive questioning, which brings a great burden on persons with ADRD (PwDs) and their caregivers. Conversational robots hold promise of coping with this problem and hence alleviating the burdens on caregivers. In this paper, we proposed a partially observable markov decision process (POMDP) model for the PwD…
▽ More
People with Alzheimer's disease and related dementias (ADRD) often show the problem of repetitive questioning, which brings a great burden on persons with ADRD (PwDs) and their caregivers. Conversational robots hold promise of coping with this problem and hence alleviating the burdens on caregivers. In this paper, we proposed a partially observable markov decision process (POMDP) model for the PwD-robot interaction in the context of repetitive questioning, and used Q-learning to learn an adaptive conversation strategy (i.e., rate of follow-up question and difficulty of follow-up question) towards PwDs with different cognitive capabilities and different engagement levels. The results indicated that Q-learning was helpful for action selection for the robot. This may be a useful step towards the application of conversational social robots to cope with repetitive questioning in PwDs.
△ Less
Submitted 18 April, 2021;
originally announced April 2021.
-
Chip Placement with Deep Reinforcement Learning
Authors:
Azalia Mirhoseini,
Anna Goldie,
Mustafa Yazgan,
Joe Jiang,
Ebrahim Songhori,
Shen Wang,
Young-Joon Lee,
Eric Johnson,
Omkar Pathak,
Sungmin Bae,
Azade Nazi,
Jiwoo Pak,
Andy Tong,
Kavya Srinivasa,
William Hang,
Emre Tuncer,
Anand Babu,
Quoc V. Le,
James Laudon,
Richard Ho,
Roger Carpenter,
Jeff Dean
Abstract:
In this work, we present a learning-based approach to chip placement, one of the most complex and time-consuming stages of the chip design process. Unlike prior methods, our approach has the ability to learn from past experience and improve over time. In particular, as we train over a greater number of chip blocks, our method becomes better at rapidly generating optimized placements for previously…
▽ More
In this work, we present a learning-based approach to chip placement, one of the most complex and time-consuming stages of the chip design process. Unlike prior methods, our approach has the ability to learn from past experience and improve over time. In particular, as we train over a greater number of chip blocks, our method becomes better at rapidly generating optimized placements for previously unseen chip blocks. To achieve these results, we pose placement as a Reinforcement Learning (RL) problem and train an agent to place the nodes of a chip netlist onto a chip canvas. To enable our RL policy to generalize to unseen blocks, we ground representation learning in the supervised task of predicting placement quality. By designing a neural architecture that can accurately predict reward across a wide variety of netlists and their placements, we are able to generate rich feature embeddings of the input netlists. We then use this architecture as the encoder of our policy and value networks to enable transfer learning. Our objective is to minimize PPA (power, performance, and area), and we show that, in under 6 hours, our method can generate placements that are superhuman or comparable on modern accelerator netlists, whereas existing baselines require human experts in the loop and take several weeks.
△ Less
Submitted 22 April, 2020;
originally announced April 2020.
-
A Novel Fuzzy Approximate Reasoning Method Based on Extended Distance Measure in SISO Fuzzy System
Authors:
I. M. Son,
S. I. Kwak,
U. J. Han,
J. H. Pak,
M. Han,
J. R. Pyon,
U. S. Ryu
Abstract:
This paper presents an original method of fuzzy approximate reasoning that can open a new direction of research in the uncertainty inference of Artificial Intelligence(AI) and Computational Intelligence(CI). Fuzzy modus ponens (FMP) and fuzzy modus tollens(FMT) are two fundamental and basic models of general fuzzy approximate reasoning in various fuzzy systems. And the reductive property is one of…
▽ More
This paper presents an original method of fuzzy approximate reasoning that can open a new direction of research in the uncertainty inference of Artificial Intelligence(AI) and Computational Intelligence(CI). Fuzzy modus ponens (FMP) and fuzzy modus tollens(FMT) are two fundamental and basic models of general fuzzy approximate reasoning in various fuzzy systems. And the reductive property is one of the essential and important properties in the approximate reasoning theory and it is a lot of applications. This paper suggests a kind of extended distance measure (EDM) based approximate reasoning method in the single input single output(SISO) fuzzy system with discrete fuzzy set vectors of different dimensions. The EDM based fuzzy approximate reasoning method is consists of two part, i.e., FMP-EDM and FMT-EDM. The distance measure based fuzzy reasoning method that the dimension of the antecedent discrete fuzzy set is equal to one of the consequent discrete fuzzy set has already solved in other paper. In this paper discrete fuzzy set vectors of different dimensions mean that the dimension of the antecedent discrete fuzzy set differs from one of the consequent discrete fuzzy set in the SISO fuzzy system. That is, this paper is based on EDM. The experimental results highlight that the proposed approximate reasoning method is comparatively clear and effective with respect to the reductive property, and in accordance with human thinking than existing fuzzy reasoning methods.
△ Less
Submitted 26 March, 2020;
originally announced March 2020.
-
TanksWorld: A Multi-Agent Environment for AI Safety Research
Authors:
Corban G. Rivera,
Olivia Lyons,
Arielle Summitt,
Ayman Fatima,
Ji Pak,
William Shao,
Robert Chalmers,
Aryeh Englander,
Edward W. Staley,
I-Jeng Wang,
Ashley J. Llorens
Abstract:
The ability to create artificial intelligence (AI) capable of performing complex tasks is rapidly outpacing our ability to ensure the safe and assured operation of AI-enabled systems. Fortunately, a landscape of AI safety research is emerging in response to this asymmetry and yet there is a long way to go. In particular, recent simulation environments created to illustrate AI safety risks are rela…
▽ More
The ability to create artificial intelligence (AI) capable of performing complex tasks is rapidly outpacing our ability to ensure the safe and assured operation of AI-enabled systems. Fortunately, a landscape of AI safety research is emerging in response to this asymmetry and yet there is a long way to go. In particular, recent simulation environments created to illustrate AI safety risks are relatively simple or narrowly-focused on a particular issue. Hence, we see a critical need for AI safety research environments that abstract essential aspects of complex real-world applications. In this work, we introduce the AI safety TanksWorld as an environment for AI safety research with three essential aspects: competing performance objectives, human-machine teaming, and multi-agent competition. The AI safety TanksWorld aims to accelerate the advancement of safe multi-agent decision-making algorithms by providing a software framework to support competitions with both system performance and safety objectives. As a work in progress, this paper introduces our research objectives and learning environment with reference code and baseline performance metrics to follow in a future work.
△ Less
Submitted 25 February, 2020;
originally announced February 2020.
-
Compact 3 DOF Driving Simulator using Immersive Virtual Reality
Authors:
Jungsu Pak,
Uri Maoz
Abstract:
A driving simulator was created using commercially available 3 degree of freedom motion platform (DOFreality H3) and a virtual reality head-mounted display (Oculus CV1). Using virtual reality headset as the visual simulation system with low-cost moving base platform allowed us to create a high-fidelity driving simulator with minimal cost and space. A custom motion cueing algorithm was used to mini…
▽ More
A driving simulator was created using commercially available 3 degree of freedom motion platform (DOFreality H3) and a virtual reality head-mounted display (Oculus CV1). Using virtual reality headset as the visual simulation system with low-cost moving base platform allowed us to create a high-fidelity driving simulator with minimal cost and space. A custom motion cueing algorithm was used to minimize visuo-vestibular conflict, and simulator sickness questionnaire (SSQ) was used to measure progression of simulator sickness over time while driving on a highway environment.
△ Less
Submitted 12 September, 2019;
originally announced September 2019.
-
Protection and Deception: Discovering Game Theory and Cyber Literacy through a Novel Board Game Experience
Authors:
Saboor Zahir,
John Pak,
Jatinder Singh,
Jeffrey Pawlick,
Quanyan Zhu
Abstract:
Cyber literacy merits serious research attention because it addresses a confluence of specialization and generalization; cybersecurity is often conceived of as approachable only by a technological intelligentsia, yet its interdependent nature demands education for a broad population. Therefore, educational tools should lead participants to discover technical knowledge in an accessible and attracti…
▽ More
Cyber literacy merits serious research attention because it addresses a confluence of specialization and generalization; cybersecurity is often conceived of as approachable only by a technological intelligentsia, yet its interdependent nature demands education for a broad population. Therefore, educational tools should lead participants to discover technical knowledge in an accessible and attractive framework. In this paper, we present Protection and Deception (P&G), a novel two-player board game. P&G has three main contributions. First, it builds cyber literacy by giving participants "hands-on" experience with game pieces that have the capabilities of cyber-attacks such as worms, masquerading attacks/spoofs, replay attacks, and Trojans. Second, P&G teaches the important game-theoretic concepts of asymmetric information and resource allocation implicitly and non-obtrusively through its game play. Finally, it strives for the important objective of security education for underrepresented minorities and people without explicit technical experience. We tested P&G at a community center in Manhattan with middle- and high school students, and observed enjoyment and increased cyber literacy along with suggestions for improvement of the game. Together with these results, our paper also presents images of the attractive board design and 3D printed game pieces, together with a Monte-Carlo analysis that we used to ensure a balanced gaming experience.
△ Less
Submitted 20 May, 2015;
originally announced May 2015.
-
Code Optimization on Kepler GPUs and Xeon Phi
Authors:
Yong-Chull Jang,
Hwancheol Jeong,
Jangho Kim,
Weonjong Lee,
Jeonghwan Pak,
Yuree Chung
Abstract:
Kepler GTX Titan Black and Kepler Tesla K40 are still the best GPUs for high performance computing, although Maxwell GPUs such as GTX 980 are available in the market. Hence, we measure the performance of our lattice QCD codes using the Kepler GPUs. We also upgrade our code to use the latest CPS (Columbia Physics System) library along with the most recent QUDA (QCD CUDA) library for lattice QCD. Th…
▽ More
Kepler GTX Titan Black and Kepler Tesla K40 are still the best GPUs for high performance computing, although Maxwell GPUs such as GTX 980 are available in the market. Hence, we measure the performance of our lattice QCD codes using the Kepler GPUs. We also upgrade our code to use the latest CPS (Columbia Physics System) library along with the most recent QUDA (QCD CUDA) library for lattice QCD. These new libraries improve the performance of our conjugate gradient (CG) inverter so that it runs twice faster than before. We also investigate the performance of Xeon Phi 7120P coprocessor. It has similar computing power with the Kepler GPUs in principle. However, its performance for our CG code is significantly inferior to that of the GTX Titan Black GPUs at present.
△ Less
Submitted 9 November, 2014;
originally announced November 2014.
-
Performance of Kepler GTX Titan GPUs and Xeon Phi System
Authors:
Hwancheol Jeong,
Weonjong Lee,
Jeonghwan Pak,
Kwang-jong Choi,
Sang-Hyun Park,
Jun-sik Yoo,
Joo Hwan Kim,
Joungjin Lee,
Young Woo Lee
Abstract:
NVIDIA's new architecture, Kepler improves GPU's performance significantly with the new streaming multiprocessor SMX. Along with the performance, NVIDIA has also introduced many new technologies such as direct parallelism, hyper-Q and GPU Direct with RDMA. Apart from other usual GPUs, NVIDIA also released another Kepler 'GeForce' GPU named GTX Titan. GeForce GTX Titan is not only good for gaming b…
▽ More
NVIDIA's new architecture, Kepler improves GPU's performance significantly with the new streaming multiprocessor SMX. Along with the performance, NVIDIA has also introduced many new technologies such as direct parallelism, hyper-Q and GPU Direct with RDMA. Apart from other usual GPUs, NVIDIA also released another Kepler 'GeForce' GPU named GTX Titan. GeForce GTX Titan is not only good for gaming but also good for high performance computing with CUDA. Nevertheless, it is remarkably cheaper than Kepler Tesla GPUs. We investigate the performance of GTX Titan and find out how to optimize a CUDA code appropriately for it. Meanwhile, Intel has launched its new many integrated core (MIC) system, Xeon Phi. A Xeon Phi coprocessor could provide similar performance with NVIDIA Kepler GPUs theoretically but, in reality, it turns out that its performance is significantly inferior to GTX Titan.
△ Less
Submitted 4 November, 2013;
originally announced November 2013.
