-
Simultaneous Detection of Multiple Change Points and Community Structures in Time Series of Networks
Authors:
Rex C. Y. Cheung,
Alexander Aue,
Seungyong Hwang,
Thomas C. M. Lee
Abstract:
In many complex systems, networks and graphs arise in a natural manner. Often, time evolving behavior can be easily found and modeled using time-series methodology. Amongst others, two common research problems in network analysis are community detection and change-point detection. Community detection aims at finding specific sub-structures within the networks, and change-point detection tries to f…
▽ More
In many complex systems, networks and graphs arise in a natural manner. Often, time evolving behavior can be easily found and modeled using time-series methodology. Amongst others, two common research problems in network analysis are community detection and change-point detection. Community detection aims at finding specific sub-structures within the networks, and change-point detection tries to find the time points at which sub-structures change. We propose a novel methodology to detect both community structures and change points simultaneously based on a model selection framework in which the Minimum Description Length Principle (MDL) is utilized as minimizing objective criterion. The promising practical performance of the proposed method is illustrated via a series of numerical experiments and real data analysis.
△ Less
Submitted 30 June, 2020; v1 submitted 29 November, 2018;
originally announced December 2018.
-
Marian: Cost-effective High-Quality Neural Machine Translation in C++
Authors:
Marcin Junczys-Dowmunt,
Kenneth Heafield,
Hieu Hoang,
Roman Grundkiewicz,
Anthony Aue
Abstract:
This paper describes the submissions of the "Marian" team to the WNMT 2018 shared task. We investigate combinations of teacher-student training, low-precision matrix products, auto-tuning and other methods to optimize the Transformer model on GPU and CPU. By further integrating these methods with the new averaging attention networks, a recently introduced faster Transformer variant, we create a nu…
▽ More
This paper describes the submissions of the "Marian" team to the WNMT 2018 shared task. We investigate combinations of teacher-student training, low-precision matrix products, auto-tuning and other methods to optimize the Transformer model on GPU and CPU. By further integrating these methods with the new averaging attention networks, a recently introduced faster Transformer variant, we create a number of high-quality, high-performance models on the GPU and CPU, dominating the Pareto frontier for this shared task.
△ Less
Submitted 30 May, 2018;
originally announced May 2018.
-
Achieving Human Parity on Automatic Chinese to English News Translation
Authors:
Hany Hassan,
Anthony Aue,
Chang Chen,
Vishal Chowdhary,
Jonathan Clark,
Christian Federmann,
Xuedong Huang,
Marcin Junczys-Dowmunt,
William Lewis,
Mu Li,
Shujie Liu,
Tie-Yan Liu,
Renqian Luo,
Arul Menezes,
Tao Qin,
Frank Seide,
Xu Tan,
Fei Tian,
Lijun Wu,
Shuangzhi Wu,
Yingce Xia,
Dongdong Zhang,
Zhirui Zhang,
Ming Zhou
Abstract:
Machine translation has made rapid advances in recent years. Millions of people are using it today in online translation systems and mobile applications in order to communicate across language barriers. The question naturally arises whether such systems can approach or achieve parity with human translations. In this paper, we first address the problem of how to define and accurately measure human…
▽ More
Machine translation has made rapid advances in recent years. Millions of people are using it today in online translation systems and mobile applications in order to communicate across language barriers. The question naturally arises whether such systems can approach or achieve parity with human translations. In this paper, we first address the problem of how to define and accurately measure human parity in translation. We then describe Microsoft's machine translation system and measure the quality of its translations on the widely used WMT 2017 news translation task from Chinese to English. We find that our latest neural machine translation system has reached a new state-of-the-art, and that the translation quality is at human parity when compared to professional human translations. We also find that it significantly exceeds the quality of crowd-sourced non-professional translations.
△ Less
Submitted 29 June, 2018; v1 submitted 14 March, 2018;
originally announced March 2018.
