Quality Does Matter: A Detailed Look at the Quality and Utility of Web-Mined Parallel Corpora
Authors:
Surangika Ranathunga,
Nisansa de Silva,
Menan Velayuthan,
Aloka Fernando,
Charitha Rathnayake
Abstract:
We conducted a detailed analysis on the quality of web-mined corpora for two low-resource languages (making three language pairs, English-Sinhala, English-Tamil and Sinhala-Tamil). We ranked each corpus according to a similarity measure and carried out an intrinsic and extrinsic evaluation on different portions of this ranked corpus. We show that there are significant quality differences between d…
▽ More
We conducted a detailed analysis on the quality of web-mined corpora for two low-resource languages (making three language pairs, English-Sinhala, English-Tamil and Sinhala-Tamil). We ranked each corpus according to a similarity measure and carried out an intrinsic and extrinsic evaluation on different portions of this ranked corpus. We show that there are significant quality differences between different portions of web-mined corpora and that the quality varies across languages and datasets. We also show that, for some web-mined datasets, Neural Machine Translation (NMT) models trained with their highest-ranked 25k portion can be on par with human-curated datasets.
△ Less
Submitted 14 June, 2024; v1 submitted 12 February, 2024;
originally announced February 2024.
Assessment of Fetal and Maternal Well-Being During Pregnancy Using Passive Wearable Inertial Sensor
Authors:
Eranda Somathilake,
Upekha Delay,
Janith Bandara Senanayaka,
Samitha Gunarathne,
Roshan Godaliyadda,
Parakrama Ekanayake,
Janaka Wijayakulasooriya,
Chathura Rathnayake
Abstract:
Assessing the health of both the fetus and mother is vital in preventing and identifying possible complications in pregnancy. This paper focuses on a device that can be used effectively by the mother herself with minimal supervision and provide a reasonable estimation of fetal and maternal health while being safe, comfortable, and easy to use. The device proposed uses a belt with a single accelero…
▽ More
Assessing the health of both the fetus and mother is vital in preventing and identifying possible complications in pregnancy. This paper focuses on a device that can be used effectively by the mother herself with minimal supervision and provide a reasonable estimation of fetal and maternal health while being safe, comfortable, and easy to use. The device proposed uses a belt with a single accelerometer over the mother's uterus to record the required information. The device is expected to monitor both the mother and the fetus constantly over a long period and provide medical professionals with useful information, which they would otherwise overlook due to the low frequency that health monitoring is carried out at the present. The paper shows that simultaneous measurement of respiratory information of the mother and fetal movement is in fact possible even in the presence of mild interferences, which needs to be accounted for if the device is expected to be worn for extended times.
△ Less
Submitted 19 November, 2021;
originally announced November 2021.
