Context Matters: An Empirical Study of the Impact of Contextual Information in Temporal Question Answering Systems
Authors:
Dan Schumacher,
Fatemeh Haji,
Tara Grey,
Niharika Bandlamudi,
Nupoor Karnik,
Gagana Uday Kumar,
Jason Cho-Yu Chiang,
Paul Rad,
Nishant Vishwamitra,
Anthony Rios
Abstract:
Large language models (LLMs) often struggle with temporal reasoning, crucial for tasks like historical event analysis and time-sensitive information retrieval. Despite advancements, state-of-the-art models falter in handling temporal information, especially when faced with irrelevant or noisy contexts. This paper addresses this gap by empirically examining the robustness of temporal question-answe…
▽ More
Large language models (LLMs) often struggle with temporal reasoning, crucial for tasks like historical event analysis and time-sensitive information retrieval. Despite advancements, state-of-the-art models falter in handling temporal information, especially when faced with irrelevant or noisy contexts. This paper addresses this gap by empirically examining the robustness of temporal question-answering (TQA) systems trained on various context types, including relevant, irrelevant, slightly altered, and no context. Our findings indicate that training with a mix of these contexts enhances model robustness and accuracy. Additionally, we show that the position of context relative to the question significantly impacts performance, with question-first positioning yielding better results. We introduce two new context-rich TQA datasets, ContextAQA and ContextTQE, and provide comprehensive evaluations and guidelines for training robust TQA models. Our work lays the foundation for developing reliable and context-aware temporal QA systems, with broader implications for enhancing LLM robustness against diverse and potentially adversarial information.
△ Less
Submitted 27 June, 2024;
originally announced June 2024.
Data Visualization of Traffic Violations in Maryland, U.S
Authors:
Mumen Rababah,
Mohammad Maydanchi,
Shaheen Pouya,
Mina Basiri,
Alireza Norouzi Azad,
Fatemeh Haji,
Mohammad Aminjarahi
Abstract:
Nowadays, car use has become so common and inevitable that with a high approximation, it can be said that every family has at least one car. This has caused an increase in accidents and, subsequently, road injuries. About 1.2 million people die from road injuries yearly, and 20 to 50 million live with non-fatal injuries. Investigation of this issue is essential, considering that traffic violations…
▽ More
Nowadays, car use has become so common and inevitable that with a high approximation, it can be said that every family has at least one car. This has caused an increase in accidents and, subsequently, road injuries. About 1.2 million people die from road injuries yearly, and 20 to 50 million live with non-fatal injuries. Investigation of this issue is essential, considering that traffic violations have become a global concern. There, a dataset published by the Montgomery County government was analyzed using R and Python, only Maryland crimes. The highest number of deaths is in young men, which shows an increase in traffic accident injuries in the third decade of life, and a reduction of victims of different ages was observed as a result. Factors affecting the occurrence of injuries caused by road traffic were also extracted. This can be useful in providing programs to reduce traffic violations.
△ Less
Submitted 22 August, 2022;
originally announced August 2022.
