Text2TimeSeries: Enhancing Financial Forecasting through Time Series Prediction Updates with Event-Driven Insights from Large Language Models

In the rapidly evolving field of global finance, Artificial Intelligence (AI) plays a pivotal role. In an interconnected world characterized by cross-border trade and expanding economies, marked by intricate relationships and interdependencies, AI is essential for navigating these complexities (cite \@BBNCao (2022)). Predicting stock price movements has been a long-standing focus for the AI community, as the stock market is highly sensitive to macroeconomic events, making accurate forecasting a significant challenge. Historically, research has primarily concentrated on forecasting financial markets using univariate time series prediction methods (cite \@BBNWah and Qian (2002)). Some studies have addressed this issue by employing multivariate time series prediction or by considering the interdependence of price series from different companies to forecast price movements (cite \@BBNWu et al. (2013); Xiang et al. (2022)). While time series models are effective at predicting cyclical trends and overall market growth (cite \@BBNZhou et al. (2022); Woo et al. (2022)), they often fail to capture the impact of sequential financial events. Predictions that do not consider such events tend to be less precise. The current work explores time series prediction of stock prices in a multi-modal setting that incorporates both text and time series data, where the textual description of an event is considered for short-term price prediction.

Event-driven stock sentiment prediction primarily focuses on anticipating how an event will affect stock prices, typically classifying the impact into discrete labels such as increase, decrease, or no noticeable change (cite \@BBNDing et al. (2014, 2016)). Some approaches incorporate historical price sequences to forecast whether prices will rise or fall (cite \@BBNSawhney et al. (2020)). However, the effects of an event may span several days, with varying rates of price changes. A simple sentiment label may not be sufficient to capture this complexity. Therefore, instead of assigning a limited number of sentiment polarities to an event, we model the effects of the event in terms of change directions with associated real values. Our current work investigates methods to convert market excitement related to events into real-valued stock prices over the subsequent $n$ days. We are motivated by the fact that forecasting an event’s influence on stock prices over an extended period is beneficial for devising effective intervention strategies (cite \@BBNPricope (2021)).

Leveraging the capability of short-term market excitement, large language models (LLMs) could excel in intuitively predicting future changes based on specific events (cite \@BBNLopez-Lira and Tang (2023)). LLMs like ChatGPT are particularly adept at capturing the finer nuances in stock-specific news texts and accurately predicting daily stock market returns due to their superior language understanding capabilities. (cite \@BBNLopez-Lira and Tang (2023)) also highlight the limitations of basic models like BERT in natural language understanding. Our objective is to explore the ability of LLMs to anticipate changes across multiple time points and represent these as distinct labels corresponding to different future time spans. By "time span," we refer to the period of short-term excitement in the market. Additionally, we aim to examine how these insights can inform adjustments in predictions within time-series models.

In our current research, we integrate multivariate time series data with textual information from stock specific news events to forecast how events either enhance or diminish signals in stock prices relative to the overall trend. This particular scenario we are trying to address is depicted in the Figure  1. Initially, we train multivariate time series models to predict individual stock prices. Drawing inspiration from state change models, we conceptualize market excitement following an event as shifts in the stock state (cite \@BBNBosselut et al. (2017)). To accomplish this, we leverage the event-based insights generated as discrete labels by a Large Language Model regarding the price changes for the next $n$ time points following an event occurrence. We utilize these stock state changes to anticipate the increase or decrease in a stock’s price beyond what is projected by the time series model. Following this, we combine the time series model’s predictions with the event-induced changes predicted by the state change model to refine our forecasts. To the best of our knowledge, we are the first to develop a scheme for predicting short-term excitement in stock price time series. We are introducing a novel scheme for short-term excitement prediction in stock price time series, utilizing a Large Language Model to forecast sequences of discrete labels representing event-induced price changes over time.

Methods for Time Series Analysis. Recent advancements in deep learning architectures, such as Long Short-Term Memory (LSTM) networks (cite \@BBNHochreiter and Schmidhuber (1997)), Gated Recurrent Units (GRU) (cite \@BBNChung et al. (2014)), and transformers (cite \@BBNVaswani et al. (2017)), have demonstrated significant capabilities in capturing complex temporal relationships within time series data. Various transformer models have been proposed (cite \@BBNLi et al. (2019); Zhou et al. (2021a); Wu et al. (2021); Zhou et al. (2022); Liu et al. (2021)) for forecasting time series, often designing novel attention mechanisms to handle longer sequences and using point-wise attention, which can overlook the importance of patches. Although Triformer (cite \@BBNCirstea et al. (2022)) introduces patch attention, it does not use patch inputs. Patch Time Series Transformer (Patch TST) (cite \@BBNNie et al. (2022)) was the first transformer model to use patches as inputs, capturing the semantic coherence among neighboring patches. However, these techniques cannot be directly adapted to a multimodal setting involving textual information. Our current work investigates time series prediction in a multimodal setting, comprising both time series and textual information.

Time Series Analysis for Stock Prediction.

Several time series analysis methods and machine learning techniques can be applied for stock prediction. These include ARIMA models, Exponential Smoothing State Space models (ETS) (cite \@BBNBrown (1956)), and machine learning techniques such as linear regression, decision trees, random forest, SVM, gradient boosting, Generalized Autoregressive Conditional Heteroskedasticity (GARCH) models (cite \@BBNTse and Tsui (2002); Engle (2002)), and ensemble methods involving multiple models. (cite \@BBNHu et al. (2018)) developed a hybrid attention mechanism to predict stock market movements using news articles, while BERT representations have been used to encode texts for the FEARS index (cite \@BBNDa et al. (2011)) in predicting movements in the S&P 500 index (cite \@BBNYang et al. (2019)). However, these techniques are typically adapted to handle information derived from a sequence of financial events, which can result in inaccurate predictions during unforeseen events that impact financial decisions. Our approach models time series prediction in a multimodal setting, where predictions are evaluated in the context of specific events.

NLP for Finance. Financial services have always been tightly regulated by governments due to their pervasive impact on the masses. However, following liberalization and the easing of regulations, financial technology (FinTech) has emerged as one of the top business avenues in the last decade. (cite \@BBNChen et al. (2020)) highlights the application areas of NLP in the finance domain. Financial institutions use end-to-end transformer models to scan and extract financial events from various news articles and financial announcements (cite \@BBNZheng et al. (2019)), evaluating the debt-paying ability of corporate customers. Online forums, blogs, and social media posts are monitored to extract sentiment, which is then used to predict company sales using model-agnostic meta-learning methods (cite \@BBNLin et al. (2019); Finn et al. (2017)). Similarly, insurance companies track daily posts from customers to detect and initiate early treatment of diseases (cite \@BBNLosada et al. (2019); Burdisso et al. (2019)), mitigating the chances of hazards. Social media posts also serve as indicators for stock recommendations (cite \@BBNTsai et al. (2019)). Most of these works are formulated as simple sentiment label predictions, which may not fully capture the complexity of financial events. Therefore, instead of assigning a limited number of sentiment polarities to an event, we model the effects of the event in terms of change directions with associated real values. Our current work investigates methods to convert market excitement related to events into real-valued stock prices over the subsequent $n$ days.

Our objective is to forecast the impact of an event on the price signal of a stock for the next $n$ time units and adjust the prediction of our time series model accordingly. Let’s break down the task into three steps.

1. 1.

   $P_{s}{[t:t+n]}\longleftarrow T_{s}(P_{s}{[t:t-h]};\theta_{1})$

2. 2.

   $\Delta P_{s}{[t:t+n]}\longleftarrow F(E,s;\theta_{2})$

3. 3.

   $P^{\prime}_{s}{[t:t+n]}\longleftarrow U(\Delta P_{s}{[t:t+n]},P_{s}{[t:t+n]};\theta_{3})$

Where, $T_{s}$ represents the time series function which takes the historic price of a specific stock $s$ for the previous $h$ time points as an argument and forecasts its future values for $n$ time units. $F$ denotes a function predicting the impact of an event $E$ on the price of stock $s$ for the subsequent $n$ time units from the point of occurrence of the event. Finally, $U$ signifies an update function that takes outputs from $T_{s}$ and $F$, adjusting the time signal for the upcoming $n$ time- steps by amplifying or attenuating it. we commence by training a dedicated time-series model, denoted as $T_{s}$, for each individual stock $s$. This model is designed to project the trajectory and expansion of the stock over the subsequent $n$ days, leveraging prices derived from the preceding $h$ days as its input. Central to our approach is the utilization of function $F$ within the problem formulation, tasked with assessing the influence of specific event, represented as $E$, on the market sentiment surrounding stock $s$. We conceptualize this process as a state transition problem, aimed at depicting the stock’s behavior over the ensuing $n$ days following the occurrence of an event. Within this framework, we quantify the extent of amplification or attenuation in the stock price for each future day, predicated on its corresponding stock state. The state transition and prediction are guided by the intuition of an LLM regarding the patterns of future price changes of the stock within the context of the event. Following this assessment, we implement an update mechanism denoted as $U$ to refine the predictions generated by the time-series model, integrating insights into amplification or attenuation derived from the preceding analysis. Notably, while each stock is assigned its own $T_{s}$, the other components remain consistent across all stocks. The rationale behind this strategic design choice will be explained in subsequent discussions.

Our primary objective is to enhance time series predictions in response to events using a large language model (LLM). As illustrated in Figure 2, our method integrates several key components: a time series model, an LLM trained to predict stock price changes over various future time spans as discrete labels, and mechanisms for updating the time series based on the LLM’s predictions. This section details the data, settings, and results for the following tasks: 1) Sub Task1: Training the time series models, 2) Sub Task2: Fine-tuning the LLM for price change prediction, and 3) Main Task1: Overall approach for updating the time series using the LLM’s predicted labels, as depicted in Figure 2.

We assessed the primary task of updating time series using Root Mean Squared Error (RMSE) and Mean Absolute Error (MAE) as metrics. RMSE measures the square root of the average squared differences between predicted and actual values, while MAE represents the average of the absolute differences between predicted and actual values. The results of the updated price prediction, in the context of an event, are presented in the Table 3. Clearly, updates based on LLM-predicted indicators have improved the accuracy of the time-series predictions. In contrast, $SentiEvent$ performed poorly compared to the LLM-based models. This disparity is likely due to the sophisticated background understanding and enhanced text comprehension capabilities of LLMs in the financial domain. The TimeS settings outperformed the TimeL settings. TimeS computes amplification in a probabilistic space, whereas TimeL approximates actual values of amplification from LLM-predicted labels. This approximation limits TimeL’s ability to detect errors in LLM predictions and make the necessary adjustments in amplification computation.

To avoid data contamination, we restrict ourselves from using newer LLMs. This results in sub-optimal predictions for change types and actual change values. The test data and the validation data contains news articles focusing on trading events from PRNewswire and Businesswire websites in the financial year of 2020-21. As T5 models were released before this duration, we could safely assume that training data of T5 did not overlap with the data considered in this research work. However, capabilities have improved tremendously in the recent past.

The paper introduces a multi-modal framework for modeling stock price time-series within the context of financial events. This framework integrates insights from large language models (LLMs), using predicted price changes as discrete labels to update the time series. This approach improves the accuracy of stock price forecasts during financial events. The paper also presents various experimental results demonstrating the ability of LLMs to anticipate price changes.