Contrastive Chain-of-Thought Prompting

Large Language Models (LLMs) have revolutionized natural language processing by leveraging vast amounts of data to generate human-like text. These models have gained attention for their ability to perform a wide range of language tasks, from text generation and translation to question answering and summarization. One such technique that has propelled the performance of LLMs is Chain-of-Thought (CoT) prompting (Wei et al., 2022b) . By applying CoT prompting, researchers have found substantial improvement in various tasks such as arithmetic and common sense reasoning, surpassing the efficacy of traditional methods focused on scaling model size (Wang et al., 2023; Wei et al., 2023). In a similar vein, Context-Aware Decoding (CAD) emerges as another approach to augment LLM performance (Liu et al., 2021; Li et al., 2023a; O’Brien and Lewis, 2023), priotizing relevant contextual information over pre-existing knowledge (Shi et al., 2023). While these advancements underscore significant progress, an ongoing question persists regarding the efficacy of combining CAD with CoT or with amateur prompts, which typically contain less context.

To address this question, the study aims to investigate how CoT prompts’ ability to capture sequential dependencies can be complemented by the discriminative ability of CAD, particularly when the context contradicts prior knowledge (Longpre et al., 2021; Zhou et al., 2023). In such cases, we aim to ensure that incorporating CoT prompting does not detract from the outputs derived from the provided context. Ultimately, the goal is to create faithful models capable of accurately executing mathematical and reasoning tasks while avoiding the misinterpretation of crucial contextual cues (Maynez et al., 2020; Pagnoni et al., 2021).

As seen in Table 2, CAD improved AQUA’s accuracy on Phi by a substantial result, and the same for Mistral on CommonSenseQA. The other accuracy improvements were much more modest, with three percent and below in improvement. The AQUA improvement might not show that much importance, however, because even the improved accuracy still mostly stays at the random rate of guessing.

The CoT Contrast works best with Phi-1.5 on AQuA, while it works best with Mistral 7B on CommonsenseQA. Therefore, we do not find that contrastive CoT increases problem solving performance in all language models for all data.

GSM8K notably shows a significant decrease in accuracy on Phi-1.5 using CoT contrast. This could be due to contamination in the Phi-1.5B dataset (Zhang et al., 2024)

There was also contamination in the Mistral model with GMS8K, so that may have affected the results there too(Zhang et al., 2024).

But the results demonstrate that contrastive CoT is successful when addressing common-sense multiple choice questions. The only time that one of the amateurs does not have a greater value than the baseline on multiple choice is GPT-3.5 on AquA. Some improvements are much more modest than others, but all other model-database combinations that are muultiple choice do improve.

The Mistral multiple-choice offers more improvement than Phi’s multiple-choice which could be due to Mistral being a bigger model with more parameters. It having more parameters could allow it to use the contrasting more powerfully.

Table 5 shows an interesting property of the outputs, as it appears the baseline evaluates its expressions with lower accuracy than most of the other experiments, but still results in a higher accuracy. After conducting analysis on model output for each of the experiments, it appears as though, for the experiments, the mathematical calculations may be higher in accuracy in the Amateurs, but the expressions themselves contain incorrect numerical values which may indicate an incorrect translation from the word questions to expressions.

The overall results demonstrate that contrasting with CoT prompting and amateur models is mostly successful when addressing common-sense multiple choice questions.

This work is inspired by three main ideas: Context-Aware Decoding, Chain of Thought, and prompting methods. Here we detail the most relevant papers in these paths.

The first direction that this paper relates to is prompting. The last few years have given way to major improvements in input part of prompt instructions. This is apparent with the popularity of few-shot prompting by (Brown et al., 2020), automatically learning prompts (Lester et al., 2021), or providing model prompts by describing tasks (Wei et al., 2022a; Sanh et al., 2022; Ouyang et al., 2022). This idea leads to our paper’s relation to Chain-of-Thought Prompting.

Chain-of-Thought prompting was a leading discovery with the ability to improve model performance significantly without scaling size. With such an improvement in performance, one of the main focuses of this paper was trying to take the improvement even further. Our main reference would be (Wei et al., 2023) for its groundbreaking discovery and testing of arithmetic and common-sense benchmarks. This paper uses similar benchmarks and prompting for testing chain of thought with context-aware decoding.

Lastly, this paper relates to others that pushed for context-aware decoding and its ability to decrease hallucination in LLMs. In particular, the paper that was referenced was (Shi et al., 2023) for its novelty in getting LLMs to pay more attention to the context provided. The context-aware decoding was effectively used in this paper to improve the accuracy of models and decrease hallucination.

Our findings highlight the impact of integrating expert and amateur models in Context-Aware Decoding across diverse datasets. This study highlights the need for future research prioritizing context-sensitive applications in language modeling. Further, there is a pressing need to explore the scalability of these techniques and their relevance across even broader datasets and across differing models and sizes. Future investigations could delve into testing a wider range of alpha values to unveil potentially more substantial results, aiding our understanding of the nuances within context-driven language modeling.

Our analysis could be limited in that the difference in strength between the expert and amateur models is too inconsequential. That means that there is a possibility that the models themselves have generated outputs that are not dissimilar enough to impact results.

Another limitation specifically on the Phi 1.5 GMS8K results could be the fact that Phi 1.5 is possibly contaminated with GSM8K (Zhang et al., 2024). This explains why our trials for Phi - 1.5 produced many unfinished and illogical answers when responding to input prompts, yet performed much better on the baseline compared on Amateur 1 on GSM8K (Table 2).

Phi-1.5 has also been known to work best with prompts in a QA format which inherently makes the format of the Amateur 1 and 2 prompts difficult for the model to synthesize outputs, and thus impact results (Li et al., 2023b). This could also result because of the fact that Phi-1.5 is too weak of a model with only 1.3 billion parameters to accurately display the effect of CoT contrasting.

Additionally, GPT-3.5 Turbo is a much larger model compared to Phi-1.5 and Mistral 7B. This could affect results too, because while it seems that the bigger size could make it more effective, as it’s able to do contrasting more effectively, which it might, the contrasting could also get diluted in the billions of parameters.

Among the three, only GPT-3.5 Turbo is an instruction-tuned model, meaning that it’s ability to reason through questions may not be a result of CoT contrasting but rather because it already contains such capabilities. There also might be things similar to our contrasting methods already hidden in their instructions, which would make our methods less effective.

The under-performance of GPT-3.5’s GSM8K and AQuA results may be attributed to GPT-3.5’s difficulty in consistently answering mathematical questions accurately Frieder et al. (2023), as tested GPT versions of January 9, January 30, and GPT-4 extensively with GHOSTS, a natural language mathematics dataset, and concluded they were not competent in advanced mathematical comprehension. This could explain why the accuracy did not improve even with context-aware decoding.

For future experiments, the first steps to improve should be to run experiments on non-instruction tuned and much larger models that can better reflect whether or not chain-of-thought vs. amateur contrasting improves the accuracy of outputs. There could also be more experiments done on different datasets, to see how the constrasting works differently for different types of problems. Additionally, selecting an optimal $\alpha$ value for each individual task, question or even token could potentially improve performance.