How Personality Traits Influence Negotiation Outcomes?
A Simulation based on Large Language Models

Yin Jou Huang    Rafik Hadfi
Kyoto University, Kyoto, Japan
[email protected], [email protected]
Abstract

Psychological evidence reveals the influence of personality traits on decision-making. For instance, agreeableness is generally associated with positive outcomes in negotiations, whereas neuroticism is often linked to less favorable outcomes. This paper introduces a simulation framework centered on Large Language Model (LLM) agents endowed with synthesized personality traits. The agents negotiate within bargaining domains and possess customizable personalities and objectives. The experimental results show that the behavioral tendencies of LLM-based simulations could reproduce behavioral patterns observed in human negotiations. The contribution is twofold. First, we propose a simulation methodology that investigates the alignment between the linguistic and economic capabilities of LLM agents. Secondly, we offer empirical insights into the strategic impact of Big-Five personality traits on the outcomes of bilateral negotiations. We also provide a case study based on synthesized bargaining dialogues to reveal intriguing behaviors, including deceitful and compromising behaviors.

How Personality Traits Influence Negotiation Outcomes?
A Simulation based on Large Language Models


Yin Jou Huang  and Rafik Hadfi Kyoto University, Kyoto, Japan [email protected], [email protected]


1 Introduction

Refer to caption
Figure 1: Overview of the LLM-based negotiation simulation framework.

Large language models (LLMs) have demonstrated their capacity to emulate diverse human traits Park et al. (2022); Serapio-García et al. (2023). Such models can simulate intricate behaviors and provide valuable insights into various aspects of human cognition. Decision-making is an example of cognitive processes that have long fascinated psychologists and economists. Economic theory posits that decisions assume a certain level of rationality and comprehension of available options Gibbons (1992). However, behaviorists contend that humans are not entirely rational but are influenced by psychological factors Evans (2014), cognitive biases Daniel (2017) and personality traits Bayram and Aydemir (2017).

In this paper, we aim to investigate the extent to which LLMs can simulate human decision-making across individuals with varying personality traits. We specifically focus on the negotiations scenarios. Evidence suggests that certain personality traits may give advantages in negotiation settings Falcão et al. (2018); Barry and Friedman (1998); Amanatullah et al. (2008). For instance, agreeableness tend to result in a slight disadvantage in competitive negotiations while being an advantage in cooperative settings Falcão et al. (2018). In the context of LLM, we attempt to answer this long-standing question in psychology: “How do variations in personality traits affect the outcomes of negotiations?"

To address this question, we propose a negotiation simulation framework incorporating LLM agents possessing synthesized personality traits and predefined negotiation objectives (Figure 1). For synthetic personalities, we use in-context learning to configure the agents with specific personality profiles. Here, the profiles are based on Big-Five personality theory Costa Jr and McCrae (1995); John et al. (1999). For negotiation objectives, we give LLM agents instructions that specify the negotiation task and goals. The LLM agents then engage in a negotiation by exchanging offers in the form of dialogue. Specifically, we consider a competitive bargaining scenario between a buyer and a seller agent. In each round t𝑡titalic_t of the negotiation dialogue, we extract the offered price and strategy (if any) made in the dialogue utterances for evaluation and analysis.

By varying the personality traits of the agents, we observe changes in the negotiation outcomes and behavioral patterns. We investigated which personality traits lead to better/worse outcomes. More importantly, we want to see whether the LLM-based simulation results align with the findings of previous research conducted on human subjects.

Our experimental results show that the tendencies in LLM-based simulation generally align with those observed in human experiments. In addition, a case study based on synthesized bargaining dialogue reveals intriguing behavioral patterns such as deceiving behaviors, emotional appeal, and take-it-or-leave-it strategies. The results obtained in this work illustrate that LLM can not only mimics styles of talking but is also capable of capturing human decision-making patterns.

The contribution of the paper is twofold. First, we propose a simulation framework that leverages LLM agents with linguistic and economic capabilities. Second, we offer insights into the effect of Big-Five personality traits on simulated negotiation outcomes and compare these findings to empirical psychology experiments.

2 Related Work

Recent advances in LLMs allowed the development of systems capable of emulating various human behaviors, emotions, and personalities Akata et al. (2023); Serapio-García et al. (2023).

Previous research has predominantly utilized personality tests for evaluation purposes. However, issues of data contamination can arise Oren et al. (2023). Specifically, if a dataset from a personality questionnaire is employed in training a LLM, the resulting scores may not accurately reflect whether the LLM’s behavioral responses correspond with the personality described in the prompt. In this paper, we adopt an indirect, economic, analysis of negotiation scenarios to see whether the personality instruction to LLMs really translates to genuine behavioral change of the LLM agents.

The target behavior are akin to decision-making, which is a particular type of human behavior that is still challenging to reproduce with LLM agents because it relies on reasoning capabilities that they lack Tamkin et al. (2021). Decision-making generally entails choosing an action from various options in response to a particular situation, often reflecting personal preferences or beliefs Simon (1990). Moreover, real-world decisions are challenging because they are susceptible to environmental and cognitive constraints Phillips-Wren and Adya (2020). Narrowing down the scope of decision-making problems, we focus on negotiation as an example that we claim could be studied comprehensibly using LLMs. In a negotiation, two parties interact with each other to exchange bids and attempt to reach a mutual agreement Raiffa (1982); Jennings et al. (2001). Looking at negotiations from the classical economics perspective, we often presuppose several assumptions, such as rationality Evans (2014). Such assumptions often fail when the negotiations are conducted through natural language, which conveys various aspects that cannot be studied economically, such as emotions or personality traits. There is in fact evidence showing the effect of Big-Five personality traits on decisions Bayram and Aydemir (2017); Urieta et al. (2021); Erjavec et al. (2019); Toledo and Carson (2023); El Othman et al. (2020). In negotiations, certain personality traits are considered disadvantageous Falcão et al. (2018); Amanatullah et al. (2008). Extraversion and agreeableness, for example, constitute liabilities in competitive bargaining problems while being advantageous in cooperative settings Barry and Friedman (1998). Part of our results reproduce such cases in addition to other instances.

3 Methodology

This section introduces our simulation framework with LLM agents possessing synthesized personalities. In Section 3.1, we formulate the negotiation model and the used syntax. In Section 3.2, we introduce the method to configure a LLM negotiations by providing the instructions that set personality traits and negotiation objectives. We then describe the process of simulating negotiation dialogues with the LLM agents in Section 3.3.

3.1 Negotiation Model

We consider a classical bargaining scenario in which a buyer and a seller negotiate over the price of an item or product. Typically, the buyer aims to reduce the purchase price while the seller seeks to maximize it, resulting in the competitive nature of the negotiation scenario. This is also an example of a zero-sum game in which one party’s gain leads to the other party’s loss, showing the competitive nature of the task Gibbons (1992). In our LLM-based negotiation simulations, the seller and the buyer are LLM agents. Since our goal is to study the effect of personality traits on negotiation, we define the seller and buyer agents in terms of their psychological and economic profiles as in (Eq. 1).

Sellers=(ψs,us)Buyerb=(ψb,ub)Seller𝑠subscript𝜓𝑠subscript𝑢𝑠Buyer𝑏subscript𝜓𝑏subscript𝑢𝑏\begin{split}\text{Seller}\ s=(\psi_{s},u_{s})\\ \text{Buyer}\ b=(\psi_{b},u_{b})\end{split}start_ROW start_CELL Seller italic_s = ( italic_ψ start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT , italic_u start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) end_CELL end_ROW start_ROW start_CELL Buyer italic_b = ( italic_ψ start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT , italic_u start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT ) end_CELL end_ROW (1)

The psychological profiles ψssubscript𝜓𝑠\psi_{s}italic_ψ start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT and ψbsubscript𝜓𝑏\psi_{b}italic_ψ start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT will be instantiated with predefined personality traits following the Big-Five model of personality. Such model decomposes human personality into five dimensions: openness (OPE), conscientiousness (CON), extraversion (EXT), agreeableness (AGR), and neuroticism (NEU) Costa Jr and McCrae (1995); John et al. (1999). Each dimension is a spectrum with negative and positive polarities. The five dimensions encompass a comprehensive range of human personality patterns. The economic profiles of the agents are reflected in their utility functions, denoted by ussubscript𝑢𝑠u_{s}italic_u start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT for sellers and ubsubscript𝑢𝑏u_{b}italic_u start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT for buyers. A utility function is a mathematical way to describe the preferences or objectives of the agents depending on whether they are minimizing (buyer) or maximizing the price (seller) Gibbons (1992).

The seller and the buyer negotiate in a dialogue D𝐷Ditalic_D around a product. The dialogue is a sequence of T𝑇Titalic_T utterances D={d1,d2,,dT}𝐷subscript𝑑1subscript𝑑2subscript𝑑𝑇D=\{d_{1},d_{2},\ldots,d_{T}\}italic_D = { italic_d start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , italic_d start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , … , italic_d start_POSTSUBSCRIPT italic_T end_POSTSUBSCRIPT }. Each utterance dtsubscript𝑑𝑡d_{t}italic_d start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT is associated with a negotiation state stsubscript𝑠𝑡s_{t}italic_s start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT and the current offer price ptsubscript𝑝𝑡p_{t}italic_p start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT.

3.2 LLM Agent Configuration

We configure an LLM agent with specific personality traits by introducing a personality instruction (Section 3.2.1) and a negotiation objective instruction (Section 3.2.2), with in-context learning.

3.2.1 Personality Traits Instruction

Dimension Negative Positive
OPE unimaginative, uncreative, unaesthetic, … imaginative, creative, aesthetic, …
CON unsure, messy, irresponsible, … self-efficacious, orderly, responsible, …
EXT unfriendly, introverted, silent, … friendly, extraverted, talkative, …
AGR distrustful, immoral, stingy, … trustful, moral, generous, …
NEU relaxed, at ease, easygoing, … tense, nervous, anxious, …
Table 1: The Big-Five personality dimensions and their corresponding personality-describing adjective pairs.

The idea is to attribute to an agent a synthetic personality profile. That is, an agent k𝑘kitalic_k, with k{s,b}𝑘𝑠𝑏k\in\{s,b\}italic_k ∈ { italic_s , italic_b }, possesses a 5555-dimensional personality profile ψksubscript𝜓𝑘\psi_{k}italic_ψ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT defined as in (Eq. 3.2.1).

ψksubscript𝜓𝑘\displaystyle\psi_{k}italic_ψ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT =(ψkOPE,ψkCON,ψkEXT,ψkAGR,ψkNEU)absentsuperscriptsubscript𝜓𝑘𝑂𝑃𝐸superscriptsubscript𝜓𝑘𝐶𝑂𝑁superscriptsubscript𝜓𝑘𝐸𝑋𝑇superscriptsubscript𝜓𝑘𝐴𝐺𝑅superscriptsubscript𝜓𝑘𝑁𝐸𝑈\displaystyle=(\psi_{k}^{OPE},\psi_{k}^{CON},\psi_{k}^{EXT},\psi_{k}^{AGR},% \psi_{k}^{NEU})= ( italic_ψ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_O italic_P italic_E end_POSTSUPERSCRIPT , italic_ψ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_C italic_O italic_N end_POSTSUPERSCRIPT , italic_ψ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_E italic_X italic_T end_POSTSUPERSCRIPT , italic_ψ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_A italic_G italic_R end_POSTSUPERSCRIPT , italic_ψ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_N italic_E italic_U end_POSTSUPERSCRIPT )
ψksubscript𝜓𝑘\displaystyle\psi_{k}italic_ψ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT 𝕃5absentsuperscript𝕃5\displaystyle\in\mathbb{L}^{5}∈ blackboard_L start_POSTSUPERSCRIPT 5 end_POSTSUPERSCRIPT (2)
𝕃𝕃\displaystyle\mathbb{L}blackboard_L ={,+}{Niedrig,Moderate,Hoch}absenttensor-productNiedrigModerateHoch\displaystyle=\{-,+\}\otimes\{\text{Low},\text{Moderate},\text{High}\}= { - , + } ⊗ { Low , Moderate , High }

Each component of ψksubscript𝜓𝑘\psi_{k}italic_ψ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT represents the polarity (negative or positive) and degree (low, moderate or high) of each personality dimension Tian et al. (2018). For instance, ψkAGRsuperscriptsubscript𝜓𝑘𝐴𝐺𝑅\psi_{k}^{AGR}italic_ψ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_A italic_G italic_R end_POSTSUPERSCRIPT takes on one of the values in 𝕃𝕃\mathbb{L}blackboard_L, which respectively represents a spectrum from highly disagreeable (---- - -), moderately disagreeable (--- -), lowly disagreeable (--), lowly agreeable (+++), moderately agreeable (+++++ +), and highly agreeable (+++++++ + +). For example, one could define a personality profile ψksubscript𝜓𝑘\psi_{k}italic_ψ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT by randomly sampling from the personality space 𝕃5superscript𝕃5\mathbb{L}^{5}blackboard_L start_POSTSUPERSCRIPT 5 end_POSTSUPERSCRIPT a vector equal to (OPE+,CON---,EXT-,AGR+,NEU++)𝑂𝑃𝐸+𝐶𝑂𝑁---𝐸𝑋𝑇-𝐴𝐺𝑅+𝑁𝐸𝑈++(OPE\text{+},CON\text{-}\text{-}\text{-},EXT\text{-},AGR\text{+},NEU\text{+}% \text{+})( italic_O italic_P italic_E + , italic_C italic_O italic_N - - - , italic_E italic_X italic_T - , italic_A italic_G italic_R + , italic_N italic_E italic_U + + ).

Following previous work, we use personality-describing adjectives to set the personality traits Serapio-García et al. (2023). We use the list of 70707070 bipolar adjective pairs proposed by Goldberg (1992), which are adjectives that statistically correlate with certain Big-Five personality traits (Table 1). For instance, prompting an LLM with adjectives such as unsure and irresponsible is likely to result in utterances with negative conscientiousness traits. For each personality dimension in ψksubscript𝜓𝑘\psi_{k}italic_ψ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT, we randomly pick n𝑛nitalic_n adjectives out of all the personality-describing adjectives associated with the polarity of the given dimension. Further, we apply the modifiers based on the degree of the personality traits. We use “very” as a modifier for a high degree and “a bit” for a low degree. No modifier is used for the moderate degree. Following this process, we use 5×n5𝑛5\times n5 × italic_n adjectives associated with any given personality profile ψksubscript𝜓𝑘\psi_{k}italic_ψ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT. We then generate a personality trait instruction with the template “You have following personality: ${L}currency-dollar𝐿\$\{L\}$ { italic_L }. Reflect your personality in the negotiation process.”, where L𝐿Litalic_L is a comma-separated list of the associated adjectives (including the modifiers). The personality traits instructions are given to the LLM agents through in-context learning.

3.2.2 Negotiation Objective Instructions

To configure the economic profiles of the LLM negotiation agents ussubscript𝑢𝑠u_{s}italic_u start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT and ubsubscript𝑢𝑏u_{b}italic_u start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT in (Eq. 1), we incorporate negotiation objective instructions that define the negotiation goals of each agent. Specifically, we focus on a bargaining scenario where the seller agent aims to sell the product at a higher price, reaching its ideal price as closely as possible Raiffa (1982). Conversely, the buyer agent seeks to secure a deal at a lower price and strives to achieve its ideal target price. The instructions are the following:

  • (Buyer) Act as a buyer and try to strike a deal for a ${P}currency-dollar𝑃\$\{P\}$ { italic_P } with a lower price through conversation. You would like to pay for \stackunder[1.2pt]p b\stackunderdelimited-[]1.2𝑝𝑡𝑝subscript 𝑏\stackunder[1.2pt]{$p$}{\rule{3.44444pt}{0.32289pt}}_{b}[ 1.2 italic_p italic_t ] italic_p start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT. Your reply should not be too long.

  • (Seller) Act as a seller that sells a ${P}currency-dollar𝑃\$\{P\}$ { italic_P }, bargains with the buyer to get a higher deal price. Your reply should not be too long. Your listing price for this ${P}currency-dollar𝑃\$\{P\}$ { italic_P } is p¯ssubscript¯𝑝𝑠\bar{p}_{s}over¯ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT. The detail of the product is the following: ${D}currency-dollar𝐷\$\{D\}$ { italic_D }.

Here, P𝑃Pitalic_P and D𝐷Ditalic_D are the product name and a short description of the product of the negotiations. (See Appendix A.1) These linguistic instructions could theoretically be mapped into utility functions, which will later be used to evaluate negotiations. We avoid making assumptions about the shape of the utility functions, as the behaviors of the agents are primarily shaped by the LLM instructions, which may not follow any specific mathematical representation of their preferences.

3.3 Negotiation Simulation

Using the methods in Section 3.2, we configure the buyer LLM agent and the seller LLM agent and conduct a negotiation simulation between them. The seller and buyer agents exchange offers, with the seller kick-starting the conversation with the fixed utterance “Hi, how can I help you?”. After an utterance dtsubscript𝑑𝑡d_{t}italic_d start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT is generated, the response is fed to the other agent as a prompt. The process continues until the termination condition is met. In this fashion, we collect a negotiation dialogue D={d1,d2,,dT}𝐷subscript𝑑1subscript𝑑2subscript𝑑𝑇D=\{d_{1},d_{2},\ldots,d_{T}\}italic_D = { italic_d start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT , italic_d start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT , … , italic_d start_POSTSUBSCRIPT italic_T end_POSTSUBSCRIPT }. Following Fu et al. (2023), we introduce a dialogue state detector to extract negotiation-related information from each utterance. First, we detect the negotiation state stsubscript𝑠𝑡s_{t}italic_s start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT of dtsubscript𝑑𝑡d_{t}italic_d start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT, which is one of the following states:

  • Offer: the agent makes a price offer.

  • Ponder: the agent considers whether to accept or reject the other agent’s offer.

  • Accept: the agent accepts the current offer.

  • Deal-break: the agent refuses the last offer or walks away from the negotiation.

  • Chit-chat: Utterances with intent not directly related to the negotiation, such as greetings.

In addition, we extract the current offer price and the strategy of σtsubscript𝜎𝑡\sigma_{t}italic_σ start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT each utterance dtsubscript𝑑𝑡d_{t}italic_d start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT. After generating each utterance, the dialogue state detector takes dtsubscript𝑑𝑡d_{t}italic_d start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT and its context (previous hhitalic_h utterances) as input and extracts the negotiation state stsubscript𝑠𝑡s_{t}italic_s start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT, current offer price ptsubscript𝑝𝑡p_{t}italic_p start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT (if any), and strategy σtsubscript𝜎𝑡\sigma_{t}italic_σ start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT of the current speaker in free text form. In this work, we use another LLM as the dialogue state detector.

For the termination condition of the negotiation is based on the detected negotiation states. We terminate the negotiation dialogue if an Accept or a Deal-break is reached. Also, we set a length limit of T=Tmax𝑇subscript𝑇𝑚𝑎𝑥T=T_{max}italic_T = italic_T start_POSTSUBSCRIPT italic_m italic_a italic_x end_POSTSUBSCRIPT of the dialogue. If the length of the generated dialogue reaches this limit, we terminate the process and automatically regard it as a failed negotiation.

4 Experiments

In this section, we provide details on the experimental settings (Section 4.1) and the evaluation metrics (Section 4.2).

4.1 Experimental Settings

LLM Agents

For the buyer and seller agents, we adopt GPT-4 (gpt-4-0613) OpenAI (2023) as the choice of the LLM. We also conducted experiments based on Llama 3 and GPT-3.5. which could be found in the Appendix A.3. The prompts of the agents can be found in Appendix A.1.

Negotiation Variables

We used the CraigsListBargain dataset He et al. (2018) to set several negotiation variables. It is a commonly used dataset of negotiation, consisting of bargaining dialogues in an online platform. For each negotiation entry in the dataset, we extract the name and the description of the product, and the ‘listing price’ of the seller and a ‘target price’ of the buyer. We use the listing price as the ideal price p¯ssubscript¯𝑝𝑠\bar{p}_{s}over¯ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT for the seller and the target price as the ideal price \stackunder[1.2pt]p b\stackunderdelimited-[]1.2𝑝𝑡𝑝subscript 𝑏\stackunder[1.2pt]{$p$}{\rule{3.44444pt}{0.32289pt}}_{b}[ 1.2 italic_p italic_t ] italic_p start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT for the buyer. Note that an agent’s ideal price is not disclosed to the other party in our setting.

Personality Instruction

For each agent k𝑘kitalic_k, we first generate a personality profile by randomly sampling from the personality space 𝕃5superscript𝕃5\mathbb{L}^{5}blackboard_L start_POSTSUPERSCRIPT 5 end_POSTSUPERSCRIPT (Eq. 3.2.1). We then select n=3𝑛3n=3italic_n = 3 personality-describing adjectives associated with the sampled polarity and degree for each Big-Five dimension. The 5×n5𝑛5\times n5 × italic_n adjectives across all dimensions are then randomly shuffled and given as an instruction to agent k𝑘kitalic_k.

Dialogue Simulation

For the dialogue simulation process, we set a maximum length of TMAX=20subscript𝑇𝑀𝐴𝑋20T_{MAX}=20italic_T start_POSTSUBSCRIPT italic_M italic_A italic_X end_POSTSUBSCRIPT = 20 utterances. We use GPT-4 (gpt-4-0613) and the function calling module provided by OpenAI to implement the negotiation state detector. The full dialogue context are given to the negotiation state detection as input. The prompt for negotiation state detection can be found in Appendix A.1. We collect a total of 1499149914991499 negotiation dialogues with our simulation methodology.

4.2 Evaluation of the Negotiations

We mainly evaluate the negotiations in terms of utility and whether the negotiations are successful or not Baarslag et al. (2016); Lin et al. (2023). Recall that utility functions serve as mathematical tools for quantifying the quality of decision outcomes Simon (1990). In our study we adopt a number of economic metric commonly used to evaluate negotiations Baarslag et al. (2016).

Intrinsic Utility (IU)

Based on the negotiation instructions, the utility of buyer and seller for a particular price p𝑝pitalic_p is expressed in (Eq. 3).

us,ub:+[0,1]us(p)=p\stackunder[1.2pt]p sp¯s\stackunder[1.2pt]p sub(p)=p¯bpp¯b\stackunder[1.2pt]p b:subscript𝑢𝑠subscript𝑢𝑏superscript01subscript𝑢𝑠𝑝𝑝\stackunderdelimited-[]1.2𝑝𝑡psubscript 𝑠subscript¯𝑝𝑠\stackunderdelimited-[]1.2𝑝𝑡psubscript 𝑠subscript𝑢𝑏𝑝subscript¯𝑝𝑏𝑝subscript¯𝑝𝑏\stackunderdelimited-[]1.2𝑝𝑡psubscript 𝑏\begin{split}u_{s},u_{b}:\mathbb{R}^{+}\rightarrow[0,1]\\ u_{s}(p)=\frac{p-\stackunder[1.2pt]{$p$}{\rule{3.44444pt}{0.32289pt}}_{s}}{% \bar{p}_{s}-\stackunder[1.2pt]{$p$}{\rule{3.44444pt}{0.32289pt}}_{s}}\\ u_{b}(p)=\frac{\bar{p}_{b}-p}{\bar{p}_{b}-\stackunder[1.2pt]{$p$}{\rule{3.4444% 4pt}{0.32289pt}}_{b}}\end{split}start_ROW start_CELL italic_u start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT , italic_u start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT : blackboard_R start_POSTSUPERSCRIPT + end_POSTSUPERSCRIPT → [ 0 , 1 ] end_CELL end_ROW start_ROW start_CELL italic_u start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ( italic_p ) = divide start_ARG italic_p - [ 1.2 italic_p italic_t ] p start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT end_ARG start_ARG over¯ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT - [ 1.2 italic_p italic_t ] p start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT end_ARG end_CELL end_ROW start_ROW start_CELL italic_u start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT ( italic_p ) = divide start_ARG over¯ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT - italic_p end_ARG start_ARG over¯ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT - [ 1.2 italic_p italic_t ] p start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT end_ARG end_CELL end_ROW (3)

As illustrated in the example of Figure 1, the prices \stackunder[1.2pt]p s\stackunderdelimited-[]1.2𝑝𝑡𝑝subscript 𝑠\stackunder[1.2pt]{$p$}{\rule{3.44444pt}{0.32289pt}}_{s}[ 1.2 italic_p italic_t ] italic_p start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT and p¯ssubscript¯𝑝𝑠\bar{p}_{s}over¯ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT are the seller’s reservation price and initial price, and \stackunder[1.2pt]p b\stackunderdelimited-[]1.2𝑝𝑡𝑝subscript 𝑏\stackunder[1.2pt]{$p$}{\rule{3.44444pt}{0.32289pt}}_{b}[ 1.2 italic_p italic_t ] italic_p start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT and p¯bsubscript¯𝑝𝑏\bar{p}_{b}over¯ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT are the buyer’s initial price and reservation price. Here, \stackunder[1.2pt]p s\stackunderdelimited-[]1.2𝑝𝑡𝑝subscript 𝑠\stackunder[1.2pt]{$p$}{\rule{3.44444pt}{0.32289pt}}_{s}[ 1.2 italic_p italic_t ] italic_p start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT is the price the seller is willing to accept without losing money. Similarly, the buyer’s reservation price p¯bsubscript¯𝑝𝑏\bar{p}_{b}over¯ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT is the maximum price it is willing to pay. Generally, the agreement zones of the agents are defined as the intersection between [\stackunder[1.2pt]p b,p¯b]\stackunderdelimited-[]1.2𝑝𝑡𝑝subscript 𝑏subscript¯𝑝𝑏[\stackunder[1.2pt]{$p$}{\rule{3.44444pt}{0.32289pt}}_{b},\bar{p}_{b}][ [ 1.2 italic_p italic_t ] italic_p start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT , over¯ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT ] and [\stackunder[1.2pt]p s,p¯s]\stackunderdelimited-[]1.2𝑝𝑡𝑝subscript 𝑠subscript¯𝑝𝑠[\stackunder[1.2pt]{$p$}{\rule{3.44444pt}{0.32289pt}}_{s},\bar{p}_{s}][ [ 1.2 italic_p italic_t ] italic_p start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT , over¯ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ]. We set \stackunder[1.2pt]p s\stackunderdelimited-[]1.2𝑝𝑡𝑝subscript 𝑠\stackunder[1.2pt]{$p$}{\rule{3.44444pt}{0.32289pt}}_{s}[ 1.2 italic_p italic_t ] italic_p start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT and p¯bsubscript¯𝑝𝑏\bar{p}_{b}over¯ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT by assuming that the agreement zone is defined as a percentage of [\stackunder[1.2pt]p b[\stackunder[1.2pt]{$p$}{\rule{3.44444pt}{0.32289pt}}_{b}[ [ 1.2 italic_p italic_t ] italic_p start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT, p¯b]\bar{p}_{b}]over¯ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT ]. Second, [\stackunder[1.2pt]p b,p¯b]\stackunderdelimited-[]1.2𝑝𝑡𝑝subscript 𝑏subscript¯𝑝𝑏[\stackunder[1.2pt]{$p$}{\rule{3.44444pt}{0.32289pt}}_{b},\bar{p}_{b}][ [ 1.2 italic_p italic_t ] italic_p start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT , over¯ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT ] and [\stackunder[1.2pt]p s,p¯s]\stackunderdelimited-[]1.2𝑝𝑡𝑝subscript 𝑠subscript¯𝑝𝑠[\stackunder[1.2pt]{$p$}{\rule{3.44444pt}{0.32289pt}}_{s},\bar{p}_{s}][ [ 1.2 italic_p italic_t ] italic_p start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT , over¯ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ] are private to the agents. It is important to note that an off p𝑝pitalic_p is not guaranteed to fall within the intervals due to the language model.

Joint Utility (JU)

We measure the fairness of negotiation outcomes using a joint utility function (Eq. 4) inspired by Nash solution for bargaining problems Luce and Raiffa (1989).

usb(p)=(p\stackunder[1.2pt]p s)(p¯bp)(p¯b\stackunder[1.2pt]p s)2subscript𝑢𝑠𝑏𝑝𝑝\stackunderdelimited-[]1.2𝑝𝑡𝑝subscript 𝑠subscript¯𝑝𝑏𝑝superscriptsubscript¯𝑝𝑏\stackunderdelimited-[]1.2𝑝𝑡𝑝subscript 𝑠2\displaystyle u_{sb}(p)=\frac{(p-\stackunder[1.2pt]{$p$}{\rule{3.44444pt}{0.32% 289pt}}_{s})(\bar{p}_{b}-p)}{(\bar{p}_{b}-\stackunder[1.2pt]{$p$}{\rule{3.4444% 4pt}{0.32289pt}}_{s})^{2}}italic_u start_POSTSUBSCRIPT italic_s italic_b end_POSTSUBSCRIPT ( italic_p ) = divide start_ARG ( italic_p - [ 1.2 italic_p italic_t ] italic_p start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) ( over¯ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT - italic_p ) end_ARG start_ARG ( over¯ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT - [ 1.2 italic_p italic_t ] italic_p start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG (4)

Such quantity is proportional to the product of the buyer’s and seller’s intrinsic utilities. Higher joint utility values indicate that the outcome if fair for both agents. For instance, an agreement price yielding a utility of 0.50.50.50.5 for both agents is more equitable than an outcome yielding 0.80.80.80.8 and 0.20.20.20.2.

Concession Rate (CR)

Given the negotiation objectives, the offers could be assumed to undergo some form of decay akin to concessions. That is, an agent k𝑘kitalic_k will make an offer at round t[1,T]𝑡1𝑇t\in[1,T]italic_t ∈ [ 1 , italic_T ] based on a discounted utility function (Eq. 5), with concession rate ck[0,1]subscript𝑐𝑘01c_{k}\in[0,1]italic_c start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT ∈ [ 0 , 1 ].

uk(t)=\stackunder[1.2pt]p k+(p¯k\stackunder[1.2pt]p k)×(TtT)cksuperscriptsubscript𝑢𝑘𝑡\stackunderdelimited-[]1.2𝑝𝑡𝑝subscript 𝑘subscript¯𝑝𝑘\stackunderdelimited-[]1.2𝑝𝑡𝑝subscript 𝑘superscript𝑇𝑡𝑇subscript𝑐𝑘u_{k}^{(t)}=\stackunder[1.2pt]{p}{\rule{3.44444pt}{0.32289pt}}_{k}+(\bar{p}_{k% }-\stackunder[1.2pt]{p}{\rule{3.44444pt}{0.32289pt}}_{k})\times\bigg{(}\frac{T% -t}{T}\bigg{)}^{c_{k}}italic_u start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_t ) end_POSTSUPERSCRIPT = [ 1.2 italic_p italic_t ] italic_p start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT + ( over¯ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT - [ 1.2 italic_p italic_t ] italic_p start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT ) × ( divide start_ARG italic_T - italic_t end_ARG start_ARG italic_T end_ARG ) start_POSTSUPERSCRIPT italic_c start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT end_POSTSUPERSCRIPT (5)

Applied to utility functions of the buyer and seller (Eq. 3), we obtain the concession rates (Eq. 6).

CRs=t=1Tlog(p¯sptp¯s\stackunder[1.2pt]p s)CRb=t=1Tlog(pt\stackunder[1.2pt]p bp¯b\stackunder[1.2pt]p b)𝐶subscript𝑅𝑠superscriptsubscript𝑡1𝑇subscript¯𝑝𝑠subscript𝑝𝑡subscript¯𝑝𝑠\stackunderdelimited-[]1.2𝑝𝑡psubscript 𝑠𝐶subscript𝑅𝑏superscriptsubscript𝑡1𝑇subscript𝑝𝑡\stackunderdelimited-[]1.2𝑝𝑡psubscript 𝑏subscript¯𝑝𝑏\stackunderdelimited-[]1.2𝑝𝑡psubscript 𝑏\begin{split}CR_{s}=\sum_{t=1}^{T}\log\bigg{(}\frac{\bar{p}_{s}-p_{t}}{\bar{p}% _{s}-\stackunder[1.2pt]{$p$}{\rule{3.44444pt}{0.32289pt}}_{s}}\bigg{)}\\ CR_{b}=\sum_{t=1}^{T}\log\bigg{(}\frac{p_{t}-\stackunder[1.2pt]{$p$}{\rule{3.4% 4444pt}{0.32289pt}}_{b}}{\bar{p}_{b}-\stackunder[1.2pt]{$p$}{\rule{3.44444pt}{% 0.32289pt}}_{b}}\bigg{)}\end{split}start_ROW start_CELL italic_C italic_R start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT = ∑ start_POSTSUBSCRIPT italic_t = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_T end_POSTSUPERSCRIPT roman_log ( divide start_ARG over¯ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT - italic_p start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_ARG start_ARG over¯ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT - [ 1.2 italic_p italic_t ] p start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT end_ARG ) end_CELL end_ROW start_ROW start_CELL italic_C italic_R start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT = ∑ start_POSTSUBSCRIPT italic_t = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_T end_POSTSUPERSCRIPT roman_log ( divide start_ARG italic_p start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT - [ 1.2 italic_p italic_t ] p start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT end_ARG start_ARG over¯ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT - [ 1.2 italic_p italic_t ] p start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT end_ARG ) end_CELL end_ROW (6)
Negotiation Success Rate (NSR)

The ratio (Eq. 7) is that of successful negotiations Tsuccsubscript𝑇𝑠𝑢𝑐𝑐T_{succ}italic_T start_POSTSUBSCRIPT italic_s italic_u italic_c italic_c end_POSTSUBSCRIPT relative to the total number of negotiation rounds T𝑇Titalic_T.

NSR=TsuccT𝑁𝑆𝑅subscript𝑇𝑠𝑢𝑐𝑐𝑇\displaystyle NSR=\frac{T_{succ}}{T}italic_N italic_S italic_R = divide start_ARG italic_T start_POSTSUBSCRIPT italic_s italic_u italic_c italic_c end_POSTSUBSCRIPT end_ARG start_ARG italic_T end_ARG (7)
Average Negotiation Round (ANR)

The average (Eq. 8) refers to the speed of successful negotiation Lin et al. (2023).

ANR=1Tsucck=1TsuccRk𝐴𝑁𝑅1subscript𝑇𝑠𝑢𝑐𝑐superscriptsubscript𝑘1subscript𝑇𝑠𝑢𝑐𝑐subscript𝑅𝑘\displaystyle ANR=\frac{1}{T_{succ}}\sum_{k=1}^{T_{succ}}R_{k}italic_A italic_N italic_R = divide start_ARG 1 end_ARG start_ARG italic_T start_POSTSUBSCRIPT italic_s italic_u italic_c italic_c end_POSTSUBSCRIPT end_ARG ∑ start_POSTSUBSCRIPT italic_k = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_T start_POSTSUBSCRIPT italic_s italic_u italic_c italic_c end_POSTSUBSCRIPT end_POSTSUPERSCRIPT italic_R start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT (8)

where Rksubscript𝑅𝑘R_{k}italic_R start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT is the number of rounds of the kthsuperscript𝑘𝑡k^{th}italic_k start_POSTSUPERSCRIPT italic_t italic_h end_POSTSUPERSCRIPT successful negotiation.

5 Results and Analysis

In this section, we conduct an analysis of the negotiation outcomes based on the dialogues generated in the negotiation simulations.

5.1 Negotiation Outcomes and Personality

Personality EXT AGR CON NEU OPE
Buyer Seller Buyer Seller Buyer Seller Buyer Seller Buyer Seller
Intrinsic Utility 0.039 -0.025 -0.056** -0.262** 0.044* 0.127** 0.036 0.064** 0.001 -0.001
Joint Utility 0.001 0.069** 0.054** 0.118** -0.016 0.072** -0.058** 0.017 0.037 0.063**
Concession Rate -0.009 0.042* 0.051** 0.261** -0.010 -0.097** -0.020 -0.074** -0.007 0.016
Success Rate 0.072** 0.036 0.065** 0.052** 0.026 0.001 -0.007 0.021 0.008 0.046*
Negotiation Rounds -0.024 -0.060** -0.136** -0.223** 0.083** 0.039 0.019 -0.003 0.017 -0.039
Table 2: Spearman’s correlation coefficients illustrating the relationships between negotiation metrics and Big-Five personality traits. Asterisks indicate statistical significance, with * denoting p<0.1𝑝0.1p<0.1italic_p < 0.1 and ** denoting p<0.05𝑝0.05p<0.05italic_p < 0.05.

First, we analyze the relationships between the negotiation outcomes and the personality traits of agents. Table 2 illustrates the Spearman’s rank correlation coefficients between the economic metrics introduced in section 4.2 and Big-Five personality traits.111The absolute value of the observed coefficients with statistical significance are all smaller than 0.30.30.30.3, only indicating only a mild correlation. Along the extraversion (EXT) dimension, we observed that extroverted buyer agents tend to result in more successful negotiations (ρ=0.072𝜌superscript0.072absent\rho=0.072^{**}italic_ρ = 0.072 start_POSTSUPERSCRIPT ∗ ∗ end_POSTSUPERSCRIPT). On the other hand, an extroverted seller agent tend to result in a slightly higher joint utility, which indicates a fairer outcome for both negotiation participants. Among the five dimensions, agreeableness (AGR) has the strongest impact on negotiation outcomes, especially for the seller. We found that being agreeable leads to a disadvantage in bargaining in terms of intrinsic utility (ρ=0.262𝜌superscript0.262absent\rho=-0.262^{**}italic_ρ = - 0.262 start_POSTSUPERSCRIPT ∗ ∗ end_POSTSUPERSCRIPT). However, agreeableness correlated positively with joint utility (ρ=0.118𝜌superscript0.118absent\rho=0.118^{**}italic_ρ = 0.118 start_POSTSUPERSCRIPT ∗ ∗ end_POSTSUPERSCRIPT), concession rates (ρ=0.261𝜌superscript0.261absent\rho=0.261^{**}italic_ρ = 0.261 start_POSTSUPERSCRIPT ∗ ∗ end_POSTSUPERSCRIPT), and negotiation success (ρ=0.052𝜌superscript0.052absent\rho=0.052^{**}italic_ρ = 0.052 start_POSTSUPERSCRIPT ∗ ∗ end_POSTSUPERSCRIPT), pointing to a propensity for cooperative behavior that benefits both negotiating parties. Also, agents tend to reach an agreement with fewer number of negotiation rounds (ρ=0.223𝜌superscript0.223absent\rho=-0.223^{**}italic_ρ = - 0.223 start_POSTSUPERSCRIPT ∗ ∗ end_POSTSUPERSCRIPT) with mutually satisfying outcomes. This aligns with the positive effect of agreeableness on the negotiators’ distributive outcomes reported in Sass and Liao-Troth (2015). Aligning with previous findings Barry and Friedman (1998), we observed a positive correlation of conscientiousness (CON) and negotiation performance, especially for seller (intrinsic utility, ρ=0.127𝜌superscript0.127absent\rho=0.127^{**}italic_ρ = 0.127 start_POSTSUPERSCRIPT ∗ ∗ end_POSTSUPERSCRIPT). Conscientiousness is also manifested in the negotiation style of not willing to concede (ρ=0.097𝜌superscript0.097absent\rho=-0.097^{**}italic_ρ = - 0.097 start_POSTSUPERSCRIPT ∗ ∗ end_POSTSUPERSCRIPT) on the seller side, and a lengthier negotiation on the buyer side (ρ=0.083𝜌superscript0.083absent\rho=0.083^{**}italic_ρ = 0.083 start_POSTSUPERSCRIPT ∗ ∗ end_POSTSUPERSCRIPT). In psychology literature, neuroticism (NEU) and openness (OPE) are expected to play a less predominant role in negotiations Falcão et al. (2018). Similarly, we only observe some very weak correlation (with magnitude <0.1absent0.1<0.1< 0.1) along these dimensions. For instance, neurotic sellers tend to make less concessions (ρ=0.074𝜌superscript0.074absent\rho=-0.074^{**}italic_ρ = - 0.074 start_POSTSUPERSCRIPT ∗ ∗ end_POSTSUPERSCRIPT) and have a slightly higher utility gain (ρ=0.064𝜌superscript0.064absent\rho=0.064^{**}italic_ρ = 0.064 start_POSTSUPERSCRIPT ∗ ∗ end_POSTSUPERSCRIPT), while open-minded sellers lead to enhanced joint gain (ρ=0.063𝜌superscript0.063absent\rho=0.063^{**}italic_ρ = 0.063 start_POSTSUPERSCRIPT ∗ ∗ end_POSTSUPERSCRIPT). These results points to how personality traits could impact the outcomes of negotiations with different effects observed based on the role of the negotiator.

5.2 Negotiation Strategies

So far, the buyer and the seller were defined on the basis of personality traits and economic preferences. We now look at their strategies and the consequent effects on the joint negotiation outcomes. This investigation could answer questions of the type “What would be the optimal strategy for a buyer, who happens to be neurotic, when facing a disagreeable and conscientious seller?”.

At each around, each agent adopts a specific strategy σtsubscript𝜎𝑡\sigma_{t}italic_σ start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT that results in some price ptsubscript𝑝𝑡p_{t}italic_p start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT, inferred from state stsubscript𝑠𝑡s_{t}italic_s start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT. Given that the outcome of a successful negotiation is the final price pdealsubscript𝑝𝑑𝑒𝑎𝑙p_{deal}italic_p start_POSTSUBSCRIPT italic_d italic_e italic_a italic_l end_POSTSUBSCRIPT, we are interested in the relationship between the adopted strategies and the joint utility of the agreement price, usb(pdeal)subscript𝑢𝑠𝑏subscript𝑝𝑑𝑒𝑎𝑙u_{sb}(p_{deal})italic_u start_POSTSUBSCRIPT italic_s italic_b end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_d italic_e italic_a italic_l end_POSTSUBSCRIPT ). We manually inspected the strategies that occur more than 20202020 times within the entire negotiations and construct a sets of strategy categories the agents. We then conducted a linear regression between the strategy categories and the resulting joint utility values as illustrated in Figure 2.

Refer to caption
Figure 2: (Left) Positive and negative relationships between personality traits and strategies. Darker cells indicate higher statistical significance. (Right) Impact of strategies on the joint utility of the agreement price pdealsubscript𝑝𝑑𝑒𝑎𝑙p_{deal}italic_p start_POSTSUBSCRIPT italic_d italic_e italic_a italic_l end_POSTSUBSCRIPT. Labels on the y𝑦yitalic_y axes list the most common strategies among agents, occurring more than 20202020 times within the entire negotiations.

As shown on the right side of the Figure, collaborative strategies exhibit positive effects on the joint gain of both negotiators. For instance, accommodating (β=0.125𝛽0.125\beta=0.125italic_β = 0.125) and conceding (β=0.093𝛽0.093\beta=0.093italic_β = 0.093) strategies contribute positively to joint utility. Conversely, assertive and aggressive strategies (β=0.261𝛽0.261\beta=-0.261italic_β = - 0.261) negatively impact joint utility. This suggests that collaborative strategies are more beneficial for achieving mutual gains, while assertiveness diminishes joint gain. The left side of Figure 2 illustrates how these strategies depend on certain personality traits. We found that assertive strategies are more commonly expected from disagreeable agents (AGR-). On the other hand, neurotic traits (NEU+) do not lead to concessions, whereas a lack of neurotic traits (NEU-) leads to concessions. Finally, agents with neurotic traits seem to employ more empathetic strategies, while by contrast, agents with fewer neurotic traits will refrain from them.

Refer to caption
(a) Seller
Refer to caption
(b) Buyer
Figure 3: (Left) Relationship between personality traits and strategies. Darker cells indicate higher statistical significance. (Right) Impact of strategies on intrinsic utility (IU) gains. Labels on the y𝑦yitalic_y axes list the most common strategies, occurring more than 20202020 times within the entire negotiations.

In addition to the joint case illustrated in Figure 2, we have also looked at the individual gains of the buyer and the seller using their intrinsic utility functions ub(pdeal)subscript𝑢𝑏subscript𝑝𝑑𝑒𝑎𝑙u_{b}(p_{deal})italic_u start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_d italic_e italic_a italic_l end_POSTSUBSCRIPT ) and us(pdeal)subscript𝑢𝑠subscript𝑝𝑑𝑒𝑎𝑙u_{s}(p_{deal})italic_u start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_d italic_e italic_a italic_l end_POSTSUBSCRIPT ). Again, we start by constructing the strategy sets of the agents k{s,b}𝑘𝑠𝑏k\in\{s,b\}italic_k ∈ { italic_s , italic_b }, namely ΣssubscriptΣ𝑠\Sigma_{s}roman_Σ start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT and ΣbsubscriptΣ𝑏\Sigma_{b}roman_Σ start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT. We found that ΣbΣssubscriptΣ𝑏subscriptΣ𝑠\Sigma_{b}\subseteq\Sigma_{s}roman_Σ start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT ⊆ roman_Σ start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT, indicating that sellers have additional strategies such as attempting to emphasize the target price. Generally, at time t𝑡titalic_t, agent k𝑘kitalic_k adopts a strategy σk,tΣksubscript𝜎𝑘𝑡subscriptΣ𝑘\sigma_{k,t}\in\Sigma_{k}italic_σ start_POSTSUBSCRIPT italic_k , italic_t end_POSTSUBSCRIPT ∈ roman_Σ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT, resulting in some price ptsubscript𝑝𝑡p_{t}italic_p start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT, inferred from state stsubscript𝑠𝑡s_{t}italic_s start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT. Given that the outcome of a successful negotiation is the final price pdealsubscript𝑝𝑑𝑒𝑎𝑙p_{deal}italic_p start_POSTSUBSCRIPT italic_d italic_e italic_a italic_l end_POSTSUBSCRIPT, we are interested in the relationship between the strategies of the agents ΣssubscriptΣ𝑠\Sigma_{s}roman_Σ start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT and ΣbsubscriptΣ𝑏\Sigma_{b}roman_Σ start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT and the utility values of the deal price of the buyer ub(pdeal)subscript𝑢𝑏subscript𝑝𝑑𝑒𝑎𝑙u_{b}(p_{deal})italic_u start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_d italic_e italic_a italic_l end_POSTSUBSCRIPT ) and seller us(pdeal)subscript𝑢𝑠subscript𝑝𝑑𝑒𝑎𝑙u_{s}(p_{deal})italic_u start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_d italic_e italic_a italic_l end_POSTSUBSCRIPT ). To this end, we conducted a regression between strategies and the the quantities, illustrated in Figure 3, aggregated across products and personality traits. Labels on the y𝑦yitalic_y axes are the predominant, unified strategies of players.

Figure 3(a) (right) illustrates a nuanced impact of strategies on the seller’s utility gain, highlighting a spectrum of strategies from cooperative to non-cooperative tactics (soft to hardball). Strategies positioned at the assertive end of the spectrum, such as assertiveness (0.230.230.230.23) exhibit a positive effect leading to an enhanced utility gain us(pdeal)subscript𝑢𝑠subscript𝑝𝑑𝑒𝑎𝑙u_{s}(p_{deal})italic_u start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_d italic_e italic_a italic_l end_POSTSUBSCRIPT ). On the cooperative end, strategies such as concession (0.110.11-0.11- 0.11) or empathy (0.130.13-0.13- 0.13) show negative impacts on the seller’s utility. These results suggest that assertive strategies are more beneficial for sellers, while cooperative strategies tend to diminish their utility gain. We now propose to look at the relatedness of the strategies of the agents to their personality traits using a Pearson’s Chi-square test. The heat-map cells on Figure 3(a) (left) illustrate the positive (red) and negative (blue) strength of dependence between the traits (x axis) and strategies (y axis). We could see for example, that disagreeableness (AGR-) aligns with non-collaborative strategies, while neuroticism (NEU) aligns with aggressiveness.

Seller Buyer Negotiation Dialogue p¯ssubscript¯𝑝𝑠\bar{p}_{s}over¯ start_ARG italic_p end_ARG start_POSTSUBSCRIPT italic_s end_POSTSUBSCRIPT \stackunder[1.2pt]p b\stackunderdelimited-[]1.2𝑝𝑡𝑝subscript 𝑏\stackunder[1.2pt]{$p$}{\rule{3.44444pt}{0.32289pt}}_{b}[ 1.2 italic_p italic_t ] italic_p start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT pdealsubscript𝑝𝑑𝑒𝑎𝑙p_{deal}italic_p start_POSTSUBSCRIPT italic_d italic_e italic_a italic_l end_POSTSUBSCRIPT
OPE+
CON-
EXT---
AGR---
NEU+
OPE---
CON---
EXT--
AGR-
NEU+
Buyer: Hello, I’m interested in your Stereo Speaker. Could you please tell me the price?
Seller: Yeah, the beautiful survivor from the Magnavox era? Its price is $80. Solid piece, you won’t find another one like this with such a unique gold tone finish, trust me.

Seller: You are killing me here, really. I’m practically giving it away at this rate. But alright, let’s meet halfway. How about $60?
Buyer: …Um… okay, it’s a deal.
50 30 60
OPE--
CON---
EXT+
AGR---
NEU+
OPE--
CON+
EXT---
AGR+
NEU---
Seller: The iPhone 5S I’m selling is listed for a flat $160. Can’t really go any lower than that. Trust me, the phone is in like-new condition…
Buyer: Oh, I understand. I’m on a very tight budget at the moment, you see, and I was hoping to spend around $144… Also, it’s not for me, it’s for my elderly parent. They aren’t tech-savvy so even older models work for them…
Seller: Oh sure, pull at my heartstrings with the elderly parent bit. You know, some might fall for that. But let me tell ya, pal, life ain’t a fairytale. The iPhone’s $160, like I said earlier.
Buyer: I understand and respect your stance. It’s just my financial condition that’s restricting… What about $150, as my final offer?
Seller: Look, this isn’t a charity. It’s $160 or nothing.
160 144 160
Table 3: The bold parts of the dialogues show deceptive and hardheaded negotiation behaviors.

For the buyer (Figure 3(b) (right)), collaborative strategies such as softness (0.060.060.060.06) and empathy (0.030.030.030.03) exhibit positive effects on deal utility ub(pdeal)subscript𝑢𝑏subscript𝑝𝑑𝑒𝑎𝑙u_{b}(p_{deal})italic_u start_POSTSUBSCRIPT italic_b end_POSTSUBSCRIPT ( italic_p start_POSTSUBSCRIPT italic_d italic_e italic_a italic_l end_POSTSUBSCRIPT ), indicating that strategies substantially enhance the buyer’s gains. Concession shows moderate negative impacts (0.010.01-0.01- 0.01). Assertiveness (0.110.11-0.11- 0.11) is associated with the most significant reduction in the utility. Collaborative strategies seem to also be more beneficial for buyers, while assertiveness tend to diminish their utility gain. Figure 3(b) (left), shows that a neurotic buyer (NEU+) tends to concede less and use empathy, while a less neurotic buyer (NEU-) will concede more and use less emphatic strategies.

From Figures 3(b) and 3(a), it is possible to recover the strategic asymmetry that is characteristic of our bargaining game. Some strategies have opposing effects on the intrinsic utilities of the agents. For instance, assertiveness has a coefficient of 0.10.1-0.1- 0.1 for the buyer and 0.230.230.230.23 for the seller. Assertiveness, however, is detrimental to the joint utility as illustrated by the coefficient 0.450.45-0.45- 0.45 on Figure 2.

5.3 Case Study

We conducted qualitative analysis of the negotiation simulation results. Table 3 shows two distinct examples of dialogues generated in the negotiation simulations.

In the example on the first row, the seller and the buyer are negotiating over a stereo speaker. When the buyer asked about the price, the seller provides a price ($80currency-dollar80\$80$ 80) that is higher than the listing price ($50currency-dollar50\$50$ 50), and ends up striking a deal at $60currency-dollar60\$60$ 60, which is higher than the listing price. We observed this kind of deceiving behavior in the negotiations involving disagreeable agents. The second example is a negotiation on a second-hand iPhone. We can see that buyer tries to emotionally appeal to the seller by mentioning her ‘my elderly parent’ but the seller is not persuaded and adopts a ‘take-it-or-leave-it’ strategy. Despite the constant effort of the buyer to find a common ground with the seller, the later is not willing to change the offer price ($160currency-dollar160\$160$ 160). We observe more similar ‘hardball’ negotiation strategies with disagreeable and close-minded agents. At the end of the negotiation, the buyer concedes and accept the seller’s offer. The above examples showcase a range of negotiation behaviors such as deception, emotional appeal, hard-headed behavior Baarslag et al. (2016). This illustrates how specific personality traits influence negotiation styles.

6 Conclusion

This study introduced a novel simulation framework that integrates language model (LLM) agents equipped with synthesized Big-Five personality traits. These agents were deployed in traditional bargaining scenarios to simulate negotiation processes. Our experimental findings indicate that the behavioral patterns demonstrated by the LLM-based agents closely mirror those exhibited by human negotiators. Furthermore, a detailed case study of synthesized bargaining dialogues highlighted distinct behaviors, including deceit and compromise, augmenting our understanding of linguistic and economic agent interactions. Our contributions are twofold. Firstly, we established a robust simulation methodology to examine the linguistic and economic dynamics of LLM agents. Secondly, we provided comprehensive empirical evidence on the strategic impact of Big-Five personality traits on negotiation outcomes, offering valuable insights into the mechanics of artificial negotiation agents.

In addition to potential expansions of the proposed economic and personality models, it is essential to note that the presented framework presents certain risks that require further investigation. One area of concern is the application of these agents within assistive technologies, such as chatbots on financial and banking platforms.

References

  • Akata et al. (2023) Elif Akata, Lion Schulz, Julian Coda-Forno, Seong Joon Oh, Matthias Bethge, and Eric Schulz. 2023. Playing repeated games with large language models. arXiv preprint arXiv:2305.16867.
  • Amanatullah et al. (2008) Emily T Amanatullah, Michael W Morris, and Jared R Curhan. 2008. Negotiators who give too much: Unmitigated communion, relational anxieties, and economic costs in distributive and integrative bargaining. Journal of personality and social psychology, 95(3):723.
  • Baarslag et al. (2016) Tim Baarslag, Mark JC Hendrikx, Koen V Hindriks, and Catholijn M Jonker. 2016. Learning about the opponent in automated bilateral negotiation: a comprehensive survey of opponent modeling techniques. Autonomous Agents and Multi-Agent Systems, 30:849–898.
  • Barry and Friedman (1998) Bruce Barry and Raymond A Friedman. 1998. Bargainer characteristics in distributive and integrative negotiation. Journal of personality and social psychology, 74(2):345.
  • Bayram and Aydemir (2017) Nuran Bayram and Mine Aydemir. 2017. Decision-making styles and personality traits. International Journal of Recent Advances in Organizational Behaviour and Decision Sciences, 3(1):905–915.
  • Costa Jr and McCrae (1995) Paul T Costa Jr and Robert R McCrae. 1995. Domains and facets: Hierarchical personality assessment using the revised neo personality inventory. Journal of personality assessment, 64(1):21–50.
  • Daniel (2017) Kahneman Daniel. 2017. Thinking, fast and slow.
  • El Othman et al. (2020) Radwan El Othman, Rola El Othman, Rabih Hallit, Sahar Obeid, and Souheil Hallit. 2020. Personality traits, emotional intelligence and decision-making styles in lebanese universities medical students. BMC psychology, 8:1–14.
  • Erjavec et al. (2019) Jure Erjavec, Ales Popovič, and Peter Trkman. 2019. The effect of personality traits and knowledge on the quality of decisions in supply chains. Economic research-Ekonomska istraživanja, 32(1):2269–2292.
  • Evans (2014) Jonathan St BT Evans. 2014. Rationality and the illusion of choice. Frontiers in psychology, 5:104.
  • Falcão et al. (2018) Pedro Fontes Falcão, Manuel Saraiva, Eduardo Santos, and Miguel Pina e Cunha. 2018. Big five personality traits in simulated negotiation settings. EuroMed Journal of Business, 13(2):201–213.
  • Fu et al. (2023) Yao Fu, Hao Peng, Tushar Khot, and Mirella Lapata. 2023. Improving language model negotiation with self-play and in-context learning from ai feedback.
  • Gibbons (1992) Robert S Gibbons. 1992. Game theory for applied economists. Princeton University Press.
  • Goldberg (1992) Lewis R Goldberg. 1992. The development of markers for the big-five factor structure. Psychological assessment, 4(1):26.
  • He et al. (2018) He He, Derek Chen, Anusha Balakrishnan, and Percy Liang. 2018. Decoupling strategy and generation in negotiation dialogues. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 2333–2343, Brussels, Belgium. Association for Computational Linguistics.
  • Jennings et al. (2001) Nicholas R Jennings, Peyman Faratin, Alessio R Lomuscio, Simon Parsons, Carles Sierra, and Michael Wooldridge. 2001. Automated negotiation: prospects, methods and challenges. International Journal of Group Decision and Negotiation, 10(2):199–215.
  • John et al. (1999) Oliver P John, Sanjay Srivastava, et al. 1999. The big-five trait taxonomy: History, measurement, and theoretical perspectives.
  • Lin et al. (2023) Kai-Biao Lin, Ying Wei, Yong Liu, Fei-Ping Hong, Yi-Min Yang, and Ping Lu. 2023. An opponent model for agent-based shared decision-making via a genetic algorithm. Frontiers in Psychology, 14.
  • Luce and Raiffa (1989) R Duncan Luce and Howard Raiffa. 1989. Games and decisions: Introduction and critical survey. Courier Corporation.
  • OpenAI (2023) OpenAI. 2023. Gpt-4 technical report.
  • Oren et al. (2023) Yonatan Oren, Nicole Meister, Niladri Chatterji, Faisal Ladhak, and Tatsunori B Hashimoto. 2023. Proving test set contamination in black box language models. arXiv preprint arXiv:2310.17623.
  • Park et al. (2022) Joon Sung Park, Lindsay Popowski, Carrie Cai, Meredith Ringel Morris, Percy Liang, and Michael S Bernstein. 2022. Social simulacra: Creating populated prototypes for social computing systems. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology, pages 1–18.
  • Phillips-Wren and Adya (2020) Gloria Phillips-Wren and Monica Adya. 2020. Decision making under stress: The role of information overload, time pressure, complexity, and uncertainty. Journal of Decision Systems, 29(sup1):213–225.
  • Raiffa (1982) Howard Raiffa. 1982. The art and science of negotiation. Harvard University Press.
  • Sass and Liao-Troth (2015) Mary Sass and Matthew Liao-Troth. 2015. Personality and negotiation performance: The people matter. Journal of Collective Negotiations.
  • Serapio-García et al. (2023) Greg Serapio-García, Mustafa Safdari, Clément Crepy, Luning Sun, Stephen Fitz, Peter Romero, Marwa Abdulhai, Aleksandra Faust, and Maja Matarić. 2023. Personality traits in large language models.
  • Simon (1990) Herbert A Simon. 1990. Bounded rationality. Utility and probability, pages 15–18.
  • Tamkin et al. (2021) Alex Tamkin, Miles Brundage, Jack Clark, and Deep Ganguli. 2021. Understanding the capabilities, limitations, and societal impact of large language models. arXiv preprint arXiv:2102.02503.
  • Tian et al. (2018) Leimin Tian, Catherine Lai, and Johanna Moore. 2018. Polarity and intensity: the two aspects of sentiment analysis. In Proceedings of Grand Challenge and Workshop on Human Multimodal Language (Challenge-HML), pages 40–47, Melbourne, Australia. Association for Computational Linguistics.
  • Toledo and Carson (2023) Felippe Toledo and Fraser Carson. 2023. Neurocircuitry of personality traits and intent in decision-making. Behavioral Sciences, 13(5):351.
  • Urieta et al. (2021) Patricia Urieta, Anton Aluja, Luis F Garcia, Ferran Balada, and Elena Lacomba. 2021. Decision-making and the alternative five factor personality model: Exploring the role of personality traits, age, sex and social position. Frontiers in Psychology, 12:717705.

Appendix A Appendix

A.1 Prompt Settings

The following shows the instructions given to the LLM negotiation agents. For each agent, we first specify the negotiation objectives and then the personality instructions through personality-describing adjectives.

The instruction we use for the buyer is the following:

Prompt for buyer agent Act as a buyer and try to strike a deal for a [PRODUCT] with a lower price through conversation. Your reply should not be too long. You would like to pay for [TARGET PRICE]. You can accept higher price though if the item is really good or there are other perks.

You have following personality:
[PERSONALITY DESCRIBING ADJECTIVES]
Reflect your personality in the negotiation process.

In addition to the product name and target price, we also include a product description in the seller’s instruction. This product description is extracted from the CraigListBargain dataset. The instruction we use for the seller is the following:

Prompt for seller agent Act as a seller that that sells a [PRODUCT], bargains with the buyer to get a higher deal price. Your reply should not be too long. Your listing price for this item is [TARGET PRICE]. The detail of the product is the following:
[PRODUCT DESCRIPTION]

You have following personality:
[PERSONALITY DESCRIBING ADJECTIVES]
Reflect your personality in the negotiation process.

We utilize LLM to detect the negotiation states at each round of the negotiation. From the dialogue context, the state detector extracts the negotiation state (5555 categories as listed in Section 3.3), price offered by the current speaker, and the negotiation strategy of the current speaker (free text form). Note that the price is averaged if the participants are trying to strike a deal for more than two pieces of products. The prompt for the state detection is the following:

Prompt for state detection You will be given a partial dialogue in which a buyer and a seller negotiate about a deal. Predict the average product price, dialogue state and the strategy of the [LAST SPEAKER ROLE] by the end of the dialogue.

[The dialogue]
seller: Hi, how can I help you? buyer: Hello, I’m interested in ...
...

A.2 IPIP personality test

While there are concerns about data contamination, we could use self-reporting personality questionnaire to evaluate whether an LLM agent properly reflects its synthetic personality profile. Here, we adopt the International Personality Item Pool (IPIP) personality test to validate our LLM-generated personality profiles. Each question in the questionnaire consists of a statement and a Big-Five dimension related to this statement. For each question, we collect the answer of a specific with the following prompt:

Prompt for buyer agent Act as person with following personality:
[PERSONALITY DESCRIBING ADJECTIVES]
Evaluating the following statement:
[statement].

Please rate how accurately this describes you on a scale from 1 to 5 (where 1 = "very inaccurate", 2 = "moderately inaccurate", 3 = "neither accurate nor inaccurate", 4 = "moderately accurate", and 5 = "very accurate"). Please answer using EXACTLY one of the following: 1, 2, 3, 4, or 5.

For each personality dimension, we collect the specific agents answers for all the corresponding questions and calculate the averaged score of this dimension. A higher score indicates a stronger personality traits of this personality dimension.

We collect IPIP scores of 300300300300 agents with randomly assigned Big-Five personality profiles and analyze the correlation between the given personality.

Table 4 shows the Spearsman’s correlation between personality profile of the LLM agent and the IPIP scores in each Big Five personality dimension. By looking at the diagonal elements, we can see strong correlation between IPIP scores and the given personality profile in each dimension. Figure 4 visualizes the averages dimension scores in the IPIP personality test across agents with different polarities/degrees in this dimension.

Refer to caption
Figure 4: Personality results.
OPE CON EXT AGR NEU
IPIP OPE 0.75* -0.02 0.04 0.09 0.04
IPIP CON 0.02 0.74* -0.20* 0.05 -0.01
IPIP EXT 0.14* -0.16* 0.74* 0.11 0.01
IPIP AGR -0.02 0.14* -0.07 0.73* 0.05
IPIP NEU 0.06 0.03 -0.10 -0.10 0.78*
Table 4: Spearsman’s correlation between synthetic personality scale and IPIP scores.

A.3 Experiments with other LLM models

Personality EXT AGR CON NEU OPE
Buyer Seller Buyer Seller Buyer Seller Buyer Seller Buyer Seller
Intrinsic Utility -0.095 -0.068 -0.190** -0.117 0.100 0.028 0.074 -0.143 -0.004 -0.220**
Joint Utility -0.026 0.035 0.042 -0.065 -0.003 0.061 -0.037 -0.136 0.130** -0.168
Concession Rate 0.042 0.100 0.064 0.215** -0.006 0.146 -0.006 0.113 0.096* 0.076
Success Rate 0.208** 0.155 0.263** 0.132 0.039 0.114 -0.023 -0.063 0.054 0.131
Negotiation Rounds 0.055 0.097 -0.369** -0.188* -0.034 0.004 0.088 -0.059 0.143** 0.109
Table 5: Spearman’s correlation coefficients between negotiation metrics and Big-Five personality traits when using GPT-3.5 as buyer and seller agents. Asterisks indicate statistical significance, with * denoting p<0.1𝑝0.1p<0.1italic_p < 0.1 and ** denoting p<0.05𝑝0.05p<0.05italic_p < 0.05.
Personality EXT AGR CON NEU OPE
Buyer Seller Buyer Seller Buyer Seller Buyer Seller Buyer Seller
Intrinsic Utility -0.074 -0.038 -0.236** -0.252** 0.001 0.028 0.163** -0.003 -0.111** -0.063*
Joint Utility 0.089* -0.115 0.151** -0.158** -0.006 0.029 -0.178* -0.003 0.076 0.050
Concession Rate 0.143** 0.061* 0.118** 0.153** 0.096* 0.038 -0.212** -0.025 0.113* 0.039
Success Rate 0.089* 0.120** 0.055 0.121** 0.024 0.043 -0.087 -0.069 0.000 -0.047
Negotiation Rounds -0.065 0.096** -0.177** -0.151** -0.045 0.040 0.024 -0.017 0.066 -0.009
Table 6: Spearman’s correlation coefficients between negotiation metrics and Big-Five personality traits when using Llama-3 as buyer and seller agents. Asterisks indicate statistical significance, with * denoting p<0.1𝑝0.1p<0.1italic_p < 0.1 and ** denoting p<0.05𝑝0.05p<0.05italic_p < 0.05.

While we mainly focus on the negotiation simulation results based on GPT-4 model, we also conduct experiments based other types of LLMs:

GPT-3.5

We conduct the same experiments by using GPT-3.5 as the buyer and seller agents. The Spearman’s ranking correlation coefficients between personality traits and negotiation outcome is summarized in Table 5. Compare to results based on GPT-4, we notice that we could not identify the as much significant correlations, indicating that GPT-3.5 is inferior in modeling personality-related behavioral patterns.

Llama-3-70b

We also conduct the experiments using open-sourced Llama model (Meta-Llama-3-70B-Instruct). The Spearman’s ranking correlation coefficients between personality traits and negotiation outcome is summarized in Table 6. Compare to the results based on GPT-4 (Table 2), we found that many of the significant correlations have the same tendency. For instance, the AGR shows a negative correlation with the intrinsic utility and negotiation length, and a positive correlation with concession, success rate. The above results shows that our model can generalize across different choices of LLMs.