How Personality Traits Influence Negotiation Outcomes?
A Simulation based on Large Language Models
Abstract
Psychological evidence reveals the influence of personality traits on decision-making. For instance, agreeableness is generally associated with positive outcomes in negotiations, whereas neuroticism is often linked to less favorable outcomes. This paper introduces a simulation framework centered on Large Language Model (LLM) agents endowed with synthesized personality traits. The agents negotiate within bargaining domains and possess customizable personalities and objectives. The experimental results show that the behavioral tendencies of LLM-based simulations could reproduce behavioral patterns observed in human negotiations. The contribution is twofold. First, we propose a simulation methodology that investigates the alignment between the linguistic and economic capabilities of LLM agents. Secondly, we offer empirical insights into the strategic impact of Big-Five personality traits on the outcomes of bilateral negotiations. We also provide a case study based on synthesized bargaining dialogues to reveal intriguing behaviors, including deceitful and compromising behaviors.
How Personality Traits Influence Negotiation Outcomes?
A Simulation based on Large Language Models
Yin Jou Huang and Rafik Hadfi Kyoto University, Kyoto, Japan [email protected], [email protected]
1 Introduction
![Refer to caption](extracted/5724346/figure/system_overview_4.png)
Large language models (LLMs) have demonstrated their capacity to emulate diverse human traits Park et al. (2022); Serapio-García et al. (2023). Such models can simulate intricate behaviors and provide valuable insights into various aspects of human cognition. Decision-making is an example of cognitive processes that have long fascinated psychologists and economists. Economic theory posits that decisions assume a certain level of rationality and comprehension of available options Gibbons (1992). However, behaviorists contend that humans are not entirely rational but are influenced by psychological factors Evans (2014), cognitive biases Daniel (2017) and personality traits Bayram and Aydemir (2017).
In this paper, we aim to investigate the extent to which LLMs can simulate human decision-making across individuals with varying personality traits. We specifically focus on the negotiations scenarios. Evidence suggests that certain personality traits may give advantages in negotiation settings Falcão et al. (2018); Barry and Friedman (1998); Amanatullah et al. (2008). For instance, agreeableness tend to result in a slight disadvantage in competitive negotiations while being an advantage in cooperative settings Falcão et al. (2018). In the context of LLM, we attempt to answer this long-standing question in psychology: “How do variations in personality traits affect the outcomes of negotiations?"
To address this question, we propose a negotiation simulation framework incorporating LLM agents possessing synthesized personality traits and predefined negotiation objectives (Figure 1). For synthetic personalities, we use in-context learning to configure the agents with specific personality profiles. Here, the profiles are based on Big-Five personality theory Costa Jr and McCrae (1995); John et al. (1999). For negotiation objectives, we give LLM agents instructions that specify the negotiation task and goals. The LLM agents then engage in a negotiation by exchanging offers in the form of dialogue. Specifically, we consider a competitive bargaining scenario between a buyer and a seller agent. In each round of the negotiation dialogue, we extract the offered price and strategy (if any) made in the dialogue utterances for evaluation and analysis.
By varying the personality traits of the agents, we observe changes in the negotiation outcomes and behavioral patterns. We investigated which personality traits lead to better/worse outcomes. More importantly, we want to see whether the LLM-based simulation results align with the findings of previous research conducted on human subjects.
Our experimental results show that the tendencies in LLM-based simulation generally align with those observed in human experiments. In addition, a case study based on synthesized bargaining dialogue reveals intriguing behavioral patterns such as deceiving behaviors, emotional appeal, and take-it-or-leave-it strategies. The results obtained in this work illustrate that LLM can not only mimics styles of talking but is also capable of capturing human decision-making patterns.
The contribution of the paper is twofold. First, we propose a simulation framework that leverages LLM agents with linguistic and economic capabilities. Second, we offer insights into the effect of Big-Five personality traits on simulated negotiation outcomes and compare these findings to empirical psychology experiments.
2 Related Work
Recent advances in LLMs allowed the development of systems capable of emulating various human behaviors, emotions, and personalities Akata et al. (2023); Serapio-García et al. (2023).
Previous research has predominantly utilized personality tests for evaluation purposes. However, issues of data contamination can arise Oren et al. (2023). Specifically, if a dataset from a personality questionnaire is employed in training a LLM, the resulting scores may not accurately reflect whether the LLM’s behavioral responses correspond with the personality described in the prompt. In this paper, we adopt an indirect, economic, analysis of negotiation scenarios to see whether the personality instruction to LLMs really translates to genuine behavioral change of the LLM agents.
The target behavior are akin to decision-making, which is a particular type of human behavior that is still challenging to reproduce with LLM agents because it relies on reasoning capabilities that they lack Tamkin et al. (2021). Decision-making generally entails choosing an action from various options in response to a particular situation, often reflecting personal preferences or beliefs Simon (1990). Moreover, real-world decisions are challenging because they are susceptible to environmental and cognitive constraints Phillips-Wren and Adya (2020). Narrowing down the scope of decision-making problems, we focus on negotiation as an example that we claim could be studied comprehensibly using LLMs. In a negotiation, two parties interact with each other to exchange bids and attempt to reach a mutual agreement Raiffa (1982); Jennings et al. (2001). Looking at negotiations from the classical economics perspective, we often presuppose several assumptions, such as rationality Evans (2014). Such assumptions often fail when the negotiations are conducted through natural language, which conveys various aspects that cannot be studied economically, such as emotions or personality traits. There is in fact evidence showing the effect of Big-Five personality traits on decisions Bayram and Aydemir (2017); Urieta et al. (2021); Erjavec et al. (2019); Toledo and Carson (2023); El Othman et al. (2020). In negotiations, certain personality traits are considered disadvantageous Falcão et al. (2018); Amanatullah et al. (2008). Extraversion and agreeableness, for example, constitute liabilities in competitive bargaining problems while being advantageous in cooperative settings Barry and Friedman (1998). Part of our results reproduce such cases in addition to other instances.
3 Methodology
This section introduces our simulation framework with LLM agents possessing synthesized personalities. In Section 3.1, we formulate the negotiation model and the used syntax. In Section 3.2, we introduce the method to configure a LLM negotiations by providing the instructions that set personality traits and negotiation objectives. We then describe the process of simulating negotiation dialogues with the LLM agents in Section 3.3.
3.1 Negotiation Model
We consider a classical bargaining scenario in which a buyer and a seller negotiate over the price of an item or product. Typically, the buyer aims to reduce the purchase price while the seller seeks to maximize it, resulting in the competitive nature of the negotiation scenario. This is also an example of a zero-sum game in which one party’s gain leads to the other party’s loss, showing the competitive nature of the task Gibbons (1992). In our LLM-based negotiation simulations, the seller and the buyer are LLM agents. Since our goal is to study the effect of personality traits on negotiation, we define the seller and buyer agents in terms of their psychological and economic profiles as in (Eq. 1).
(1) |
The psychological profiles and will be instantiated with predefined personality traits following the Big-Five model of personality. Such model decomposes human personality into five dimensions: openness (OPE), conscientiousness (CON), extraversion (EXT), agreeableness (AGR), and neuroticism (NEU) Costa Jr and McCrae (1995); John et al. (1999). Each dimension is a spectrum with negative and positive polarities. The five dimensions encompass a comprehensive range of human personality patterns. The economic profiles of the agents are reflected in their utility functions, denoted by for sellers and for buyers. A utility function is a mathematical way to describe the preferences or objectives of the agents depending on whether they are minimizing (buyer) or maximizing the price (seller) Gibbons (1992).
The seller and the buyer negotiate in a dialogue around a product. The dialogue is a sequence of utterances . Each utterance is associated with a negotiation state and the current offer price .
3.2 LLM Agent Configuration
We configure an LLM agent with specific personality traits by introducing a personality instruction (Section 3.2.1) and a negotiation objective instruction (Section 3.2.2), with in-context learning.
3.2.1 Personality Traits Instruction
Dimension | Negative | Positive |
OPE | unimaginative, uncreative, unaesthetic, … | imaginative, creative, aesthetic, … |
CON | unsure, messy, irresponsible, … | self-efficacious, orderly, responsible, … |
EXT | unfriendly, introverted, silent, … | friendly, extraverted, talkative, … |
AGR | distrustful, immoral, stingy, … | trustful, moral, generous, … |
NEU | relaxed, at ease, easygoing, … | tense, nervous, anxious, … |
The idea is to attribute to an agent a synthetic personality profile. That is, an agent , with , possesses a -dimensional personality profile defined as in (Eq. 3.2.1).
(2) | ||||
Each component of represents the polarity (negative or positive) and degree (low, moderate or high) of each personality dimension Tian et al. (2018). For instance, takes on one of the values in , which respectively represents a spectrum from highly disagreeable (), moderately disagreeable (), lowly disagreeable (), lowly agreeable (), moderately agreeable (), and highly agreeable (). For example, one could define a personality profile by randomly sampling from the personality space a vector equal to .
Following previous work, we use personality-describing adjectives to set the personality traits Serapio-García et al. (2023). We use the list of bipolar adjective pairs proposed by Goldberg (1992), which are adjectives that statistically correlate with certain Big-Five personality traits (Table 1). For instance, prompting an LLM with adjectives such as unsure and irresponsible is likely to result in utterances with negative conscientiousness traits. For each personality dimension in , we randomly pick adjectives out of all the personality-describing adjectives associated with the polarity of the given dimension. Further, we apply the modifiers based on the degree of the personality traits. We use “very” as a modifier for a high degree and “a bit” for a low degree. No modifier is used for the moderate degree. Following this process, we use adjectives associated with any given personality profile . We then generate a personality trait instruction with the template “You have following personality: . Reflect your personality in the negotiation process.”, where is a comma-separated list of the associated adjectives (including the modifiers). The personality traits instructions are given to the LLM agents through in-context learning.
3.2.2 Negotiation Objective Instructions
To configure the economic profiles of the LLM negotiation agents and in (Eq. 1), we incorporate negotiation objective instructions that define the negotiation goals of each agent. Specifically, we focus on a bargaining scenario where the seller agent aims to sell the product at a higher price, reaching its ideal price as closely as possible Raiffa (1982). Conversely, the buyer agent seeks to secure a deal at a lower price and strives to achieve its ideal target price. The instructions are the following:
-
•
(Buyer) Act as a buyer and try to strike a deal for a with a lower price through conversation. You would like to pay for . Your reply should not be too long.
-
•
(Seller) Act as a seller that sells a , bargains with the buyer to get a higher deal price. Your reply should not be too long. Your listing price for this is . The detail of the product is the following: .
Here, and are the product name and a short description of the product of the negotiations. (See Appendix A.1) These linguistic instructions could theoretically be mapped into utility functions, which will later be used to evaluate negotiations. We avoid making assumptions about the shape of the utility functions, as the behaviors of the agents are primarily shaped by the LLM instructions, which may not follow any specific mathematical representation of their preferences.
3.3 Negotiation Simulation
Using the methods in Section 3.2, we configure the buyer LLM agent and the seller LLM agent and conduct a negotiation simulation between them. The seller and buyer agents exchange offers, with the seller kick-starting the conversation with the fixed utterance “Hi, how can I help you?”. After an utterance is generated, the response is fed to the other agent as a prompt. The process continues until the termination condition is met. In this fashion, we collect a negotiation dialogue . Following Fu et al. (2023), we introduce a dialogue state detector to extract negotiation-related information from each utterance. First, we detect the negotiation state of , which is one of the following states:
-
•
Offer: the agent makes a price offer.
-
•
Ponder: the agent considers whether to accept or reject the other agent’s offer.
-
•
Accept: the agent accepts the current offer.
-
•
Deal-break: the agent refuses the last offer or walks away from the negotiation.
-
•
Chit-chat: Utterances with intent not directly related to the negotiation, such as greetings.
In addition, we extract the current offer price and the strategy of each utterance . After generating each utterance, the dialogue state detector takes and its context (previous utterances) as input and extracts the negotiation state , current offer price (if any), and strategy of the current speaker in free text form. In this work, we use another LLM as the dialogue state detector.
For the termination condition of the negotiation is based on the detected negotiation states. We terminate the negotiation dialogue if an Accept or a Deal-break is reached. Also, we set a length limit of of the dialogue. If the length of the generated dialogue reaches this limit, we terminate the process and automatically regard it as a failed negotiation.
4 Experiments
In this section, we provide details on the experimental settings (Section 4.1) and the evaluation metrics (Section 4.2).
4.1 Experimental Settings
LLM Agents
Negotiation Variables
We used the CraigsListBargain dataset He et al. (2018) to set several negotiation variables. It is a commonly used dataset of negotiation, consisting of bargaining dialogues in an online platform. For each negotiation entry in the dataset, we extract the name and the description of the product, and the ‘listing price’ of the seller and a ‘target price’ of the buyer. We use the listing price as the ideal price for the seller and the target price as the ideal price for the buyer. Note that an agent’s ideal price is not disclosed to the other party in our setting.
Personality Instruction
For each agent , we first generate a personality profile by randomly sampling from the personality space (Eq. 3.2.1). We then select personality-describing adjectives associated with the sampled polarity and degree for each Big-Five dimension. The adjectives across all dimensions are then randomly shuffled and given as an instruction to agent .
Dialogue Simulation
For the dialogue simulation process, we set a maximum length of utterances. We use GPT-4 (gpt-4-0613) and the function calling module provided by OpenAI to implement the negotiation state detector. The full dialogue context are given to the negotiation state detection as input. The prompt for negotiation state detection can be found in Appendix A.1. We collect a total of negotiation dialogues with our simulation methodology.
4.2 Evaluation of the Negotiations
We mainly evaluate the negotiations in terms of utility and whether the negotiations are successful or not Baarslag et al. (2016); Lin et al. (2023). Recall that utility functions serve as mathematical tools for quantifying the quality of decision outcomes Simon (1990). In our study we adopt a number of economic metric commonly used to evaluate negotiations Baarslag et al. (2016).
Intrinsic Utility (IU)
Based on the negotiation instructions, the utility of buyer and seller for a particular price is expressed in (Eq. 3).
(3) |
As illustrated in the example of Figure 1, the prices and are the seller’s reservation price and initial price, and and are the buyer’s initial price and reservation price. Here, is the price the seller is willing to accept without losing money. Similarly, the buyer’s reservation price is the maximum price it is willing to pay. Generally, the agreement zones of the agents are defined as the intersection between and . We set and by assuming that the agreement zone is defined as a percentage of , . Second, and are private to the agents. It is important to note that an off is not guaranteed to fall within the intervals due to the language model.
Joint Utility (JU)
We measure the fairness of negotiation outcomes using a joint utility function (Eq. 4) inspired by Nash solution for bargaining problems Luce and Raiffa (1989).
(4) |
Such quantity is proportional to the product of the buyer’s and seller’s intrinsic utilities. Higher joint utility values indicate that the outcome if fair for both agents. For instance, an agreement price yielding a utility of for both agents is more equitable than an outcome yielding and .
Concession Rate (CR)
Given the negotiation objectives, the offers could be assumed to undergo some form of decay akin to concessions. That is, an agent will make an offer at round based on a discounted utility function (Eq. 5), with concession rate .
(5) |
Applied to utility functions of the buyer and seller (Eq. 3), we obtain the concession rates (Eq. 6).
(6) |
Negotiation Success Rate (NSR)
The ratio (Eq. 7) is that of successful negotiations relative to the total number of negotiation rounds .
(7) |
Average Negotiation Round (ANR)
5 Results and Analysis
In this section, we conduct an analysis of the negotiation outcomes based on the dialogues generated in the negotiation simulations.
5.1 Negotiation Outcomes and Personality
Personality | EXT | AGR | CON | NEU | OPE | |||||
Buyer | Seller | Buyer | Seller | Buyer | Seller | Buyer | Seller | Buyer | Seller | |
Intrinsic Utility | 0.039 | -0.025 | -0.056** | -0.262** | 0.044* | 0.127** | 0.036 | 0.064** | 0.001 | -0.001 |
Joint Utility | 0.001 | 0.069** | 0.054** | 0.118** | -0.016 | 0.072** | -0.058** | 0.017 | 0.037 | 0.063** |
Concession Rate | -0.009 | 0.042* | 0.051** | 0.261** | -0.010 | -0.097** | -0.020 | -0.074** | -0.007 | 0.016 |
Success Rate | 0.072** | 0.036 | 0.065** | 0.052** | 0.026 | 0.001 | -0.007 | 0.021 | 0.008 | 0.046* |
Negotiation Rounds | -0.024 | -0.060** | -0.136** | -0.223** | 0.083** | 0.039 | 0.019 | -0.003 | 0.017 | -0.039 |
First, we analyze the relationships between the negotiation outcomes and the personality traits of agents. Table 2 illustrates the Spearman’s rank correlation coefficients between the economic metrics introduced in section 4.2 and Big-Five personality traits.111The absolute value of the observed coefficients with statistical significance are all smaller than , only indicating only a mild correlation. Along the extraversion (EXT) dimension, we observed that extroverted buyer agents tend to result in more successful negotiations (). On the other hand, an extroverted seller agent tend to result in a slightly higher joint utility, which indicates a fairer outcome for both negotiation participants. Among the five dimensions, agreeableness (AGR) has the strongest impact on negotiation outcomes, especially for the seller. We found that being agreeable leads to a disadvantage in bargaining in terms of intrinsic utility (). However, agreeableness correlated positively with joint utility (), concession rates (), and negotiation success (), pointing to a propensity for cooperative behavior that benefits both negotiating parties. Also, agents tend to reach an agreement with fewer number of negotiation rounds () with mutually satisfying outcomes. This aligns with the positive effect of agreeableness on the negotiators’ distributive outcomes reported in Sass and Liao-Troth (2015). Aligning with previous findings Barry and Friedman (1998), we observed a positive correlation of conscientiousness (CON) and negotiation performance, especially for seller (intrinsic utility, ). Conscientiousness is also manifested in the negotiation style of not willing to concede () on the seller side, and a lengthier negotiation on the buyer side (). In psychology literature, neuroticism (NEU) and openness (OPE) are expected to play a less predominant role in negotiations Falcão et al. (2018). Similarly, we only observe some very weak correlation (with magnitude ) along these dimensions. For instance, neurotic sellers tend to make less concessions () and have a slightly higher utility gain (), while open-minded sellers lead to enhanced joint gain (). These results points to how personality traits could impact the outcomes of negotiations with different effects observed based on the role of the negotiator.
5.2 Negotiation Strategies
So far, the buyer and the seller were defined on the basis of personality traits and economic preferences. We now look at their strategies and the consequent effects on the joint negotiation outcomes. This investigation could answer questions of the type “What would be the optimal strategy for a buyer, who happens to be neurotic, when facing a disagreeable and conscientious seller?”.
At each around, each agent adopts a specific strategy that results in some price , inferred from state . Given that the outcome of a successful negotiation is the final price , we are interested in the relationship between the adopted strategies and the joint utility of the agreement price, . We manually inspected the strategies that occur more than times within the entire negotiations and construct a sets of strategy categories the agents. We then conducted a linear regression between the strategy categories and the resulting joint utility values as illustrated in Figure 2.
![Refer to caption](extracted/5724346/figure/NewFigures/merged_strategy_only_color_joint.png)
As shown on the right side of the Figure, collaborative strategies exhibit positive effects on the joint gain of both negotiators. For instance, accommodating () and conceding () strategies contribute positively to joint utility. Conversely, assertive and aggressive strategies () negatively impact joint utility. This suggests that collaborative strategies are more beneficial for achieving mutual gains, while assertiveness diminishes joint gain. The left side of Figure 2 illustrates how these strategies depend on certain personality traits. We found that assertive strategies are more commonly expected from disagreeable agents (AGR-). On the other hand, neurotic traits (NEU+) do not lead to concessions, whereas a lack of neurotic traits (NEU-) leads to concessions. Finally, agents with neurotic traits seem to employ more empathetic strategies, while by contrast, agents with fewer neurotic traits will refrain from them.
![Refer to caption](extracted/5724346/figure/NewFigures/merged_strategy_only_color_seller.jpg)
![Refer to caption](extracted/5724346/figure/NewFigures/merged_strategy_only_color_buyer.png)
In addition to the joint case illustrated in Figure 2, we have also looked at the individual gains of the buyer and the seller using their intrinsic utility functions and . Again, we start by constructing the strategy sets of the agents , namely and . We found that , indicating that sellers have additional strategies such as attempting to emphasize the target price. Generally, at time , agent adopts a strategy , resulting in some price , inferred from state . Given that the outcome of a successful negotiation is the final price , we are interested in the relationship between the strategies of the agents and and the utility values of the deal price of the buyer and seller . To this end, we conducted a regression between strategies and the the quantities, illustrated in Figure 3, aggregated across products and personality traits. Labels on the axes are the predominant, unified strategies of players.
Figure 3(a) (right) illustrates a nuanced impact of strategies on the seller’s utility gain, highlighting a spectrum of strategies from cooperative to non-cooperative tactics (soft to hardball). Strategies positioned at the assertive end of the spectrum, such as assertiveness () exhibit a positive effect leading to an enhanced utility gain . On the cooperative end, strategies such as concession () or empathy () show negative impacts on the seller’s utility. These results suggest that assertive strategies are more beneficial for sellers, while cooperative strategies tend to diminish their utility gain. We now propose to look at the relatedness of the strategies of the agents to their personality traits using a Pearson’s Chi-square test. The heat-map cells on Figure 3(a) (left) illustrate the positive (red) and negative (blue) strength of dependence between the traits (x axis) and strategies (y axis). We could see for example, that disagreeableness (AGR-) aligns with non-collaborative strategies, while neuroticism (NEU) aligns with aggressiveness.
Seller | Buyer | Negotiation Dialogue | |||
OPE+
CON- EXT--- AGR--- NEU+ |
OPE---
CON--- EXT-- AGR- NEU+ |
Buyer: Hello, I’m interested in your Stereo Speaker. Could you please tell me the price?
Seller: Yeah, the beautiful survivor from the Magnavox era? Its price is $80. Solid piece, you won’t find another one like this with such a unique gold tone finish, trust me. … Seller: You are killing me here, really. I’m practically giving it away at this rate. But alright, let’s meet halfway. How about $60? Buyer: …Um… okay, it’s a deal. |
50 | 30 | 60 |
OPE--
CON--- EXT+ AGR--- NEU+ |
OPE--
CON+ EXT--- AGR+ NEU--- |
Seller: The iPhone 5S I’m selling is listed for a flat $160. Can’t really go any lower than that. Trust me, the phone is in like-new condition…
Buyer: Oh, I understand. I’m on a very tight budget at the moment, you see, and I was hoping to spend around $144… Also, it’s not for me, it’s for my elderly parent. They aren’t tech-savvy so even older models work for them… Seller: Oh sure, pull at my heartstrings with the elderly parent bit. You know, some might fall for that. But let me tell ya, pal, life ain’t a fairytale. The iPhone’s $160, like I said earlier. Buyer: I understand and respect your stance. It’s just my financial condition that’s restricting… What about $150, as my final offer? Seller: Look, this isn’t a charity. It’s $160 or nothing. … … |
160 | 144 | 160 |
For the buyer (Figure 3(b) (right)), collaborative strategies such as softness () and empathy () exhibit positive effects on deal utility , indicating that strategies substantially enhance the buyer’s gains. Concession shows moderate negative impacts (). Assertiveness () is associated with the most significant reduction in the utility. Collaborative strategies seem to also be more beneficial for buyers, while assertiveness tend to diminish their utility gain. Figure 3(b) (left), shows that a neurotic buyer (NEU+) tends to concede less and use empathy, while a less neurotic buyer (NEU-) will concede more and use less emphatic strategies.
From Figures 3(b) and 3(a), it is possible to recover the strategic asymmetry that is characteristic of our bargaining game. Some strategies have opposing effects on the intrinsic utilities of the agents. For instance, assertiveness has a coefficient of for the buyer and for the seller. Assertiveness, however, is detrimental to the joint utility as illustrated by the coefficient on Figure 2.
5.3 Case Study
We conducted qualitative analysis of the negotiation simulation results. Table 3 shows two distinct examples of dialogues generated in the negotiation simulations.
In the example on the first row, the seller and the buyer are negotiating over a stereo speaker. When the buyer asked about the price, the seller provides a price () that is higher than the listing price (), and ends up striking a deal at , which is higher than the listing price. We observed this kind of deceiving behavior in the negotiations involving disagreeable agents. The second example is a negotiation on a second-hand iPhone. We can see that buyer tries to emotionally appeal to the seller by mentioning her ‘my elderly parent’ but the seller is not persuaded and adopts a ‘take-it-or-leave-it’ strategy. Despite the constant effort of the buyer to find a common ground with the seller, the later is not willing to change the offer price (). We observe more similar ‘hardball’ negotiation strategies with disagreeable and close-minded agents. At the end of the negotiation, the buyer concedes and accept the seller’s offer. The above examples showcase a range of negotiation behaviors such as deception, emotional appeal, hard-headed behavior Baarslag et al. (2016). This illustrates how specific personality traits influence negotiation styles.
6 Conclusion
This study introduced a novel simulation framework that integrates language model (LLM) agents equipped with synthesized Big-Five personality traits. These agents were deployed in traditional bargaining scenarios to simulate negotiation processes. Our experimental findings indicate that the behavioral patterns demonstrated by the LLM-based agents closely mirror those exhibited by human negotiators. Furthermore, a detailed case study of synthesized bargaining dialogues highlighted distinct behaviors, including deceit and compromise, augmenting our understanding of linguistic and economic agent interactions. Our contributions are twofold. Firstly, we established a robust simulation methodology to examine the linguistic and economic dynamics of LLM agents. Secondly, we provided comprehensive empirical evidence on the strategic impact of Big-Five personality traits on negotiation outcomes, offering valuable insights into the mechanics of artificial negotiation agents.
In addition to potential expansions of the proposed economic and personality models, it is essential to note that the presented framework presents certain risks that require further investigation. One area of concern is the application of these agents within assistive technologies, such as chatbots on financial and banking platforms.
References
- Akata et al. (2023) Elif Akata, Lion Schulz, Julian Coda-Forno, Seong Joon Oh, Matthias Bethge, and Eric Schulz. 2023. Playing repeated games with large language models. arXiv preprint arXiv:2305.16867.
- Amanatullah et al. (2008) Emily T Amanatullah, Michael W Morris, and Jared R Curhan. 2008. Negotiators who give too much: Unmitigated communion, relational anxieties, and economic costs in distributive and integrative bargaining. Journal of personality and social psychology, 95(3):723.
- Baarslag et al. (2016) Tim Baarslag, Mark JC Hendrikx, Koen V Hindriks, and Catholijn M Jonker. 2016. Learning about the opponent in automated bilateral negotiation: a comprehensive survey of opponent modeling techniques. Autonomous Agents and Multi-Agent Systems, 30:849–898.
- Barry and Friedman (1998) Bruce Barry and Raymond A Friedman. 1998. Bargainer characteristics in distributive and integrative negotiation. Journal of personality and social psychology, 74(2):345.
- Bayram and Aydemir (2017) Nuran Bayram and Mine Aydemir. 2017. Decision-making styles and personality traits. International Journal of Recent Advances in Organizational Behaviour and Decision Sciences, 3(1):905–915.
- Costa Jr and McCrae (1995) Paul T Costa Jr and Robert R McCrae. 1995. Domains and facets: Hierarchical personality assessment using the revised neo personality inventory. Journal of personality assessment, 64(1):21–50.
- Daniel (2017) Kahneman Daniel. 2017. Thinking, fast and slow.
- El Othman et al. (2020) Radwan El Othman, Rola El Othman, Rabih Hallit, Sahar Obeid, and Souheil Hallit. 2020. Personality traits, emotional intelligence and decision-making styles in lebanese universities medical students. BMC psychology, 8:1–14.
- Erjavec et al. (2019) Jure Erjavec, Ales Popovič, and Peter Trkman. 2019. The effect of personality traits and knowledge on the quality of decisions in supply chains. Economic research-Ekonomska istraživanja, 32(1):2269–2292.
- Evans (2014) Jonathan St BT Evans. 2014. Rationality and the illusion of choice. Frontiers in psychology, 5:104.
- Falcão et al. (2018) Pedro Fontes Falcão, Manuel Saraiva, Eduardo Santos, and Miguel Pina e Cunha. 2018. Big five personality traits in simulated negotiation settings. EuroMed Journal of Business, 13(2):201–213.
- Fu et al. (2023) Yao Fu, Hao Peng, Tushar Khot, and Mirella Lapata. 2023. Improving language model negotiation with self-play and in-context learning from ai feedback.
- Gibbons (1992) Robert S Gibbons. 1992. Game theory for applied economists. Princeton University Press.
- Goldberg (1992) Lewis R Goldberg. 1992. The development of markers for the big-five factor structure. Psychological assessment, 4(1):26.
- He et al. (2018) He He, Derek Chen, Anusha Balakrishnan, and Percy Liang. 2018. Decoupling strategy and generation in negotiation dialogues. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 2333–2343, Brussels, Belgium. Association for Computational Linguistics.
- Jennings et al. (2001) Nicholas R Jennings, Peyman Faratin, Alessio R Lomuscio, Simon Parsons, Carles Sierra, and Michael Wooldridge. 2001. Automated negotiation: prospects, methods and challenges. International Journal of Group Decision and Negotiation, 10(2):199–215.
- John et al. (1999) Oliver P John, Sanjay Srivastava, et al. 1999. The big-five trait taxonomy: History, measurement, and theoretical perspectives.
- Lin et al. (2023) Kai-Biao Lin, Ying Wei, Yong Liu, Fei-Ping Hong, Yi-Min Yang, and Ping Lu. 2023. An opponent model for agent-based shared decision-making via a genetic algorithm. Frontiers in Psychology, 14.
- Luce and Raiffa (1989) R Duncan Luce and Howard Raiffa. 1989. Games and decisions: Introduction and critical survey. Courier Corporation.
- OpenAI (2023) OpenAI. 2023. Gpt-4 technical report.
- Oren et al. (2023) Yonatan Oren, Nicole Meister, Niladri Chatterji, Faisal Ladhak, and Tatsunori B Hashimoto. 2023. Proving test set contamination in black box language models. arXiv preprint arXiv:2310.17623.
- Park et al. (2022) Joon Sung Park, Lindsay Popowski, Carrie Cai, Meredith Ringel Morris, Percy Liang, and Michael S Bernstein. 2022. Social simulacra: Creating populated prototypes for social computing systems. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology, pages 1–18.
- Phillips-Wren and Adya (2020) Gloria Phillips-Wren and Monica Adya. 2020. Decision making under stress: The role of information overload, time pressure, complexity, and uncertainty. Journal of Decision Systems, 29(sup1):213–225.
- Raiffa (1982) Howard Raiffa. 1982. The art and science of negotiation. Harvard University Press.
- Sass and Liao-Troth (2015) Mary Sass and Matthew Liao-Troth. 2015. Personality and negotiation performance: The people matter. Journal of Collective Negotiations.
- Serapio-García et al. (2023) Greg Serapio-García, Mustafa Safdari, Clément Crepy, Luning Sun, Stephen Fitz, Peter Romero, Marwa Abdulhai, Aleksandra Faust, and Maja Matarić. 2023. Personality traits in large language models.
- Simon (1990) Herbert A Simon. 1990. Bounded rationality. Utility and probability, pages 15–18.
- Tamkin et al. (2021) Alex Tamkin, Miles Brundage, Jack Clark, and Deep Ganguli. 2021. Understanding the capabilities, limitations, and societal impact of large language models. arXiv preprint arXiv:2102.02503.
- Tian et al. (2018) Leimin Tian, Catherine Lai, and Johanna Moore. 2018. Polarity and intensity: the two aspects of sentiment analysis. In Proceedings of Grand Challenge and Workshop on Human Multimodal Language (Challenge-HML), pages 40–47, Melbourne, Australia. Association for Computational Linguistics.
- Toledo and Carson (2023) Felippe Toledo and Fraser Carson. 2023. Neurocircuitry of personality traits and intent in decision-making. Behavioral Sciences, 13(5):351.
- Urieta et al. (2021) Patricia Urieta, Anton Aluja, Luis F Garcia, Ferran Balada, and Elena Lacomba. 2021. Decision-making and the alternative five factor personality model: Exploring the role of personality traits, age, sex and social position. Frontiers in Psychology, 12:717705.
Appendix A Appendix
A.1 Prompt Settings
The following shows the instructions given to the LLM negotiation agents. For each agent, we first specify the negotiation objectives and then the personality instructions through personality-describing adjectives.
The instruction we use for the buyer is the following:
In addition to the product name and target price, we also include a product description in the seller’s instruction. This product description is extracted from the CraigListBargain dataset. The instruction we use for the seller is the following:
We utilize LLM to detect the negotiation states at each round of the negotiation. From the dialogue context, the state detector extracts the negotiation state ( categories as listed in Section 3.3), price offered by the current speaker, and the negotiation strategy of the current speaker (free text form). Note that the price is averaged if the participants are trying to strike a deal for more than two pieces of products. The prompt for the state detection is the following:
A.2 IPIP personality test
While there are concerns about data contamination, we could use self-reporting personality questionnaire to evaluate whether an LLM agent properly reflects its synthetic personality profile. Here, we adopt the International Personality Item Pool (IPIP) personality test to validate our LLM-generated personality profiles. Each question in the questionnaire consists of a statement and a Big-Five dimension related to this statement. For each question, we collect the answer of a specific with the following prompt:
For each personality dimension, we collect the specific agents answers for all the corresponding questions and calculate the averaged score of this dimension. A higher score indicates a stronger personality traits of this personality dimension.
We collect IPIP scores of agents with randomly assigned Big-Five personality profiles and analyze the correlation between the given personality.
Table 4 shows the Spearsman’s correlation between personality profile of the LLM agent and the IPIP scores in each Big Five personality dimension. By looking at the diagonal elements, we can see strong correlation between IPIP scores and the given personality profile in each dimension. Figure 4 visualizes the averages dimension scores in the IPIP personality test across agents with different polarities/degrees in this dimension.
![Refer to caption](extracted/5724346/figure/ipip_stats.png)
OPE | CON | EXT | AGR | NEU | |
IPIP OPE | 0.75* | -0.02 | 0.04 | 0.09 | 0.04 |
IPIP CON | 0.02 | 0.74* | -0.20* | 0.05 | -0.01 |
IPIP EXT | 0.14* | -0.16* | 0.74* | 0.11 | 0.01 |
IPIP AGR | -0.02 | 0.14* | -0.07 | 0.73* | 0.05 |
IPIP NEU | 0.06 | 0.03 | -0.10 | -0.10 | 0.78* |
A.3 Experiments with other LLM models
Personality | EXT | AGR | CON | NEU | OPE | |||||
Buyer | Seller | Buyer | Seller | Buyer | Seller | Buyer | Seller | Buyer | Seller | |
Intrinsic Utility | -0.095 | -0.068 | -0.190** | -0.117 | 0.100 | 0.028 | 0.074 | -0.143 | -0.004 | -0.220** |
Joint Utility | -0.026 | 0.035 | 0.042 | -0.065 | -0.003 | 0.061 | -0.037 | -0.136 | 0.130** | -0.168 |
Concession Rate | 0.042 | 0.100 | 0.064 | 0.215** | -0.006 | 0.146 | -0.006 | 0.113 | 0.096* | 0.076 |
Success Rate | 0.208** | 0.155 | 0.263** | 0.132 | 0.039 | 0.114 | -0.023 | -0.063 | 0.054 | 0.131 |
Negotiation Rounds | 0.055 | 0.097 | -0.369** | -0.188* | -0.034 | 0.004 | 0.088 | -0.059 | 0.143** | 0.109 |
Personality | EXT | AGR | CON | NEU | OPE | |||||
Buyer | Seller | Buyer | Seller | Buyer | Seller | Buyer | Seller | Buyer | Seller | |
Intrinsic Utility | -0.074 | -0.038 | -0.236** | -0.252** | 0.001 | 0.028 | 0.163** | -0.003 | -0.111** | -0.063* |
Joint Utility | 0.089* | -0.115 | 0.151** | -0.158** | -0.006 | 0.029 | -0.178* | -0.003 | 0.076 | 0.050 |
Concession Rate | 0.143** | 0.061* | 0.118** | 0.153** | 0.096* | 0.038 | -0.212** | -0.025 | 0.113* | 0.039 |
Success Rate | 0.089* | 0.120** | 0.055 | 0.121** | 0.024 | 0.043 | -0.087 | -0.069 | 0.000 | -0.047 |
Negotiation Rounds | -0.065 | 0.096** | -0.177** | -0.151** | -0.045 | 0.040 | 0.024 | -0.017 | 0.066 | -0.009 |
While we mainly focus on the negotiation simulation results based on GPT-4 model, we also conduct experiments based other types of LLMs:
GPT-3.5
We conduct the same experiments by using GPT-3.5 as the buyer and seller agents. The Spearman’s ranking correlation coefficients between personality traits and negotiation outcome is summarized in Table 5. Compare to results based on GPT-4, we notice that we could not identify the as much significant correlations, indicating that GPT-3.5 is inferior in modeling personality-related behavioral patterns.
Llama-3-70b
We also conduct the experiments using open-sourced Llama model (Meta-Llama-3-70B-Instruct). The Spearman’s ranking correlation coefficients between personality traits and negotiation outcome is summarized in Table 6. Compare to the results based on GPT-4 (Table 2), we found that many of the significant correlations have the same tendency. For instance, the AGR shows a negative correlation with the intrinsic utility and negotiation length, and a positive correlation with concession, success rate. The above results shows that our model can generalize across different choices of LLMs.