# Chatbots emphasized fairness across economic games

> Five chatbot families produced concentrated choices and differed from human patterns in payoff preferences and cross-game consistency.

Canonical: https://aischolar.cc/blog/chatbots-behavioral-economics-games

[← All articles](https://aischolar.cc/blog)

AISCHOLAR / BLOG

# Chatbots emphasized fairness across economic games

Five chatbot families produced concentrated choices and differed from human patterns in payoff preferences and cross-game consistency.

October 3, 2026

### A battery of strategic choices

Yutong Xie and colleagues benchmark five chatbot families on behavioral-economics games that probe trust, fairness, cooperation, and risk in [_How Different AI Chatbots Behave? Benchmarking Large Language Models in Behavioral Economics Games_](https://arxiv.org/pdf/2412.12362). The battery includes prisoner’s dilemma, trust, ultimatum, dictator, public-goods, and bomb-risk tasks. The authors compare choice distributions with human-player behavior, then estimate payoff preferences and consistency across games.

### Concentrated choices, different payoff patterns

The tested chatbots often produced concentrated choice distributions, while human choices were more varied. In the payoff analysis, models put more weight on fairness than the human comparison data. Inferred preferences also varied by game: a pattern in one setting did not always carry through another. These are measured response patterns on the benchmark, rather than observations of private motives.

The authors report behavior shifts across model versions and sizes, so version-specific measurement matters when interpreting a game profile. The suite’s clearest use is comparative: showing where each tested chatbot’s choices align with or depart from the human distributions.

### Bibliography

-   Xie, Y., Liu, Y., Ma, Z., Shi, L., Wang, X., Yuan, W., Jackson, M. O., & Mei, Q. (2024). _How Different AI Chatbots Behave? Benchmarking Large Language Models in Behavioral Economics Games_. arXiv:2412.12362v1 \[cs.CL\]. [Full paper (PDF)](https://arxiv.org/pdf/2412.12362).

Original source: [https://arxiv.org/pdf/2412.12362](https://arxiv.org/pdf/2412.12362)

About AIScholar

## Study LLM behavior.

AIScholar is a research workspace for controlled, replicated studies of LLM behavior using single-turn text responses from OpenRouter-served models. The nine-stage workflow includes response coding, visualization, analysis and write-up; researchers validate measurements and interpret results.

[Explore AIScholar ↗](https://aischolar.cc/features)
