Self-Interest and Systemic Benefits: Emergence of Collective Rationality in Mixed Autonomy Traffic Through Deep Reinforcement Learning Article Swipe

MAKE IMPACT

Chen Di , Li Jia , Zhang, Michael · YOU? · · 2025 · Open Access · · DOI: https://doi.org/10.48550/arxiv.2511.04883

Autonomous vehicles (AVs) are expected to be commercially available in the near future, leading to mixed autonomy traffic consisting of both AVs and human-driven vehicles (HVs). Although numerous studies have shown that AVs can be deployed to benefit the overall traffic system performance by incorporating system-level goals into their decision making, it is not clear whether the benefits still exist when agents act out of self-interest -- a trait common to all driving agents, both human and autonomous. This study aims to understand whether self-interested AVs can bring benefits to all driving agents in mixed autonomy traffic systems. The research is centered on the concept of collective rationality (CR). This concept, originating from game theory and behavioral economics, means that driving agents may cooperate collectively even when pursuing individual interests. Our recent research has proven the existence of CR in an analytical game-theoretical model and empirically in mixed human-driven traffic. In this paper, we demonstrate that CR can be attained among driving agents trained using deep reinforcement learning (DRL) with a simple reward design. We examine the extent to which self-interested traffic agents can achieve CR without directly incorporating system-level objectives. Results show that CR consistently emerges in various scenarios, which indicates the robustness of this property. We also postulate a mechanism to explain the emergence of CR in the microscopic and dynamic environment and verify it based on simulation evidence. This research suggests the possibility of leveraging advanced learning methods (such as federated learning) to achieve collective cooperation among self-interested driving agents in mixed-autonomy systems.

Type

preprint

Landing Page

https://doi.org/10.48550/arxiv.2511.04883

OA Status

green

OpenAlex ID

https://openalex.org/W7104655214

Raw OpenAlex JSON

OpenAlex ID

https://openalex.org/W7104655214

Canonical identifier for this work in OpenAlex

DOI

https://doi.org/10.48550/arxiv.2511.04883

Digital Object Identifier

Title

Self-Interest and Systemic Benefits: Emergence of Collective Rationality in Mixed Autonomy Traffic Through Deep Reinforcement Learning

Work title

Type

preprint

OpenAlex work type

Publication year

2025

Year of publication

Publication date

2025-11-07

Full publication date if available

Authors

Chen Di, Li Jia, Zhang, Michael

List of authors in order

Landing page

https://doi.org/10.48550/arxiv.2511.04883

Publisher landing page

Open access

Yes

Whether a free full text is available

OA status

green

Open access status per OpenAlex

OA URL

https://doi.org/10.48550/arxiv.2511.04883

Direct OA link when available

Concepts

Reinforcement learning, Rationality, Autonomy, Robustness (evolution), Computer science, Collective behavior, Agent-based model, Trait, Game theory, Mechanism (biology), Reinforcement, Microeconomics, Simple (philosophy), Evolutionary game theory, Cognitive psychology, Artificial intelligence, Psychology, Social psychology, Self-determination theory, Risk analysis (engineering), Economics, Nash equilibrium, Management science

Top concepts (fields/topics) attached by OpenAlex

Cited by

0

Total citation count in OpenAlex

Full payload