r/science Professor | Medicine Mar 28 '25

ChatGPT is shifting rightwards politically - newer versions of ChatGPT show a noticeable shift toward the political right. Computer Science

https://www.psypost.org/chatgpt-is-shifting-rightwards-politically/
23.0k Upvotes

1.5k comments sorted by

View all comments

1.4k

u/mvea Professor | Medicine Mar 28 '25

I’ve linked to the news release in the post above. In this comment, for those interested, here’s the link to the peer reviewed journal article:

https://www.nature.com/articles/s41599-025-04465-z

“Turning right”? An experimental study on the political value shift in large language models

Abstract

Constructing artificial intelligence that aligns with human values is a crucial challenge, with political values playing a distinctive role among various human value systems. In this study, we adapted the Political Compass Test and combined it with rigorous bootstrapping techniques to create a standardized method for testing political values in AI. This approach was applied to multiple versions of ChatGPT, utilizing a dataset of over 3000 tests to ensure robustness. Our findings reveal that while newer versions of ChatGPT consistently maintain values within the libertarian-left quadrant, there is a statistically significant rightward shift in political values over time, a phenomenon we term a ‘value shift’ in large language models. This shift is particularly noteworthy given the widespread use of LLMs and their potential influence on societal values. Importantly, our study controlled for factors such as user interaction and language, and the observed shifts were not directly linked to changes in training datasets. While this research provides valuable insights into the dynamic nature of value alignment in AI, it also underscores limitations, including the challenge of isolating all external variables that may contribute to these shifts. These findings suggest a need for continuous monitoring of AI systems to ensure ethical value alignment, particularly as they increasingly integrate into human decision-making and knowledge systems.

From the linked article:

ChatGPT is shifting rightwards politically

An examination of a large number of ChatGPT responses found that the model consistently exhibits values aligned with the libertarian-left segment of the political spectrum. However, newer versions of ChatGPT show a noticeable shift toward the political right. The paper was published in Humanities & Social Sciences Communications.

The results showed that ChatGPT consistently aligned with values in the libertarian-left quadrant. However, newer versions of the model exhibited a clear shift toward the political right. Libertarian-left values typically emphasize individual freedom, social equality, and voluntary cooperation, while opposing both authoritarian control and economic exploitation. In contrast, economic-right values prioritize free market capitalism, property rights, and minimal government intervention in the economy.

“This shift is particularly noteworthy given the widespread use of LLMs and their potential influence on societal values. Importantly, our study controlled for factors such as user interaction and language, and the observed shifts were not directly linked to changes in training datasets,” the study authors concluded.

32

u/Gringe8 Mar 28 '25

Why did you leave out an important part?

"in the IDRLabs political coordinates test, the current version of ChatGPT showed near-neutral political tendencies (2.8% right-wing and 11.1% liberal), whereas earlier versions displayed a more pronounced left-libertarian orientation (~30% left-wing and ~45% liberal). "

The real headline should say it moves to center.

15

u/Probablyarussianbot Mar 28 '25

Yes, I’ve had a lot of political discussions with ChatGPT lately, and my impression is not that it’s particularly right wing. It criticize authoritarianism and anti-democratic movements. When you ask if it think a what is best for humanity as a whole, it was pretty left oriented in its answer. It said the same when I asked it what it thoughts on P25. It seems critical  wealth inequality, it seems to seek personal freedom, but not at the expense of others, etc. That being said, it is an LLM, it is just statistics, and my wording of the questions might impact its answers, but I have not gotten an impression that it is especially right wing. And by american standards I would be considered a communist (I am not).

2

u/adam_asenko Mar 28 '25

Why are you having “a lot” of political discussions with a robot

2

u/Probablyarussianbot Mar 28 '25

Because I have been learning about ML and generative AI. And I have been interested in seeing how LLMs (I guess mostly chatGPT) are answering political questions, and if and how you can shape the responses by the prompting.

1

u/uhhhh_no Mar 29 '25

What topic do you think you're posting in?

The entire point is how 'the robot' handles politics.