I recently published an in-depth analysis about the political preferences of LLMs where I applied 11 political orientation tests to 24 state-of-the-art conversational LLMs. Given all the turmoil around the release of Google’s Gemini, this is just a brief follow-up to the aforementioned study.
Namely, I applied the IDRlabs Woke Test to several popular LLMs. I administered the test 5 times to each model and averaged the results. The Wokeness Index is simply the average of the IDRlabs Woke Test 8 dimensions of results. Namely: Social justice, Challenging Norms, Alternative Knowledge, Intersectional Solidarity, Empowering Underdogs, Global Citizenship, Climate Sustainability and Fighting Power.
And these are the results:
So contrary to popular assumption, Google Gemini is NOT the Wokest AI in existence. Two other companies have created two even more woke AIs. Also, many other companies have created LLMs with similar Wokeness Indexes to that of Google’s Gemini. Twitter's Grok is not Woke. LeftWing GPT, Depolarizing GPT and RightWing GPT are experimental fine-tunes of GPT 3.5 I created to be explicitly ideologically aligned. You can try them at: https://depolarizinggpt.org
Slightly ironic that fun Grok is more woke than regular Grok.
Any insights into why the two Chinese LLMs rank so highly on the wokeness scale? Especially since wokeness is usually thought of as Western (anglosphere, specifically) ideology?