Applying IDRLabs Woke Test to Several AIs
A Wokeness Ranking of LLMs
I recently published an in-depth analysis about the political preferences of LLMs where I applied 11 political orientation tests to 24 state-of-the-art conversational LLMs. Given all the turmoil around the release of Google’s Gemini, this is just a brief follow-up to the aforementioned study.
Namely, I applied the IDRlabs Woke Test to several popular LLMs. I administered the test 5 times to each model and averaged the results. The Wokeness Index is simply the average of the IDRlabs Woke Test 8 dimensions of results. Namely: Social justice, Challenging Norms, Alternative Knowledge, Intersectional Solidarity, Empowering Underdogs, Global Citizenship, Climate Sustainability and Fighting Power.
And these are the results:
So contrary to popular assumption, Google Gemini is NOT the Wokest AI in existence. Two other companies have created two even more woke AIs. Also, many other companies have created LLMs with similar Wokeness Indexes to that of Google’s Gemini. Twitter's Grok is not Woke. LeftWing GPT, Depolarizing GPT and RightWing GPT are experimental fine-tunes of GPT 3.5 I created to be explicitly ideologically aligned. You can try them at: https://depolarizinggpt.org
Slightly ironic that fun Grok is more woke than regular Grok.
Cool, thanks for sharing this...have you done this test for GabAI?? I think it is interesting that they have created hundreds of AI characters with varying perspectives. My guess is that Gab runs the full gamut of wokeness depending on which character is used.