Open post eris@p.enes.lv :verified-purple: @Ukko@akko.disqordia.space · 38mo ago Replying to @randomwalker@mastodon.social <p>The "ChatGPT has a liberal bias" paper has at least 4 *independently* fatal flaws:<br />– Tested an older model, not ChatGPT.<br />– Used a trick prompt to bypass the fact that it actually refuses to opine on political q's.<br />– Order effect: flipping q's in the prompt changes bias from Democratic to Republican.<br />– The prompt is very long and seems to make the model simply forget what it's supposed to do.<br />By <span class="h-card" translate="no"><a href="https://mastodon.social/@sayashk" class="u-url mention">@<span>sayashk</span></a></span> and me, summarizing our analysis and a separate one by Colin Fraser. <a href="https://www.aisnakeoil.com/p/does-chatgpt-have-a-liberal-bias" target="_blank" rel="nofollow noopener" translate="no"><span class="invisible">https://www.</span><span class="ellipsis">aisnakeoil.com/p/does-chatgpt-</span><span class="invisible">have-a-liberal-bias</span></a></p> @randomwalker @sayashk >Order effect: flipping q's in the prompt changes bias from Democratic to Republican. automating troll politics posts via chatgpt here we go