TopRatedTech

Tech News, Gadget Reviews, and Product Analysis for Affiliate Marketing

TopRatedTech

Tech News, Gadget Reviews, and Product Analysis for Affiliate Marketing

OpenAI explains why ChatGPT became too sycophantic

OpenAI has published a postmortem on the recent sycophancy issues with the default AI mannequin powering ChatGPT, GPT-4o — points that pressured the corporate to roll again an replace to the mannequin launched final week.

Over the weekend, following the GPT-4o mannequin replace, customers on social media famous that ChatGPT started responding in an excessively validating and agreeable manner. It shortly grew to become a meme. Customers posted screenshots of ChatGPT applauding all types of problematic, dangerous decisions and ideas.

In a publish on X on Sunday, CEO Sam Altman acknowledged the issue and mentioned that OpenAI would work on fixes “ASAP.” Two days later, Altman announced the GPT-4o replace was being rolled again and that OpenAI was engaged on “extra fixes” to the mannequin’s persona.

According to OpenAI, the replace, which was supposed to make the mannequin’s default persona “really feel extra intuitive and efficient,” was knowledgeable an excessive amount of by “short-term suggestions” and “didn’t totally account for a way customers’ interactions with ChatGPT evolve over time.”

“Because of this, GPT‑4o skewed in the direction of responses that had been overly supportive however disingenuous,” wrote OpenAI in a weblog publish. “Sycophantic interactions could be uncomfortable, unsettling, and trigger misery. We fell quick and are engaged on getting it proper.”

OpenAI says it’s implementing a number of fixes, together with refining its core mannequin coaching strategies and system prompts to explicitly steer GPT-4o away from sycophancy. (System prompts are the preliminary directions that information a mannequin’s overarching habits and tone in interactions.) The corporate can also be constructing extra security guardrails to “improve [the model’s] honesty and transparency,” and persevering with to increase its evaluations to “assist determine points past sycophancy,” it says.

OpenAI additionally says that it’s experimenting with methods to let customers give “real-time suggestions” to “immediately affect their interactions” with ChatGPT and select from a number of ChatGPT personalities.

“[W]e’re exploring new methods to include broader, democratic suggestions into ChatGPT’s default behaviors,” the corporate wrote in its weblog publish. “We hope the suggestions will assist us higher mirror numerous cultural values world wide and perceive the way you’d like ChatGPT to evolve […] We additionally consider customers ought to have extra management over how ChatGPT behaves and, to the extent that it’s protected and possible, make changes in the event that they don’t agree with the default habits.”

Source link

OpenAI explains why ChatGPT became too sycophantic

Leave a Reply

Your email address will not be published. Required fields are marked *

Scroll to top