OpenAI's introduction of the Sora app, a social media platform featuring AI-generated videos in a TikTok-style feed, has initiated discussions among current and former company researchers regarding its alignment with OpenAI's stated nonprofit mission. The app, launched recently, has already showcased a prevalence of deepfakes, including those of OpenAI CEO Sam Altman.
John Hallman, an OpenAI pretraining researcher, expressed mixed sentiments on X, stating, "AI-based feeds are scary." He added, "I won't deny that I felt some concern when I first learned we were releasing Sora 2. That said, I think the team did the absolute best job they possibly could in designing a positive experience… We’re going to do our best to make sure AI helps and does not hurt humanity." Boaz Barak, another OpenAI researcher and Harvard professor, echoed these concerns, remarking, "I share a similar mix of worry and excitement. Sora 2 is technically amazing but it’s premature to congratulate ourselves on avoiding the pitfalls of other social media apps and deepfakes."
The launch prompted former OpenAI researcher Rohan Pandey to promote his new startup, Periodic Labs, which focuses on building AI systems for scientific discovery. Pandey contrasted his venture with the "infinite AI TikTok slop machine," implying a divergence in AI development goals.
Sam Altman addressed the company's foray into social media on X, explaining the strategic rationale. He stated that the company primarily needs capital for building AI capable of scientific discovery, with significant research efforts dedicated to Artificial General Intelligence (AGI). Altman added, "It is also nice to show people cool new tech/products along the way, make them smile, and hopefully make some money given all that compute need." He cited the initial skepticism around ChatGPT as an example of the nuanced realities in a company's optimal trajectory.
This development underscores a persistent tension within OpenAI, balancing its rapid growth as a consumer tech entity with its nonprofit charter focused on beneficial AI. The California Attorney General, Rob Bonta, recently emphasized concerns "with ensuring that the stated safety mission of OpenAI as a nonprofit remains front and center" during the company's ongoing for-profit transition.
OpenAI has articulated that Sora is designed for creative expression rather than optimizing for time spent, contrasting it with platforms known for addictive loops. The company indicated plans to implement user reminders for prolonged scrolling and prioritize content from known contacts. This approach aims to avoid issues such as doomscrolling and addiction. While OpenAI has faced challenges with unintended sycophancy in ChatGPT, the company maintains it is committed to preventing similar pitfalls in Sora. The long-term alignment of the Sora app with its users and OpenAI's broader mission remains under observation.
