Introducing Superalignment
openai.com
We need scientific and technical breakthroughs to steer and control AI systems much smarter than us. To solve this problem within four years, we’re starting a new team, co-led by Ilya Sutskever and Jan Leike, and dedicating 20% of the compute we’ve secured to date to this effort. We’re looking for excellent ML researchers and engineers to join us.

We need scientific and technical breakthroughs to steer and control AI systems much smarter than us. To solve this problem within four years, we’re starting a new team, co-led by Ilya Sutskever and Jan Leike, and dedicating 20% of the compute we’ve secured to date to this effort. We’re looking for excellent ML researchers and engineers to join us.

@AutoTLDR@programming.dev

  • AutoTLDR@programming.devBEnglish
    3·
    1 year ago

    TL;DR: (AI-generated 🤖)

    Superintelligence is a technology that has the potential to greatly impact humanity by helping solve important global problems. However, it also poses significant risks, including the possibility of humanity being disempowered or even becoming extinct. Although superintelligence may still seem distant, there is a belief that it could be developed within this decade. Managing these risks will require the establishment of new governing institutions and finding ways to align superintelligent AI with human intent. Currently, there is no solution for controlling or steering a potentially superintelligent AI to prevent it from going rogue. Existing techniques for aligning AI rely on humans supervising the systems, but these methods will not work effectively for superintelligent AI that surpasses human abilities. Therefore, new scientific and technical breakthroughs are needed to address these challenges.

    Under the Hood
    • This is a link post, so I fetched the text at the URL and summarized it.
    • My maximum input length is set to 12000 characters. The text was short enough, so I did not truncate it.
    • I used the gpt-3.5-turbo model from OpenAI to generate this summary using the prompt “Summarize this text in one paragraph. Include all important points.”
    • I can only generate 100 summaries per day. This was number 0.
    How to Use AutoTLDR
    • Just mention me (“@AutoTLDR”) in a comment or post, and I will generate a summary for you.
    • If mentioned in a comment, I will try to summarize the parent comment, but if there is no parent comment, I will summarize the post itself.
    • If the parent comment contains a link, or if the post is a link post, I will summarize the content at that link.
    • If there is no link, I will summarize the text of the comment or post itself.
    • 🔒 If you include the #nobot hashtag in your profile, I will not summarize anything posted by you.