Content
summary Summary

OpenAI has announced an open call for experts across a range of domains to join the OpenAI Red Teaming Network, aimed at improving the safety of their AI models.

Ad

Red teaming is part of OpenAI's iterative development process, which includes internal and external adversarial testing. With this formal launch, OpenAI aims to deepen and broaden its collaboration with external experts.

Experts in the network will assist with risk assessment based on their area of expertise throughout the model and product development lifecycle. The goal is to provide diverse and continuous input to make red teaming an iterative process. OpenAI's call to action is open to experts from around the world, regardless of prior experience with AI systems or language models.

Some areas in which OpenAI's red teaming network will be active. | Bild: OpenAI

Network members are compensated for their contributions to a red teaming project. The experts will also have the opportunity to interact with each other on general red teaming practices and lessons learned. They won't be restricted from publishing their research or pursuing other opportunities per se, but they will have to abide by non-disclosure agreements (NDAs).

Ad
Ad

Applications are open until December 1, 2023.

Microsoft does red teams too

If you want to learn more about red teaming, check out Microsoft's red teaming process. The company has detailed its strategy for "red teaming" AI models like GPT-4, using independent teams to test for vulnerabilities in the system before deployment.

The tech giant uses red teaming at the model and system level, including for applications such as Bing Chat. Red teaming for AI is particularly challenging due to the unpredictable nature and rapid evolution of AI systems. Multiple layers of defense are needed, according to Microsoft.

Ad
Ad
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.
Support our independent, free-access reporting. Any contribution helps and secures our future. Support now:
Bank transfer
Summary
  • OpenAI is launching an open call for its Red Teaming Network, inviting domain experts to collaborate on evaluating and red teaming their AI models.
  • The initiative aims to establish a more formal collaboration with external experts to make AI models more secure and reliable.
  • Domain experts who join the network will be compensated and not restricted from publishing their research or pursuing other opportunities, but they may be under an NDA and must abide by it.
Sources
Online journalist Matthias is the co-founder and publisher of THE DECODER. He believes that artificial intelligence will fundamentally change the relationship between humans and computers.
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.