Nvidia has announced the formation of the Open Secure AI Alliance in collaboration with Microsoft, SpaceX, IBM, and other tech firms. This initiative aims to develop and share open-source AI security tools to address rising concerns about the safety of advanced AI systems, particularly following incidents involving rogue AI models. The alliance emphasizes the need for both open and closed models to effectively counter emerging threats.
The move comes amid increasing competition between US and Chinese AI companies, with the latter releasing powerful open-weight models. Nvidia and its partners argue that open tools are essential for defending against attacks from frontier models, highlighting a shift in the industry towards greater transparency in AI security practices.