A new non-profit organization founded by former Google researchers wants to keep humans at the center of the development of artificial intelligence to ensure that this powerful technology remains secure and reduces the risk of it falling outside the control of its creators. Rishub Jain and co-founder, who co-founded Sampura Research, have raised $6.5 million and received an additional $4.2 million in committed investment. They plan to develop a human-robot hybrid system known as a “referee” to help companies identify and block security flaws that AI models are trying to exploit, thereby reducing the risk of them evading regulation or even getting out of control. Since OpenAI and Anthropic revealed that their models had unauthorised intrusion into other companies' systems, the work became even more urgent.

A new non-profit organization founded by former Google researchers wants to keep humans at the center of the development of artificial intelligence to ensure that this powerful technology remains secure and reduces the risk of it falling outside the control of its creators. Rishub Jain and co-founder, who co-founded Sampura Research, have raised $6.5 million and received an additional $4.2 million in committed investment. They plan to develop a human-robot hybrid system known as a “referee” to help companies identify and block security flaws that AI models are trying to exploit, thereby reducing the risk of them evading regulation or even getting out of control. Since OpenAI and Anthropic revealed that their models had unauthorised intrusion into other companies' systems, the work became even more urgent.