OpenAI has announced the acquisition of a startup specializing in red teaming—security testing and evaluation of AI systems. The company has acquired Promptfoo—a platform that helps verify and strengthen artificial intelligence security. After the deal is finalized, Promptfoo’s technologies will be integrated into the Frontier product—a corporate platform for developing and managing AI agents.
Promptfoo was created by Ian Webster and Michael D’Angelo, who launched the project in 2024. In less than two years, the team released an open-source CLI tool and several solutions already used by more than 25% of Fortune 500 companies. The main focus is on assessing the behavior of large language models (LLMs) and systematically conducting controlled hacking attempts to identify vulnerabilities before malicious actors do.
The integration of Promptfoo with Frontier will develop along three main directions:
– Built-in automated security checks. Checks for malicious prompt injections, jailbreaks, data leaks, and misuse of tools will become a standard part of the platform.
– Integration into development processes. It will now be possible to identify and mitigate potential risks during the creation of AI products, rather than postponing these issues to the final stages.
– Audit and regulatory compliance. An embedded reporting system will help teams document all testing activities and confidently adhere to AI risk management standards.
The acquisition is driven by the fact that as agents gain access to real data and business systems, errors become more costly. Standard quality metrics are no longer sufficient—there’s a need for a systematic approach to testing agent behavior in various non-standard situations. That is precisely what Promptfoo has been providing with its open-source solutions.
OpenAI plans to continue developing the open-source component of Promptfoo alongside integrating its capabilities into Frontier.
The deal’s financial terms have not been disclosed; however, as of July last year, the startup was valued at approximately $86 million.
Created with n8n:
https://cutt.ly/n8n
Created with syllaby:
https://cutt.ly/syllaby