News, news analysis, and commentary on the latest trends in cybersecurity technology.
eSentire Labs Open Sources Project to Monitor LLMs
The eSentire LLM Gateway provides monitoring and governance of ChatGPT and other large language models being used in the organization.
eSentire Labs has announced the eSentire LLM Gateway, an open source implementation framework that provides security teams with visibility and control to monitor the use of ChatGPT and other large language models (LLMs) in their environments. The LLM Gateway is available on GitHub.
The LLM Gateway was originally developed for internal eSentire use to govern and monitor corporate usage of ChatGPT, Google Bard, and other LLMs, the company said. Security operations center and threat response teams have access to telemetry that can be used to identify LLM-based attacks that are more sophisticated than phishing and impersonation attacks, said Alexander Feick, vice-president of eSentire Labs, in a statement.
The open source project gives IT administrators the ability to integrate and apply their own security controls, including corporate policies, usage rules, and prompts.
The LLM Gateway creates a protective layer between corporate data and AI applications and logs all interaction with LLMs, according to eSentire. All interactions are logged to enhance monitoring and security controls. Plug-ins provide IT administrators with recommendations on how to visualize and track LLM usage.
The company plans to introduce a complete managed detection and response for its LLM service offering, Feick said.
About the Author(s)
You May Also Like
Is AI Identifying Threats to Your Network?
May 14, 2024Where and Why Threat Intelligence Makes Sense for Your Enterprise Security Strategy
May 15, 2024Safeguarding Political Campaigns: Defending Against Mass Phishing Attacks
May 16, 2024Why Effective Asset Management is Critical to Enterprise Cybersecurity
May 21, 2024Finding Your Way on the Path to Zero Trust
May 22, 2024
Black Hat USA - August 3-8 - Learn More
August 3, 2024Cybersecurity's Hottest New Technologies: What You Need To Know
March 21, 2024