eSentire’s LLM Gateway implementation framework enables security teams with visibility and control to improve their governance and operational monitoring of ChatGPT and other Large Language Models
eSentire, the Authority in Managed Detection and Response (MDR), announced that its new innovation hub, eSentire Labs, has introduced an open-source implementation framework to help security teams globally improve how they govern and monitor the use of Large Language Models (LLMs) internally. eSentire’s LLM Gateway is available now for download on GitHub.
Latest CIO Interview: CIO Influence Interview with Craig Hinkley, Chief Executive Officer at CloudBolt
“We plan to introduce a complete MDR for LLM service offering, extending eSentire’s service promise of preventing business disruption across this new attack surface, as the MDR leader in Generative AI security.”
“We are in the midst of a technology revolution where Generative AI is democratizing innovation across organizations of all sizes. But having the right controls is imperative to tap into its power, securely,” said Alexander Feick, VP of eSentire Labs. “We are helping security practitioners take the first step to gaining visibility and control over this exciting innovation with the eSentire LLM Gateway.”
eSentire Labs is a place where innovation occurs within eSentire. Ideas, originating from every team across the organization, including eSentire’s Threat Response Unit (TRU), Security Operations Center (SOC) and engineering teams, are validated, prototyped and evaluated for complete productization, partnership or open-source projects. The introduction of eSentire’s LLM Gateway as an open-source framework was an ideal introductory launch for the Labs team given its commitment to helping organizations scale their use of Generative AI, securely.
eSentire first developed its LLM Gateway for internal purposes to govern and monitor corporate usage of ChatGPT, Google Bard and other LLMs. Over time, eSentire Labs enhanced the Gateway with additional controls and business policies specific to eSentire. Recognizing that its LLM Gateway could be leveraged as a reference implementation for IT administrators to access this important product category with confidence as they evaluate future full-scale gateway solutions, eSentire has elected to open source its initial implementation framework.
Read More About CIO Interview: CIO Influence Interview with Ivan Lee, CEO and Co-founder at Datasaur
Benefits of the eSentire LLM Gateway include:
- Creates a protective layer between corporate data and open AI applications including ChatGPT
- All LLM interactions are logged, enhancing monitoring & security control, while also surfacing core use cases from functional and power users
- As an open-source framework, security practitioners can integrate and apply their own security controls including corporate policies, usage rules and prompts, and contribute suggestions to further collaboration with the broader cybersecurity community
- Basic recommendations on how to visualize and track LLM usage are included within the eSentire LLM Gateway’s initial plug-ins
Chris Turek, Senior Managing Director and CIO for Evercore, a premier global independent investment banking advisory firm, partnered with eSentire to trial its LLM Gateway and was able to accelerate his team’s Generative AI strategy as a result. “Evercore is very interested in Generative AI and believes it will further enhance our differentiated capabilities that lead to superior client results. However, Evercore always puts our clients and the privacy and the confidentiality of their data first. Partnering with eSentire, and in particular the team at eSentire Labs, allows us to do both. eSentire has been a cornerstone in our information security program for over 10 years and with their work on Generative AI they have proven they will be for years to come.”
eSentire Labs is thrilled with the LLM Gateway’s initial testing and has launched its framework organization-wide across the team of 650 eSentire employees. “The telemetry that we’re tracking will give our SOC and Threat Response Unit experts the advantage in identifying LLM-based attacks, far beyond the sophisticated phishing and impersonation scams being reported market-wide today,” confirmed Feick. “We plan to introduce a complete MDR for LLM service offering, extending eSentire’s service promise of preventing business disruption across this new attack surface, as the MDR leader in Generative AI security.”
Browse The Complete Interview About CIO : CIO Influence Interview with Shirley Salzman, CEO and Co-Founder at SeeMetrics
[To share your insights with us, please write to sghosh@martechseries.com]
