BT Group's Digital Unit Launches GenAI Gateway Platform Powered by AWS

BT Group's Digital Unit launches 'GenAI Gateway' platform, powered by AWS, accelerating the company's safe adoption of generative AI at scale

The GenAI Gateway, a generative AI enablement platform, built in collaboration with AWS, enables BT Group to tap into the power of GenAI with safe, secure access to Large Language Models (LLMs) from a scalable number of foundation model providersPlatform supports prompt security, central privacy controls, billing per use case, enterprise search, and use of multiple corporate data sources to enable the company to be flexible and responsible in the use of different AI models requiredEthics and performance are enabled through embedded guardrails that limit the risk of exploitation of the models ("jailbreak risk")A single consolidated Group platform reduces duplication of effort and resources as BT Group scales and accelerates the adoption of generative AI as APIs, security configuration, infrastructure management etc., can be managed centrally, reducing the risk of error along the way BT Group's Digital Unit has announced the launch of an innovative internal platform to help the company tap into the power of large language models (LLMs) from providers such as Anthropic, Meta, Claude, Cohere, and Amazon. The GenAI Gateway, built in collaboration with AWS and using Amazon Bedrock, Amazon SageMaker and AWS Professional Services capabilities, provides secure, private access to a range of natural-language processing and large language models, a critical tool BT Group will use as it embeds AI into the way it runs the business. Ad-hoc use of LLMs, whilst appropriate for test and development work, is not well suited to large scale use; cost control, security and privacy need more careful management. LLM performance also needs to be monitored, for unexpected errors (e.g. "hallucinations") and model decay over time (where LLMs stop behaving as expected). The GenAI Gateway also gives BT Group protection against 'lock-in' to any given LLM if any other issues emerge. The use of GenAI Gateway platform will encourage BT Group engineers to use the right model for the right use case, at the right price, as it supports per-use case budget tracking. A consolidated platform reduces duplication of effort and resources, as BT Group scales the adoption of generative AI. Application programming interfaces (APIs), security configuration and infrastructure management, can all be managed centrally, reducing the risk of error and the cost of maintaining separate LLMs for every use case. GenAI Gateway, deployed on AWS, is accessed via secure APIs, like all the components of BT Group's modular digital architecture. GenAI Gateway uses Amazon Bedrock, a fully managed service that offers a choice of high-performing foundation models from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon through a single API; as well Amazon SageMaker, a fully managed service that brings together a broad set of tools to enable high-performance, low-cost machine learning for any use case. The platform supports prompt security, chat history, FinOps billing per use case, enterprise search, as well as use of multiple corporate data sources. Central privacy controls include separate tenants for each use case, the use of Personal Identifiable Information filters, the location of the data within the UK and the isolation of trained models from each other, protecting data in line with Group policies and relevant regulation. Guardrails are built into the GenAI Gateway, limiting the risk of jailbreaks or toxic interactions, filtering out queries that go beyond the remit of specific applications - ensuring both performance and ethical guardrails are built-in by design. Gen AI Gateway is one of the several key enablers we are deploying to enable BT Group as an AI-enabled enterprise, and we will also use our "data fabric" data management platform to help enforce governing policies for how data can be used, as well as to manage access control and data sovereignty restrictions. GenAI Gateway is live today with the first beta use cases. A trial in Openreach is summarising engineering notes on Ethernet and full fibre jobs, helping to simplify processes and boost productivity for its teams and Communications Provider customers. A second use case, supporting contract analysis for the Group's Business, legal and procurement teams, is also live. Fabio Cerone, GM EMEA Telco at AWS, said: "The BT Group GenAI Gateway is showcasing how enterprises can effectively deploy generative AI at scale and speed. It's been a brilliant, pioneering opportunity to collaborate and work backwards from the customer to provide a way to accelerate deployment of generative AI use cases into production with embedded security and compliance. The GenAI Gateway will trigger the flywheel effect in the adoption of generative AI, delivering quicker results for BT Group and its customers." Deepika Adusumilli, Managing Director, Data & AI, BT Group's Digital Unit said: "AI is helping us reimagine the future of our company. We believe that where our data is a constant, we need flexibility with our LLMs. GenAI Gateway allows us to tap into this powerful new set of technologies at scale, in a way that is safe, responsible, flexible and scalable, delivering the ambition we have for AI to unlock the human potential within BT Group, today and in the future." END About BT Group BT Group is the UK's leading provider of fixed and mobile telecommunications and related secure digital products, solutions and services. We also provide managed telecommunications, security and network and IT infrastructure services to customers across 180 countries. BT Group consists of three customer-facing units: Consumer serves individuals and families in the UK; Business covers companies and public services in the UK and internationally; Openreach is an independently governed, wholly owned subsidiary wholesaling fixed access infrastructure services to its customers - over 650 communications providers across the UK. British Telecommunications plc is a wholly owned subsidiary of BT Group plc and encompasses virtually all businesses and assets of the BT Group. BT Group plc is listed on the London Stock Exchange. For more information, visit www.bt.com/about

BT Group Launches GenAI Gateway to Harness Large Language Models

Initial pilot projects focused on engineering notes and contract analysis. BT Group's Digital Unit has announced the launch of GenAI Gateway, a new internal platform aimed at leveraging large language models (LLMs) from providers such as Anthropic, Meta, Claude, Cohere, and Amazon. Developed in partnership with AWS, the platform utilises Amazon Bedrock and Amazon SageMaker to provide secure access to advanced natural language processing tools. The GenAI Gateway provides private access to a range of natural language processing and large language models, a critical tool BT Group will use as it embeds AI into the way it runs the business, the British operator said Tuesday. Also Read: BT Group, Equinix, and Toshiba Trial Quantum-Secured Data Center Connection The GenAI Gateway addresses several challenges associated with LLM deployment, including cost control, security, and performance monitoring. Reportedly, it mitigates the risks of vendor lock-in, allowing BT engineers to select the most suitable model for specific applications while ensuring compliance with data privacy regulations. Key features of the platform include: Also Read: BT Group to Trial MAUD Technology with Edgio as First CDN Partner Gen AI Gateway is one of the several key enablers we are deploying to enable BT Group as an AI-enabled enterprise. We will also use our "data fabric" data management platform to help enforce governing policies for how data can be used, as well as to manage access control and data sovereignty restrictions, the company said. According to BT Group, GenAI Gateway is live today with its first beta use cases. It is already in use for two pilot projects: summarising engineering notes for Openreach's fiber jobs, which helps simplify processes and boost productivity for both its teams and Communications Provider customers, and aiding contract analysis for the Group's legal and procurement teams. Also Read: BT Group Achieves Enhanced 5G SA Uplink Performance With Carrier Aggregation Commenting on the launch, the Managing Director of Data and AI at BT Group's Digital Unit said, "AI is helping us reimagine the future of our company. We believe that where our data is a constant, we need flexibility with our LLMs. GenAI Gateway allows us to tap into this powerful new set of technologies at scale, in a way that is safe, responsible, flexible and scalable, delivering the ambition we have for AI to unlock the human potential within BT Group, today and in the future."