AI Infrastructure

Google Cloud's New TPU 8tx Is Built to Protect Sensitive AI Data While It Runs

AI Infrastructure · Confidential Computing

Google Cloud's new TPU 8tx pairs Google's AI accelerators with AMD EPYC host processors, a design intended to protect prompts, model weights, and intermediate data through encryption in host memory and in transit, with hardware isolation while the accelerators run.

By Shashi Bellamkonda · November 9, 2026
10+
hyperscalers and frontier AI labs using EPYC as host processor (AMD, 2026)
1st
cloud TPU system with hardware-enforced confidential computing (AMD, 2026)
5
Google Cloud confidential services AMD lists as built on its security technology (AMD, 2026)
TPU 8tx extends confidential computing from the host processor to the accelerators that run your AI model. AMD's EPYC chip anchors that chain, and Google Cloud operates it. Your protection depends on how Google implements it.

Because encrypted data has to be readable at the moment a chip computes on it, that moment has been the hard part of protecting artificial intelligence workloads in the cloud. Organizations that want their intellectual property to stay secure and proprietary pay close attention to that exposure whenever they move models and data onto cloud accelerators. Google Cloud and AMD announced on November 9 that TPU 8tx, a system built on Google's Tensor Processing Units, known as TPUs, uses 5th Gen AMD EPYC server processors as its host and delivers hardware-enforced confidential computing. The two companies describe it as the first cloud TPU system to do so. EPYC is AMD's brand of server processors, and a host processor is the main chip that prepares data and directs the accelerators doing the AI work.

The host processor extends confidential computing out to each accelerator

According to AMD, the host processor handles workload orchestration and data preparation, and it manages communication with the TPUs. AMD Secure Encrypted Virtualization in the EPYC processor, together with the TPU, extends confidential computing protection beyond the processor to the connected accelerators. The system verifies an accelerator's identity and security configuration before granting it direct access to protected memory, which AMD says helps keep customer prompts, model weights, and intermediate data encrypted in processor memory and in transit, with hardware isolation while the accelerator executes.

Google Cloud's Mark Lohmeyer said teams moving AI agents into production need confidence that their data and intellectual property stay private, even from the underlying infrastructure. He said customers get "silicon-level data protection" alongside the low-latency performance that reasoning models need.

EPYC hosts accelerators from several different makers

AMD states that EPYC is the host processor for more than 10 hyperscalers and frontier AI labs (AMD, 2026), across systems using GPUs from AMD and Nvidia as well as custom accelerators. AMD's Dan McNamara said the company built leadership across EPYC generations in performance, memory bandwidth, and input and output capacity, the traits that keep accelerated systems productive.

TPU 8tx adds a Google accelerator to that list, and AMD sells its own Instinct GPUs for the same kind of AI work. That gives AMD a host-processor business across systems that use its own GPUs or Nvidia's as well as custom accelerators such as Google's TPUs.

Your protection rests on AMD's silicon and on how Google implements it

AMD's footnote says Infinity Guard security features vary by EPYC generation and must be enabled by the server maker or cloud provider. In TPU 8tx, Google Cloud is both the accelerator maker and the cloud provider, so one company designs the accelerator and operates the service. The detail to look for is the evidence a customer receives that the verification step happened.

That gives AMD a host-processor business across systems that use its own GPUs or Nvidia's as well as custom accelerators such as Google's TPUs.
Google claims a near-zero performance penalty for TPU 8tx. Before planning workloads, ask for the benchmark method and the attestation evidence, and confirm availability timing.

Google and AMD built toward TPU 8tx across several EPYC generations

AMD says the two companies have collaborated across multiple EPYC generations, from general-purpose to accelerated workloads, leading up to Google Cloud's current C4D, N4D, H4D, Z4D, and G4 virtual machines, which are the server types customers rent from Google Cloud. AMD's Secure Encrypted Virtualization technology supports five Google Cloud confidential services, including Confidential VMs and Confidential GKE, the protected versions of its virtual machines and its Google Kubernetes Engine container service. The companies have also worked together on security for years, including reviews of AMD security processor firmware by Google security experts.

For context on how another large provider approaches the same problem, Amazon Web Services, known as AWS, protects data in use through its own Nitro System hardware. According to AWS, no mechanism exists for any AWS operator to access customers' Amazon Elastic Compute Cloud instances within the Nitro System, the controls that prevent operator access are part of the AWS Service Terms, and Nitro-based instances need no code changes to receive the protection. AWS Nitro Enclaves adds an isolated environment inside an instance, with cryptographic attestation that lets a customer confirm only authorized code is running.

Three requests would let you evaluate TPU 8tx

Google's announcement claims up to 2x lower latency than TPU 8t with a near-zero performance penalty (Google, 2026), and the details behind that claim are the next thing to collect:

  • Ask Google which links in the chain from host processor to accelerator it attests, and what evidence a customer receives.
  • Ask for the benchmark method behind Google's performance claim and the overhead on your own workloads, and ask when TPU 8tx becomes available.
  • Ask Google which protections TPU 8tx requires, how it enforces them, and which configuration details customers can verify through attestation.
CIO/CTO Viability Question
Which layers of your AI stack can your cloud provider show you evidence for, and which rest on the provider's word? Put that question to Google Cloud this quarter, ask it to name the attestation evidence TPU 8tx produces for accelerator workloads, and attach the written answer to your next security review.
AMD. "AMD EPYC Expands Its Leadership at the Foundation of AI." AMD Newsroom, 9 Nov. 2026, newsroom.amd.com/news/amd-epyc-expands-leadership-foundation-ai/.
Amazon Web Services. "AWS Confidential Computing." Amazon Web Services, aws.amazon.com/confidential-computing/. Accessed 9 Nov. 2026.
Google. "Our Newest TPUs: 8tx and 8i Max, Built for the Agentic Era." Google Blog, 9 Nov. 2026, blog.google/innovation-and-ai/infrastructure-and-cloud/global-network/tpu-8i-max-and-8tx/.
Disclaimer: This blog reflects my personal views only. Content does not represent the views of my employer, Info-Tech Research Group. AI tools may have been used for brevity, structure, or research support. Please independently verify any information before relying on it.