On Tuesday, Google announced that TorchTPU, its long-awaited open-source version of PyTorch, is now available. This move positions Google alongside Amazon in an effort to dismantle Nvidia’s stronghold over the AI industry, where a vast majority of applications are code-defaulted to run on Nvidia’s Graphics Processing Units (GPUs).
PyTorch is the widely used open-source toolkit enabling developers and startups to build and train AI models, utilized by approximately 85% of applications. Originally developed by Meta (Facebook) in 2016—long before the rise of Large Language Models (LLMs)—the framework was designed to function optimally with Nvidia’s hardware. By 2022, Meta had transferred oversight of PyTorch to the Linux Foundation, a nonprofit hosting numerous critical open-source projects.
Google’s TorchTPU allows AI applications to execute on Google’s specialized AI chips, known as Tensor Processing Units (TPUs). The framework facilitates seamless migration of existing PyTorch apps to Google Cloud with minimal effort, requiring only a simple configuration adjustment rather than rewriting the entire application.
Amazon released its own PyTorch variant, TorchNeuron, earlier in the week. This tool enables AI apps to port to Amazon's Trainium chip on AWS without code rewriting. Furthermore, Amazon is actively working to decouple PyTorch’s features from Nvidia-specific dependencies, increasing the framework's openness to various hardware types by default.
Google appears to be outpacing Amazon in some aspects by collaborating directly with Meta, Hugging Face, Inferact, and RadixArk to ensure TorchTPU integrates smoothly with these essential development tools. Additionally, the search giant introduced a dedicated TPU agent suite to assist developers in migrating applications and resolving errors, while concurrently updating its LiteRT tool to enhance compatibility with PyTorch-based apps on mobile and embedded devices.
Despite these advancements, the widespread adoption of alternative chips and cloud services does not guarantee an immediate mass migration away from Nvidia hardware. However, Amazon and Google are clearly dedicated to eroding Nvidia's current competitive advantage.
The Editorial Staff at AIChief is a team of professional content writers with extensive experience in AI and marketing. Founded in 2025, AIChief has quickly grown into the largest free AI resource hub in the industry.