Run LLM inference on Cloud Run GPUs with Hugging Face Transformers.js

Cloud Run GPUs let you run large language model (LLM) inference in a fully managed environment. In this tutorial, you deploy a backend service that uses the Transformers.js package, the JavaScript equivalent of the Hugging Face transformers Python library, to serve Google's Gemma 2 model.

To complete the step-by-step walkthrough, see the codelab for How to Run Transformers.js on Cloud Run GPUs.