Run LLM inference on Cloud Run GPUs with Hugging Face Transformers.js
Stay organized with collections
Save and categorize content based on your preferences.
Cloud Run GPUs let you run large language model (LLM) inference in a
fully managed environment. In this tutorial, you deploy a backend
service that uses the Transformers.js
package, the
JavaScript equivalent of the Hugging Face transformers
Python library, to serve Google's
Gemma 2
model.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2026-10-09 UTC."],[],[]]