Use GPUs in Cloud Run // TRAIN BRAIN

Use GPUs in Cloud Run

Sign up for the preview → https://goo.gle/3NnobXv
GPU best practices → https://goo.gle/4elRpBE
Run LLM inference on Cloud Run GPUs with Ollama → https://goo.gle/3BwN6F1
Cloud Run, known for its scalability, now incorporates GPUs, ushering in a new era for machine learning inference. Join Googlers Martin Omander and Wietse Venema as they provide a practical demonstration of deploying Google's Gemma 2, an open-source large language model, through Ollama on Cloud Run.
Chapters:
0:00 - Intro
0:22 - Google Vertex AI vs GPUs with Cloud Run
1:12 - AI app architecture
2:04 - [Demo] Deploying Ollama API
3:26 - [Demo] Testing the deployment
5:28 - [Demo] Build & deploy the front end
6:02 - How do GPUs scale on Cloud Run?
6:34 - Where are Gemma 2 model files stored?
7:12 - Getting started with GPUs in Cloud Run
More Resources:
Cloud Run pricing → https://goo.gle/3BeMhAD
Watch more Serverless Expeditions → https://goo.gle/ServerlessExpeditions
Subscribe to Google Cloud Tech → https://goo.gle/GoogleCloudTech
#ServerlessExpeditions #GoogleCloud
Speaker: Martin Omander, Wietse Venema
Products Mentioned: Cloud Run, Gemma

Google Cloud Tech

Helping you build what's next with secure infrastructure, developer tools, APIs, data analytics and machine learning....

Embeddings for AI/ML and RAG apps

Build RAG apps with embeddings

How to secure your cloud with VPC Service Controls

Leverage LLM strengths for your features ?

Deploy Hugging Face models from Vertex AI Model Garden

Introducing pipe syntax in BigQuery and Cloud Logging

Experience multimodal AI with manga ONE PIECE (ワンピース)

Gemini for Developers - Vertex AI

Architecting a healthcare and life sciences startup with Google Cloud

Cloud KMS Autokey best practices

Boost productivity with Gemini Code Assist's Multi-suggestion Feature

Meet AI’s multitool: Vector embeddings

What are text embeddings?

Visualize data with Looker Studio

Dataflow for IoT galactic research

How to customize Gemini Code Assist with your private code

Dataflow for real-time IoT analytics

Persistent runtimes for notebooks ❌⌛️? #ProTip

Modern generative AI use cases #shorts

Gemini for Developers - Security

A developer’s guide to LLMs

Gemini for Developers - RAG

Use GPUs in Cloud Run

Getting started with Vertex AI #shorts

How Volkswagen built its AI assistant pt. 2

Gemini at Work: Create a marketing campaign with Imagen 3

Gemini at Work: Extracting business-critical insights from video content

Dataflow: Real-time clickstream analytics

Dataflow for Real-time Clickstream Analytics

Gemini in action: How Volkswagen built its AI assistant pt. 1

How to automate resource encryption with Cloud KMS Autokey and Terraform

AI agents for developers productivity #shorts

Gemini for Developers - BigQuery

Gemini Code Assist: AI-powered code generation

Visualize BigQuery data with Looker

Learn how PODS used Google AI to build the world's smartest billboard

With Gemini, PODS unlocked a new way to do marketing!

Can you use AI to build AI? ???

How to reduce deployment risk with blue-green deployments

? How to run ads across the galaxy with Dataflow

Dataflow for Real-time Marketing Intelligence

?⚡️? Supercharge BigQuery with Claude

How to get started with AI ??️

How to turn Google Sheets into a powerful analytics tool with Looker

Unleash Data's Full Potential: The Looker Story

Calling Cloud Run from C#

♿ Building a more inclusive world with tech

How Dataflow helps astronauts and you ?

Dataflow for Real-time Log Replication and Analytics

Generic AI? No thank you! ?? It's the fine-tuned models for me ??‍♂️

Use AI to speed through repetitive tasks

How to automate resource encryption with Cloud KMS Autokey

Intelligent Search at scale with Spanner

How can theme parks use AI?

Safe RAG for LLMs

Gemini for Developers - AlloyDB

Is slow data holding you back?

Dataflow for Real-time ETL and Integration

Gemini + APIs = ⏱️?

Encryption with Cloud KMS Keys

Racing to the cloud with IoT

Introduction to Google Cloud Backup and DR

Supercharge your business with Dataflow

Dataflow for Real-time ML and Generative AI

Advice for devs new to AI

How are senior developers using AI?

AlloyDB - Columnar Engine in Action

Build AI chat apps on Google Cloud

? Ask your BigQuery questions with Gemini powered natural language

Google Mainframe Modernization - Refactor for Batch

Infrastructure as code

Safety first with the Vertex AI Gemini API

Enhancing GKE efficiency with Filestore multishares

Multimodal AI

Gemini 1.5 Flash: Unlock high-speed, affordable AI for your apps

Enhancing SRE with Gemini for Google Cloud

Gmail's Spanner Revolution - How Planet-Scale Infra Transformed Silently

Datastream how-to: Recovering a failed stream

Google Cloud Innovators

Service-Centric Cross-Cloud Network demo - AWS and Google Cloud