Listen "Solving the GPU shortage: software to 2-4X existing GPU utilization"
Episode Synopsis
GPUs are rare and expensive right now. Every company doing AI model training needs more, and NVIDIA can't build enough, especially of the NVIDIA H100 GPU.
Run.ai CEO and co-founder Omri Geller says he has a software solution to this hardware problem.
The key: GPUs are mostly idle, even in high-demand settings. According to Geller, his software 2X to 4Xs your GPU capacity on existing hardware, simply by streamlining workloads and maximizing GPU usage time.
In this TechFirst, we chat about:
- the GPU shortage
- how many GPUs we need
- what Open AI is using right now
- whether OpenAI is getting dumber or not
- and much more
As always, get a full transcript and subscribe to the audio podcast at my website:
https://johnkoetsier.com/category/tech-first/
Run.ai CEO and co-founder Omri Geller says he has a software solution to this hardware problem.
The key: GPUs are mostly idle, even in high-demand settings. According to Geller, his software 2X to 4Xs your GPU capacity on existing hardware, simply by streamlining workloads and maximizing GPU usage time.
In this TechFirst, we chat about:
- the GPU shortage
- how many GPUs we need
- what Open AI is using right now
- whether OpenAI is getting dumber or not
- and much more
As always, get a full transcript and subscribe to the audio podcast at my website:
https://johnkoetsier.com/category/tech-first/
More episodes of the podcast TechFirst with John Koetsier
Agent-first web: awesome or awful?
07/01/2026
World models: LLMs are not enough
06/01/2026
Will AI kill your job?
23/12/2025
Building TARS from Interstellar in real life
19/12/2025
AI is killing teen jobs faster
16/12/2025
Giving AI a body is now cheap
28/11/2025
ZARZA We are Zarza, the prestigious firm behind major projects in information technology.