IT & Data Science

Can New Approaches to GPU Machine Management Speed Delivery of Deep Learning Projects?

November 5, 2021
Fara Hain

At the AI Summit in NYC, Omri Geller, Run:AI CEO spoke on the subject of GPU management. This was his session topic:

Can New Approaches to GPU Machine Management Speed Delivery of Deep Learning Projects?

In many organizations that have taken on deep learning (DL) initiatives, GPU resources are allocated statically or even managed manually inside spreadsheets. Companies buy expensive GPU servers but don’t have control, visibility, or a way to maximize utilization of GPUs efficiently for their users. This leads to training bottlenecks and resource allocation issues, impacting the productivity of data scientists, the time to production for DL projects, and the rapid escalation of infrastructure costs.

In this session, led by Omri Geller of Run:AI, we will examine new approaches to the problem of GPU machine management that can maximize resource utilization for deep learning:

  • What’s been done in the past?
  • Could Kubernetes alone, which is growing quickly in adoption, solve the infrastructure management problem?
  • Could advanced scheduling concepts be applicable?
  • What can we learn or adapt from HPC for DL projects?
  • Can virtualization concepts be applied to better utilize GPUs?

Here are the slides from his presentation.

Feel free to watch the talk here.

Fara Hain
VP Marketing

Marketers get a bad rap today, with many people assuming we're paid to trick people into buying things they don't need. :) I believe in marketing of a different sort; the creative expression of a brand, the humanizing of a corporate entity, and the important task of helping consumers find products that will make their lives easier. My experience, 20+ years in mostly B2B marketing, has involved all of those and then some. I have worked mostly in the software industry, and primarily at startups - with a short stint in venture capital along the way that taught me about the financial side of company building. I occasionally blog on my new favorite marketing topic, account based marketing, at


Like This Article?

Here are some more that may interest you.