Nobody Needs a GPU All Day

📰 Medium · Machine Learning

Learn how to optimize GPU usage for data science tasks and why most work doesn't require constant GPU power

intermediate Published 24 Jun 2026

Action Steps

Assess your current GPU usage to identify idle times
Optimize your workflow to minimize GPU-intensive tasks
Explore cloud GPU options and their cost-effectiveness
Implement techniques to reduce GPU usage, such as model pruning or knowledge distillation
Monitor and adjust your GPU usage regularly to ensure optimal performance

Who Needs to Know This

Data scientists and machine learning engineers can benefit from understanding how to efficiently use GPUs for their workflows, reducing costs and increasing productivity

Key Insight

💡 Most data science work doesn't require constant GPU power, and optimizing usage can lead to significant cost savings

Key Takeaways

Learn how to optimize GPU usage for data science tasks and why most work doesn't require constant GPU power

Full Article

Title: Nobody Needs a GPU All Day

URL Source: https://medium.com/@lanavajasuiza/nobody-needs-a-gpu-all-day-96bde3155cca?source=rss------machine_learning-5

Published Time: 2026-06-24T12:06:00Z

Markdown Content:
[Sitemap](https://medium.com/sitemap/sitemap.xml)

[Open in app](https://play.google.com/store/apps/details?id=com.medium.reader&referrer=utm_source%3DmobileNavBar&source=post_page---top_nav_layout_nav-----------------------------------------)

Sign up

[Sign in](https://medium.com/m/signin?operation=login&redirect=https%3A%2F%2Fmedium.com%2F%40lanavajasuiza%2Fnobody-needs-a-gpu-all-day-96bde3155cca&source=post_page---top_nav_layout_nav-----------------------global_nav------------------)

[](https://medium.com/?source=post_page---top_nav_layout_nav-----------------------------------------)

Get app

[Write](https://medium.com/m/signin?operation=register&redirect=https%3A%2F%2Fmedium.com%2Fnew-story&source=---top_nav_layout_nav-----------------------new_post_topnav------------------)

[Search](https://medium.com/search?source=post_page---top_nav_layout_nav-----------------------------------------)

Sign up

[Sign in](https://medium.com/m/signin?operation=login&redirect=https%3A%2F%2Fmedium.com%2F%40lanavajasuiza%2Fnobody-needs-a-gpu-all-day-96bde3155cca&source=post_page---top_nav_layout_nav-----------------------global_nav------------------)

![Image 1: Unknown user](https://miro.medium.com/v2/resize:fill:64:64/1*dmbNkD5D-u45r44go_cf0g.png)

Member-only story

# Nobody Needs a GPU All Day

[![Image 2: Ana Ndongo](https://miro.medium.com/v2/resize:fill:64:64/1*9saZVbAp-WKSsGYWyMbzaw.jpeg)](https://medium.com/@lanavajasuiza?source=post_page---byline--96bde3155cca---------------------------------------)

[Ana Ndongo](https://medium.com/@lanavajasuiza?source=post_page---byline--96bde3155cca---------------------------------------)

Follow

3 min read

·

1 hour ago

[](https://medium.com/m/signin?actionUrl=https%3A%2F%2Fmedium.com%2F_%2Fvote%2Fp%2F96bde3155cca&operation=register&redirect=https%3A%2F%2Fmedium.com%2F%40lanavajasuiza%2Fnobody-needs-a-gpu-all-day-96bde3155cca&user=Ana+Ndongo&userId=ea94a5b78887&source=---header_actions--96bde3155cca---------------------clap_footer------------------)

[](https://medium.com/m/signin?actionUrl=https%3A%2F%2Fmedium.com%2F_%2Frepost%2Fp%2F96bde3155cca&operation=register&redirect=https%3A%2F%2Fmedium.com%2F%40lanavajasuiza%2Fnobody-needs-a-gpu-all-day-96bde3155cca&user=Ana+Ndongo&userId=ea94a5b78887&source=---header_actions--96bde3155cca---------------------repost_header------------------)

[](https://medium.com/m/signin?actionUrl=https%3A%2F%2Fmedium.com%2F_%2Fbookmark%2Fp%2F96bde3155cca&operation=register&redirect=https%3A%2F%2Fmedium.com%2F%40lanavajasuiza%2Fnobody-needs-a-gpu-all-day-96bde3155cca&source=---header_actions--96bde3155cca---------------------bookmark_footer------------------)

[Listen](https://medium.com/m/signin?actionUrl=https%3A%2F%2Fmedium.com%2Fplans%3Fdimension%3Dpost_audio_button%26postId%3D96bde3155cca&operation=register&redirect=https%3A%2F%2Fmedium.com%2F%40lanavajasuiza%2Fnobody-needs-a-gpu-all-day-96bde3155cca&source=---header_actions--96bde3155cca---------------------post_audio_button------------------)

Share

Most of the time, your GPU is waiting for you.

Press enter or click to view image in full size

![Image 3](https://miro.medium.com/v2/resize:fit:700/1*2hXSGJsPD48blUXTmWus9Q.jpeg)

## Most Data Science Work Doesn’t Happen on a GPU

When people start learning machine learning, they often assume that the GPU is the most important part of the workflow.

I thought the same, but:

> GPUs are expensive.
>
> Cloud GPUs are expensive.

And every article about AI seems to suggest that more compute is always better. But after spending months working with notebooks, experiments and machine learning projects, I noticed something surprising:

**My GPU spent most of its time doing absolutely nothing.**

## The Invisible Part of Data Science

Training a model

Read full article → ← Back to Reads

Nobody Needs a GPU All Day

Key Takeaways

Full Article

Related Videos