How do Graphics Cards Work? Exploring GPU Architecture

How do Graphics Cards Work? Exploring GPU Architecture with tags graphics card, graphics processing unit, graphics pipeline, video games, gpu, cpu vs gpu, cuda core, 3090, 3090 vs 4090, best graphics card, how do graphics cards work?, 3090ti, 3080ti, 3080, 3070, 5090, 5080, 5090 titan, nvidia, nvidia, latest graphics cards, 5090 release, 5090 gpu, 5080 graphics card, gpu architecture, tensor cores, bitcoin mining, gpu mining, neural network, gpus, graphics cards, how do gpus work?, gpu vs cpu explained, gpu vs cpu architecture, branch education

Graphics Cards can run some of the most incredible video games, but how many calculations do they perform every single second? Well, some of the most advanced graphics perform 36 Trillion calculations or more every single second. But how can a single device manage these tens of trillions of calculations? In this video, we explore the architecture inside the 3090 graphics card and the GA102 GPU chip architecture.

Note: We chose to feature the 30 series of GPUs because, to create accurate 3D models, we had to tear down a 3090 GPU rather destructively. We typically select a slightly older model because we're able to find broken components on eBay. If you're wondering, the 4090 can perform 82.58 trillion calculations a second, and then we're sure the 5090 will be even more.

Table of Contents:

00:00 - How many calculations do Graphics Cards Perform?

02:15 - The Difference between GPUs and CPUs?

04:56 - GPU GA102 Architecture

06:59 - GPU GA102 Manufacturing

08:48 - CUDA Core Design

11:09 - Graphics Cards Components

12:04 - Graphics Memory GDDR6X GDDR7

15:11 - All about Micron

16:51 - Single Instruction Multiple Data Architecture

17:49 - Why GPUs run Video Game Graphics, Object Transformations

20:53 - Thread Architecture

23:31 - Help Branch Education Out!

24:29 - Bitcoin Mining

26:50 - Tensor Cores

27:58 - Outro

Animation: Mike Radjabov, Sherdil Davronov, Adrei Dulay, Parvesh Khatri

Research, Script and Editing: Teddy Tablante

Twitter: @teddytablante

Modeling: Mike Radjabov, Prakash Kakadiya

Voice Over: Phil Lee

Sound Design by Drilu: www.drilu.world

Sound Design and mix: David Pinete

Additional Sound Design: Raúl Núñez

Supervising Sound Editor: Luis Huesca

Erratum:

04:50 Ubuntu is a type of Linux

08:45 3080 has 10GB, not 12GB.

Image Attribution:

Wikipedia contributors. "Embarrassingly Parallel", "Graphics Processing Unit", "Parallel Computing" , " SIMD", " Single Instruction, Multiple Threads" , "Thread block (CUDA Programming)". Wikipedia, The Free Encyclopedia. Wikipedia, The Free Encyclopedia, Visited October 18th 2024

Textbooks and Papers

A TON of information was found in Nvidia's white papers. You can find them here:

We recommend the GA102 architecture white paper and the fermi architecture white paper.

#GPU #GraphicsCard #Micron