Introduction to GPU computing 101:
Abstract:
At the beginning everything was simple:
The computing Industry using Cenetral Purpose Units (CPU) and the gaming industry acted like two parallel lines which never meet.
Gamers were using dedicated Gaming Consoles (Atari, Sega, Megason – Rings a bell?).
Slowly, with the development of computers and television screens, the graphic processors (GPU) field became powerful now dominanting in the gaming industry and overcomeing the video consoles mainly at “professional gamers” use.
What is the GPU (Graphics Processing Unit)?
Graphics processor designed for graphics applications, so the structure of the processor architecture is dedicated to treat matrices of pixels.
GPU is a massively parallel processor support thousands of active threads, the parallelism is possible thanks to large number of calculation cores designed to perform quickly specific functions
In order to really understand how GPU computing can save us hours, we have to look back in history of Alegbra:
Linear algebra is the branch of mathematics concerning vector spaces and linear mappings between such spaces. It includes the study of lines, planes, and subspaces, but is also concerned with properties common to all vector spaces. (WikipediA).
The first systematic link between Euclidean geometry and algebra has done by René Descartes in 1637, by the invention of Cartesian coordinates.About 10 years later Isaac Newton used the Linear algebra to formulate his famous Newton’s Second law of motion. In 1857 developed Arthur Cayley the matrix, At this point the relationship between mathematics & Physics changed. Up to this point the physics in fact was the motivation for the mathematics development; Researchers sought out mathematical patterns to explain physical phenomena. But the 18th century is a turning point because at this point mathematics develops as separate path without physical essence. For example to develop the theory of general relativity, Einstein is required to learn Tensors mathematics which was already mature mathematics filed.Picture is also a matrix (Coincidence) and also electric fields, magnetic fields, discrete Fourier transform and more..
Computers always helped in solving mathematical problems, but it is the 20th century which was a breaking point:
The interaction between computing and mathematics blurs the boundaries.
A weeks calculation found their solution in a few hours Using graphics computation engine
In this way the graphics processor became mathematics and physics researchers best friend.
This “friendly relationship” is actually based on what we call : Task parallelism :
What is Task Parallelism:
Task parallelism (also known as function parallelism and control parallelism) is a form of parallelization of computer code across multiple processors in parallel computing environments. Task parallelism focuses on distributing tasks—concretely performed by processes or threads—across different parallel computing nodes. It contrasts to data parallelism as another form of parallelism. (Wikipedia)
GPU computing and Task Parallelism:
- GPU is a massively parallel processor Support thousands of active threads
- GPU Computing requires a programming model that can efficiently express that kind of parallelism
- GPU designed as a numeric computing engine
- Will not perform well on some tasks as CPUs
- Most applications will use both CPUs and GPUs
- CUDA implements such a programming model
The CUDA platform is a software layer that gives direct access to the GPU’s virtual instruction set and parallel computational elements
Typical software Applications of GPU Computing:
Within the typical software application of GPU computing we can find:
- Evolved Machines
- Matlab
- Hanweck Associates
- CST
- Manifold® System
There are 3 main GPU system configuration:
Nvidia graphic cards are the main GPU cards in use for GPU computing, this is the simpliest choose mode between cards:
There many applications examples, here’s a few:
HPC Solutions:
4U GPU:
- Support 8 double width GPU cards (K10/K20M/K20X/K40/K80/Xeon Phi)
- Support up to 160W CPU
- 24 x 2.5 inches HDD bays
- 4 x 1600W (2+2) Platinum level redundant power supply
Key Applications:
- Mission-critical app
- enterprise server
- large database
- E-business
- on-line transaction processing
- oil & gas
- medical app.
2U DP:
- Support up to 6 double width GPU cards (K10/K20M/K20X/K40/K80/K2/K1/Xeon Phi)
- 10 hot-swap 2.5” HDD
- 16 DIMMs, up to 1TB memories
- Platinum level 2000W power supply
Key Application:
- Computational Finance
- HPC/Oil and gas
- Weather and Climate Analysis
1U up to 4xGPU:
- Support up to 4 double width GPU cards (including GTX)
- Titanium*/Platinum-level 2000W power supply
- No GPU-Preheat
- Cost Optimized System
Key Application:
- Oil & Gas
- Research & Scientifics
- VDI technology
- Computational Finance
l
CAD station 2D and 3D:
Software Description”
- 2D and 3D CAD tools
Customer Requirements
- Compact form factor
- 160 W processor support
- 2 GPUs (1 Quadro, 1 Tesla)
SuperWorkstation Solution
SYS-7038A-I
Digital Broadcasting:
Software Description”
- Top tier video editing software
Customer Requirements:
- 4 GPUs in a desktop workstation
- 160 W processor support
SuperWorkstation Solution
SYS-7048GR-TR
Aerospace & Defense
Customer Challenges
- Multiple GPU support
- Expansive storage
- Upgrade path for additional HDDs
Opportunity
- 100+ units/month
SuperWorkstation Solution
SYS-7048A-T
EIM E.S.C with Supermicro offers tremendous solutions for GPU computing, with many advantages:
- Built like a server and designed to run 24/7
- High-density configurations with up to 4 GPUs
- High performance with up to 1 TB of DDR4 & 160 W Haswell CPU support
- Easily expandable and serviceable with toolless and hot-swappable hard drive bays
- Supermicro & EIM are able to provide a full range of workstation solutions to meet the customer’s needs.