Turning software into hardware - Hastlayer · CPU vs GPU vs FPGA 13 Parallelism Program complexity...

Turning software into computer chips - Hastlayer

Zoltán Lehóczky @ Lombiq

GPU Day 11.07.2019

Warning

Hastlayer is currently in alpha stage!

What’s Hastlayer?

computer program → computer chip (hardware)

logic expressed as software → logic expressed as hardware

…with FPGAs

• Field-Programmable Gate Array

• Can behave like any other chip (with limitations)

• Can dynamically be „re-wired”

Image by SparkFun Electronics, Boulder, USA

FPGAs?

• Found in routers, X-ray machines, self-driving cars…

• Compute accelerator

• You need to be a hardware engineer to utilize them

computer program → FPGA logic

.NET (C#, VB, C++, F#, Python, PHP, JavaScript…) → FPGA logic

What’s the point?

CPU vs GPU vs FPGA

Parallelism Program complexity Power efficiency

CPU GPU FPGA

CPU GPU FPGA FPGA with Hastlayer

How hard to learn?

The benefits of FPGAs for us all

• Performance increase for parallel compute-bound algorithms

• Higher power efficiency

• Still only software development

Demo: Hands-on Hastlayer

What’s next?

Project Catapult support

• Microsoft’s FPGA platform in TACC and Azure

• Hastlayer is in the Project Catapult Academic Program

• 8GB vs 100MB RAM, PCIe vs USB, ~10x capacity

• Azure networking, Project Brainwave, direct FPGA access?

• Let me know if you’d like a preview!

Posit number format

• https://hastlayer.com/arithmetics

• Better range/accuracy than IEEE float

• We already have a posit „processor”

And more!

• More use-cases

• Partnership with the Wigner Research Centre for Physics

• FPGAs in every datacenter (AWS, Azure, Intel)

Wrapping up

I like this, how do I start?

• Check out the SDK: https://github.com/Lombiq/Hastlayer-SDK/

• Be ready for an FPGA-filled future!

Are you ready to *be* the hardware?

• zoltan.lehoczky@lombiq.com

• https://hastlayer.com

• https://github.com/Lombiq/Hastlayer-SDK/

• https://lombiq.com

Turning software into hardware - Hastlayer · CPU vs GPU vs FPGA 13 Parallelism Program complexity...

Documents

Computing Performance Benchmarks among CPU, GPU, and FPGA · 2.2.2. GPU Architecture and Parallelism..... 12 2.3. FPGA Background ... astonishing performance using the hundreds of

CMPT454 GPU Managed Database · GPGPU: General Purpose GPU, using GPU for usual CPU usage. Outline 1. GPU VS CPU 2. GPU Implementation 3. Products 4. Future Holds. GPU VS CPU. GPU

West Coast Spectrometer Team Mark Wagner, Berkeley project manager, FPGA designer Terry Filiba, data transport: FPGA --> CPU --> GPU Suraj Gowda, boosting

LabVIEW FPGA and GPU

cpu and GPU

Parallelizing the Simplex Method with OpenCLsc14.supercomputing.org/sites/all/themes/sc14/files/archive/tech... · FPGA vs CPU GPU vs CPU CPU OpenCL vs CPU GPU vs SoPlex 10 5 10 6

Cygnus: GPU meets FPGA for HPC - RIKEN R-CCS · 2020. 2. 27. · FPGA-GPU DMA (FPGA ← GPU) FPGA-GPU DMA (FPGA → GPU) direction via CPU FPGA-GPU DMA GPU→FPGA 17 1.44 FPGA→GPU

Agenda CPU Threads Flip Queue CPU Queues GPU Hardware Queue

CONTENTS...FPGA（Altera） HDDL GNA マルチデバイスヘテロジニアス CPU/Extension GPU VPU FPGA HDDL GNA 推論ライブラリプラグイン MKL-DNN clDNN DLⅠA 各種ライブラリ

FPGA Towards Verified Hardware Compilation · Performance Extreme Computing (HPEC), 2013. oughput 0 750 1500 2250 3000 CPU GPU FPGA oughput att 0 25 50 75 100 ... John Wickerson Towards

Hardware solutions for radar processing FPGA / GPU / CPU ...jf.degurse.free.fr/files/singap_gpu.pdf · 3 Characteristics of candidate embedded products AMD Phen. II 1090T CPU AMD

FPGA Acceleration of LFRic - EMiT · • “GPU vs FPGA Performance Comparison”, Berton White Paper •GPU: 0.07-0.12 vs. FPGA: 0.23 €/Gflop/s/W •GPU: 20 vs. FPGA: 70 Gflops/W

HetExchange: Encapsulating heterogeneous CPU-GPU

GPUfs: Integrating a file system with GPUs · CPU-GPU CPU GPUs Accelerated applications OS. Mark Silberstein - UT Austin 4 Software-hardware gap is widening Manycore processors FPGA

5g, gpu and fpga

GPU VS FPGA: EXAMPLE APPLICATION ON WHITE-LIGHT … · FPGA vs. GPU implementations Architectural concepts for WLI processing GPU VS FPGA: EXAMPLE APPLICATION ON WHITE-LIGHT INTERFEROMETRY

Arquitectura de Hardware Heterogénea para la Ejecución de ...profesores.fi-b.unam.mx/fpga/Algoritmo_Vision.pdf · Adquisición del hardware (FPGA, CPU, GPU) y software (IDE, Sistema

Yu Wang - nicsefc.ee.tsinghua.edu.cn€¦ · CPU/FPGA/GPU/emerging memory technology. He has received Best Paper Award in FPGA 2017, NVMSA 2017, ISVLSI 2012, and Best Poster Award

Cooperative CPU, GPU and FPGA Heterogeneous …...Cooperative CPU, GPU and FPGA Heterogeneous Execution with EngineCL 3 not always followed by a reduction in energy consumption, for

Gpu vs fpga