Polyglot on the JVM with Graal (English)

PolyglotontheJVMwithGraal

Akihiro Nishikawa

May 20, 2017JJUGCCC2017Spring

SafeHarborStatementThefollowingisintendedtooutlineourgeneralproductdirection.Itisintendedforinformationpurposesonly,andmaynotbeincorporatedintoanycontract.Itisnotacommitmenttodeliveranymaterial,code,orfunctionality,andshouldnotberelieduponinmakingpurchasingdecisions.Thedevelopment,release,andtimingofanyfeaturesorfunctionalitydescribedforOracle’sproductsremainsatthesolediscretionofOracle.

ProgramAgenda

What’sGraal?What’sGraal VM?

PolyglotinGraal VM

Howtouse

Appendix

What’sGraal?What’sGraal VM?

Graal andGraal VM

• Anew compiler for HotSpot written inJavaand with afocus onspeculativeoptimizations.– BasedHotSpot– Aggressivehigh-leveloptimizations– JVMCIand Graal included inJDK9(modified version of JDK8available viaOTN)

Graal andGraal VM

• JVMpackagedwithGraal,Truffle,andotherlanguagessuchasJavaScript,R,Ruby,andsoon.

Graal VM

Graal andGraal VM

HotSpot

Compiler Interface

Client Server

HotSpot

HotSpotVM Graal VM

Compiler Interface

Client

PolyglotinGraal VM

TheOneVMConceptHighperformancepolyglotvirtualmachine

TheRubyLogoisCopyright(c)2006,YukihiroMatsumoto.ItislicensedunderthetermsoftheCreativeCommonsAttribution-ShareAlike 2.5agreementJSLogoCopyright(c)2011ChristopherWilliams<chris@iterativedesigns.com>,MITlicence

YoucandistributetheRlogounderthetermsoftheCreativeCommonsAttribution-ShareAlike 4.0Internationallicense(CC-BY-SA4.0)or(atyouroption)theGNUGeneralPublicLicenseversion2(GPL-2).

Impl Impl Impl Impl

VM VM VM VM

Impl Impl Impl Impl

• JavaScript– BetterECMAScript2016scorethanV8– AlmostsameperformanceasV8– Fullysupportfornode.js

• R– Statisticallanguage

• Ruby– ForkofJRuby– 5〜10xbetterperformance

• C、C++、Fortran– NativelanguagesupportviaLLVM

GraalVMPolyglot

HotSpot

Truffle

LLVM(Sulong)RRubyJavaScript

Truffle

• Togetherwiththe Graal compiler,Truffleinterpretersareautomaticallyjust-in-timecompiledandprogramsrunningontopofthemcanreachperformanceofnormalJava.

• Providesthebasicfoundationforbuildingabstract-syntax-tree(AST)interpretersthatperform self-optimizations atruntime– TheincludedTruffleDSL providesaconvenientwaytoexpresssuchoptimizations.

Frameworkforimplementinglanguagesassimpleinterpreters

Fullycompatibleincludingnativemodulesupport!Graal.js Architecture

C++JavaScript Java

nodemoduleswithonlyJavaScript

nodestandardlibrary

V8API Thread pool(libeio)

Event loop(libev)

DNS(c-ares)

crypto(OpenSSL)

Graal.js JavaScriptEngine

AdapterV8APItoGraal.js (viaJNI)

Nativeextensions nodebindings(socket,http,…)

nodemoduleswithnativeextensions

• Goal:realizetheadvantagesoftheTrufflestackforR– SuperiorperformancewithoutresortingtoC/C++/Fortran/…– Designedfordata-heavyandparallelapplications– CRAN/Bioconductorrepositorysupport

• Notan”incrementalimprovement”onGNUR– Newexecutionenginewrittenfromscratch,basedonTruffle– Designedasadrop-inreplacementforGNUR

• SpeedupoverlatestGNURinterpreter– Somewherebetween2and10x

https://github.com/graalvm/fastr

JavaScriptinGraal VM

Completeness

ECMAScript2015(ES6)(16298tests/16417tests)

FailingtestsaretoalargepartUnicodeRegularExpressions

93.4%ECMAScript2016(ES7)Supportsexponentiationoperator,Array.prototype.includes

Failsduetonewblock-levelfunctiondeclarationandcorner-casetestsofthespreadoperator

Classicresearchbenchmarks(Octane)

V8(5.4.500.6) Graal.js

roughlylevelwithV8

RubyinGraal VM

Completeness– languageandcorelibrary

RubyLanguageJRuby:94%

96% Ruby corelibrariesJRuby: 95%

Classicresearchbenchmarks– 10-20xfaster

45GraalVMJRuby+invokedynamicRuby

Biggerscoreisbetter(basedonRuby score)

BenchmarksboundbyallocationorBigInteger performance

“But,it’seasytooptimizethatkindofcode!”

Simplelocalvariables

Vectorisation opportunities

Simplefloatingpointarithmetic

Basicloops

Nomethodcalls(exceptoperators)

Onlytypesarenumerical orboolean

“RealRubyismuchmorecomplex!”

Smalltalk-styleblocksinsteadofloops

Loopboundsareobjectsinsteadofsimplevalues

Instancevariables

Logichiddeninmethods

Arrays

ArithmetichiddenincorelibrarymethodsIntermediateobjects

Hashmappedtoanarrayofarrays,viaanotherarray,convertedbacktoahash

Innerlooppixels representedasahashof r,g,b

Nolocalvariables,onlymethodcalls

Metaprogrammingsend Dynamicallycreatedsymbol

Actuallogicmethoddynamicmethodcalls

ChunkyPNGkernels

1000 GraalVMJRuby+invokedynamicRuby

Manyofthesebenchmarksareoptimised awayentirelybyGraalVM

PSD.rb kernels

1000 GraalVM JRuby+invokedynamic Ruby

Polyglot

RESTpublicinternet

RESTprivateintranet

RESTpublicinternet

HowwedopolyglotinGraal VM

RubyTruffle::Interop.eval('application/language', source)

value = Truffle::Interop.import(name)

Truffle::Interop.export(name)

JavaScriptInterop.eval('application/language', source)

value = Interop.import(name)

Interop.export(name)

// Returns 20Interop.eval('application/javascript', '14 + 6')

JavaScriptinRuby

puts Truffle::Interop.eval('application/javascript','14 + 6')

Thisreturns20

JavaScript Ruby

JavaScriptinRuby

Truffle::Interop.eval('application/javascript', "function add(a,b) {

return a + b;}Interop.export('add',

add.bind(this));")

add = Truffle::Interop.import('add')

puts add.call(14,2)

UsesfunctiondefinedinJavaScriptfromRuby

JavaScript

Performance

Warmsupandthenreportsiterationspersecond

Randominputsstopthewholethingbeingtotallyoptimizedaway

010000002000000300000040000005000000600000070000008000000900000010000000

GraalVM JRuby+invokedynamic Ruby

nsPerSecon

JavaScript(V8)RewritteninJavaScriptandcallitonV8

Ruby+JavaScript(V8)

100000

150000

200000

250000

300000

350000

Ruby(justRuby) Ruby(Ruby+JSwithV8)

nsPerSecon

IncaseofRhino

JRuby +JavaScript(Rhino)

100000

200000

300000

400000

500000

600000

JRuby+indy(justRuby) JRuby+indy(Ruby+JSwithRhino)

nsPerSecon

IncaseofNashorn

JRuby +JavaScript(Nashorn)

100000

200000

300000

400000

500000

600000

JRuby+indy(justRuby) JRuby+indy(Ruby+JSwithRhino)

JRuby+indy(Ruby+JSwithNashorn)

nsPerSecon

IncaseofGraal VM

Ruby+JavaScript(Graal VM)

010000002000000300000040000005000000600000070000008000000900000010000000

GraalVM(justRuby) GraalVM(Ruby+JS) JRuby+invokedynamic Ruby

nsPerSecon

010000002000000300000040000005000000600000070000008000000900000010000000

GraalVM(justRuby)

GraalVM(Ruby+JS)

JRuby+indy(justRuby)

JRuby+indy(Ruby+JSwithRhino)

JRuby+indy(Ruby+JS

withNashorn)

Ruby(justRuby)

Ruby(Ruby+JSwith

nsPerSecon

100000

1000000

10000000

GraalVM(justRuby)

GraalVM(Ruby+JS)

JRuby+indy(justRuby)

JRuby+indy(Ruby+JSwithRhino)

JRuby+indy(Ruby+JS

withNashorn)

Ruby(justRuby)

Ruby(Ruby+JSwith

nsPerSecon

HowGraal achievesthis

Hotspot

JITGraal

Truffle

BasicsofTruffleandGraal

BasicConcepts• Commonrepresentationofprograms

• Keepitrichenoughtonothavetothrowawaymeaning

• Commonoptimizationoftherepresentation

x + y * z

load_local xload_local yload_local zcall *call +

pushq %rbpmovq %rsp, %rbpmovq %rdi, -8(%rbp)movq %rsi, -16(%rbp)movq %rdx, -24(%rbp)movq -16(%rbp), %raxmovl %eax, %edxmovq -24(%rbp), %raximull %edx, %eaxmovq -8(%rbp), %rdxaddl %edx, %eaxpopq %rbpret

Node Rewriting for Profiling Feedback

AST InterpreterRewritten Nodes

AST InterpreterUninitialized Nodes

Compilation usingPartial Evaluation

Compiled Code

Node Transitions

Uninitialized Integer

Generic

DoubleString

T.Würthinger,C.Wimmer,A.Wöß,L.Stadler,G.Duboscq,C.Humer,G.Richards,D.Simon,andM.Wolczko.OneVMtorulethemall.InProceedingsofOnward!,2013.

Compiled Code

Node Transitions

Generic

DoubleString

Compiled Code

Node Transitions

Generic

DoubleString

Deoptimizationto AST Interpreter

Node Rewriting to Update Profiling Feedback

Recompilation usingPartial Evaluation

Deoptimizationto AST Interpreter

Node Rewriting to Update Profiling Feedback

Recompilation usingPartial Evaluation

Frequently executed call

Evenifanotherlanguage…

Frequently executed call

Lookingathoweffectivethisis

HowtouseGraal VM

• Includes:– JVM(REorDK)– Java– JavaScript– Ruby– R–Moreinthefuture

• Binarytarball release• MacorLinux

Graal VM– everythinginonepackagetoday

Java9– runsonanunmodifiedJVM

Hotspot

Truffle

JS others…Ruby

JVMCI(JVMCompilerInterface)

Java9– runsonanunmodifiedJVM

Hotspot

Truffle

JS others…Ruby

viaMavenetc

Java 9

Appendix

http://www.oracle.com/technetwork/oracle-labs/program-languagesSearchfor“Graal OTN”

https://github.com/graalvmSearchfor“GitHub GraalVM”

AcknowledgementsOracleDaniloAnsaloniStefanAnzingerCosminBascaDanieleBonettaMatthiasBrantnerPetrChalupaJürgenChristLaurentDaynèsGillesDuboscqMartinEntlicherBrandonFishBastianHossbachChristianHumerMickJordanVojinJovanovicPeterKesslerDavidLeopoldsederKevinMenardJakubPodlešákAleksandarProkopecTomRodriguez

Oracle(continued)RolandSchatzChrisSeatonDougSimonŠtěpánŠindelářZbyněkŠlajchrtLukasStadlerCodrutStancuJanŠtolaJaroslavTulachMichaelVanDeVanterAdamWelcChristianWimmerChristianWirthPaulWögererMarioWolczkoAndreasWößThomasWürthinger

JKULinzProf.HanspeterMössenböckBenoitDalozeJosefEislThomasFeichtingerMatthiasGrimmerChristianHäublJosefHaiderChristianHuberStefanMarrManuelRiggerStefanRumzuckerBernhardUrban

Universityof EdinburghChristopheDubachJuanJoséFumero AlfonsoRanjeet SinghToomas Remmelg

LaBRIFloréal Morandat

Universityof California,IrvineProf.MichaelFranzGulfemSavrunYeniceriWeiZhang

Purdue UniversityProf.JanVitekTomasKaliberaPetrMajLeiZhao

T.U.DortmundProf.PeterMarwedelHelenaKotthausIngoKorb

Universityof California,DavisProf.DuncanTempleLangNicholasUlle

Universityof Lugano,SwitzerlandProf.WalterBinderSunHaiyangYudiZheng

OracleInternsBrianBellevilleMiguelGarciaShamsImamAlexeyKaryakinStephenKellAndreasKunftVolkerLantingGeroLeinemannJulianLettnerJoeNashDavidPiorkowskiGregorRichardsRobertSeilbeckRifatShariyar

AlumniErikEcksteinMichaelHauptChristosKotselidisHyunjinLeeDavidLeibsChrisThalingerTillWestmann

SafeHarborStatementTheprecedingisintendedtooutlineourgeneralproductdirection.Itisintendedforinformationpurposesonly,andmaynotbeincorporatedintoanycontract.Itisnotacommitmenttodeliveranymaterial,code,orfunctionality,andshouldnotberelieduponinmakingpurchasingdecisions.Thedevelopment,release,andtimingofanyfeaturesorfunctionalitydescribedforOracle’sproductsremainsatthesolediscretionofOracle.

Polyglot on the JVM with Graal (English)

Technology

Polyglot I

Polyglot heaven

Java Enterprise with Polyglot JVM

Polyglot Programming in the JVM - Øredev

Kató Lomb - Polyglot

Polyglot Programming @ CONFESS

Visualizing Graal

Sulong: Fast LLVM IR Execution on the JVM with Truffle and ... · Sulong: Fast LLVM IR Execution on the JVM with Truffle and Graal FOSDEM 2016: 31. January 2016 ... Deo pti miz ati

IndicThreads-Pune12-Polyglot & Functional Programming on JVM

Polyglot Programmer

Creating polyglot and scalable applications on the jvm using Vert.x

Polyglot JVM

Polyglot - June 2009

Polyglot on the JVM with Graal (Japanese)

Web polyglot programming

Gpus graal

Polyglot Sample

Thomas'Wuerthinger' - AMDdeveloper.amd.com/wordpress/media/2012/10/jvmls...JVM LANGUAGE SUMMIT | JULY 2013 5 WHY WE CHOSE GRAAL Graal is a highly extensible, open-source, just-in-time

Graal: A quest for the JVM to leverage its own J Doug ...wiki.jvmlangsummit.com/images/c/c4/Simon_Graal_Presentation.pdf · Graal: A quest for the JVM

Polyglot on the JVM with Graal - JUG · Key Features of Graal • Designed for speculative optimizations and deoptimization – Metadata for deoptimizationis propagated through all