Polyglot alchemy: JSR 223 in action

1. Polyglot alchemy: JSR 223 in action FabriceMatrat Marc Campora

2. Marc Campora • Sr Manager • Java Middleware • mcampora@amadeus.com • @mcampora

3. FabriceMatrat • System Architect • Technical Evangelist • fmatrat@amadeus.com • @fabricematrat

6. Amadeus • Leading provider of IT solutions for the travel industry • Connect Providers (ex. airlines) and Resellers (ex. TAs) • Provide IT solutions (ex. check-in or inventory system)

7. System Constraints 600k Terminals 1.6B Transactions/day <0.5s Response time 3.7M Bookings/day 100+ IT changes/day 99.99% Availability

8. Our products • Inventory • Departure control • Self Booking Tools • Point-of-sale • e-Commerce • Mobile companions

9. Technical platform • A clear technical strategy • RIA even for the mobile • Community products • SaaS, multi-tenants infrastructure

10. Problem statement • Community versus specific

11. From SaaS to PaaS Application UI Application logic Middleware & Framework

12. From SaaS to PaaS Application UI A P I Custom UI Custom UI Application logic Custom logic Script execution environment Middleware & Framework

13. Features and ambition

16. Scripting on JVM Application UI A P I Script Script Script Application logic Script execution environment Middleware & Framework

17. Scripting for Amadeus PaaS

18. Language Choice (2010)

19. Groovy

20. Embed Groovy Binding binding = new Binding(); binding.setVariable("foo", new Integer(2)); GroovyShellshell = new GroovyShell(binding); shell.evaluate("println 'Hello World!'; x = 123; return foo * 10");

21. Embed Groovy ClassLoader parent = getClass().getClassLoader(); GroovyClassLoader loader = newGroovyClassLoader(parent); File script = new File("HelloWorld.groovy")Class<GroovyObject> groovyClass = loader.parseClass(script); GroovyObjectgroovyObject = groovyClass.newInstance(); groovyObject.invokeMethod("run", new Object[0]);

22. Embed Groovy String[] roots = new String[] { "/my/groovy/script/path" }; GroovyScriptEnginegse = newGroovyScriptEngine(roots); Binding binding = new Binding(); binding.setVariable("input", "world"); gse.run("hello.groovy", binding); System.out.println(binding.getVariable("output"));

24. JSR223

25. Groovy vs. JSR 223 Bindingbinding = newBinding(); binding.setVariable("foo", newInteger(2)); GroovyShellshell = newGroovyShell(binding); shell.evaluate("println'Hello World!'; x = 123; return foo * 10"); ScriptEngineManagermgr = newScriptEngineManager(); ScriptEngineengine= mgr.getEngineByName("groovy"); Bindigs bindings = engine.createBindings(); bindings.put("foo", newInteger(2)); engine.eval("println'Hello World!'; x = 123; return foo * 10",bindings);

26. JSR 223 in and out

28. Multiple script technology ScriptEngineManagermgr = newScriptEngineManager(); ScriptEngineengine = mgr.getEngineByName( "freemarker"); engine.eval("Hello ${who}!"); ScriptEngineManagermgr = newScriptEngineManager(); ScriptEngineengine = mgr.getEngineByName( "groovy"); engine.eval("println'Hello World!'");

29. Common API

31. Availability • 800 languages on JVM • Around 60 are maintained • 20 have JSR 223 Implementation

32. Performance • Compilation Result • JSR 223 No Access • Storage Script Script Script Script Compilation Result

33. Performance • Cache Byte Code Custom classloader Cache

34. Hot swapping Groovy • Run 2 versions of the same script Passport.groovy got changed Custom classloader Passport.class new code 1110000011 new hash new code 1110000011 new hash

36. Sandbox • Script in JVM sharing platform and resources

37. Sandbox • Bad things can happen • Consume resources (CPU, disk, threads) • Java and Amadeus API is available • java.lang.System.exit(1)

38. Access control

39. Compile : How ? • Check every node in AST @ compile time • org.codehaus.groovy.control.customizers.CompilationCustomizer • org.codehaus.groovy.ast.GroovyCodeVisitor

40. Compile : Design • Deny/Allow/Deny • Blacklist Everything • Whitelist • Blacklist Methods granularity in whitelisted classes • java.lang.System java.lang.System.exit java.lang.System.currentTimeMillis

41. Compile : Implementation classSecureCodeCustomizerextendsCompilationCustomizer { publicSecureCodeCustomizer() { super(CompilePhase.CANONICALIZATION); } publicvoid call(…) { finalModuleNodeast = source.getAST(); ast.getStatementBlock().visit(new SecureCodeVisitor()); … } } classSecureCodeVisitorimplementsGroovyCodeVisitor { publicvoidvisitMethodCallExpression(MethodCallExpressioncall) { checkMethodAuthorized(call); … } publicvoidvisitStaticMethodCallExpression (…) {…} publicvoidvisitClassExpression (…) {…} … }

42. Access control

43. Runtime • Java Security • leverage the JVM's Security Managers • Wrap Primitive/Method • Add Wrapping ((Object)"ls").execute() defobj = ((Object)"ls") // Throw an exception if necessary authorizeStatement(obj, "execute") obj.execute();

44. Resource Sharing

45. Sandbox code (for stability) • Timeout enforcement • Protection against infinite loops and other patterns • Injected @ compile time via AST transformation @groovy.transform.TimedInterrupt( value = 10L, unit = TimeUnit.SECONDS ) defconfig = newCompilerConfiguration() def customizer = newASTTransformationCustomizer( [value:10L, unit:TimeUnit.SECONDS], TimedInterrupt) config.addCompilationCustomizers(customizer)

46. We are not alone • Oracle Application Developer Framework • https://github.com/sjurgemeyer/GR8ConfUS2013/tree/master/JimDriscoll • Jenkins • http://kohsuke.org/2012/04/27/groovy-secureastcustomizer-is-harmful/ • Call to the community for improvement !

47. Resource Sharing

48. Remoting • AST can optimize the Contextual information sent to the Execution Farm. REST/Json with application context Application farm Scripting farm(s)

49. Remoting • Isolation • SandBox Failure • Memory or IO contentions • No Resources Impact on Main application Farm • Customers or staging isolation • On demand provisioning • Fine grain usage reports • Billing Model