40 likes | 207 Views
SysML World Cup?. Purpose? Unleash ML researchers to solve systems problems? Frame the problems more rigorously? Shape some benchmarks to shape the field? Win the prize? Who will play?. Peter Bonik, Jeff Chase, Nitesh Chawla, Rebecca Isaacs, Emre Kiciman. Why a new game?.
E N D
SysML World Cup? • Purpose? • Unleash ML researchers to solve systems problems? • Frame the problems more rigorously? • Shape some benchmarks to shape the field? • Win the prize? • Who will play? Peter Bonik, Jeff Chase, Nitesh Chawla, Rebecca Isaacs, Emre Kiciman
Why a new game? • There are existing annual “cup” challenges in the ML community. • KDD • Why not offer “packaged” systems challenges to KDD cup? • Would meet most of the goals. • How much of the domain knowledge / structure / context can/should we “launder out”? • How black are the boxes? • Which is harder: defining the problem or finding the solution?
Nature of the challenges • What makes the systems problems interesting to ML researchers? What are the unique / interesting / hard aspects of these problems? • Self-optimizing adaptation • Self-healing unbalanced training sets • Dueling control loops • Risk management? (reasoning about probabilities)
More Q than A • How to frame a SysML cup challenge? • How much domain context? • Do the “clusters” of research in this area lead to multiple separate challenges? • Show me the data! • And supersize me. • How to frame the “why button” as a Grand Challenge? • More wine?