status of aida and jas 3 by victor serbo l.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
Status of AIDA and JAS 3 by Victor Serbo PowerPoint Presentation
Download Presentation
Status of AIDA and JAS 3 by Victor Serbo

Loading in 2 Seconds...

play fullscreen
1 / 32

Status of AIDA and JAS 3 by Victor Serbo - PowerPoint PPT Presentation


  • 310 Views
  • Uploaded on

Status of AIDA and JAS 3 by Victor Serbo. What is AIDA History/Collaboration/Documentation Some Details Examples Future plans JAS: Description and Status Conclusion. What is AIDA. Abstract Interfaces for Data Analysis (AIDA)

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Status of AIDA and JAS 3 by Victor Serbo' - clare


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
status of aida and jas 3 by victor serbo
Status of AIDA and JAS 3by Victor Serbo
  • What is AIDA
  • History/Collaboration/Documentation
  • Some Details
  • Examples
  • Future plans
  • JAS: Description and Status
  • Conclusion

ACAT’2002, Moscow, June 24-28, 2002

what is aida
What is AIDA
  • Abstract Interfaces for Data Analysis (AIDA)
  • “The goals of the AIDA project are to define abstract interfaces for common physics analysis objects, such as histograms, ntuples, fitters, IO etc.The adoption of these interfaces should make it easier for developers and users to select to use different tools without having to learn new interfaces or change their code. In addition it should be possible to exchange data (objects) between AIDA compliant applications.”

ACAT’2002, Moscow, June 24-28, 2002

abstract interfaces
Abstract Interfaces
  • Only define “protocol” that analysis objects have to understand, no internal details
  • Can use object only through Abstract Interface
  • Define only pure virtual methods
    • AIDA defines behavior, analysis tool provides implementation
  • Use Factories to be able to switch implementations easily:
    • IAnalysisFactory af = IAnalysisFactory.create();

ACAT’2002, Moscow, June 24-28, 2002

motivation
Motivation
  • Advantages
    • The user needs to learn only one set of interfaces
    • Same user code can be used with different AIDA-compliant analysis applications
    • Different analysis tools can exchange analysis objects
      • same storage format, use functionality from other tools
    • Pool experience of different developer teams
      • LHC++, OpenScientist, JAS
  • Two versions of AIDA interfaces
    • One for C++
    • One for Java
    • As identical as possible

ACAT’2002, Moscow, June 24-28, 2002

aida example

A

I

D

A

Analysis tool 1

Analysis tool 2

User code (e.g. GEANT4)

AIDA Example
  • Use same code with any AIDA-compliant analysis tool.

ACAT’2002, Moscow, June 24-28, 2002

history
History
  • Initial idea formed during discussion at HepVis-99 workshop at Orsay
    • Informal AIDA discussions at CERN in 2000
    • AIDA workshops:
      • January 2001 - Paris/Orsay
      • April 2001 - Boston (preceding HepVis 2001)
      • Informal meetings (e.g during Geant4 meetings and video conferences)
      • June 2002 – CERN
    • Interfaces have been designed by discussion and (eventual) consensus
      • Takes some time, but result is well though out and robust

ACAT’2002, Moscow, June 24-28, 2002

organization developers
Organization - Developers
  • No formal collaboration/author list.
  • Some people who have contributed (ideas, code, etc).
    • Guy Barrand, Pavel Binko, Grzegorz Chwajol, Mark Donszelmann, Wolfgang Hoschek, Tony Johnson, Emmanuel Medernach, Dino Ferrero Merlino, Lorenzo Moneta, Jakub Moscicki, Ioannis Papadopoulos, Andreas Pfeiffer, Max Sang, Victor Serbo, Max Turri
  • Apologies to people accidentally missed

ACAT’2002, Moscow, June 24-28, 2002

organization code documentation
Organization – Code, Documentation
  • AIDA – open source project
    • CVS repository: cvs.freehep.org
      • “anonymous” download available
    • Web page: http://aida.freehep.org
      • General information, relevant links
      • Tutorial, users’ guide, examples
      • Downloads and web-browsable source code
      • Test cases (coming soon)

ACAT’2002, Moscow, June 24-28, 2002

current status
Current Status
  • AIDA Version 2.2 released (December 2001)
    • First “End User” release
    • Three implementations of AIDA exist
      • Anaphe/Lizard (C++)
        • http://anaphe.web.cern.ch/anaphe
      • Open Scientist (C++)
        • http://www.lal.in2p3.fr/OpenScientist
      • JAIDA/JAS (Java) + AIDA-JNI 1.0 (C++)
        • http://java.freehep.org/lib/freehep/doc/aida
    • GEANT4 adopted AIDA for analysis
  • AIDA 3.0 Currently under discussion
    • Release: end of September 2002

ACAT’2002, Moscow, June 24-28, 2002

aida interfaces summary
AIDA Interfaces Summary
  • AIDA Factories
  • ITuple
  • IHistogram
  • ICloud
  • ITree

ACAT’2002, Moscow, June 24-28, 2002

example program java
Example Program (Java)

l

  • Create, fill, and view 1D and 2D histograms
  • Factories:
    • Can switch implementations without recompiling
    • Framework can hide factories

;

ACAT’2002, Moscow, June 24-28, 2002

ituple
ITuple
  • ITuple- interface to the Data
    • “get/set” methods for double, float, int, …
    • Information about columns: min, max, mean, rms
    • Navigating: start(), next(), skip(int nRows)
    • Project ITuple into 1D, 2D, 3D histogram
    • New features for AIDA 3.0:
      • Support for complex internal structures (subfolders)
      • Chaining of ITuples

ACAT’2002, Moscow, June 24-28, 2002

ihistogram 1d 3d
IHistogram (1D-3D)
  • Binned histogram: IHistogram1D, 2D, 3D
    • “fill” methods (with/without weight)
    • Histogram info: entries, mean, rms, axis
    • Bin info: centre, entries, height, error
    • Histogram arithmetic: add, multiply, divide
    • Convenience methods, like coordinate-to-index conversion

ACAT’2002, Moscow, June 24-28, 2002

icloud
ICloud
  • Unbinned collection of points: ICloud1D, 2D, 3D
    • Can represent scatter plot, dynamically rebinnable histogram
    • Can be converted to a binned histogram
    • Standard “get/set” methods for entries
    • Collection info: lower, upper, mean, rms

ACAT’2002, Moscow, June 24-28, 2002

ifunction and fitting
IFunction and Fitting
  • Fitting: IFunction, IFitFunction
    • IFunction – simple interface, allows to set parameters and get function value
    • IFitFunction – fit function to a histogram
      • Extends IFunction
      • Various fit control methods: step size, bounds, etc.
      • Allows to perform fit and get results
      • AIDA 2.2 fitting functionality fairly limited
    • AIDA 3.0 (Under discussion) extended functionality

ACAT’2002, Moscow, June 24-28, 2002

itree
ITree
  • ITree
    • directory-like structure (Unix directory convention)
      • Methods like: cd, ls, mkdir, etc.
    • AIDA analysis objects (tuples, histograms, clouds, ets.) exist within ITree directories
    • “save/restore” functionality, hides storage details from the user
      • Compatible with database or file storage
      • Can support multiple file formats
      • Mount/Unmount functionality (like unix) allows multiple stores to be seamlessly merged
      • AIDA XML format is defined for data interchange

ACAT’2002, Moscow, June 24-28, 2002

future unofficial ideas
Future (unofficial ideas)
  • Developer-level interfaces
    • Code sharing
    • More robust operation
  • Put AIDA-based utilities in CVS
    • Utility to test AIDA implementations
    • User contributions
  • Common binary storage format
  • More development in fitting interfaces
    • IFitter, IOptimizer, IFitResult, IPlotter

ACAT’2002, Moscow, June 24-28, 2002

slide18
JAS
  • Java Analysis Studio (JAS)
    • Written entirely in Java – really portable
    • Originally targeted at offline analysis – but also used extensively for online monitoring
    • Rich, easy to use GUI
      • Can view trees, plots, HTML pages with embedded active objects
    • Built-in editor/compiler for writing analysiscode
      • Based on open source JEdit editor (pure Java editor, syntax highlighting, auto indent, parenthesis matching, etc.)
    • Local and Client-Server Operation
      • Access local or remote analysis objects
      • Can send analysis code to the data and ship back only the results

ACAT’2002, Moscow, June 24-28, 2002

jas continue
JAS (continue)
  • Java Analysis Studio
    • Modular/Extensible via Plugins
      • Plugins extend basic JAS functionality
        • Define experiment-specific utilities (event display, analysis utilities, specialized tables)
        • Add menus, create control areas, consoles, and output pages
      • Data Format Independent through Data InterfaceModules (DIM)
        • DIM is special type of Plugin – makes data available for JAS
        • DIMs exist for PAW, Root, Flat Files, SQL, stdHEP, HepTuples
        • You can write your own DIM for your data format
      • Plugin examples:
        • Particle decay tree
        • WIRED event display

ACAT’2002, Moscow, June 24-28, 2002

jas gui

Built-in HTML viewer with embeddable “objects” (plots, buttons, etc.).

Pages can display histograms. User can control layout, add, remove plots.

Tree area provides access to analysis objects. Each item has popup menu and double-click action.

JAS GUI

Plot Widget, shows data in real time, optimized for fast refresh performance.

ACAT’2002, Moscow, June 24-28, 2002

jas usage
JAS Usage
  • BaBar Online Monitoring
    • Online Monitoring API
    • Static HTML pages with embedded live and reference plots. Plots can be overlaid.
  • US Linear Collider Studies
    • Have an entire recon+analysis package written in Java
      • Using JAS as analysis interface
      • Making use of remote data access using repository at University of Pennsylvania
  • Other smaller scale users

ACAT’2002, Moscow, June 24-28, 2002

jas 3
JAS 3
  • Major rewrite of many JAS components
    • Use AIDA interfaces and JAIDA implementation for analysis: histograming, histogram arithmetic, fitting, tuples etc.
    • The JAS plot widget will become the FreeHEP plotter
    • JAS itself will become a modular application framework, into which various analysis components can be plugged. Major plugins will include WIRED, the JAS Plotter, and JAIDA. 
    • Scripting support (Jython ?)
    • New module Example: JAS Tuple Explorer, is being used by the Babar Ambient Data explorer

ACAT’2002, Moscow, June 24-28, 2002

tuple explorer
Tuple Explorer
  • Display Tree Leaves
    • Plot
    • Histogram
    • XY Plot
    • Create new columns
    • Apply cuts
  • BaBar uses Tuple Explorer as Ambient DB browser
  • Demo after talk

ACAT’2002, Moscow, June 24-28, 2002

conclusion
Conclusion
  • AIDA is becoming mature project
    • Functionally sound
    • Regular meetings
    • Release schedule
  • Next release of AIDA and AIDA-compliant analysis tools – September 2002
  • JAS 3
    • Easy to use and extend
    • Uses Java implementation of AIDA for analysis

ACAT’2002, Moscow, June 24-28, 2002

details backup
Details (backup):
  • Histogram
  • Cloud
  • Tuple
  • Tree
  • FreeHEP Plotter

ACAT’2002, Moscow, June 24-28, 2002

details ituple
Details - ITuple
  • Interface to

the Data:

ACAT’2002, Moscow, June 24-28, 2002

details ihistogram 1d 3d

IHistogram:

Common functionality for all histograms (like entries, label, dimension,)

IHistogram1D

IHistogram2D

IHistogram3D

Details – IHistogram (1D-3D)

ACAT’2002, Moscow, June 24-28, 2002

details icloud

ICloud:

Common functionality for all histograms (like entries, label, dimension,)

ICloud1D

ICloud2D

ICloud3D

Details - ICloud
  • Unbinned collection of points: ICloud1D, 2D, 3D
    • Can represent scatter plot, dynamically rebinnable histogram
    • Can be automatically converted to a binned histogram

ACAT’2002, Moscow, June 24-28, 2002

details itree
Details – ITree
  • Directory-like

structures: ITree

ACAT’2002, Moscow, June 24-28, 2002

details freehep plotter
Details - FreeHEP Plotter
  • FreeHEP Plotter The FreeHEP plotter will be based on the existing JAS Plotter (JASHist), but with changes to add new features requested by users, a plugin structure to make adding new plot types easier, and a more flexible data model to make attaching various different data types possible. The FreeHEP plotter will fully support displaying all AIDA plots types.
  • A partial list of design goals include:
    • Support for histogram, XYPlot, ScatterPlot, 2D color maps, lego plots, contour plots ..
    • Must be able to use any object as annotation or labels (arrows, latex, etc.)
    • Must be able to build complex plots (multiple axes, shared axes, etc.)
    • Extensible set of renderer
    • Extensible set of data source interfaces
    • Arbitrary map from axis to coordinate system (log, linear)
    • Support 2D and 3D drawing (and in principle also inventor, opengl etc.)
    • Able to support strings (sorted?), dates, numeric axis
    • Binned and non-binned axes, rebinning for binned axis
    • Output as postscript, SVG etc.
    • Variable bin size
    • Able to support legends, titles, annotations etc
    • Able to select a range in 1D and 2D plots for zooming, fitting in range, cuts etc
    • Labels should resize to fit bounds
    • Support for functions, directly setting initial values

(next page …)

ACAT’2002, Moscow, June 24-28, 2002

details freehep plotter continue
Details - FreeHEP Plotter (continue)
  • User able to directly interact with objects, move them around (including outside plot boundaries)
  • Property pages and popup menus for customization
  • Arbitrary interactions between plot and data (rebinning, zooming etc.)
  • External objects should be able to insert (or delete) items into property pages, popup menus
  • Extensible using OO techniques (e.g. Specialized Axes)
  • Plot should be able to provide menus to external GUI
  • Saving/Restoring from XML
  • Real time updating
  • High performance (rapid updates)

ACAT’2002, Moscow, June 24-28, 2002

june 2002 developers workshop
June 2002 Developers Workshop
  • 2 Day “Users Workshop”
  • 3 Day “Developer Workshop”
    • Items under discussion
      • Fitting (two proposals, from SLAC, CERN)
      • Improved plotting (IPlotter)
      • Graph (XYData)
      • Tuple chaining, merging
      • Small updates/extensions to API
    • Input/Participation from new people welcomed!

ACAT’2002, Moscow, June 24-28, 2002