1 / 35

BES III 离线软件系统 BES III Offline Software System (BOSS)

BES III 离线软件系统 BES III Offline Software System (BOSS). 李卫东 2004 年11月19日. calibUtil Services. Gaudi services. Gaudi Client. Calibrator. Register, write Search Read. Simulation. Pre-tracking. Calibration. Detector-Geo. Cal-MDC. Cal-TOF. Fast-track. Event-T0. Reconstruction.

helene
Download Presentation

BES III 离线软件系统 BES III Offline Software System (BOSS)

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. BES III 离线软件系统BES III Offline Software System (BOSS) 李卫东 2004年11月19日

  2. calibUtil Services Gaudi services Gaudi Client Calibrator Register, write Search Read Simulation Pre-tracking Calibration Detector-Geo Cal-MDC Cal-TOF Fast-track Event-T0 Reconstruction Gaudi Physics Analysis Exp. data MC data Post-tracking EventDisplay Cal-Data Control-Data MDC-track EMC(B/E) TOF(B/E) MUID Metadata (persistent) MySQL rdbms REC Data Phy-tracking V0FIND EVERTEX DST Made DST Data BES III 离线软件系统 Calibration & Database FACS Reconstruction Simulation Generator Transient Event Store Simulation Digitization

  3. 离线软件子系统负责人 • Simulation H. M. Liu • Reconstruction Z. P. Mao • Framework and Analysis Core Software (FACS) W. D. Li • Calibration and Database (new) J. F. Qiu • Parameters database design and access • Tools for database storage and retrieval of calibration data • Algorithms for calibration constant measurements • Tools for examination of calibration results

  4. 研究团队 总共：22 名 研究人员 离线数据分析系统负责人 副负责人 数据重建 探测器刻度 框架和物理分析工具 MC事例产生和模拟 子系统负责人 子系统负责人 子系统负责人 子系统负责人 • 北京大学： • 一名教授、一名博士生 • 山东大学： • 一名教授、一名讲师、一名博士生 • 湖南大学:　一名硕士生 • 浙江大学、四川大学（正申请加入） • 中科院高能物理研究所： • 三名研究员、一名副研究员 • 一名助理研究员、二名实习研究员 • 二名博士后 • 六名博士生 • 中国科技大学:　一名博士生

  5. 软件开发环境 • Concurrent Versions System (CVS) is used for version management • ViewCVS for browsing files in CVS repository • Configuration Management Tool ( CMT) is used: • to define and maintain a software package • to define and manage dependence on other packages • to generate binaries and executables • to organize releases • Main language C++, Linux RedHat 7.2/7.3 with gcc 2.95/3.2

  6. package package package package package package package package package package package package 软件系统的配置管理 • Internal software • Gaudi • External software • HEP software • Public domain software Installation area Release area sources CVS cmt Work area binaries generated External External External External cmt

  7. 开发过程 • 建立项目的工作分解结构( WBS ) • 人员、内容、时间、里程碑 • 软件模块开发： • 分析软件功能、需求 • 定义和其它模块间的接口 • 软件设计 • 软件实现 • 软件的测试、文档和评审 • 软件发布

  8. 软件发布 6 Months 3 - 4 Months 软件测试 2 – 3 Months 软件实现 1 Month Weeks Days 迭代式开发模式 理想 实践 时间 软件设计 需求分析

  9. Software Framework Evolvement • BES Analysis Framework (BESF) • Based on Belle software • Supports two types of data management: Panther and ProxyDict • Added more features e.g. new dynamic library loading and new software components e.g. Service etc • Implemented Event I/O: Raw Data and NDST Data • Build system: Automake and CMT • Currently all reconstruction algorithms being developed in the BESF • BOSS Gaudi framework • A concrete implementation of the underlying architecture: Gaudi

  10. Gaudi Framework • provides standard interfaces for the common components necessary for data processing and analysis • Gaudi users: LHCb, ATLAS, HARP, GLAST, OPERA etc ISvcLocator ApplicationMgr IDataProviderSvc IProperty IAlgorithm EventDataSvc Concrete Algorithm IDataProviderSvc DetectorDataSvc IHistogramSvc HistogramSvc Obj_A Obj_B MessageSvc IMessageSvc IParticlePropertySvc ParticlePropertySvc

  11. Why Gaudi ? • Benefits • In general, gain more in simplicity, modularity, flexibility and extendibility • Clear separation of experiment-dependent and experiment-independent parts. Only need to focus on BES III specific packages. • Save coding time. Many common utilities and services available. • More control available in work flow: sequence, branch and filter • Support of multi-threaded implementation: no extra constraints if online event filter system reuses offline packages. • Cost of migrating to Gaudi • A steep learning curve for core developer although well documented.

  12. Converter Converter Application Manager Converter Transient Event Store Data Files Message Service Persistency Service Event Data Service JobOptions Service Algorithm Algorithm Algorithm Data Files Transient Detector Store Particle Prop. Service Persistency Service Detec. Data Service Other Services Data Files Transient Histogram Store Persistency Service Histogram Service Gaudi Architecture Object Diagram

  13. Data Flow in Gaudi • Each algorithm only knows what data (type and name) is expecting as input and creating as output • The only coupling is through the data • Scheduling of sub-algorithms is responsibility of the parent algorithm T1 Real data flow Apparent data flow Transient Event Data Store Data T1 Algorithm A Data T2, T3 T2 T3 Data T2 Algorithm B Data T4 Control flow A Data T3, T4 Algorithm C T4 Parent B Data T5 C T5

  14. Data Service (3) Request load (2) Search in Store PersistencyService Request dispatcherObjy, ROOT,.. (5) Register Conversion Service (4) Request creation Data Store Converter Converter Converter Converter Reconstruction (1) : Data Access Unsuccessful ifrequested object is not present Algorithm (1) Retrieve object

  15. Reconstruction (2) : Event I/O

  16. Application Layer Geometry Data Objects DB Access Layer DB Records Reconstruction (3) : geometry data

  17. Calibration Infrastructure (1) Calibrator Gaudi Client calibUtil interface Write/register Search Read Signifies “uses” or “accesses” Metadata (persistent) Data (persistent) MySQL rdbms bad strips (XML) CAL calibs (ROOT)

  18. Calibration Infrastructure (2)

  19. Simulation (1): BOOST Event GENBES Generator Geometry Geant4 Tracking Detector Digitization Response Raw data MC truth HepEvt format Hit objects

  20. Simulation (2) p=0.5 -1.5GeV |cosθ|<0.9 Hits in TOF (no threshold cut) Hits in MDC

  21. Simulation (3) Gaudi Applications • Simulation Application • Event Generator • Simulation • Digitization Simulation Simulation Generator ① Calibration Transient Event Store Reconstruction Gaudi ② Physics Analysis Simulation ③ EventDisplay ④ ⑤ Digitization • Three major independent components communicate through Gaudi Transient Event Store.

  22. Event Display (1)

  23. Event Display (2)

  24. Event Filter (EF): Event Selection

  25. 质量控制 （1） • 详细的计划 • 利用 MS Project制定工作分解结构，共计 250 多项 • 任务书 • 开发人员的个人计划 • 良好的软件设计 • 利用 UML描述设计，工具软件 MS Visio和 IBMRational Rose • 对于引进的软件，实行软件设计逆向工程 • 设计以 PowerPoint方式，在软件会上进行汇报。 • 需要加强技术设计文档的编写

  26. 质量控制（2） • 规范的编程 • 利用 CERN 的研究成果，制定约 70 条 C++ 编程规则。 • 涵盖命名规则、代码组织、控制流、对象生命周期、类接口、错误处理、可读性和可维护性等方面。 • 分两个级别：推荐、必需执行。 • 高频率的软件构建 • 将难得一见的集成工作转化为频繁进行的常规工作 • 国外许多实验采用日构建 (Nightly Build) • 基础：自动构建、统一代码源和“冒烟”测试。

  27. 质量控制（3） • Gaudi 核心框架和组件 • 可以节省大量的代码，代码结构会更加清晰 • 能够保持整体架构的稳定性和一致性 • 面向组件： • 减轻耦合度太高导致的复杂度 • 框架管理组件 • 用户只需要了解接口，而不需要了解实现细节 • 测试驱动的开发 • 主要的错误来源 • 软件复杂程度大 • 时间的压力 • 缺乏或没有进行沟通 • 编程错误

  28. 质量控制（4） • 采用的测试类型 • 单元测试 Unit Tests • 系统测试 System Tests (包括集成测试、回归测试和可接受测试) • 性能测试 Performance Tests • 端对端测试 End-to-end Tests ( Data Challenge ) • 测试工具 • CppUnit: provides a support for unit testing of C++ programs. • Valgrind: check for memory leaks and uninitialised data • 系统测试人员

  29. 质量控制（5） • 不同层次的设计评估 (Technical Reviews) • 非正式设计回顾 ( Walkthrough ) • 设计检查 ( Inspection ) • 项目评审 ( Final Review ) • 长期的性能优化研究

  30. 其它工具 (1): ViewCVS

  31. 其它工具 (2): Database Designer

  32. BOSS 使用的外部软件包 • LessTif • MYSQL • PGSQL • ROOT • XercesC • Xt • Gaudi • AIDA • Anaphe • Boost • CERNLIB • CLHEP • FOX • GENBES • Geant4

  33. BES III 离线软件系统研发时间线

  34. BOSS Major Milestones • 2004-12-30 BOSS alpha release • integration with BOOST simulation • Running the reconstruction chain for MDC, TOF, EMC and MC can be achieved in the BOSS Gaudi framework. • EDM for both Raw Data and reconstructed data deployed. Completion of fully functional Event Data I/O. • 2005-10-30 BOSS betta release • Simulation and reconstruction chain functions reasonably well and can successfully process several thousand events. • Common physics analysis tools and utilities available. • Physics study in BOSS can start. • 2006-12-30 BOSS production release

  35. 谢谢大家！

More Related