1 / 15

K42 Internals

K42 Internals. Dilma da Silva for K42 group IBM TJ Watson Research. K42 Goals. Scalability Flexibility/customizability Framework for OS research Linux API and ABI and kernel module compatible Available to collaborators under LGPL Maintainability/extensibility.

keaton-knox
Download Presentation

K42 Internals

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. K42 Internals Dilma da Silva for K42 group IBM TJ Watson Research FastOS PI Meeting/Workshop

  2. K42 Goals • Scalability • Flexibility/customizability • Framework for OS research • Linux API and ABI and kernel module compatible • Available to collaborators under LGPL • Maintainability/extensibility FastOS PI Meeting/Workshop

  3. OS function in user-level library examples: timers, thread library... allows OS services to be customized for applications with specialized needs avoids interactions with kernel/servers, reduces space/time overhead in kernel/servers Object-oriented design at all levels Application Application Linux emulation Linux emulation OS lib OS lib Servers Micro-kernel Structure FastOS PI Meeting/Workshop

  4. Object-oriented design FastOS PI Meeting/Workshop

  5. OO Design: MM Objects Region FCM FR Region Region Process Region FCM FR Region FCM: File Cache Management FR: File Representative HAT: Hardware Address Translation HAT FastOS PI Meeting/Workshop

  6. Region FCM FR Process Region FCM FR Region Process Region FCM FR FastOS PI Meeting/Workshop

  7. Region Region Region Region Region Region Specialization and Clustered Objects • OO design enables specialized implementations FastOS PI Meeting/Workshop

  8. Clustered object infrastructure • Per-processor level of indirection avoids any centralized bottleneck • Provides library to simplify distributed implementation • Caching of local state • Incremental distribution of services • DHash Focus on locality! • Read-Copy-Update techniques • Use non-blocking synchronization • Avoid locking hierarchies FastOS PI Meeting/Workshop

  9. Hot-swapping • change one system component/type for another without bringing system down • potential uses • scalability • performance • monitoring • extensibility • testing • Dynamic update: system availability FastOS PI Meeting/Workshop

  10. Hot-Swapping/Dynamic Update • Depends on: • object-oriented structure of system • technology to establish a quiescent state • level of indirection • Implementation has no additional overhead • when not swapping an object • for objects not being swapped • Limitations: • is not instantaneous • initial prototype • Current work: coordinated swapping, interface changes, external policies... FastOS PI Meeting/Workshop

  11. Independent workloads FastOS PI Meeting/Workshop

  12. More hot-swapping Adaptive paging Adaptive file imp. FastOS PI Meeting/Workshop

  13. Memclone benchmark: Memory intensive parallel application FastOS PI Meeting/Workshop

  14. Performance monitoring • unified cheap scalable non-blocking tracing infrastructure for correctness and performance debugging • key parts of design transferred to LTT • post processing tools easy to develop: lock contention, sampling, time breakdown, visualization, caching effects, ... • in final numbers, disabled, but only %1.6 difference UP and 24 way FastOS PI Meeting/Workshop

  15. Status http://www.research.ibm.com/K42 dilmasilva@us.ibm.com FastOS PI Meeting/Workshop

More Related