210 likes | 292 Views
Explore architectures, technologies, security, and scheduling strategies in grid systems like gLite and Globus. Learn about parallel processing platforms, job management, authentication, and authorization. Discover key components and challenges in grid architecture and evolution.
E N D
Revisão geral CG 07/08
Introdução • Plataformas de processamento paralelo e distribuído • Clusters • Gerenciadores de recursos • NQE • SGE • Condor • Definições de grid
Condor • Escalonamento oportunista • Matchmaking • Classads • Arquitetura e processo principais • Comandos principais • Checkpointing • DAGMan • Master-worker • Flocking
gLite • Aspectos administrativos de desenvolvimento do middleware • Arquitetura: serviços • Job workflow • Segurança • Autenticação • Autorização • Proxies • Organizações virtuais (VO e VOMS)
gLite • Sistema de informação • R-gma • Accounting • Apel • Dgas • Storage elements • Gestão de jobs
EGEE • Overview do projeto • Objetivos • Aplicações • Projetos relacionados • Sustentabilidade
Arquitetura de grids e Globus • Desafios • History and Evolution of Grid • Introduction to Grid Architecture • Key Components - Resource infrastructure • Services in the Web and the Grid • Technology: Globus
Arquitetura de grids e Globus • Modelo da ampulheta (hourglass model) • Aplicações • Collective services • Core • Fabric
Arquitetura de grids e Globus • Web services • Grid services • OGSA/OGSI • Globus • Serviços • limitações
Application Description Languages • Script-like • Workflow-based • Xml-based
Languages • DAGMan • VDL • GXML • AGWL • XPWSL • GEL • GRID-ADL
gLite • Autenticação e autorização • Chaves públicas e privadas • Certificados • Formas de criptografia • Segurança no gLite • X.509 PKI • Organizações virtuais • IGTF • Certificate authorities e registration authorities • CRLs • CNs e DNs • Renovação de certificado • Login to the grid, delegation
Grid Systems and Scheduling • Taxonomia (segundo Foster): • Computacionais • Data grids • Service grids • Taxonomia de aplicações • Distributed supercomputing • High-Throughput Computing • On-Demand Computing • Data-Intensive Computing • Collaborative Computing
Grid Systems and Scheduling (cont.) • Alternative classification: • Independent • Loosely-coupled • Tightly-coupled • Application management • Partitioning • Mapping • allocation
Grid Systems and Scheduling (cont.) • Particionamento e aglomeração de grafos de aplicação • Heurísticas de particionamento: • Graph collapsing • Dominant edge • Machine cut • zeroing
Grid Systems and Scheduling (cont.) • Survey de estratégias de escalonamento • Kwok & Ahmad • Casavant & Khul • List scheduling family • Dominance sequence clustering (DSC) • Kumar & Biswas • Minimax • Zomaya et al.: Muliple queues with duplication • Reinforcement learning
Grid Systems and Scheduling (cont.) • Resource management • When to transfer • Which task • Which node • Sender-initiated • Receiver-initiated • Simmetrically-initiated • When to collect info
Scheduling mechanisms for grids(according to Berman and reviewed by Kayser) • Application • Job • Resource • Meta-scheduler
Scheduling mechanisms for grids • Legion • Globus • MyGrid/OurGrid • GrADS • EasyGrid • Nimrod/G • AppLeS • GRAnD/AppMan
Grid Systems and Scheduling (cont.) • Grid operating systems
gLite: WMS & DMS • Workload Management system • Features • API • Data Management System • Features • API