1 / 7

TeraGrid Accounting System Progress and Plans

TeraGrid Accounting System Progress and Plans. David Hart dhart@sdsc.edu July 26, 2007. Recent Accounting Activities. Server/Software Upgrade (Aug 2006) New hardware, PostgreSQL upgrade Test and development instances on prior hardware Ongoing monitoring

makani
Download Presentation

TeraGrid Accounting System Progress and Plans

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. TeraGrid Accounting SystemProgress and Plans David Hartdhart@sdsc.edu July 26, 2007

  2. Recent Accounting Activities • Server/Software Upgrade (Aug 2006) • New hardware, PostgreSQL upgrade • Test and development instances on prior hardware • Ongoing monitoring • NPU processing bottleneck eliminated (Dec 2006) • Troubleshooting, identifying and fixing issue • Solving Purdue Condor job backlog • Support for tracking arbitrary job “attributes” (Jan 2007) • Targeting proposed gateway needs • Project out-of-funds/expired packets, PI notification (March 2007) • Plus update to provide more info to RPs in RPI packets • Notification in use by NCSA, TG Cluster; Purdue planned • User inactivation (RAI packets) • Credits/debits via NPUs (May 2007) • Refunds, reservation charges, storage charges (in SUs), misc. credits/debits • TGCDB user “roles” (May 2007) • NPUs can flag user types including “community user”, “PI”, “co-PI”, “allocation manager.” • Other roles can be added. (Perhaps “training user”)

  3. Activities currently underway • Job/NPU processing improvements • Simpler TGCDB structure, faster processing, easier error correction • Will also permit improved reporting capabilities • Ready, pending RP action • AMIE benchmarking • To identify bottlenecks and improve packet transport performance • Supporting ability for users to change contact information via portal • GRAM/grid job info • Already supported by TGCDB/AMIE, requires RP action

  4. Ongoing Activities • DNs and DN propagation • TGCDB/AMIE components in place, troubleshooting TG-wide compliance • Portal support • Miscellaneous requests, including improvements to add user form, portal logins, etc. • Support for adding/decommissioning new resources, RPs • NCAR and Frost • Abe, Ranger, Big Ben, storage resources added • Lemieux, Radium, Tiger decommissioned • tgusage updates • Updated to v2.9 from v2.4 in August 2006 • Requested feature to extract per-job details • Ongoing support for trouble tickets, error correction • Including backloads of PSC data and PSC/SDSC DACs

  5. Recent POPS Developments • Portal login support • Supporting grant data collection changes • to comply with NSF policy change • New resource types (storage, ASP) and billing units (TBs, Months) • Sept: Online proposal status tracking, viewing of reviewer comments • Enhanced admin capabilities to customize award notices and automate email notifices to PIs/co-PIs • Plans • Context-based help • Go “paperless” for reviewer meeting materials • DAC changes for NSF Graduate Fellows

  6. Planned Activities • Storage usage accounting and reporting • Near-term updates • New features requested by other TG areas or to reflect policy changes • AMIE optimizations • Streamlining TGCDB procedures and triggers • New “Core Services” proposal submitted • To replace current NCSA/SDSC Core-leveraged funding for allocations and accounting-related activities • Better integration of and communication between POPS and Allocations activities/staff with TGCDB and Accounting activities/staff

  7. TeraGrid Core Services 2.0 • Major focus for next year • Multi-site, GIG-funded team for requirements gathering and initial design • Top to bottom evaluation and integration of the allocation, authentication, authorization, and accounting system components • Seamless interaction between POPS, TGCDB, TGUP, Gateways infrastructure, and Authentication system • Eliminate NCSA Sybase from the critical path • Automate process to minimize the human effort required • Multi-site or site-independent project/user creation

More Related