Census bureau
Download
1 / 14

Census Bureau - PowerPoint PPT Presentation


  • 88 Views
  • Uploaded on

Census Bureau. System IPT Decennial Systems Database Modernization Support. DRIS Decennial Response Integration System. Date: 07/30/2007. Index. What have we done in past 3 months dscmotd1 and DE101 compare Moved to DE101 and then to BE101 And many more … Work done on DE101

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' Census Bureau' - ormand


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Census bureau

Census Bureau

System IPT

Decennial Systems Database Modernization Support

DRIS

Decennial Response Integration System

Date: 07/30/2007


Index
Index

  • What have we done in past 3 months

    • dscmotd1 and DE101 compare

    • Moved to DE101 and then to BE101

    • And many more …

  • Work done on DE101

    • Scripts creation for load

    • Studying application for index creation

  • UECT creation from UNM

    • Writing script based on state retrieval

    • Unit testing for UECT


  • Full load

  • Full test for UECT load- successful

  • Compare times with old machine

  • Performance and tuning

    • Partitioning tables

    • Comparing results for 2000

  • Change in retrieval criteria

    • Retrieval criteria to LCO basis

    • Changed scripts

    • Partitioned tables based on LCO

    • Unit testing and full testing

    • Taking advantage based on CPUs

    • Running scripts in parallel


    • Move DE101 to BE101

      • Move scripts from DE101 to BE101

      • Test all scripts for performance

    • Data modeling

      • Version difference

      • Production m/c

      • Work around/Solution

    • Reverse Engineering effort


    What have we done in past 3 months
    What have we done in past 3 months

    • dscmotd1 and DE101 compare

    • Moved to DE101 and then to BE101

    • And many more …

    dscmotd1

    BE101

    DE101

    • Got acceptable and best results on DE101

    • Moved schema to DE101


    Work done on de101
    Work done on DE101

    • Scripts created for

      • Data load

      • Indexes

      • analyzing table objects

    • Study application to create proper indexes

      • Fast data retrieval

      • Fast data update

    • Test data load and compare with old machine

      • Acceptable results

        • Data load in 1.5 hrs for whole country compare to 30 hrs on old machine


    Uect creation from unm
    UECT creation from UNM

    • Scripts based on state retrieval – 2000

    • Unit testing

    • Full load testing

    • Full test for UECT load- successful

    • Compare times with old machine

    UNM table

    UECT

    process

    UNM table

    Retrieval based on state


    Performance tuning
    Performance & Tuning

    • Results not up to the mark

    • P & T was needed

    • Data size, too high

      • table partitioning

    UECT

    process

    Retrieval based on state


    Change in retrieval criteria
    Change in retrieval criteria

    • Data retrieval based on LCO and NOT on state based

    • Unit and full testing

    • Advantages of CPU bound operations

    • Scripts run in parallel

    UECT

    process

    Retrieval based on LCO


    Moving from de101 to be101
    Moving from DE101 to BE101

    • Got new host

    • DE101 - Production

    • BE101 – Beta/test

    • Same configuration

    • Whole testing to be done


    Data modeling problems
    Data Modeling Problems

    • Data repository was not compatible with Database version

    • Could not do data modeling using Oracle designer

    • Work around using third party tool. No stoppage of work

    Oracle db

    10g

    Desktop

    Data modeling

    X

    Designer repository

    6.x

    Versions not

    compatible

    DE101


    Work around
    Work Around

    • Work around using third party tool. No stoppage of work

    Desktop

    Data modeling

    Third party tool

    Oracle db

    10g

    Versions compatible

    Scripts creation/

    execution

    DE101


    Reverse engineering effort not done
    Reverse Engineering effort – not done

    Oracle db

    Desktop

    Data modeling

    DE101

    Designer repository

    Versions compatible

    BE104



    ad