1 / 9

Source Data Management

Source Data Management. Near Real Time (NRT) Batch. NRT Data Submission. Changes are triggered on source tables On each change event triggers store the source system’s internal key in an ordered log IAA business logic is applied to the key Transitioning out of the IAA target population

tadhg
Download Presentation

Source Data Management

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Source Data Management • Near Real Time (NRT) • Batch

  2. NRT Data Submission • Changes are triggered on source tables • On each change event triggers store the source system’s internal key in an ordered log • IAA business logic is applied to the key • Transitioning out of the IAA target population • A current picture of the key’s data is recorded on transaction logs • Data is presented to IAA in an encrypted format using views of the transaction logs • IAA decrypts the data after it has traveled over SQLNET • IAA stores the most recent version of the source key’s data in the IAA Oracle relational database

  3. NRT PeopleSoft Installation • Package prewritten by DoIT for participating PeopleSoft schools • Designed to make the implementation process more straightforward and cost effective for the source system • Automatically creates most database objects including the triggers, log tables, IAA business logic code, and the encrypted views • Uses PL/SQL • Institution’s technologist follows a series of detailed steps • Already used successfully at UW-Colleges and UW-Madison

  4. NRT (Non-PS) Installation • The NRT concept will work on any database system that supports event triggering (including external events) • UW-Madison Special Authorization and UW-Processing Center Student Payroll have also chosen to implement the NRT solution

  5. Batch Data Submission • Source system creates formatted flat files of all relevant IAA data • Source creates MD5 sums • Files are SCP’d to the IAA server • IAA verifies MD5 sums • IAA loads data to Oracle staging tables • IAA loader processes the files • Changes are derived by comparing what exists in the IAA database to the most recent batch file

  6. PeopleSoft Batch SQR • SQR batch feed developed at UW-Milwaukee for their PeopleSoft system • UW-Milwaukee has shared this code with other participating batch PeopleSoft schools • Has saved time and money for those that have used it • Implemented successfully at UW-Superior, UW-River Falls, and UW-Milwaukee

  7. Custom IAA Data Extract • Batch feed developed by a participating source using the IAA technical packet as a guide • Prewritten code is not an option for some source systems • Implemented successfully at UW-Eau Claire, UW-Stout, and UW-Processing Center

More Related