1 / 21

Enterprise Business Processes and Re porting ( IS 6214 )

Enterprise Business Processes and Re porting ( IS 6214 ). MBS MIMAS `17 th Feb 2010. Fergal Carton Bu siness Information Systems. Last week. Feedback on presentations Data cubes Types of data Dynamic / Static Cucina example Soft information Data recording. This week. Data storage

mairi
Download Presentation

Enterprise Business Processes and Re porting ( IS 6214 )

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Enterprise Business Processes and Reporting(IS 6214) MBS MIMAS `17th Feb 2010 Fergal Carton Business Information Systems

  2. Last week • Feedback on presentations • Data cubes • Types of data • Dynamic / Static • Cucina example • Soft information • Data recording

  3. This week • Data storage • Deciding what information to collect • Exploiting data warehouses • Cucina and real time information • Extract, transform, load (ETL) • Real time data • Refresh rates and response times

  4. Data storage • Series of ad-hoc systems manual and computer-based (spreadsheet, filed forms…) • Dedicated databases for manufacturing data (QC, shipping etc…) • Process Control Systems (technical parameters) • Other specialised proprietary systems (integration may not be easy). • ERP system with its own data structure or fed by existing systems

  5. Deciding what information to collect • Information cost + overload mean not all data are useful • Some framework can be used – e.g. Critical Success Factors (CSF) • Questions that must be answered: • How is it measured and broken down? • How often should it be measured? • Who should know about it? • Where can the data be found? • How should it be presented?

  6. Exploiting the DW data Static Reporting Data Staging Area Source Systems Scrutinising Multidimensional Data Warehouse Data Cubes OLAP tools Relational Database on a dedicated Server Extraction Cleaning Transformation Loading De normalised, data Discovering Data Mining …….

  7. Think about real-time for Cucina • What information is required real time? • Can you differentiate between report types • Static • Scrutinising • Discovery

  8. ETL Tools • Extraction, Transformation, and Loading • Specification based • Eliminate custom coding • Third party and DBMS based tools

  9. Data extraction and transformation • Getting data out of legacy applications • Cleaning up the data • Enriching it with new data • Converting it to a form suitable for upload • Staging areas

  10. Data Quality Problems • Multiple identifiers • Multiple field names • Different units • Missing values • Orphaned values • Multipurpose fields • Conflicting data • Different update times

  11. Example 1 – the supplier file New supplier code to include city where firm is based Assignation of category based on amounts purchased OLD Sup code Sup name Sup address City Phone 4 digits NEW Sup code Sup name Sup address… Phone Cat 3 letters + 1,2,3 depending 4 digits on total purchases last year

  12. Example 2: merging files • Complete customer file based on Accounts and Sales and Shipping OLD (finance) CustID name address city account number credit limit balance OLD (sales) CustID* name address city discount rates sales_to_date rep_name OLD (Shipping) CustID** name address city Preferred haulier

  13. Refreshing databases • Timing • Criticality of information • Volume of data • Response time • Real-time requirement • Level of aggregation / granularity

  14. Warehouse Database Life cycle of the DW First time load Operational Databases Refresh Refresh Purge or Archive Refresh

  15. Real time information • Up to date • On-line • Actual data • Live feed • Decisions made on what basis?

  16. Real time requirement? • Historical sales or accounting data, not real-time • Sales as quarter end approaches • Inventory levels for MRP • Exchange rates, when is Visa rate calculated? • Real-time processing: card transactions down

  17. Response times • Response times are a function of : • response time, • Infrastructure elements, • Database sizing • Transaction processing • Interfaces • Reporting • Other processing demands • Peak times • …

  18. Example • Revenue reports from EMC Data warehouse • Report can grow to >1million lines at quarter end • Should not be run on ERP server • Poorly designed?

  19. Manager’s view • Volume has been increasing at a huge pace compared to … like, you go talk to Jonathan, … my answer to it will be, get used to it, it’s not going to go away, I don’t care what you do, it’s not my problem, I want the reports, you deal with the volume of records, it’s not going to go away, you deal with it.

  20. Refresh Optimization

  21. Determining the Refresh Frequency • Maximize net refresh benefit • Value of data timeliness • Cost of refresh • Satisfy data warehouse and source system constraints

More Related