1 / 12

File Import Mapping in IDMC Cleanse Functions & Import Job Monitoring Explained

Weu2019ll dive into the File Import Process in IDMC and cover two important topics:<br>u2705 Cleanse Functions<br>u2705 Import Job Monitoring<br><br>We offer Master Data Management, ETL, Data Engineering, Data analysis, Data Science, Data Governance, Data Modeling, Big Data, Data Quality and Observability, Data Cataloging, Data cleansing, Data Privacy & Security, etc.<br><br>Ready to take your security to the next level? Letu2019s talk! ud83dudcac<br><br>ud83dudcde Call Now: 91-9821931210<br>ud83dudce7 E-Mail: support@inventmodel.com<br>ud83cudf10 Visit Website: https://inventmodel.com/course/informatica-mdm-online-live-training

keshav30
Download Presentation

File Import Mapping in IDMC Cleanse Functions & Import Job Monitoring Explained

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Cloud Informatica MDM SaaS https://inventmodel.com +91-98219-31210support@inventmodel.com

  2. Agenda 1. While creating Mapping for File Import what kind of Cleanse Functions are available https://inventmodel.com +91-98219-31210support@inventmodel.com 2. How to monitor Import Job in Cloud SaaS

  3. While creating Mapping for File Import what kind of Cleanse Functions are available https://inventmodel.com +91-98219-31210support@inventmodel.com

  4. Cleanse Functions: In MDM SaaS, cleanse functions are used to standardize and validate data, ensuring data quality before it’s saved, and can include string manipulation, logical operations, data conversion, and custom validations.  • Purpose: • Cleanse functions in MDM SaaS (Master Data Management as a Service) are designed to ensure data quality and consistency by performing tasks like: • Standardization: Transforming data into a consistent format (e.g., converting "Doctor" to "Dr.") • Validation: Checking data against predefined rules or constraints (e.g., ensuring a phone number is in the correct format) • Data Cleansing: Removing or correcting inconsistencies, errors, and duplicates InventModel Technology Solution +91-9821931210 support@inventmodel.com https://inventmodel.com +91-98219-31210support@inventmodel.com

  5. Types of Functions: • Standard Functions: MDM platforms often provide a library of pre-built functions for common data manipulation tasks. • Custom Functions: Users can create their own functions to address specific data cleansing needs. • In-built services: In MDM SAAS we have inbuilt data quality services where we have got multiple functions for cleansing the data , transforming the data and for other purposes as well. InventModel Technology Solution +91-9821931210 support@inventmodel.com https://inventmodel.com +91-98219-31210support@inventmodel.com

  6. How they work: • Each configured cleanse function is called before data is saved in the MDM system.  • The cleanse function applies to a data value in a record, standardizing or verifying it.  • The output of the cleanse function can be assigned to a column in the staging table or used for further processing.  • Examples: • Standardizing salutations (e.g., "Doctor" to "Dr.")  • Formatting addresses  • Validating phone numbers  • Removing duplicate records  InventModel Technology Solution +91-9821931210 support@inventmodel.com https://inventmodel.com +91-98219-31210support@inventmodel.com

  7. Benefits: • Improved Data Quality: Ensures data accuracy and consistency across the MDM system.  • Reduced Errors: Prevents errors caused by inconsistent or incorrect data.  • Enhanced Data Governance: Facilitates better data management and control.  • Better Decision-Making: Provides a reliable data foundation for business decisions.  InventModel Technology Solution +91-9821931210 support@inventmodel.com https://inventmodel.com +91-98219-31210support@inventmodel.com

  8. 2. How to monitor Import Job in Cloud SaaS InventModel Technology Solution +91-9821931210 support@inventmodel.com https://inventmodel.com +91-98219-31210support@inventmodel.com

  9. Monitoring import job in MDM Saas: For monitoring import job in MDM Saas first we have to go to my jobs section and there we have to select the respective job . Note: Every time when we import a file One job will get triggered for that import in backend. InventModel Technology Solution +91-9821931210 support@inventmodel.com https://inventmodel.com +91-98219-31210support@inventmodel.com

  10. Step 2nd: • now after clicking on that job one page will open • there in ingress section .we can see • 4 stages in which each import job will get executed in sequence. • These stages are( transform, load, index for search and generate tokens). InventModel Technology Solution +91-9821931210 support@inventmodel.com https://inventmodel.com +91-98219-31210support@inventmodel.com

  11. Now we can review and monitor each stage separately like what is there runtime what kind of operation are being performed and what are the entity for which this Stage is being executed and we can also see the errors. All these stages are dependent on each other and once the previous stage gets completed only then the job will move to the next stage. InventModel Technology Solution +91-9821931210 support@inventmodel.com https://inventmodel.com +91-98219-31210support@inventmodel.com

  12. THANKYOU https://inventmodel.com +91-98219-31210support@inventmodel.com

More Related