1 / 4

Batch Processing: Large, Complex Data Analysis

With batch processing, data is collected in batches and then fed into an analytics system. A u201cbatchu201d is a group of data points collected within a given time period

Technoligeek
Download Presentation

Batch Processing: Large, Complex Data Analysis

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Batch Processing: Large, Complex Data Analysis With batch processing, data is collected in batches and then fed into an analytics system. A “batch” is a group of data points collected within a given time period.

  2. Batch Processing: Large, Complex Data Analysis Unlike stream processing, batch processing does not immediately feed data into an analytics system, so results are not available in real-time. With batch processing, some type of storage is required to load the data, such as a database or a file system.

  3. Batch Processing: Large, Complex Data Analysis Batch processing is ideal for very large data sets and projects that involve deeper data analysis. The method is not as desirable for projects that involve speed or real-time results. Additionally, many legacy systems only support batch processing.

  4. Batch Processing: Large, Complex Data Analysis This often forces teams to use batch processing during a cloud data migration involving older mainframes and servers. In terms of performance, batch processing is also optimal when the data has already been collected. Batch Processing Example: Each day, a retailer keeps track of overall revenue across all stores. Instead of processing every purchase in real-time, the retailer processes the batches of each store’s daily revenue totals at the end of the day. For information on real time vs batch processing please visit Rivery.io

More Related