File:Kafka Batch processing.jpg

From Wikimedia Commons, the free media repository
Jump to navigation Jump to search

Original file(1,195 × 798 pixels, file size: 76 KB, MIME type: image/jpeg)

Captions

Captions

Real time Batch Processing using Kafka and Spark Streaming from https://sparkdatabox.com

Summary

[edit]
Description
English: This file represents the architecture diagram of how you can do a realtime project using, Hive, Spark and Kafka. Data is pulled from MySQL database using Scoop and stored into HDFS file system. Using Spark and Kafka the data is further streamed into Hive.
Date
Source Own work
Author SparkDatabox

Licensing

[edit]
I, the copyright holder of this work, hereby publish it under the following license:
w:en:Creative Commons
attribution share alike
This file is licensed under the Creative Commons Attribution-Share Alike 4.0 International license.
You are free:
  • to share – to copy, distribute and transmit the work
  • to remix – to adapt the work
Under the following conditions:
  • attribution – You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
  • share alike – If you remix, transform, or build upon the material, you must distribute your contributions under the same or compatible license as the original.

File history

Click on a date/time to view the file as it appeared at that time.

Date/TimeThumbnailDimensionsUserComment
current23:31, 18 March 2020Thumbnail for version as of 23:31, 18 March 20201,195 × 798 (76 KB)SparkDatabox (talk | contribs)Uploaded own work with UploadWizard

There are no pages that use this file.