What is Spring XD???

Spring-XD is a unified, distributed, and extensible service for data ingestion, real time analytics, batch processing, and data export. The Spring-XD project is an open source Apache 2 License licenced project whose goal is to tackle big data complexity. Much of the complexity in building real-world big data applications is related to integrating many disparate systems into one cohesive solution across a range of use-cases. Common use-cases encountered in creating a comprehensive big data solution are

High throughput distributed data ingestion from a variety of input sources into big data store such as HDFS or Splunk

Real-time analytics at ingestion time, e.g. gathering metrics and counting values.

Workflow management via batch jobs. The jobs combine interactions with standard enterprise systems (e.g. RDBMS) as well as Hadoop operations (e.g. MapReduce, HDFS, Pig, Hive or Cascading).

High throughput data export, e.g. from HDFS to a RDBMS or NoSQL database.

The Spring-XD project aims to provide a one stop shop solution for these use-cases.

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s