Spring-Batch for a massive nightly / hourly Hive / MySQL data processing

mysql hadoop etl hive spring-batch

If you want to stay within the Hadoop ecosystem, I'd highly recommend checking out Oozie to automate your workflow. We (Cloudera) provide a packaged version of Oozie that you can use to get started. See our recent blog post for more details.

mysql hadoop etl hive spring-batch

Why not use JasperETL or Talend? Seems like the right tool for the job.

mysql hadoop etl hive spring-batch

I've used Cascading quite a bit and found it be quite impressive:

Cascading

It is a M/R abstraction layer, and runs on Hadoop.

CodeHunter

Spring-Batch for a massive nightly / hourly Hive / MySQL data processing

Recent Posts

How can I color dots in a xy scatterplot according to column value?

How to update a claim in ASP.NET Identity?

What does {0} mean when initializing an object?

Accessing members of items in a JSONArray with Java

How to log SQL statements in Spring Boot?

Powershell Get-WebSite name parameter is ignored

How to detect scroll to bottom of html element

Java synchronized method

How to test controllers with CodeIgniter?

Detect Visual Composer

Matplotlib: Specify format of floats for tick labels

Rails join a list of strings with commas and "and" before the last