Singer.io

Description

Simple, Composable, Open Source ETL
Singer powers data extraction and consolidation for all of your organization’s tools.

The open-source standard for writing scripts that move data.
Singer describes how data extraction scripts—called “taps” —and data loading scripts—called “targets”— should communicate, allowing them to be used in any combination to move data from any source to any destination. Send data between databases, web APIs, files, queues, and just about anything else you can think of.

try it
For example, these two simple commands pull currency exchange rate data from Exchangeratesapi.io into a CSV file:

Check out the directory of taps and targets for more data sources and destinations.

Features
Unix-inspired
Singer taps and targets are simple applications composed with pipes—no daemons or complicated plugins needed.
JSON-based
Singer applications communicate with JSON, making them easy to work with and implement in any programming language. Singer also supports JSON Schema to provide rich data types and rigid structure when needed.
Efficient
Singer makes it easy to maintain state between invocations to support incremental extraction.

Singer Taps
Taps extract data from any source and write it to a standard stream in a JSON-based format.