Singer is an open source tool that helps bring order to the messy world of custom ETL scripts. Singer allows users to mix and match inputs and outputs, making their ETL processes much more modular–and therefore easier to run and maintain. Singer uses JSON to move all data between sources and destinations, so you won’t have to worry about incompatible formats once you’ve set your ETL tasks up to run. Panoply’s integration with Singer makes it easy to move data from anywhere with a supported tap–Singer’s term for a data collection script–into an automated cloud warehouse. And since Singer is open source and supported by a broad community of developers, if you can’t find the tap you need, you can just write your own, without having to worry about building loading functions for Panoply.
The Apache Zepplin notebook is an open-source BI tool that creates sharable data analytics documents. With Zeppelin’s web-based tool, you can ingest, discover, analyze, and visualize data and create interactive charts. Zeppelin supports more than 20 data interpreters including Spark, SQL, and PostgreSQL as back-end plugins. If your business needs big data analysis in Zeppelin, adding the Panoply integration tool gives you enterprise-level support, smooth data operations, power, and speed. Panoply’s automated pipeline manages the entire ETL process on the secure cloud. It continuously uploads, sorts, and simplifies data from any source and stores it in one place. The all-in-one Panoply ETL streams your latest data to your output. So your analysis results are always based on your latest, most relevant data.