Sync JSON data into Panoply

ETL the Modern Way. Get your data out of JSON so you can analyze it.

Data from a JSON file are read and imported into Panoply through the File Upload data source. The object or record in your JSON file is imported into Panoply as a table record. The destination table can be a fixed or a dynamic one. Any nested data in your object will be moved to their own table and be provided with the relevant foreign key to create a parent to child table relationship with the nesting object's table. Also, Panoply's support for the JSON Lines text format increases your JSON file's capacity to hold data. This format allows you to include and write many objects in one JSON file that would otherwise be impossible when using the plain JSON format.

Modernizing JSON ETL

What is ETL?

Integrating data for analytics can be especially hard in a fast-shifting, rapid growth startup environment, where relevant business data might be spread out across a collection of apps and spreadsheets. ETL (Extract, Transform, Load) tools will help you collect your data from APIs and file transfers (the Extract step), convert them into standardized analytics-ready tables (the Transform step) and put them all into a single data repository (the Load step) to centralize your analytics efforts.

The shift to ELT

The traditional ETL model is a relic of the pre-cloud era, when compute resources were expensive, and everything needed to be cleaned up before analysis. These days, moving the transformation step closer to the time of analysis is not only feasible, it’s desirable. ELT lets you load raw data, increasing your analytical flexibility and moving relevant data more quickly from your engineering team to your analytics and BI teams.

All in one JSON data pipeline

Panoply’s 80+ data connectors and built-in automated cloud data warehouse will let you go from a collection of siloed datasets to sophisticated analyses that integrate your JSON data in a matter of minutes. Panoply is the only tool that combines an ETL process with a data warehouse, giving you total control over your data from sync to storage. We’ll handle all the infrastructure so you can skip the engineering work and go straight to analysis with your favorite BI tool.

Get easy access to all your JSON data in all your tools.

BI tools commonly used with JSON data

JSON