Google Drive Automated ETL

ETL the Modern Way. Get your data out of Google Drive so you can analyze it.

The Google Drive data source allows you to import data from files stored in your Google Drive account. Panoply supports, various files types including character-delimited files (CSV, TSV), JSON, plain text files, and Microsoft Excel files. Archive-type files like .tar and .gzip are also valid, provided that they contain the aforementioned supported files. eFor file sources that support structured or semi-structured data, like CSV or Excel files, Panoply uses the first row of their data as the columns of their target table. Any rows after that become the records. Sources that contain nested data, usually JSON files, have their nested data extracted and moved to their own tables with foreign keys provided. Lastly, archive files are decompressed, and then their individual files processed accordingly.

Modernizing Google Drive ETL

What is ETL?

Integrating data for analytics can be especially hard in a fast-shifting, rapid growth startup environment, where relevant business data might be spread out across a collection of apps and spreadsheets. ETL (Extract, Transform, Load) tools will help you collect your data from APIs and file transfers (the Extract step), convert them into standardized analytics-ready tables (the Transform step) and put them all into a single data repository (the Load step) to centralize your analytics efforts.

The shift to ELT

The traditional ETL model is a relic of the pre-cloud era, when compute resources were expensive, and everything needed to be cleaned up before analysis. These days, moving the transformation step closer to the time of analysis is not only feasible, it’s desirable. ELT lets you load raw data, increasing your analytical flexibility and moving relevant data more quickly from your engineering team to your analytics and BI teams.

All in one Google Drive data pipeline

Panoply’s 80+ data connectors and built-in automated cloud data warehouse will let you go from a collection of siloed datasets to sophisticated analyses that integrate your Google Drive data in a matter of minutes. Panoply is the only tool that combines an ETL process with a data warehouse, giving you total control over your data from sync to storage. We’ll handle all the infrastructure so you can skip the engineering work and go straight to analysis with your favorite BI tool.

Google Drive