Shopify Advanced Settings

Advanced Settings

For users who have some experience working with their data in Panoply, there are a number of items that can be customized for this data source.

1. Incremental Key: The Shopify data source pulls data incrementally based on when the ingestion process was last successfully completed. By default, Panoply pulls the last 365 days of your Shopify data the first time you click the Collect button, which results in a slower run time. All subsequent data collections (for the same Shopify data source) will only pull the delta between the last time it finished successfully and the run date.
2. Destination Schema: This is the name of the target schema to save the data. The default schema for data warehouses built on Google BigQuery is panoply. The default schema for data warehouses built on Amazon Redshift is public. This cannot be changed once a source has been collected.
3. Destination Prefix:
   • The Destination default is shopify_<__category>_<__resource>, where <__resource> represents the information contained within the data available (category). For example, if the user selects billing for the category, a table will be created for each endpoint (resource), such as shopify_billing_applicationcharge. See the Data Dictionar for the list of data available (categories) and endpoints (resources).
   • If there is nested data within the selected endpoint, child tables will be created with the naming convention of shopify_<__category>_<__resource>_<name>. where <name> is the name of the nested data. For example, for any nested data called customers, the default destination table is shopify_<__category>_<__resource>_customers.
   • If a user enters a Destination Prefix, that will overwrite the default of shopify. For example, if user enters my_shopify_data as a Destination Prefix, the destination table would be my_shopify_data_<__category>_<__resource>.
4. Exclude: The Exclude option allows you to exclude certain data, such as names, addresses, or other personally identifiable information. Enter the column names of the data to exclude.
5. Click Save Changes, then Collect.
   • The data source appears grayed out while the collection runs.
   • You may add additional data sources while this collection runs.
   • You can monitor this collection from the Jobs page or the Data Sources page.
   • After a successful collection, navigate to the Tables page to review the data results.