As a data engineer, I enjoy my work, but when it comes to integrating and managing data there are quite a few tasks that are downright tedious. From data remodeling to juggling a hodgepodge of software to address disaster recovery,…
Continue reading What Do Data Engineers Do That Keeps Them Awake At Night
Today’s considered data management best practices, advocate building resilient architectures that span multiple data centers, regions or even continents.This week’s massive internet earthquake caused by the Amazon S3 outage in their us-east region was a stark reminder of why. When…
Continue reading Introducing Panoply Multi Zone Redshift Cluster
One of the main goals of this blog is to help developers and data architects, just like us, with their Amazon Redshift operations, including Redshift security. Starting from a full comparison with Google BigQuery, explaining how to load Google analytics data…
Continue reading Redshift Security – Encrypting Loads with S3/KMS/Lambda
Data analyst? You must be familiar with both Tableau and AWS Redshift. And you must know, or at least you should believe me that integrating the Redshift columnar-based database speed with the mature, rich and interactive Tableau creates an awesome…
Continue reading Tableau & Redshift: How to Visualize Amazon Redshift Data
The basic free Google Analytics (GA) functionality is great for small and medium websites and mobile applications, but as your online business expands, you will start looking to get more of this data. However, GA lacks advanced capabilities such as…
Continue reading Step-by-Step: Loading Data from Google Analytics to Redshift
Amazon re:Invent is a great place to gather feedback from industry professionals, and especially gauge cloud-industry trends. This past year, we used the opportunity to collect and analyze statistics disclosed by industry professionals surveyed at our booth. The results reveal…
Continue reading Future Of Data Warehousing Is Cloud: This Survey Proves It
A smart, proactive PostgreSQL connection pooler, we are proud to announce our PGproxy offers the advantages of query routing and rewriting, making it optimal for data engineers who need to query their databases, and removing the concern of inconsistencies that…
If you’re looking for a solution for processing huge chuncks of data, then there are lots of options these days. Depending on your use case and the type of operations you want to perform on data, you can choose from…
Continue reading Apache Spark Architecture, Use Cases and Issues
Attendance at this year’s AWS re:Invent conference almost doubled, from 18,000 people last year to 32,000 people last week. The large, international cloud computing event attracted professionals from all types of industries, including financial services, healthcare, gaming, and others interested…
Continue reading Data-Oriented Takeaways from AWS re:Invent 2016: Query S3, Batch, Glue and More
We’re sure you’re already beginning to build your re:Invent schedule for 2016. As the largest cloud conference in the world approaches, it’s time to make sure that you’re maximizing your time and making the most of this stimulating Las Vegas…
Continue reading 5 Sessions On Redshift To Add To Your AWS Re:Invent Schedule
The cloud, unlike the Force, is not a mystical energy that surrounds us and binds us.Yet the word cloud has been attributed sorcerous properties which antiquitate your IT infrastructure and empower you to endlessly grow according to your needs without…
Continue reading Castles in the Cloud: Tips for Cloud Infrastructure
We often come across new products aiming to help us with our lives or improve our productivity. It’s in our best interests to find the best products that will minimize tedious work to none, but still most of the time…
