This is the third and final part in the 101 series covering big data concepts, terminology and technologyWhen I joined panoply.io I was clueless as to what data driven meant, much less big data and the technologies that drive it.…
Blog
Data Dithering: How Noisy Data Can Improve Data Importing
Data Warehousing
Data and music have much in common given that both tell stories with points and notes, yet each on its own lacks the coherence and context that distinguishes music from noise. Paradoxically, in the modern world of music and data,…
Continue reading Data Dithering: How Noisy Data Can Improve Data Importing
Handling and Constructing JSON Semi-Structured Data Models
Tutorials
The byproduct of the ever increasing integration of the internet in our daily lives is massive growth of data transitioning between applications and servers every minute. In order to make these transitions fast we needed data structures that are less…
Continue reading Handling and Constructing JSON Semi-Structured Data Models
Blitz Analyzing With Microsoft SandDance
BI and Data Visualization
Microsoft Research just released SandDance, a free web-based data visualization tool.The first thing that struck me was that SandDance is a really weird name for a data visualization tool. It’s a standout in the landscape of Power BIs, Sisenses and…
How Data Structures Impact the Data Warehouse
Data Stack Data WarehousingThis is the second part in a 101 series covering Big Data concepts, terminology and technology.By this point it should be clear that there is much more to a data driven company than technology. I remember complaining throughout high school…
Continue reading How Data Structures Impact the Data Warehouse
Hadoop Alternatives: What Other Big Data Solutions Are Out There
Data Engineering
As a species we’ve invented some pretty nifty things. It’s practically consensus that the wheel, the printing press and the internet top the list but we don’t need to look that far back to find innovations with the potential to…
Continue reading Hadoop Alternatives: What Other Big Data Solutions Are Out There
How to Improve the ETL Process Flow with Row Data Processing
ETL and ELTETL processes (extract, transform and load) might be fundamentally flawed.When we save data we do so for a purpose. In the context of reporting that purpose is to enable us to answer questions regarding our business; what is the number…
Continue reading How to Improve the ETL Process Flow with Row Data Processing
Build KPIs not One Time Reports
Being Data-Driven Best PracticesBusinesses need to deliver insights fast if not immediately. If this were not true, we would not be writing this post, you wouldn’t be reading it and over all, big data would be less of a diamond in the rough.…
Data Warehouse What?
Data WarehousingThis is the first part in a 101 series covering Big Data concepts, terminology and technology. Starting with the data warehouse and data warehouse concepts.Over the past few months I have poured over a wide variety of articles and sources…
Why We Built Panoply And What Ray Kurzweil’s Law Of Accelerated Returns Has To Do With It
Data Warehousing
“An analysis of the history of technology shows that technological change is exponential…So we won’t experience 100 years of progress in the 21st century — it will be more like 20,000 years of progress (at today’s rate)”When I first read…