Tag: ETL
-
A Linux/Mac OS X Command Line Interface to AffiliateWindow
This article was written for a client due to the fact that we were unable to test the Affiliate Window API with the documentation available at the time Introduction Affiliate Window offer a tracking and management solutions for maintaining an affiliate program. This works by directing sales to a merchant from an affiliates’ website. In…
-
At last someone we understand …
It is rare with all the background reading and research that I have to do that I read a contemporary book and say “Yes, this guy gets it” – notice that I say contemporary. There are plenty of good books about the day-to-day business intelligence problems that I see which were written over 20 years…
-
Data Warehouse Appliances – Fad or Future?
This article was originally written for Conspectus Magazine in December 2006 and has been updated in November 2009 by the original author Despite all the hype from vendors the basics of data warehousing have remained fundamentally unchanged – extract data from multiple source systems, reformat the information into an easy to query structure, load it into a…
-
Analysis by ETL …
Performing source-system analysis by writing ETL is just about the most expensive way you can do it; but many organisations do exactly that. Why? Because they “can’t afford” to do their analysis the cheaper way. No, this does not make sense. This is how it works… In most data warehousing projects, business analysts are separated…
-
Oh what a tangled web we weave, when first we practise to deceive!
The deception in our case is the accuracy of the data and the return on investment of the data warehouse solution. Too often projects make compromises in the implementation of a business intelligence solution that create massive cost and user dis-satisfaction downstream that lead to the failure of BI projects: For example: * In the…
-
BI Convention over Configuration
The convention over configuration discussion when designing a data warehouse often leads to fanatical discussions by technical people over the ‘best’ approach to do things. Convention can be used to define the standard way to design a data model (see Process Neutral Data Modelling) or to implement an ETL transformation (for example a reducing sets approach)…
-
We’ve got a new puppy – we’ve called him ETL!
Monday … Our house is full of optimism today – we’ve been out and spent an absolute fortune on a pedigree pup. We were really impressed by the salesman at the shop. He offered something to each family member. Mum (our family manager and my wife) was sold on the the cost efficiency. We won’t…
-
Can Business Intelligence Be Agile ?
The agile manifesto and it’s underlying principles set out four key values for developing software solutions: Individuals and interactions over processes and tools Working software over comprehensive documentation Customer collaboration over contract negotiation Responding to change over following a plan If an organisation is willing to accept these values for software development then how much more important should adoption of them be for…
-
How Data Works
Every business believes that their data is unique. However the storage and management of that data uses similar methods and technologies across all organisations. As a result the same issues of consistency, performance and quality occur across all organisations. The commercial difference between organisations is not whether they have data issues but how they react…
-
Configuration Management & Issue Tracking
One commonly overlooked side of building a data warehouse is the need for configuration management and issue tracking. This article looks at a way to do this. Since this article was written we have upgraded from Bugzilla to Trac and CVS to SVN and integrated in in our Project Services Introduction ETL tool transformations, data…
Data Management & Warehousing 
You must be logged in to post a comment.