Data Management & Warehousing
  • Welcome
    • Contact Us
    • QR Codes
    • Privacy & Cookie Policy
    • Internal
    • Websites
  • White Papers
  • Presentations
  • Blog
  • Our Services
    • Rates
Home » Archive for category "Guest Bloggers"

Category Archives: Guest Bloggers

The top three mistakes I have seen in data warehousing projects

Posted on 11 July 2012 by Posted in Guest Bloggers Leave a comment

A guest blog by Don DeLoach, CEO of Infobright

Having been a supplier of technology for many years, I have talked to a lot of prospects and customers and seen a lot of projects. Most projects are reasonably good, some are great, and then some others are disasters. The disasters are probably more prominent than they should be, but over time I have noticed there are a number of common themes here. In particular, there are three really common mistakes I see often:

Mistake One: the Big Bang Theory

This is the single most common mistake. The project plan envisions the “perfect deliverable” on day one of production. The team is not content with delivering something that is usable, but far short of optimum. It needs to to be the ultimate data warehouse, capable of mesmerizing its users from the onset. What generally happens is the spec gets over-engineered, the timetable is extended over and over as target dates are missed, and the budget is reworked and increased accordingly. It takes money to have people work for extra months at a time. But the real kicker is that when it finally gets to the day of reckoning, where the non-believers are put in their place based on what will surely be an out of body data warehousing experience, the unveiling falls flat. I mean, really flat. Why do you think this is? You would think with so much more time and extra money, the end result should be fantastic, right? It should, but that is seldom the case. This is for two reasons. First, the fabulous end result, when doing a big bang approach, is seldom the same target by the time the result is delivered. In other words, nirvana as defined at the project start eighteen months earlier, no longer looks like nirvana now. Second, the knowledge of the cost and time overruns has the net effect of raising expectations. Basically, people say “this thing must be really wonderful if it costs this much and takes this long”. Whoops.

Mistake Two: Great map, but no destination

In general, the plans that go into data warehousing projects are often well thought out… to a point. Well thought out like political positions. Strong on those ideas that we all want to aspire to, yet a bit short on specifics. Such as is it able to deliver insightful information about our operations, or it will allow us to probe the depth of our data to determine meaningful trends to guide our business? All good. Yep. Except when you find out that the report you tailored the warehouse for runs in 10 seconds, but the query you ran to see what the main referring sites were to the promotion you ran last week where the conversion rate was over 12%, took 2 1/2 hours. The best projects start small, and address the very real, very specific requirements that need to be addressed. These are not lofty and nebulous designs, but specific definitions of what needs to be done.

Mistake Three: Forgetting that it’s a swimming pool

Have you ever owned, or do you know anyone who owned a pool? They are really great fun. More so in the summer, actually, but really fun. But here’s the thing. The cost up front is just the beginning. Opening up at the start of the season…bucks. Weekly chemical treatments…more bucks. Skimming? Cleaning? Mechanical systems? Bucks, bucks, bucks. End of summer, time to close the pool…more bucks still. And so it goes with data warehouses. It’s not just the cost of the hardware and the software. It’s not even just the additional cost of getting it set up in the first place. Depending on what you are doing, what tools you are using, and what problems you are trying to solve, you will likely spend the majority of your money on people to keep it going. That’s right, the pool guy meets the data warehouse guy. Only instead of skimming and adding chemicals he (or she) is indexing, partitioning, and possibly adding additional disk subsystems or more cores as well. In my experience this ongoing cost is often not heavily considered, and more often underestimated. And just as the pool suppliers don’t emphasize this ongoing cost when they sell you the pool, neither do data warehousing vendors.

Have you ever heard of salt water pools? While probably it is not for everyone, they are indeed growing in popularity. Do you know why? You guessed it, they can be maintained for a slight fraction of the requirements of traditional pools. A fraction. As technology evolves, there are equivalents to salt water pools, requiring less ongoing resources yet perfectly if not uniquely suited for certain situations.

All in all, technology has evolved to an exciting place as we come to grips with the emerging world of Big Data. The norms of yesterday are not the de facto norms of today, and the big mistakes most commonly made in the past do not need to be repeated.

Don DeLoach is President & CEO of Infobright Inc. a database vendor with technology that combines a column-oriented database and a ‘knowledge grid’ architecture. The Infobright database software is integrated with MySQL but has its own proprietary data storage and query optimization layers. Infobright focus on the machine generated data market.

Got something to say?  Please write an article for us as a Guest Blogger!

Column Store Databases Data Warehousing Guest Bloggers InfoBright MySQL

Guest Bloggers

Posted on 3 July 2012 by David M. Walker Posted in Guest Bloggers Leave a comment

We’re not the only ones with opinions – so maybe you would like to share yours with us as a guest blogger. We would really appreciate a one-off blog post from you as our guest blogger

If you want to submit something here are our guest blogging guide lines:

  • We want content relevant to the site, so anything about business intelligence, management information, data warehousing, data quality, data management or the processes to run such a project e.g. governance, project management, etc are welcome
  • Your post must not promote or denigrate a particular vendor or product and should try to express any pros or cons of your approach
  • Please ensure that it reflect your personal opinion, one that we would be putting your name against and that you would be happy to see it there, we are happy to also include a link to your company if you wish
  • It should be informative – The reader should say “I haven’t though about it like that before” after reading it
  • The post must be at least 500 words long, spell checked and in English
  • Data Management & Warehousing reserve the right of editorial control

If you have something to say and want to contribute then please contact us to discuss it

Guest Bloggers

Archives

Random Quote

The whole is more than the sum of its parts.

— Aristotle (ca 330 BC)

Contact Details

Tel (UK): 01458 850 433
Skype : datamgmt

Registered Office

Manchester House, High Street
Stalbridge, Sturminster Newton
Dorset, DT10 2LL
United Kingdom

Company Registration

Registered in England and Wales
Registration Number: 3526504
VAT Registration: GB724448236
Directors: DM & HJ Walker

© 1995-2013 Data Management & Warehousing
This website uses cookies to improve your experience. We'll assume you're ok with this, but you can opt-out if you wish.Accept Read More
Privacy & Cookies Policy