Archive for April, 2010

BI and GIS: the cultural clash

Monday, April 26th, 2010

A lot of things could be said about cultural differences between the two communities and how they had influenced the grow of GIS and BI’s projects, markets, business models and companies. I will talck about that in a future post. For the moment  I want to focus the analysis on what happens when these two different cultures get in touch. Of course, because of the past separation, there is a cultural clash. They don’t know each other very well and this causes some mis-perception problems.  In general the two communities wrongly estimate the reciprocal complexity. For what I have seen so far BI folks tend to overestimate the inherent complexity of the GIS world while, on the contrary, GIS folks tend to underestimate the inherent complexity of BI world.

culturalclash

It’s sufficient  to give a look at the positioning of  two of the most popular open source BI suite, Pentaho e Jaspersoft, to realize how much they are attracted by location intelligence (LI) but, at the same time,  scared by the perceived complexity of GIS. Both of them allow users to perform a little bit of LI. Pentaho’s solution is a mashup, based on Google Map API, while Jasper solution is based on a catalogue of static flash maps that are thematized on the fly. Both this solutions are very simple and do no fully exploit spatial data and GIS capabilities. BTW they are publicized a lot by both vendors. You can find here a couple of examples of that: one for pentaho and one for jaspersoft. This mean that both vendors recognize the power of LI (at least as a marketing weapon) but at the same time they do not plan, according to their public roadmaps, to add further improvements on this front, at least for this year. Why? They have other, more urgent, priorities. Sure. But the question is: why LI is not one of them? In my opinion they think that evolve their solutions in order to fully integrate external GIS through standard interfaces would be quite costly for them to develop and most of all for their customer to adopt. As I said before, in my humble opinion, BI folks tend to overestimate the complexity of GIS world.

On the other hand in the GIS world, when a large amount of data is collected and need to be analyzed, existing BI solutions (tools and practice) are usually ignored. For what I have seen they tend solve analytical problem with some custom solution mostly based on charts and simple dashboards. Dimensional data modelling techniques are almost  unknown. I have seen recently a couple of interesting presentations on SOS (sensor observation service). In both case the amount of data collected by sensors spread on the territory was huge. In both case data wasn’t consolidated  into a dimensional store neither there was plan to do so in the future. They were and probably still are 100×100 happy with their custom BI solution based on high normalized database, a collection of flash charts popping up upon a click over the map and absolutely nothing else. You can object that these eamples cannot be generalized. I totally agree but what we can say about OGC. In the geo world, OGC defines open starndards for everythings: how to encode spatial data, how to query spatial data, how to style spatial data, how to marge spatial data, ecc … BTW there is not a single standard on how to analyze spatial data. There is no interst at the moment to standardize the way spatial data can be exploited by BI suite or in other words on how GIS can interact with BI suite. For what I have seen this topic is not percieved as urgent. This because, in my humble opinion, GIS folks tend to understimate the inherent complexity that arouse when there is the need to analyse huge amount of data, the exactly same complexity that BI world have learned to face (…and some time also to manage ;) ), in all its multivariate forms, in the last 20 years.

This cultural barrier to LI traction is to me mainly based on  two myths. The reality is that GIS is not so complex and BI is not so simple. Yes it’s true that in the GIS world there are a lot of standards but the key ones are probably less than five and they are also quite simple in their nature.  It’s like in the xml world.There are many different standards but the greatest part of them are just sovrastructures, created  for specialized purposes over the key ones. On the other hand BI is not just about custom charts or simple reports. Probably that was true 25 years ago, when this ad was made, but it is not the case anymore. Today to realize a succesfful BI project two things are neaded and both or them are not easy  to be  found: a complex stack of different integrated technologies (BI Suite) and people skilled in in BI with the right belance of knowledge and experience (BI Specialist)

For these reasons I strongly suggest to folks from both parts to re-consider their prejudices on the other world, to try to dive a little more into it  (in both cases good documentation it’s not a scarce resource) and, in the end, to escape from this premature cognitive closure that can keep them away from some really intersting possibilities.

Open Core and Pure Open Source

Friday, April 16th, 2010

The recent OSBC Conference in San Francisco has risen again the “never-sleeping” debate about the open core model and, generally speaking, on open source business models. It is also collected by Andrea Gioia in his OSS Discussions, available in this Blog, entitled Open Core Predecessors, The rise of Open Core and The debate on Open Core. From the last link, I’ve chosen Gartner Brian Prentice’s post Open-Core: The Emperor’s New Clothes. I don’t want to extend this debate. I just would like to underline some aspects, which I apply everyday, with some colleagues of mine, on the open source approach of the projects belonging to the Engineering Group’s SpagoWorld initiative.

Interestingly enough, Brian has made people communicate animatedly about this topic, also if Gartner is not an open source fan. Well, everybody knows that Gartner is mainly followed by important buyers, and this made it happen.

First of all, I agree with Brian when he says at the end of his article: “Be clear, there’s nothing nefarious going on with open core. It’s just that there’s just nothing particularly new or innovative going on either.“ Actually, there’s no “better” or “worse” model. There are different models and the open source takes advantage of the richness that comes from this reality, instead of basing itself on the scanty of resources. At the same time, while evaluating the various models, you must always consider the different “point of view” of the involved people, ranging from vendors, financers to users. It makes the difference!

Afterwards, Brian underlines two main aspects concerning the Open Core: the completeness that open source versions can offer, compared to critical or important features and the supporting communities.

These are important aspects that SpagoWorld considers as crucial, being based on the “pure open source” model: SpagoBI, Spagic and Spago4Q projects release only one complete, stable open source version, while the payment of a fee is applied only for support services, with no adoption of a different licence from LGPL.

As for the functional completeness, I share Brian’s opinion, who says about the Commercial Open Source “If you’re like most corporate IT customers I speak to – at least the ones considering solutions from open core providers – then chances are you’ll be starting your assessment based on their full version product rather than the free open source offering.” In relation to this, let me bring you the example of SpagoBI, the only entirely open source business intelligence suite. Users don’t have to spend time evaluating which is the most suitable version to choose. And they don’t need to migrate to an enterprise version in the future either. Moreover, the availability of a unique open source version fosters the software guided growth, not only by vendors, but also by users and by the adopting projects themselves. This allows the availability of a suite which grows over time and which faces the aspects that no other open source BI application have ever faced (ex. Location Intelligence).

At this point, the question is: are these openness, flexibility and richness really appreciated by users, analysts and by the market?

On the one hand, the enterprises ask for important references (which are not difficult to be found). On the other hand, sometimes they feel that the solutions that invest a lot of money on marketing activities are more valuable than the solutions that offer adequate requirements and sustainability. So, how is the availability of a wide range of features (here again the “pure open source” model at work) seen: as “richness” or as “complexity”?

Moreover, the analysts ask for information on revenues, whose majority consists of the sell of proprietary licenses.

What a harsh reality for “pure open source” players, too! They must be particularly patient…

Finally, as for communities, Brian says: “Even the very definition of “community” is being adapted to suit the open core narrative. What has largely interested the corporate IT world is the concept of a community as a collection of code contributors working outside a normal project/company structure. But now open core providers are extending the term community to include users and even resellers. That, of course, is what we’ve all been calling a software ecosystem for the last twenty years. Same old, same old – just co-opted terminology used to describe it“.

Yes, the software ecosystem model is not a new one. But many different software and non-only-software ecosystems working in connection or not, within a same space (i.e.: ecology of value), could be a new answer to an old request: how to bring innovation and value in the market. It depends on what innovation and value is. I’ll be back on it soon.

Location Intelligence’s adoption barriers

Monday, April 12th, 2010

Having a Geographical Information System (GIS) and a Business Intelligence (BI) infrastructure in place is not enough to enable Location Intelligence (LI).  LI is the combination between spatial data and business data with the precise aim to improve the decision making process. In other words having a GIS and a BI infrastructure in place is a necessary condition, but not a sufficient one, for realizing LI.

Integration of these two software stacks is needed. Unfortunately  this is not any easy task :(

GIS and BI have evolved and prospered in the past years separately one from the other. As a result they are really different in terms of technologies, communities and markets. It’s normal so that there are barriers to face and breakdown in order to bring these two different worlds together.

“The brick walls are not there to keep us out; the brick walls are there to give us a chance to show how badly we want something”the last lectureRandy Pausch

We want really badly to see this barriers fall down and will we work toward this aim in the near future. Our commitment in this direction is proved by  what we have already done so far and  from what we are planning to do next.

BTW playing the role of innovator in the LI  domain is only a part  of our plan. We would like to play also the role of  the innovation facilitator by creating an open ecosystem composed by different subjects, coming from GIS and BI world, around LI and related technologies.  More on this will be disclosed in the near future.

For the moment I would like to introduce my personal (home made) taxonomy of the main barriers to the pervasive diffusion of LI solutions.  I usually devide them in two main categories:

  1. internal (integration) barriers
  2. external (adoption) barriers

Internal integration barriers are rooted in the existing differences between the communities that respectively backed BI and GIS. They originates by the past story of these two communities (cultural barriers) and by the way they look at the future (strategic barriers).

External adoption barriers are instead rooted in the natural market diffidence toward a brand new technology.  LI solutions are just at the beginning of the adoption curve, very far from the chasm.

barrier

I will dedicate my next three posts to analyze separately each one of these barriers (cultural,  startegic and market barriers) more in detail.  Of course any suggestion and/or feedback on this topics is more than welcomed so do not be afraid to leave a comment down here :)

The debate on Open Core business model

Thursday, April 8th, 2010

There has been a significant amount of interest in the Open Core business model since Andrew Lampitt articulated it and its benefits for combining open source and commercial licensing.

After a period of relative calm  the debate liven up again last month after the Open Source Business Conference when few analysts critically review the usage of Open Core business model made by many commercial open source companies.  I have collected all links to posts that I find more interesting to sum up this debate in three list on friendfeed:

  1. Open Core Predecessors: the debate on open source business models before the advent of open core
  2. The rise of Open Core: The early debate on open core business model started in August 2008 with the Andrew Lampitt’s post containing its first definition
  3. The debate on Open Core: The last weeks debate on open core model

All links in each  list are ordered by date (the first is the more recent). If you have some interesting links that I have not yet included, please send them to me. I will keep these list updated integrating them with all your suggestions. If you want to share with the SpagoWorld’s community your opinions on this topic please leave a comment down here or answear to this quick poll or  join the discussion on our linked-in group.