Not all Predictive
Analytic tools are born equal

Analytic tools are also usually named "Analytical CRM tools".


Let's return to the same example as for the previous section about "CRM tools" in general. Let's assume that you want to do a direct-mail marketing campaign for one of your product. You must find all the customers that are susceptible to buy your product and send them a brochure or leaflet (this is a classical "propensity to buy" setting but the same reasoning applies to any other settings: cross-selling, upselling, probability of default, etc.).

The main objective of any analytic tool is to generate the best, most accurate, ranking (or "list of candidates"). There are mainly 2 different approaches to generate the ranking: segmentation or prediction. Different software use different approach:

  1. Segmentation tools: This covers 99% of the available tools. These tools are very easy to create and are, most of the time, only a small component into a larger "Operational CRM tool".

    Some Example: Probance, Miner3D, Webtrends Segments,...

    All these "segmentation-based" tools are very inaccurate and always lead to very poor ROI's compared to Predictive-Analytic-tools.

  2. Predictive Analytic tools:These tools are quite intricate to create and although they all deliver superior performances compared to simple "Segmentation tools", the quality of the delivered results (quality of the ranking) varies greatly between them.
We will now give a little bit more detail about these 2 approaches.
By its very nature, segmentation is a technique well-adapted for exploratory work.
In opposition, predictive analytics is discriminatory in nature.

Let's give a small example:

Segmentation techniques

"Segmentation techniques" can be represented like this:
segmentation illustration

Each candy in the cookie-jar represents a know prospect. The big red cross represents our segmentation: we decided to create 4 segments based on our analysis of our population.

The objective of the exercise here is to create the best ranking: We want to select only the prospects that will buy our product. To create this ranking, we will analyze our population and we will pay a special attention to the people that already have the product (these costumers are represented with a Chokotoff label: chokotoff)

There are many different ways to define segments of your population. Segments can be defined:

  • Using simple business-rules: for example:
    • Segment 1 is composed by the men with age<30
    • Segment 2 is composed by the men with age>30
    • Segment 3 is composed by the women with age<30
    • Segment 4 is composed by the women with age>30
    Usually, one finds such business-rules using an obsolete In-RAM-OLAP tool to explore the population and try to find "good" segments.
  • Using "advanced analytics": using tools like Stardust (KMeans clustering, Hierarchical clustering,etc.) or SpadSoft.
In most of the time, the segments inside your population have been created “by a very smart guy a few years ago”. In the above example, the criteria that was used to create the 4 segments is the position of the candy in the cookie-jar.

Let’s now create a “ranking” based on our segmentation. A ranking is simply an ordered list that contains all your prospects sorted from the one with the highest probability of purchase to the one with the lowest of purchase.

We can easily compute the "probability of purchase" of the different customers inside a specific segment: it's the percentage of buyers inside the segment.

To create our ranking, we will order our segments from the "best" one (the one with the highest number of buyers in percent) to the "worst" one (the one with the lowest number of buyers in percent).

Here is an illustration of the ranking:
Grraphical Illustration of the ranking obtained using segmentation technique

The same ranking can also be illustrated in this way (the "Y" axis is now the cumulative number of buyers found):
Classical lift curve obtained using segmentation technique

The blue curve in the above chart is named the “Lift curve”. The lift curve allows you to “see” the quality of your ranking. Different “Analytical CRM tools” will have different lift curves. The lift curve directly translates into ROI! The TIMi suite includes a unique tool that directly estimates, based on the lift curve, the ROI (in Euros or Dollars) of your marketing campaign. A good "Analytical CRM" software will be able to directly find all the buyers and it will generate a "high lift curve". The higher the lift curve, the better your ranking, the higher your ROI.


HIGHER LIFT CURVE = HIGHER ACCURACY = HIGHER ROI

Predictive techniques

“Predictive techniques” can be represented like this:
predictive illustration


The large bold red circle represents our predictive model. The objective of this predictive model (in technical terms: the “target”) is to find all the people that have bought your product.

This predictive model is making 4 errors:
  • Two blue candy and one yellow candy are classified as "customers currently having the product". These errors are interesting: they represent very good "leads" (i.e. customer that do NOT have your product yet but are very likely to purchase it)
  • one customer is classified as somebody that did not bough your product but, in reality, he bought it.


Predictive models that are built with TIMi also give you in addition the exact probability of purchase of each customer. In the above example, the prospects that are inside the thin red curve have the highest probability of purchase.

The quality of the ranking obtained through predictive technique is visible on the lift curve:

Classical lift curve obtained using predictive technique


Comparison (in terms of ROI) of
segmentation- based and
prediction-based techniques

In a classical lift-curve, the X-horizontal-axis is traditionally in percent: it’s the percentage of the population selected. Also, in a classical lift-curve, the Y-vertical-axis is traditionally also in percent: it’s the percentage of the buyers found.

Let’s plot the 2 lift curves (the one obtained from the segmentation and the one obtained from the predictive model) on the same chart (the X and Y axis are now in percent):

The 2 lift curves obtained using segmentation (in blue) and predictive (in red) technique


In the above chart, there is a yellow line: This yellow line represents the "random selection": For example, if you select randomly 50% of your population, you will "find" 50% of your buyers, thus the yellow line goes through the coordinate (50%; 50%). The "random selection line" represents the worst selection/ranking that you can do (i.e. it's a pure random selection).

In the above chart, the lift that characterizes the ranking obtained through predictive analytics (the red one) is higher than the one obtained with the segmentation technique (the blue one). This is always the case. What does it means?
  1. Predictive model creates better rankings: On this example the ranking obtain through predictive analytics will typically generate 20% more cash than the ranking obtained through segmentation technique.
  2. The predictive model is able to extract out of your database the "right people": The predictive model exactly "extracted" the right people: i.e. the ones that are interested in buying your product (and very few other people).
  3. Depending on the context, a difference between 2 rankings that is as small as 2 or 3 percent on the lift could mean millions of euros (or dollars) of difference between the corresponding marketing campaign. This is especially true in the banking, telecommunication and insurance world. In these fields, a few added percent on the lift curve directly translate to hundred thousands of added ROI for your marketing campaigns. You NEED to have the best lift. Otherwise, you are losing money at each marketing action.

The lift obtained with TIMi are systematically better than the lift obtained with any other commercially available analytical CRM software (it’s very common to have an improvement from 10% to 20% at X=10%) (i.e. it's very common to have an added ROI of 10% to 20% when using TIMi, compared to other tool analytical CRM tool).

Why are there so many people still using segmentation techniques to create their ranking?
The answer is:
  1. Creating a predictive model used to be extremely difficult: Very often, you had to hire expensive "specialized consultants" during 2 or 3 months to obtain a medium-accuracy predictive model (and you have to wait even longer if they were using SAS). With TIMi, everybody can now create extremely accurate rankings/lifts in a few mouse clicks, in a few minutes. This is a revolution.
  2. Standard "predictive software" (like SAS, SPSS,…) have enormous difficulties analyzing huge databases. They run for hours without giving any results. Whatever the size of your database, TIMi always gives an extremely accurate ranking in a few minutes.
  3. Usually, software that are able to create correct predictive models are (very!) expensive (SAS,SPSS,…). To have the same functionalities as the "basic TIMi package", it’s very common to pay between 170.000 and 240.000 euros per computer, per year. TIMi costs 24.000 euros per 4 computers per year. This is a revolution.
  4. To create correct predictive models with other tools, you need first to "clean" our databases to remove all errors (like "negative ages"). This process is usually extremely time-consuming (and expensive) and thus people generally avoid using predictive modelling. In opposition, TIMi completely remove the need for "cleaning" and allows you to directly analyze "RAW data". TIMi can directly connect to your operational system and instantaneously give you highly accurate rankings & lifts. This is a revolution!

Here are some lift curves (automatically generated with TIMi) that illustrate the quality of different rankings:

Some lift curves


Summary


HIGHER LIFT CURVE = HIGHER ACCURACY = HIGHER ROI

You need the best ROI            for all your marketing campaigns!
You need the best accuracy for all your marketing campaigns!
You need the TIMi suite!


Next: How to compare objectively (in terms of ROI)
different Analytical CRM tools?



Test the TIMi Suite for Free!