Analytics maturity

Still need a gift? 🎄

Get the book. 135 sketches explaining the world

There are lots of questions you can ask of data. I like this model as it gives a framework for the different types of questions you might ask. It was introduced to me as the data science pyramid with descriptive analytics — measuring what’s happening — being the foundation on which others are built. You don’t have to go in order, but it’s a nice approach to consider how the questions you’re asking of your data might evolve.

To take our school Summer fête as an example, for a long time takings were all in cash and put into one bucket at the end for counting. You end up with one number for how much you raised. But you might move to collecting more descriptive data on the takings for each stall — whether the bar earns more than the tombola, for example. You then might be able to ask diagnostic questions like figuring out why one fête earned more than another with a different mix of stalls. If you know how many people came you might be able to make some predictions on the takings of a future fête based on number of people and stall types. And if you get fancy you might start to use your data to figure out how you could raise more money for the school in future.

There are many ways to slice and dice data and the questions you ask, but I like the clarifying simplicity of this one.

As far as I know, the framework is the Analytics Ascendancy model, or Analytics Value Escalator, or other such business sounding name from Gartner.

Published 14 Jun 2020

A weekly sketch by email

Learn something new in a sketch each Sunday

Get the book!
Big Ideas Little Pictures

Prefer to listen?
Try the podcast

Sketchplanations is ad-free
thanks to supporters like you.See more on Patreon

Keep exploring

The Barnum effect

The magic of open-air kitchens for Asian street food shown calling out each aspect that makes it such an ingenious set up

The street food open-air kitchen

The Rashomon effect

The Pyramid Principle

Eponym

Moon pool

The Barnum effect is our tendency to apply personal meaning to statements that could apply to many people. For statements such as the results of a personality test, the effect is stronger if: we believe they are personalised to us they are sufficiently vague — handy phrases include "at times," "a tendency to," "some of," etc. they are mostly positive — we're more inclined to accept positive evaluations of ourselves than critical ones they come from a source of authority You may recognise these tricks from a horoscope or your star sign, magicians, fortune-tellers, fortune cookies, con artists and, perhaps, marketing. There's a fascinating magician's technique you may have seen called cold reading that uses the Barnum effect with other tricks ("I see someone with heart pain in your family.") to make it seem like they know a lot of personal details about someone at a first meeting. Originally from Bertram Forer, who called it "the fallacy of personal validation," it was later known as the Forer effect until Paul Meehl suggested it should be named the Barnum effect after P. T. Barnum (now of The Greatest Showman fame) for the way he could easily fool an audience with these techniques and to emphasize that we should all know and be on the lookout for being fooled. For that reason, I called it the same here. Bertram Forer ran an experiment with his students (pdf), giving everyone the same results for their individual personality assessment. Generally, the students all thought the same description applied very well to themselves. He used these statements taken "largely from a newsstand astrology book": You have a great need for other people to like and admire you. You have a tendency to be critical of yourself. You have a great deal of unused capacity which you have not turned to your advantage. While you have some personality weaknesses, you are generally able to compensate for them. Your sexual adjustment has presented problems for you. Disciplined and self-controlled outside, you tend to be worrisome and insecure inside. At times you have serious doubts as to whether you have made the right decision or done the right thing. You prefer a certain amount of change and variety and become dissatisfied when hemmed in by restrictions and limitations. You pride yourself as an independent thinker and do not accept others' statements without satisfactory proof. You have found it unwise to be too frank in revealing yourself to others. At times you are extroverted, affable, sociable, while at other times you are introverted, wary, reserved. Some of your aspirations tend to be pretty unrealistic. Security is one of your major goals in life. Not a bad description of me... I learned about it from a discussion of the Meyers-Briggs test (I'm an ENTP btw). Here's Paul Meehl advocating for the Barnum effect: "Many psychometric reports bear a disconcerting resemblance to what my colleague Donald G. Paterson calls “personality description after the manner of P. T. Barnum” ... I suggest—and I am quite serious—that we adopt the phrase Barnum effect to stigmatize those pseudo-successful clinical procedures in which personality descriptions from tests are made to fit the patient largely or wholly by virtue of their triviality; and in which any nontrivial, but perhaps erroneous, inferences are hidden in a context of assertions or denials which carry high confidence simply because of the population base rates, regardless of the test’s validity. I think this fallacy is at least as important and frequent as others for which we have familiar labels (halo effect, leniency error, contamination, etc.). One of the best ways to increase the general sensitivity to such fallacies is to give them a name. We ought to make our clinical students as acutely aware of the Barnum effect as they are of the dangers of countertransference or the standard error of r." Meehl, P. E. (1956). Wanted—a good cook-book. American Psychologist, 11(6), 263–272. https://doi.org/10.1037/h0044164…The Barnum effect is our tendency to apply personal meaning to statements that could apply to many people. For statements such as the results of a personality test, the effect is stronger if: we believe they are personalised to us they are sufficiently vague — handy phrases include "at times," "a tendency to," "some of," etc. they are mostly positive — we're more inclined to accept positive evaluations of ourselves than critical ones they come from a source of authority You may recognise these tricks from a horoscope or your star sign, magicians, fortune-tellers, fortune cookies, con artists and, perhaps, marketing. There's a fascinating magician's technique you may have seen called cold reading that uses the Barnum effect with other tricks ("I see someone with heart pain in your family.") to make it seem like they know a lot of personal details about someone at a first meeting. Originally from Bertram Forer, who called it "the fallacy of personal validation," it was later known as the Forer effect until Paul Meehl suggested it should be named the Barnum effect after P. T. Barnum (now of The Greatest Showman fame) for the way he could easily fool an audience with these techniques and to emphasize that we should all know and be on the lookout for being fooled. For that reason, I called it the same here. Bertram Forer ran an experiment with his students (pdf), giving everyone the same results for their individual personality assessment. Generally, the students all thought the same description applied very well to themselves. He used these statements taken "largely from a newsstand astrology book": You have a great need for other people to like and admire you. You have a tendency to be critical of yourself. You have a great deal of unused capacity which you have not turned to your advantage. While you have some personality weaknesses, you are generally able to compensate for them. Your sexual adjustment has presented problems for you. Disciplined and self-controlled outside, you tend to be worrisome and insecure inside. At times you have serious doubts as to whether you have made the right decision or done the right thing. You prefer a certain amount of change and variety and become dissatisfied when hemmed in by restrictions and limitations. You pride yourself as an independent thinker and do not accept others' statements without satisfactory proof. You have found it unwise to be too frank in revealing yourself to others. At times you are extroverted, affable, sociable, while at other times you are introverted, wary, reserved. Some of your aspirations tend to be pretty unrealistic. Security is one of your major goals in life. Not a bad description of me... I learned about it from a discussion of the Meyers-Briggs test (I'm an ENTP btw). Here's Paul Meehl advocating for the Barnum effect: "Many psychometric reports bear a disconcerting resemblance to what my colleague Donald G. Paterson calls “personality description after the manner of P. T. Barnum” ... I suggest—and I am quite serious—that we adopt the phrase Barnum effect to stigmatize those pseudo-successful clinical procedures in which personality descriptions from tests are made to fit the patient largely or wholly by virtue of their triviality; and in which any nontrivial, but perhaps erroneous, inferences are hidden in a context of assertions or denials which carry high confidence simply because of the population base rates, regardless of the test’s validity. I think this fallacy is at least as important and frequent as others for which we have familiar labels (halo effect, leniency error, contamination, etc.). One of the best ways to increase the general sensitivity to such fallacies is to give them a name. We ought to make our clinical students as acutely aware of the Barnum effect as they are of the dangers of countertransference or the standard error of r." Meehl, P. E. (1956). Wanted—a good cook-book. American Psychologist, 11(6), 263–272. https://doi.org/10.1037/h0044164

Newer

RRandom

Older