April 16, 2017
TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU
Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7
Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?
In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.
Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.
She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.
Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.
Comments
A model with 3 CCD features a sensor that sees each of the different colors (Red, Green,
and Blue) leading to superior color reproduction. You need a special connector typically termed as a Fire wire
or sometimes known being an IEEE 1394 high band connector.
whether or not this publish is written by him as nobody else realize such unique approximately my difficulty.
You are wonderful! Thanks!
I've joined your feed and look forward to seeking more
of your magnificent post. Also, I've shared your site in my social networks!
Thank you for all of your time & work.
you by accident, while I was looking on Digg
for something else, Anyways I am here now and would just like to say thanks a lot for a tremendous post
and a all round interesting blog (I also love the theme/design), I don't have time to read it all at the minute but I
have saved it and also added in your RSS feeds, so when I
have time I will be back to read a great deal more, Please do keep up
the awesome job. https://www.gifts4promo.co.uk
I had no trouble navigating through all tabs and related information ended up being truly simple to do to access.
I recently found what I hoped for before you know it at all.
Reasonably unusual. Is likely to appreciate it for those who add forums or
anything, site theme . a tones way for your customer
to communicate. Excellent task. https://www.silicon-wristband.com
right here. I did however expertise a few technical issues using this
web site, as I experienced to reload the web site many times previous to I could get
it to load properly. I had been wondering if your hosting is OK?
Not that I am complaining, but slow loading instances times will often affect
your placement in google and could damage your quality score if advertising and marketing
with Adwords. Well I am adding this RSS to my e-mail and could look out for
much more of your respective exciting content. Ensure that
you update this again very soon.
it for contribution.
I have joined your rss feed and look forward to seeking more of your fantastic post.
Also, I've shared your web site in my social networks! https://www.promotiongifts.ca
I had no trouble navigating through all tabs as well as
related information ended up being truly simple
to do to access. I recently found what I hoped for before you
know it at all. Quite unusual. Is likely to appreciate it for those who add
forums or anything, website theme . a tones way for your client to communicate.
Excellent task. https://www.silicon-wristband.com
I'm trying to get my blog to rank for some targeted keywords but I'm
not seeing very good success. If you know of any please share.
Appreciate it! https://www.wristbands-australia.com
very useful.
am reading this impressive paragraph to increase my know-how.
Here is my web-site; based business
tutoringand completely explained, keep it up all the time. https://www.silicone-wristbands.co.uk
browsing for thoughts on this issue last Sunday. https://www.promogifts4au.com