Trending Topics

  1. Real VS pretentious data scientists Troy Sadkowsky 01-Mar-2017

Latest News from DS

From Bhutan 19-Feb-2017

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
e0209 sentinel key not found autodata commented on 12-Jul-2018 08:06 AM
I really enjoy examining on this internet site , it has got great posts .
Elias commented on 12-Jul-2018 08:35 AM
You're a very valuable site; could not make it without ya!


Here is my web site ::Kira Mendez
curry 3 commented on 12-Jul-2018 09:59 AM
The proper basketball footwear might help a player do well on the court,
and cut back the risk of foot and ankle injuries.
stephen curry shoes commented on 12-Jul-2018 10:18 AM
This could also be tough with sneakers because the doubtless allergenic supplies are in shut proximity and inseparable from each other.
ugg boots for women commented on 12-Jul-2018 02:24 PM
Perhaps you never run with a watch but have lately taken running extra seriously and need to enhance your occasions.
tư thế quan hệ cho bà bầu commented on 12-Jul-2018 02:54 PM
Hurrah! At laast I got a bkog from where I can truly get helpful facts regarding
my study and knowledge.
더킹카지노 commented on 12-Jul-2018 02:55 PM
Unquestionably consider that which you stated.

Your favorite reason appeared to be on the web thee
easiest factor to take into accout of. I saay to you, I
definitely get annkyed even as other folks consider concerrns
that they just do not understand about. You controlled to hit the nail
upon the highest and outlinedd out the whole thing with no need side-effects , folks cann take a signal.
Will likely be back to get more. Thanks
uggs Outlet commented on 12-Jul-2018 03:17 PM
Achilles tendinitis is one other a type of pains to the lower legs many runners come across of their
operating career.
datatogelsgp.com commented on 12-Jul-2018 04:31 PM
Your style is really unique compared to other folks I have read stuff from.
I appreciate you for posting when you've got the opportunity, Guess I'll just bookmark this
blog.
Homeinternetclub.org commented on 12-Jul-2018 05:01 PM
Please let me know if you're looking for a writer for your weblog.
You havce some realply great posts and I believe I would be a good asset.
If youu ever want to take some of tthe load off, I'd love to write some material for
your blog in exchange for a link back to mine. Please send mme an e-mail if interested.
Many thanks!
Antiaging serum plus Review commented on 12-Jul-2018 06:05 PM
What's up, this weekend is fastidious in ffavor of me, for the reason thazt
this ttime i am reading this wonderful informative piece
of writing here at my house.
Marketstrom κρεβατια commented on 12-Jul-2018 06:12 PM
I’m not that much of a online reader to be honest but your blogs really nice,
keep it up! I'll go ahead and bookmark your website to come back down the road.
Many thanks http://www.emmezootecnici.com/index.php/component/k2/itemlist/user/45941
Free Auto Approve List 7-12-2018 commented on 12-Jul-2018 07:57 PM
I've just added a fresh new list. This is by far the biggest list to date. I hope you all are having a great week. Take care and happy link building.
maxxtest 300 commented on 12-Jul-2018 08:06 PM
Your style is so unique compared to other people I have read
stuff from. Thanks for poosting when you've got the opportunity,
Guess I'll just book mark this web site.
Dominick commented on 12-Jul-2018 10:28 PM
Thanks for finally writing about >How Can Thick Data Improve the Way We Use Big Data?
<Liked it!
Irish commented on 12-Jul-2018 10:42 PM
Greetings I am so grateful I found your webpage,
I really found you by mistake, while I was looking on Digg for
something else, Regardless I am here now and would just like to say many thanks for a marvelous post and a all
round interesting blog (I also love the theme/design), I don’t have time to browse it all at the moment but I have book-marked
it and also added in your RSS feeds, so when I have time I
will be back to read a great deal more, Please do keep up the fantastic jo.
"madseasonshow" -youtube.com commented on 13-Jul-2018 03:40 AM
This helps. Cheers!
airserver 5.5.3 crack commented on 13-Jul-2018 03:40 AM
I like this website its a master peace ! Glad I found this on google .
Free Auto Approve List 7-12-2018 commented on 13-Jul-2018 05:23 AM
I've just added a fresh new list. This is by far the biggest list to date. I hope you all are having a great week. Take care and happy link building.
Free Auto Approve List 7-12-2018 commented on 13-Jul-2018 09:56 AM
I've just added a fresh new list. This is by far the biggest list to date. I hope you all are having a great week. Take care and happy link building.
Silicone wristbands commented on 13-Jul-2018 12:24 PM
What's up, I check your blog on a regular basis. Your writing style is awesome, keep doing what you're doing! https://www.customsiliconewristband.xyz
online dating commented on 13-Jul-2018 02:26 PM
Wonderful blog! I found it while browsing on Yahoo News.
Do you have any suggestions on how to get listed
in Yahoo News? I've been trying for a while but I never
seem to get there! Thanks
Eldon commented on 13-Jul-2018 02:32 PM
Cheap Tizanidine Online
Buy Tizanidine Online
Buy Muscle Relaxants
Buy Zanaflex Online
Cheap Tizanidine Online

Also visit my blog Cheap Zanaflex Online

Post a Comment




Captcha Image

Trackback Link
http://datascientists.com/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
e0209 sentinel key not found autodata commented on 12-Jul-2018 08:06 AM
I really enjoy examining on this internet site , it has got great posts .
Elias commented on 12-Jul-2018 08:35 AM
You're a very valuable site; could not make it without ya!


Here is my web site ::Kira Mendez
curry 3 commented on 12-Jul-2018 09:59 AM
The proper basketball footwear might help a player do well on the court,
and cut back the risk of foot and ankle injuries.
stephen curry shoes commented on 12-Jul-2018 10:18 AM
This could also be tough with sneakers because the doubtless allergenic supplies are in shut proximity and inseparable from each other.
ugg boots for women commented on 12-Jul-2018 02:24 PM
Perhaps you never run with a watch but have lately taken running extra seriously and need to enhance your occasions.
tư thế quan hệ cho bà bầu commented on 12-Jul-2018 02:54 PM
Hurrah! At laast I got a bkog from where I can truly get helpful facts regarding
my study and knowledge.
더킹카지노 commented on 12-Jul-2018 02:55 PM
Unquestionably consider that which you stated.

Your favorite reason appeared to be on the web thee
easiest factor to take into accout of. I saay to you, I
definitely get annkyed even as other folks consider concerrns
that they just do not understand about. You controlled to hit the nail
upon the highest and outlinedd out the whole thing with no need side-effects , folks cann take a signal.
Will likely be back to get more. Thanks
uggs Outlet commented on 12-Jul-2018 03:17 PM
Achilles tendinitis is one other a type of pains to the lower legs many runners come across of their
operating career.
datatogelsgp.com commented on 12-Jul-2018 04:31 PM
Your style is really unique compared to other folks I have read stuff from.
I appreciate you for posting when you've got the opportunity, Guess I'll just bookmark this
blog.
Homeinternetclub.org commented on 12-Jul-2018 05:01 PM
Please let me know if you're looking for a writer for your weblog.
You havce some realply great posts and I believe I would be a good asset.
If youu ever want to take some of tthe load off, I'd love to write some material for
your blog in exchange for a link back to mine. Please send mme an e-mail if interested.
Many thanks!
Antiaging serum plus Review commented on 12-Jul-2018 06:05 PM
What's up, this weekend is fastidious in ffavor of me, for the reason thazt
this ttime i am reading this wonderful informative piece
of writing here at my house.
Marketstrom κρεβατια commented on 12-Jul-2018 06:12 PM
I’m not that much of a online reader to be honest but your blogs really nice,
keep it up! I'll go ahead and bookmark your website to come back down the road.
Many thanks http://www.emmezootecnici.com/index.php/component/k2/itemlist/user/45941
Free Auto Approve List 7-12-2018 commented on 12-Jul-2018 07:57 PM
I've just added a fresh new list. This is by far the biggest list to date. I hope you all are having a great week. Take care and happy link building.
maxxtest 300 commented on 12-Jul-2018 08:06 PM
Your style is so unique compared to other people I have read
stuff from. Thanks for poosting when you've got the opportunity,
Guess I'll just book mark this web site.
Dominick commented on 12-Jul-2018 10:28 PM
Thanks for finally writing about >How Can Thick Data Improve the Way We Use Big Data?
<Liked it!
Irish commented on 12-Jul-2018 10:42 PM
Greetings I am so grateful I found your webpage,
I really found you by mistake, while I was looking on Digg for
something else, Regardless I am here now and would just like to say many thanks for a marvelous post and a all
round interesting blog (I also love the theme/design), I don’t have time to browse it all at the moment but I have book-marked
it and also added in your RSS feeds, so when I have time I
will be back to read a great deal more, Please do keep up the fantastic jo.
"madseasonshow" -youtube.com commented on 13-Jul-2018 03:40 AM
This helps. Cheers!
airserver 5.5.3 crack commented on 13-Jul-2018 03:40 AM
I like this website its a master peace ! Glad I found this on google .
Free Auto Approve List 7-12-2018 commented on 13-Jul-2018 05:23 AM
I've just added a fresh new list. This is by far the biggest list to date. I hope you all are having a great week. Take care and happy link building.
Free Auto Approve List 7-12-2018 commented on 13-Jul-2018 09:56 AM
I've just added a fresh new list. This is by far the biggest list to date. I hope you all are having a great week. Take care and happy link building.
Silicone wristbands commented on 13-Jul-2018 12:24 PM
What's up, I check your blog on a regular basis. Your writing style is awesome, keep doing what you're doing! https://www.customsiliconewristband.xyz
online dating commented on 13-Jul-2018 02:26 PM
Wonderful blog! I found it while browsing on Yahoo News.
Do you have any suggestions on how to get listed
in Yahoo News? I've been trying for a while but I never
seem to get there! Thanks
Eldon commented on 13-Jul-2018 02:32 PM
Cheap Tizanidine Online
Buy Tizanidine Online
Buy Muscle Relaxants
Buy Zanaflex Online
Cheap Tizanidine Online

Also visit my blog Cheap Zanaflex Online

Post a Comment




Captcha Image

Trackback Link
http://datascientists.com/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.