Trending Topics

  1. Real VS pretentious data scientists Troy Sadkowsky 01-Mar-2017

Latest News from DS

From Bhutan 19-Feb-2017

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
Josef commented on 10-Aug-2018 11:38 PM
Great web site! It looks extremely professional!
Keep up the good job!

my weblog;https://ferrann.mx/blog/tratamientos-para-la-caida-del-cabello/
Monroe commented on 11-Aug-2018 12:14 AM
Sustain the remarkable work !! Lovin' it!

My web blog;https://ferrann.co/blog/ketoconazol-shampoo/
Michaela commented on 11-Aug-2018 12:31 AM
Corley (48-27-1, 28 KO's) has actually won 4 straight as well as 6 from his final seven eleven app [www.minds.com] - most the triumphes have come against increasing potential customers.
Kellee commented on 11-Aug-2018 12:36 AM
Wow, stunning site. Thnx ...

My website - https://ferrann.mx/blog/shampoo-de-caballo/
Keith commented on 11-Aug-2018 12:36 AM
Many thanks very beneficial. Will certainly share site with my buddies.



my weblog -venta de minoxidil en morelia
Deena commented on 11-Aug-2018 12:42 AM
Awesome internet site you've gotten here.

my blog post;https://ferrann.com/blog/tipos-de-shampoo-usas-el-adecuado/
Chelsea commented on 11-Aug-2018 12:46 AM
Many thanks, this site is very beneficial.

Feel free to surf to my website -https://ferrann.co/blog/alopecia-femenina/
Gerald commented on 11-Aug-2018 01:01 AM
Regards for sharing your cool web site.

Feel free to surf to my web-site:https://ferrann.co/blog/cabello-graso-descubre-controlarlo/
Alphonso commented on 11-Aug-2018 01:11 AM
Keep up the awesome job !! Lovin' it!

Review my weblog ...https://creativo.studio/posicionamiento-youtube/
Filomena commented on 11-Aug-2018 01:15 AM
Thanks a bunch! This a incredible internet site!


Also visit my webpage:https://ferrann.co/blog/color-de-cabello-te-favorece/
Cruz commented on 11-Aug-2018 01:17 AM
However Rovelli deals with only 7 subject matters that include relativity, quantum natural sciences, fragment physics and also black holes.



Here is my website - seven eleven app [http://cameronurquhart.wikidot.com/blog:2]
Lillie commented on 11-Aug-2018 01:20 AM
You've got one of the greatest web-sites.

Stop by my webpage:https://ferrann.co/blog/combatiendo-molesto-frizz-cabello-sano-e-hidratado/
Juliann commented on 11-Aug-2018 01:21 AM
Maintain the remarkable work !! Lovin' it!

Feel free to surf to my webloghttps://ferrann.co/blog/como-evitar-la-caida-del-cabello-y-hacerlo-crecer/
Aileen commented on 11-Aug-2018 01:25 AM
You've one of the best internet websites.


Also visit my site -https://ferrann.co/blog/bergamota-para-el-cabello-regalo-toda-mujer/
Kimberley commented on 11-Aug-2018 01:36 AM
The seven deadly sins (https://www.dailystrength.org) wanderers in the sky are actually taken into consideration as blessed, as well as style is actually instructed to possess 7 aspects.
Chelsea commented on 11-Aug-2018 01:42 AM
The Grow older from Reagan only actually started seven months right into his presidency, when he fired the air visitor traffic operators.


My web-site ... seventeen movie (mohammeds26345134.pen.io)
Arianne commented on 11-Aug-2018 01:54 AM
Loving the info on this web site, you have done great job on the content.


Also visit my webpage ...possible purchase
Dong commented on 11-Aug-2018 02:13 AM
Keep up the good work and generating the crowd!

my web-site:https://ferrann.co/blog/kerastase-el-escandalo/
Muoi commented on 11-Aug-2018 02:26 AM
Wow because this is excellent job! Congrats and keep it up.


Feel free to surf to my site -https://ferrann.co/blog/remedios-para-que-crezca-el-cabello-2/
porno commented on 11-Aug-2018 02:52 AM
I'm really impressed with your writing skills as
well as with the layout on your weblog. Is this a paid theme or did you customize it yourself?
Either way keep up the nice quality writing, it's rare to
see a great blog like this one today.
cheap personalised wristbands commented on 11-Aug-2018 04:01 AM
Excellent beat ! I would like to apprentice
while you amend your web site, how can i subscribe
for a blog website? The account aided me a appropriate deal.
I were a little bit familiar of this your broadcast provided shiny transparent idea https://www.silicone-wristbands.co.uk
free online video games to play now commented on 11-Aug-2018 05:45 AM
Excellent goods from you, man. I have understand your stuff previoous to and you're just extremely great.
I actually like what you've acquired here, really like what you are stating and the way in which you say it.
You make it entertaining and you still care for to keep it
smart. I cant wait tto ead mhch more from you.
This is really a terrific web site.
Internet dating commented on 11-Aug-2018 08:48 AM
My developer is trying to convince me to move to .net from PHP.
I have always disliked the idea because of the expenses.
But he's tryiong none the less. I've been using WordPress
on several websites for about a year and am anxious about switching to another platform.
I have heard good things about blogengine.net. Is there a way I can transfer all my wordpress posts
into it? Any help would be really appreciated!
Court Help commented on 11-Aug-2018 09:38 AM
You really make it seem so easy with your presentation but I find this matter to be actually something that I think I would never
understand. It seems too complex and extremely
broad for me. I'm looking forward for your next post, I'll try to
get the hang of it!
access control software commented on 11-Aug-2018 09:57 AM
At this time I aam going away too do my breakfast, afterward having my breakfast
coming over again to read further news.

Post a Comment




Captcha Image

Trackback Link
http://datascientists.com/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
Josef commented on 10-Aug-2018 11:38 PM
Great web site! It looks extremely professional!
Keep up the good job!

my weblog;https://ferrann.mx/blog/tratamientos-para-la-caida-del-cabello/
Monroe commented on 11-Aug-2018 12:14 AM
Sustain the remarkable work !! Lovin' it!

My web blog;https://ferrann.co/blog/ketoconazol-shampoo/
Michaela commented on 11-Aug-2018 12:31 AM
Corley (48-27-1, 28 KO's) has actually won 4 straight as well as 6 from his final seven eleven app [www.minds.com] - most the triumphes have come against increasing potential customers.
Kellee commented on 11-Aug-2018 12:36 AM
Wow, stunning site. Thnx ...

My website - https://ferrann.mx/blog/shampoo-de-caballo/
Keith commented on 11-Aug-2018 12:36 AM
Many thanks very beneficial. Will certainly share site with my buddies.



my weblog -venta de minoxidil en morelia
Deena commented on 11-Aug-2018 12:42 AM
Awesome internet site you've gotten here.

my blog post;https://ferrann.com/blog/tipos-de-shampoo-usas-el-adecuado/
Chelsea commented on 11-Aug-2018 12:46 AM
Many thanks, this site is very beneficial.

Feel free to surf to my website -https://ferrann.co/blog/alopecia-femenina/
Gerald commented on 11-Aug-2018 01:01 AM
Regards for sharing your cool web site.

Feel free to surf to my web-site:https://ferrann.co/blog/cabello-graso-descubre-controlarlo/
Alphonso commented on 11-Aug-2018 01:11 AM
Keep up the awesome job !! Lovin' it!

Review my weblog ...https://creativo.studio/posicionamiento-youtube/
Filomena commented on 11-Aug-2018 01:15 AM
Thanks a bunch! This a incredible internet site!


Also visit my webpage:https://ferrann.co/blog/color-de-cabello-te-favorece/
Cruz commented on 11-Aug-2018 01:17 AM
However Rovelli deals with only 7 subject matters that include relativity, quantum natural sciences, fragment physics and also black holes.



Here is my website - seven eleven app [http://cameronurquhart.wikidot.com/blog:2]
Lillie commented on 11-Aug-2018 01:20 AM
You've got one of the greatest web-sites.

Stop by my webpage:https://ferrann.co/blog/combatiendo-molesto-frizz-cabello-sano-e-hidratado/
Juliann commented on 11-Aug-2018 01:21 AM
Maintain the remarkable work !! Lovin' it!

Feel free to surf to my webloghttps://ferrann.co/blog/como-evitar-la-caida-del-cabello-y-hacerlo-crecer/
Aileen commented on 11-Aug-2018 01:25 AM
You've one of the best internet websites.


Also visit my site -https://ferrann.co/blog/bergamota-para-el-cabello-regalo-toda-mujer/
Kimberley commented on 11-Aug-2018 01:36 AM
The seven deadly sins (https://www.dailystrength.org) wanderers in the sky are actually taken into consideration as blessed, as well as style is actually instructed to possess 7 aspects.
Chelsea commented on 11-Aug-2018 01:42 AM
The Grow older from Reagan only actually started seven months right into his presidency, when he fired the air visitor traffic operators.


My web-site ... seventeen movie (mohammeds26345134.pen.io)
Arianne commented on 11-Aug-2018 01:54 AM
Loving the info on this web site, you have done great job on the content.


Also visit my webpage ...possible purchase
Dong commented on 11-Aug-2018 02:13 AM
Keep up the good work and generating the crowd!

my web-site:https://ferrann.co/blog/kerastase-el-escandalo/
Muoi commented on 11-Aug-2018 02:26 AM
Wow because this is excellent job! Congrats and keep it up.


Feel free to surf to my site -https://ferrann.co/blog/remedios-para-que-crezca-el-cabello-2/
porno commented on 11-Aug-2018 02:52 AM
I'm really impressed with your writing skills as
well as with the layout on your weblog. Is this a paid theme or did you customize it yourself?
Either way keep up the nice quality writing, it's rare to
see a great blog like this one today.
cheap personalised wristbands commented on 11-Aug-2018 04:01 AM
Excellent beat ! I would like to apprentice
while you amend your web site, how can i subscribe
for a blog website? The account aided me a appropriate deal.
I were a little bit familiar of this your broadcast provided shiny transparent idea https://www.silicone-wristbands.co.uk
free online video games to play now commented on 11-Aug-2018 05:45 AM
Excellent goods from you, man. I have understand your stuff previoous to and you're just extremely great.
I actually like what you've acquired here, really like what you are stating and the way in which you say it.
You make it entertaining and you still care for to keep it
smart. I cant wait tto ead mhch more from you.
This is really a terrific web site.
Internet dating commented on 11-Aug-2018 08:48 AM
My developer is trying to convince me to move to .net from PHP.
I have always disliked the idea because of the expenses.
But he's tryiong none the less. I've been using WordPress
on several websites for about a year and am anxious about switching to another platform.
I have heard good things about blogengine.net. Is there a way I can transfer all my wordpress posts
into it? Any help would be really appreciated!
Court Help commented on 11-Aug-2018 09:38 AM
You really make it seem so easy with your presentation but I find this matter to be actually something that I think I would never
understand. It seems too complex and extremely
broad for me. I'm looking forward for your next post, I'll try to
get the hang of it!
access control software commented on 11-Aug-2018 09:57 AM
At this time I aam going away too do my breakfast, afterward having my breakfast
coming over again to read further news.

Post a Comment




Captcha Image

Trackback Link
http://datascientists.com/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.