Trending Topics

  1. Real VS pretentious data scientists Troy Sadkowsky 01-Mar-2017

Latest News from DS

From Bhutan 19-Feb-2017

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
Latonya commented on 10-Oct-2017 03:50 AM
This piece of writing is actually a nice one it assists new web people, who are wishing in favor of blogging.


Here is my web site:Purchase michael
Enrique commented on 10-Oct-2017 08:53 AM
As a Newbie, I am always exploring online for articles that can be of assistance to me.
Thank you

Feel free to surf to my blog;Michael Kors Watches For Men Nordstrom
Rudolph commented on 11-Oct-2017 12:11 AM
hi!,I really like your writing very much! proportion we keep up a correspondence more approximately your article on AOL?

I require an expert in this space to resolve my problem. Maybe that is you! Looking forward to see you.

Feel free to surf to my webpage: Party ebay tools
Ashton commented on 11-Oct-2017 12:12 PM
I was curious if you ever considered changing the structure of your site?
Its very well written; I love what youve got to say. But maybe you could a little more in the way of content so people could connect with it better. Youve got an awful lot of text for only having 1 or 2 pictures. Maybe you could space it out better?

my homepage;Site Down Tremendously
Jennifer commented on 12-Oct-2017 03:36 AM
Thanks for the good writeup. It in reality was once a entertainment account it.
Look complicated to far brought agreeable from you! However, how can we communicate?

Also visit my blog -apple store
Margo commented on 12-Oct-2017 03:59 AM
Hello I am so glad I found your blog, I really found you by error, while I was researching on Bing for something else, Anyways I am here now and would just like to say cheers for a incredible post and a all round exciting blog (I also love the theme/design), I don't have time to read through it all at the moment but I have bookmarked it and also included your RSS feeds, so when I have time I will be back to read a lot more, Please do keep up the excellent work.


Stop by my web site - Online Small
Hung commented on 12-Oct-2017 05:57 AM
I visited a lot of website but I believe this one contains something extra in it.



Here is my blog -Belzec.phorum.pl
Shona commented on 12-Oct-2017 09:48 AM
Thanks for the auspicious writeup. It in reality was once a amusement account it.
Look complicated to more added agreeable from you! However, how could we be in contact?

Here is my blog -web based business
Trisha commented on 12-Oct-2017 09:57 AM
Good way of describing, and good paragraph to take information concerning my presentation subject matter, which i am going to present in college.


Here is my webpage ::Www.Cosl.Com.Sg
Latesha commented on 12-Oct-2017 10:06 AM
Hello! This is kind of off topic but I need some help from an established blog.

Is it hard to set up your own blog? I'm not very techincal but I can figure things out pretty fast. I'm thinking about creating my own but I'm not sure where to begin. Do you have any points or suggestions? Many thanks

my page:Stylish Watches
Sasha commented on 12-Oct-2017 11:55 AM
Wow, that's what I was searching for, what a information! present here at this blog, thanks admin of this web site.



Here is my webpage;ebay Misspellings
Marco commented on 12-Oct-2017 06:29 PM
As a Newbie, I am constantly exploring online for articles that can be of assistance to me.

Thank you

My page ::cheap Stylish watches
Preston commented on 12-Oct-2017 11:03 PM
Greetings from Ohio! I'm bored to death at work so I decided to browse your blog on my iphone during lunch break.
I enjoy the information you present here and can't wait to take a look when I get home. I'm amazed at how quick your blog loaded on my cell phone .. I'm not even using WIFI, just 3G .. Anyhow, fantastic blog!

My pagefavorite Cool
Stormy commented on 13-Oct-2017 02:32 AM
Having read this I thought it was very enlightening.
I appreciate you spending some time and energy to put this short article together. I once again find myself personally spending way too much time both reading and leaving comments. But so what, it was still worthwhile!

Here is my web-site: Belzec.Phorum.Pl
Phillipp commented on 14-Oct-2017 10:46 PM
F*ckin' amazing issues here. I am very happy to see your post.
Thanks a lot and i'm looking forward to touch you. Will you kindly drop me a mail?

Here is my web page ::search engine Optimization
Genie commented on 15-Oct-2017 01:57 AM
Hi there, this weekend is pleasant for me, because this point in time i am reading this fantastic informative piece of writing here at my residence.


Visit my websiteebay System
drugs fda commented on 16-Oct-2017 09:06 AM
*It?s hard to find knowledgeable people on this topic, but you sound like you know what you?re talking about! Thanks
Hallie commented on 18-Oct-2017 08:01 AM
I was curious if you ever thought of changing the layout of your website?

Its very well written; I love what youve got to say. But maybe you could a little more in the way of content so people could connect with it better. Youve got an awful lot of text for only having one or two pictures. Maybe you could space it out better?

Feel free to surf to my website -Apps.ezeego1.com
Milford commented on 18-Oct-2017 07:21 PM
I know this site provides quality depending content and extra material, is there any other web site which provides these kinds of things in quality?


Here is my siteWww.cosl.com.sg
Shanon commented on 18-Oct-2017 09:13 PM
Thank you for the blog post. Manley and I are actually saving to get a new guide on this subject matter and your post has made all of us to save our money.
Your ideas really responded all our inquiries. In fact, above what we had thought of before we came across your wonderful blog. I no longer nurture doubts as well as a troubled mind because you have attended to each of our needs here. Thanks

My websitefreebies On Black Friday
Lucio commented on 20-Oct-2017 01:42 AM
Wow! Thank you! I always wanted to write on my website something like that.
Can I take a part of your post to my site?

Look into my page ::Michael Kors Watch Battery
TIA-942 commented on 23-Oct-2017 06:44 AM
Therefore, usually people do not choose too long cable since it might make their cord system messy.
Bonnie commented on 23-Oct-2017 11:49 PM
I do not know if it's just me or if everyone else encountering issues with your website.

It appears as though some of the text within your posts are running off the screen. Can someone else please provide feedback and let me know if this is happening to them too? This could be a problem with my browser because I've had this happen previously. Thanks

my web-site;come and play learn colors Youtube
sd sd commented on 26-Oct-2017 02:58 AM
You really should get involved in a contest for starters of the finest blogs on the web. I will recommend this web site!
sd sd commented on 26-Oct-2017 08:54 AM
health plans may be expensive but it is really very necessary to get one for yourself-

Post a Comment




Captcha Image

Trackback Link
http://datascientists.com/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
Latonya commented on 10-Oct-2017 03:50 AM
This piece of writing is actually a nice one it assists new web people, who are wishing in favor of blogging.


Here is my web site:Purchase michael
Enrique commented on 10-Oct-2017 08:53 AM
As a Newbie, I am always exploring online for articles that can be of assistance to me.
Thank you

Feel free to surf to my blog;Michael Kors Watches For Men Nordstrom
Rudolph commented on 11-Oct-2017 12:11 AM
hi!,I really like your writing very much! proportion we keep up a correspondence more approximately your article on AOL?

I require an expert in this space to resolve my problem. Maybe that is you! Looking forward to see you.

Feel free to surf to my webpage: Party ebay tools
Ashton commented on 11-Oct-2017 12:12 PM
I was curious if you ever considered changing the structure of your site?
Its very well written; I love what youve got to say. But maybe you could a little more in the way of content so people could connect with it better. Youve got an awful lot of text for only having 1 or 2 pictures. Maybe you could space it out better?

my homepage;Site Down Tremendously
Jennifer commented on 12-Oct-2017 03:36 AM
Thanks for the good writeup. It in reality was once a entertainment account it.
Look complicated to far brought agreeable from you! However, how can we communicate?

Also visit my blog -apple store
Margo commented on 12-Oct-2017 03:59 AM
Hello I am so glad I found your blog, I really found you by error, while I was researching on Bing for something else, Anyways I am here now and would just like to say cheers for a incredible post and a all round exciting blog (I also love the theme/design), I don't have time to read through it all at the moment but I have bookmarked it and also included your RSS feeds, so when I have time I will be back to read a lot more, Please do keep up the excellent work.


Stop by my web site - Online Small
Hung commented on 12-Oct-2017 05:57 AM
I visited a lot of website but I believe this one contains something extra in it.



Here is my blog -Belzec.phorum.pl
Shona commented on 12-Oct-2017 09:48 AM
Thanks for the auspicious writeup. It in reality was once a amusement account it.
Look complicated to more added agreeable from you! However, how could we be in contact?

Here is my blog -web based business
Trisha commented on 12-Oct-2017 09:57 AM
Good way of describing, and good paragraph to take information concerning my presentation subject matter, which i am going to present in college.


Here is my webpage ::Www.Cosl.Com.Sg
Latesha commented on 12-Oct-2017 10:06 AM
Hello! This is kind of off topic but I need some help from an established blog.

Is it hard to set up your own blog? I'm not very techincal but I can figure things out pretty fast. I'm thinking about creating my own but I'm not sure where to begin. Do you have any points or suggestions? Many thanks

my page:Stylish Watches
Sasha commented on 12-Oct-2017 11:55 AM
Wow, that's what I was searching for, what a information! present here at this blog, thanks admin of this web site.



Here is my webpage;ebay Misspellings
Marco commented on 12-Oct-2017 06:29 PM
As a Newbie, I am constantly exploring online for articles that can be of assistance to me.

Thank you

My page ::cheap Stylish watches
Preston commented on 12-Oct-2017 11:03 PM
Greetings from Ohio! I'm bored to death at work so I decided to browse your blog on my iphone during lunch break.
I enjoy the information you present here and can't wait to take a look when I get home. I'm amazed at how quick your blog loaded on my cell phone .. I'm not even using WIFI, just 3G .. Anyhow, fantastic blog!

My pagefavorite Cool
Stormy commented on 13-Oct-2017 02:32 AM
Having read this I thought it was very enlightening.
I appreciate you spending some time and energy to put this short article together. I once again find myself personally spending way too much time both reading and leaving comments. But so what, it was still worthwhile!

Here is my web-site: Belzec.Phorum.Pl
Phillipp commented on 14-Oct-2017 10:46 PM
F*ckin' amazing issues here. I am very happy to see your post.
Thanks a lot and i'm looking forward to touch you. Will you kindly drop me a mail?

Here is my web page ::search engine Optimization
Genie commented on 15-Oct-2017 01:57 AM
Hi there, this weekend is pleasant for me, because this point in time i am reading this fantastic informative piece of writing here at my residence.


Visit my websiteebay System
drugs fda commented on 16-Oct-2017 09:06 AM
*It?s hard to find knowledgeable people on this topic, but you sound like you know what you?re talking about! Thanks
Hallie commented on 18-Oct-2017 08:01 AM
I was curious if you ever thought of changing the layout of your website?

Its very well written; I love what youve got to say. But maybe you could a little more in the way of content so people could connect with it better. Youve got an awful lot of text for only having one or two pictures. Maybe you could space it out better?

Feel free to surf to my website -Apps.ezeego1.com
Milford commented on 18-Oct-2017 07:21 PM
I know this site provides quality depending content and extra material, is there any other web site which provides these kinds of things in quality?


Here is my siteWww.cosl.com.sg
Shanon commented on 18-Oct-2017 09:13 PM
Thank you for the blog post. Manley and I are actually saving to get a new guide on this subject matter and your post has made all of us to save our money.
Your ideas really responded all our inquiries. In fact, above what we had thought of before we came across your wonderful blog. I no longer nurture doubts as well as a troubled mind because you have attended to each of our needs here. Thanks

My websitefreebies On Black Friday
Lucio commented on 20-Oct-2017 01:42 AM
Wow! Thank you! I always wanted to write on my website something like that.
Can I take a part of your post to my site?

Look into my page ::Michael Kors Watch Battery
TIA-942 commented on 23-Oct-2017 06:44 AM
Therefore, usually people do not choose too long cable since it might make their cord system messy.
Bonnie commented on 23-Oct-2017 11:49 PM
I do not know if it's just me or if everyone else encountering issues with your website.

It appears as though some of the text within your posts are running off the screen. Can someone else please provide feedback and let me know if this is happening to them too? This could be a problem with my browser because I've had this happen previously. Thanks

my web-site;come and play learn colors Youtube
sd sd commented on 26-Oct-2017 02:58 AM
You really should get involved in a contest for starters of the finest blogs on the web. I will recommend this web site!
sd sd commented on 26-Oct-2017 08:54 AM
health plans may be expensive but it is really very necessary to get one for yourself-

Post a Comment




Captcha Image

Trackback Link
http://datascientists.com/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.