Trending Topics

  1. Real VS pretentious data scientists Troy Sadkowsky 01-Mar-2017

Latest News from DS

From Bhutan 19-Feb-2017

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
Meri commented on 16-Sep-2017 12:28 AM
F*ckin' amazing things here. I'm very satisfied to look your post.
Thanks so much and i am looking ahead to touch you. Will you please drop me a e-mail?

Review my websitevital favored cool
what is a roth 401k contribution commented on 16-Sep-2017 09:53 AM
Employer contributions are tax deductible.
Christina commented on 16-Sep-2017 05:16 PM
Hurrah, that's what I was looking for, what a stuff! present here at this webpage, thanks admin of this website.


Feel free to surf to my web pagemichael kors Womens watches
Reda commented on 17-Sep-2017 02:04 AM
Wow, that's what I was exploring for, what a stuff! existing here at this blog, thanks admin of this website.



Here is my web siteFall Watch Trends
Odette commented on 18-Sep-2017 01:16 AM
Having read this I believed it was really enlightening. I appreciate you spending some time and effort to put this informative article together.
I once again find myself spending a lot of time both reading and commenting. But so what, it was still worthwhile!

Also visit my website; Compact purses
Nereida commented on 18-Sep-2017 03:37 AM
If you desire to get a great deal from this piece of writing then you have to apply these strategies to your won blog.


my web pagePandora jewellery
Breanna commented on 18-Sep-2017 05:37 PM
Heya i'm for the first time here. I came across this board and I find It really useful & it helped me out much.

I hope to give something back and aid others like you aided me.

Here is my weblog;Pandora Bracelet sale price
Monroe commented on 18-Sep-2017 07:34 PM
I'm impressed, I have to admit. Seldom do I encounter a blog that's both educative and entertaining, and let me tell you, you've hit the nail on the head.

The issue is something that too few folks are speaking intelligently about. I am very happy I stumbled across this in my search for something relating to this.

Also visit my homepage -Ebay corporations sell
Gerald commented on 20-Sep-2017 07:52 AM
Good way of telling, and pleasant piece of writing to obtain information concerning my presentation subject matter, which i am going to deliver in school.


Feel free to surf to my homepage ...small business Online
Ruth commented on 21-Sep-2017 03:31 PM
This piece of writing is truly a fastidious one it assists new web viewers, who are wishing in favor of blogging.


Feel free to surf to my web siteBeads Carry
Courtney commented on 21-Sep-2017 09:51 PM
If you would like to take much from this piece of writing then you have to apply such methods to your won webpage.


Here is my web-site ...Www.Cosl.Com.Sg
Angela commented on 22-Sep-2017 02:27 AM
Wow! Thank you! I continuously wanted to write on my blog something like that.
Can I take a part of your post to my site?

Here is my blog;Frostfan.net
Michal commented on 22-Sep-2017 02:40 AM
Loving the information on this web site, you have done outstanding job on the content.


Look into my web-site:http://Doubledubs.Com/UserProfile/tabid/82/userId/3333759/Default.aspx
Glinda commented on 22-Sep-2017 11:29 PM
I was curious if you ever considered changing the page layout of your site?
Its very well written; I love what youve got to say. But maybe you could a little more in the way of content so people could connect with it better. Youve got an awful lot of text for only having one or two images. Maybe you could space it out better?

My page -Black friday freebies
Quinton commented on 22-Sep-2017 11:49 PM
This article is in fact a good one it helps new web users, who are wishing for blogging.



my homepage:Michael kors Watch rose gold and white
Hildred commented on 25-Sep-2017 03:54 AM
Heya i'm for the first time here. I came across this board and I find It truly useful & it helped me out much.
I hope to give something back and help others like you helped me.

Also visit my web site -behind michael kors
Ron commented on 25-Sep-2017 12:07 PM
It's amazing for me to have a web site, which is helpful in favor of my experience.
thanks admin

Also visit my site -www.cosl.com.Sg
Sara commented on 26-Sep-2017 04:06 PM
Having read this I believed it was really enlightening.
I appreciate you finding the time and energy to put this content together. I once again find myself spending a lot of time both reading and commenting. But so what, it was still worthwhile!

Feel free to visit my web-site; pandora bracelets clearance
Darrell commented on 27-Sep-2017 11:37 PM
It�s nearly impossible to find experienced people in this particular subject, but you seem like you know what you�re talking about!
Thanks

My webpage ::http://mercacoso.cnt.es/
Bernadette commented on 28-Sep-2017 01:34 AM
Loving the information on this web site, you have done great job on the articles.



Have a look at my weblog:Research Tools
Blanca commented on 28-Sep-2017 11:24 PM
Hey! This is kind of off topic but I need some guidance from an established blog.
Is it hard to set up your own blog? I'm not very techincal but I can figure things out pretty quick. I'm thinking about creating my own but I'm not sure where to start. Do you have any tips or suggestions? Thanks

Here is my web site -Charm Bracelets
Lucie commented on 28-Sep-2017 11:27 PM
I believe other website proprietors should take this internet site as an example, very clean and excellent user pleasant style and design.

My homepage ...Policy michael
Reta commented on 29-Sep-2017 02:33 AM
I'm amazed, I have to admit. Seldom do I come across a blog that's both educative and engaging, and let me tell you, you've hit the nail on the head.

The problem is an issue that not enough folks are speaking intelligently about. I'm very happy that I came across this during my search for something regarding this.

Also visit my page;Shopping Plan
Antonio commented on 29-Sep-2017 10:02 AM
I am not sure where you are getting your information, but great topic.
I needs to spend some time learning much more or understanding more. Thanks for wonderful information I was looking for this information for my mission.

Also visit my weblog: Leftover Items
Leonel commented on 29-Sep-2017 10:44 AM
Hmm is anyone else having problems with the images on this blog loading?

I'm trying to figure out if its a problem on my end or if it's the blog. Any suggestions would be greatly appreciated.

my webpage :: Michael kors watch band

Post a Comment




Captcha Image

Trackback Link
http://datascientists.com/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
Meri commented on 16-Sep-2017 12:28 AM
F*ckin' amazing things here. I'm very satisfied to look your post.
Thanks so much and i am looking ahead to touch you. Will you please drop me a e-mail?

Review my websitevital favored cool
what is a roth 401k contribution commented on 16-Sep-2017 09:53 AM
Employer contributions are tax deductible.
Christina commented on 16-Sep-2017 05:16 PM
Hurrah, that's what I was looking for, what a stuff! present here at this webpage, thanks admin of this website.


Feel free to surf to my web pagemichael kors Womens watches
Reda commented on 17-Sep-2017 02:04 AM
Wow, that's what I was exploring for, what a stuff! existing here at this blog, thanks admin of this website.



Here is my web siteFall Watch Trends
Odette commented on 18-Sep-2017 01:16 AM
Having read this I believed it was really enlightening. I appreciate you spending some time and effort to put this informative article together.
I once again find myself spending a lot of time both reading and commenting. But so what, it was still worthwhile!

Also visit my website; Compact purses
Nereida commented on 18-Sep-2017 03:37 AM
If you desire to get a great deal from this piece of writing then you have to apply these strategies to your won blog.


my web pagePandora jewellery
Breanna commented on 18-Sep-2017 05:37 PM
Heya i'm for the first time here. I came across this board and I find It really useful & it helped me out much.

I hope to give something back and aid others like you aided me.

Here is my weblog;Pandora Bracelet sale price
Monroe commented on 18-Sep-2017 07:34 PM
I'm impressed, I have to admit. Seldom do I encounter a blog that's both educative and entertaining, and let me tell you, you've hit the nail on the head.

The issue is something that too few folks are speaking intelligently about. I am very happy I stumbled across this in my search for something relating to this.

Also visit my homepage -Ebay corporations sell
Gerald commented on 20-Sep-2017 07:52 AM
Good way of telling, and pleasant piece of writing to obtain information concerning my presentation subject matter, which i am going to deliver in school.


Feel free to surf to my homepage ...small business Online
Ruth commented on 21-Sep-2017 03:31 PM
This piece of writing is truly a fastidious one it assists new web viewers, who are wishing in favor of blogging.


Feel free to surf to my web siteBeads Carry
Courtney commented on 21-Sep-2017 09:51 PM
If you would like to take much from this piece of writing then you have to apply such methods to your won webpage.


Here is my web-site ...Www.Cosl.Com.Sg
Angela commented on 22-Sep-2017 02:27 AM
Wow! Thank you! I continuously wanted to write on my blog something like that.
Can I take a part of your post to my site?

Here is my blog;Frostfan.net
Michal commented on 22-Sep-2017 02:40 AM
Loving the information on this web site, you have done outstanding job on the content.


Look into my web-site:http://Doubledubs.Com/UserProfile/tabid/82/userId/3333759/Default.aspx
Glinda commented on 22-Sep-2017 11:29 PM
I was curious if you ever considered changing the page layout of your site?
Its very well written; I love what youve got to say. But maybe you could a little more in the way of content so people could connect with it better. Youve got an awful lot of text for only having one or two images. Maybe you could space it out better?

My page -Black friday freebies
Quinton commented on 22-Sep-2017 11:49 PM
This article is in fact a good one it helps new web users, who are wishing for blogging.



my homepage:Michael kors Watch rose gold and white
Hildred commented on 25-Sep-2017 03:54 AM
Heya i'm for the first time here. I came across this board and I find It truly useful & it helped me out much.
I hope to give something back and help others like you helped me.

Also visit my web site -behind michael kors
Ron commented on 25-Sep-2017 12:07 PM
It's amazing for me to have a web site, which is helpful in favor of my experience.
thanks admin

Also visit my site -www.cosl.com.Sg
Sara commented on 26-Sep-2017 04:06 PM
Having read this I believed it was really enlightening.
I appreciate you finding the time and energy to put this content together. I once again find myself spending a lot of time both reading and commenting. But so what, it was still worthwhile!

Feel free to visit my web-site; pandora bracelets clearance
Darrell commented on 27-Sep-2017 11:37 PM
It�s nearly impossible to find experienced people in this particular subject, but you seem like you know what you�re talking about!
Thanks

My webpage ::http://mercacoso.cnt.es/
Bernadette commented on 28-Sep-2017 01:34 AM
Loving the information on this web site, you have done great job on the articles.



Have a look at my weblog:Research Tools
Blanca commented on 28-Sep-2017 11:24 PM
Hey! This is kind of off topic but I need some guidance from an established blog.
Is it hard to set up your own blog? I'm not very techincal but I can figure things out pretty quick. I'm thinking about creating my own but I'm not sure where to start. Do you have any tips or suggestions? Thanks

Here is my web site -Charm Bracelets
Lucie commented on 28-Sep-2017 11:27 PM
I believe other website proprietors should take this internet site as an example, very clean and excellent user pleasant style and design.

My homepage ...Policy michael
Reta commented on 29-Sep-2017 02:33 AM
I'm amazed, I have to admit. Seldom do I come across a blog that's both educative and engaging, and let me tell you, you've hit the nail on the head.

The problem is an issue that not enough folks are speaking intelligently about. I'm very happy that I came across this during my search for something regarding this.

Also visit my page;Shopping Plan
Antonio commented on 29-Sep-2017 10:02 AM
I am not sure where you are getting your information, but great topic.
I needs to spend some time learning much more or understanding more. Thanks for wonderful information I was looking for this information for my mission.

Also visit my weblog: Leftover Items
Leonel commented on 29-Sep-2017 10:44 AM
Hmm is anyone else having problems with the images on this blog loading?

I'm trying to figure out if its a problem on my end or if it's the blog. Any suggestions would be greatly appreciated.

my webpage :: Michael kors watch band

Post a Comment




Captcha Image

Trackback Link
http://datascientists.com/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.