Trending Topics

  1. Real VS pretentious data scientists Troy Sadkowsky 01-Mar-2017

Latest News from DS

From Bhutan 19-Feb-2017

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
Real Code commented on 13-Dec-2017 11:31 PM
You made some decent points there. I looked on the internet for the issue and found most individuals will go along with with your website.
Minnie commented on 19-Dec-2017 01:59 PM
Heya! I just wanted to ask if you ever have
any issues with hackers? My last blog (wordpress) was hacked and I ended up losing many months of hard work due to no back up.
Do you have any methods to stop hackers?
Theron Vigliotti commented on 24-Dec-2017 01:28 AM
Hello. In the aliexpress site you can find the cheapest products in the world !! Details here-> http://bit.ly/2kyBN4O Thank you very much !!
Emilio commented on 24-Dec-2017 06:56 PM
Why visitors still make use of to read news papers when in this technological globe everything is accessible on net?
situs poker commented on 25-Dec-2017 07:56 PM
Oh my goodness! Incredible article dude! Many thanks, However I am going through issues with your RSS.
I don't know why I am unable to subscribe to it. Is there anybody getting
the same RSS problems? Anyone who knows the answer will you kindly respond?
Thanx!!
situs poker terpercaya commented on 25-Dec-2017 09:54 PM
Have you ever thought about writing an e-book or guest
authoring on other blogs? I have a blog based upon on the same ideas you discuss and would really
like to have you share some stories/information. I know my audience would appreciate your work.
If you are even remotely interested, feel free to send
me an e-mail.
situs poker terbaik commented on 25-Dec-2017 11:35 PM
Woah! I'm really enjoying the template/theme of this site.
It's simple, yet effective. A lot of times it's hard to get that "perfect balance" between superb usability
and visual appearance. I must say that you've done a fantastic job with this.
Additionally, the blog loads very quick for me on Opera.
Outstanding Blog!
agen poker terpercaya commented on 26-Dec-2017 04:49 PM
Hey would you mind sharing which blog platform you're working
with? I'm going to start my own blog in the near future but I'm having a tough
time deciding between BlogEngine/Wordpress/B2evolution and
Drupal. The reason I ask is because your design seems different then most blogs and I'm looking
for something completely unique.
P.S Sorry for being off-topic but I had to ask!
Rolando commented on 27-Dec-2017 12:30 AM
you are truly a just right webmaster. The website loading pace is incredible.
It kind of feels that you are doing any unique trick. In addition, The contents are masterwork. you have performed a excellent job in this subject!

Stop by my homepage - thus calgary Real
Carmel commented on 09-Jan-2018 04:46 AM
Thank you for any other informative web site.
The place else may I am getting that kind of information written in such a perfect means? I've a mission that I'm simply now running on, and I have been on the look out for such information.

my blog post :: ebay seller account
Robin commented on 11-Jan-2018 12:10 AM
Hi there friends, good article and fastidious arguments commented here, I am genuinely enjoying by these.


Feel free to visit my webpage;michael Kors watch men unboxing
Devin commented on 12-Jan-2018 04:42 AM
hi!,I love your writing very a lot! share we keep up a correspondence extra about your article on AOL?
I require an expert on this house to resolve my problem. Maybe that is you! Taking a look forward to look you.

Look into my web site :: Costume jewelry
Adriene commented on 12-Jan-2018 11:59 AM
Greetings I am so glad I found your web site, I really found you by accident, while I was researching on Aol for something else, Regardless I am here now and would just like to say thanks for a incredible post and a all round interesting blog (I also love the theme/design), I don't have time to read through it all at the minute but I have book-marked it and also included your RSS feeds, so when I have time I will be back to read a great deal more, Please do keep up the fantastic work.



Also visit my web page ... black friday Questions
Ivy commented on 13-Jan-2018 09:55 AM
I visited a lot of website but I believe this one has got something special in it.


Feel free to visit my webpage -pandora charms vancouver
Valeria commented on 14-Jan-2018 05:57 AM
Excellent blog! Do you have any recommendations for aspiring writers?

I'm hoping to start my own website soon but I'm a little lost on everything. Would you suggest starting with a free platform like Wordpress or go for a paid option? There are so many choices out there that I'm totally overwhelmed .. Any ideas? Bless you!

Feel free to surf to my blog -christmas gift card deals 2010
Geraldo commented on 14-Jan-2018 11:18 PM
I usually do not drop a bunch of comments, however I browsed some comments on this page How Can Thick Data Improve the Way We Use Big Data?.
I do have a few questions for you if it's okay. Could it be only me or do a few of these remarks come across like they are written by brain dead visitors? :-P And, if you are writing on other places, I'd like to keep up with everything new you have to post. Would you make a list of the complete urls of all your public sites like your Facebook page, twitter feed, or linkedin profile?



Feel free to surf to my web site ::http://www.wiki.mrmoseley.Co.uk/5_Critical_Guidelines_For_Naming_A_Business
Dinah commented on 15-Jan-2018 05:03 AM
Good info and right to the point. I don't know if this is actually the best place to ask but do you folks have any thoughts on where to get some professional writers?
Thanks in advance :)

Feel free to surf to my webpage; bookkeeping For dummies
Rachael commented on 15-Jan-2018 09:22 PM
What's up friends, pleasant piece of writing and fastidious arguments commented here, I am genuinely enjoying by these.



Here is my web blog -Fine Watches
Katharina commented on 16-Jan-2018 01:29 AM
I am not sure where you are getting your information, but great topic.
I needs to spend some time learning more or understanding more. Thanks for magnificent info I was looking for this information for my mission.

Review my blog post :: Cool Worpress Plugins
JDM Web Technologies commented on 16-Jan-2018 08:06 PM
I love this post. I really like to say thanks for all these nice post.

Ahmad commented on 17-Jan-2018 04:41 AM
I was wondering if you ever considered changing the structure of your site?
Its very well written; I love what youve got to say. But maybe you could a little more in the way of content so people could connect with it better. Youve got an awful lot of text for only having 1 or 2 pictures. Maybe you could space it out better?

Have a look at my weblog ...Successful items
Serena commented on 17-Jan-2018 11:35 AM
If you want to obtain a good deal from this paragraph then you have to apply such techniques to your won blog.



my blog:buying Beads online
Dwain commented on 17-Jan-2018 11:17 PM
Hey! This is kind of off topic but I need some guidance from an established blog.
Is it very hard to set up your own blog? I'm not very techincal but I can figure things out pretty quick. I'm thinking about setting up my own but I'm not sure where to begin. Do you have any points or suggestions? Many thanks

My web-site;Quality watch
Mirta commented on 18-Jan-2018 01:53 AM
Excellent way of explaining, and nice paragraph to obtain facts on the topic of my presentation topic, which i am going to present in institution of higher education.

My web page ...pandora bracelets for women charm
Charlene commented on 19-Jan-2018 12:25 AM
Greetings from California! I'm bored to death at work so I decided to browse your website on my iphone during lunch break.
I enjoy the info you present here and can't wait to take a look when I get home. I'm shocked at how quick your blog loaded on my cell phone .. I'm not even using WIFI, just 3G .. Anyways, amazing site!

My website:party ebay

Post a Comment




Captcha Image

Trackback Link
http://datascientists.com/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
Real Code commented on 13-Dec-2017 11:31 PM
You made some decent points there. I looked on the internet for the issue and found most individuals will go along with with your website.
Minnie commented on 19-Dec-2017 01:59 PM
Heya! I just wanted to ask if you ever have
any issues with hackers? My last blog (wordpress) was hacked and I ended up losing many months of hard work due to no back up.
Do you have any methods to stop hackers?
Theron Vigliotti commented on 24-Dec-2017 01:28 AM
Hello. In the aliexpress site you can find the cheapest products in the world !! Details here-> http://bit.ly/2kyBN4O Thank you very much !!
Emilio commented on 24-Dec-2017 06:56 PM
Why visitors still make use of to read news papers when in this technological globe everything is accessible on net?
situs poker commented on 25-Dec-2017 07:56 PM
Oh my goodness! Incredible article dude! Many thanks, However I am going through issues with your RSS.
I don't know why I am unable to subscribe to it. Is there anybody getting
the same RSS problems? Anyone who knows the answer will you kindly respond?
Thanx!!
situs poker terpercaya commented on 25-Dec-2017 09:54 PM
Have you ever thought about writing an e-book or guest
authoring on other blogs? I have a blog based upon on the same ideas you discuss and would really
like to have you share some stories/information. I know my audience would appreciate your work.
If you are even remotely interested, feel free to send
me an e-mail.
situs poker terbaik commented on 25-Dec-2017 11:35 PM
Woah! I'm really enjoying the template/theme of this site.
It's simple, yet effective. A lot of times it's hard to get that "perfect balance" between superb usability
and visual appearance. I must say that you've done a fantastic job with this.
Additionally, the blog loads very quick for me on Opera.
Outstanding Blog!
agen poker terpercaya commented on 26-Dec-2017 04:49 PM
Hey would you mind sharing which blog platform you're working
with? I'm going to start my own blog in the near future but I'm having a tough
time deciding between BlogEngine/Wordpress/B2evolution and
Drupal. The reason I ask is because your design seems different then most blogs and I'm looking
for something completely unique.
P.S Sorry for being off-topic but I had to ask!
Rolando commented on 27-Dec-2017 12:30 AM
you are truly a just right webmaster. The website loading pace is incredible.
It kind of feels that you are doing any unique trick. In addition, The contents are masterwork. you have performed a excellent job in this subject!

Stop by my homepage - thus calgary Real
Carmel commented on 09-Jan-2018 04:46 AM
Thank you for any other informative web site.
The place else may I am getting that kind of information written in such a perfect means? I've a mission that I'm simply now running on, and I have been on the look out for such information.

my blog post :: ebay seller account
Robin commented on 11-Jan-2018 12:10 AM
Hi there friends, good article and fastidious arguments commented here, I am genuinely enjoying by these.


Feel free to visit my webpage;michael Kors watch men unboxing
Devin commented on 12-Jan-2018 04:42 AM
hi!,I love your writing very a lot! share we keep up a correspondence extra about your article on AOL?
I require an expert on this house to resolve my problem. Maybe that is you! Taking a look forward to look you.

Look into my web site :: Costume jewelry
Adriene commented on 12-Jan-2018 11:59 AM
Greetings I am so glad I found your web site, I really found you by accident, while I was researching on Aol for something else, Regardless I am here now and would just like to say thanks for a incredible post and a all round interesting blog (I also love the theme/design), I don't have time to read through it all at the minute but I have book-marked it and also included your RSS feeds, so when I have time I will be back to read a great deal more, Please do keep up the fantastic work.



Also visit my web page ... black friday Questions
Ivy commented on 13-Jan-2018 09:55 AM
I visited a lot of website but I believe this one has got something special in it.


Feel free to visit my webpage -pandora charms vancouver
Valeria commented on 14-Jan-2018 05:57 AM
Excellent blog! Do you have any recommendations for aspiring writers?

I'm hoping to start my own website soon but I'm a little lost on everything. Would you suggest starting with a free platform like Wordpress or go for a paid option? There are so many choices out there that I'm totally overwhelmed .. Any ideas? Bless you!

Feel free to surf to my blog -christmas gift card deals 2010
Geraldo commented on 14-Jan-2018 11:18 PM
I usually do not drop a bunch of comments, however I browsed some comments on this page How Can Thick Data Improve the Way We Use Big Data?.
I do have a few questions for you if it's okay. Could it be only me or do a few of these remarks come across like they are written by brain dead visitors? :-P And, if you are writing on other places, I'd like to keep up with everything new you have to post. Would you make a list of the complete urls of all your public sites like your Facebook page, twitter feed, or linkedin profile?



Feel free to surf to my web site ::http://www.wiki.mrmoseley.Co.uk/5_Critical_Guidelines_For_Naming_A_Business
Dinah commented on 15-Jan-2018 05:03 AM
Good info and right to the point. I don't know if this is actually the best place to ask but do you folks have any thoughts on where to get some professional writers?
Thanks in advance :)

Feel free to surf to my webpage; bookkeeping For dummies
Rachael commented on 15-Jan-2018 09:22 PM
What's up friends, pleasant piece of writing and fastidious arguments commented here, I am genuinely enjoying by these.



Here is my web blog -Fine Watches
Katharina commented on 16-Jan-2018 01:29 AM
I am not sure where you are getting your information, but great topic.
I needs to spend some time learning more or understanding more. Thanks for magnificent info I was looking for this information for my mission.

Review my blog post :: Cool Worpress Plugins
JDM Web Technologies commented on 16-Jan-2018 08:06 PM
I love this post. I really like to say thanks for all these nice post.

Ahmad commented on 17-Jan-2018 04:41 AM
I was wondering if you ever considered changing the structure of your site?
Its very well written; I love what youve got to say. But maybe you could a little more in the way of content so people could connect with it better. Youve got an awful lot of text for only having 1 or 2 pictures. Maybe you could space it out better?

Have a look at my weblog ...Successful items
Serena commented on 17-Jan-2018 11:35 AM
If you want to obtain a good deal from this paragraph then you have to apply such techniques to your won blog.



my blog:buying Beads online
Dwain commented on 17-Jan-2018 11:17 PM
Hey! This is kind of off topic but I need some guidance from an established blog.
Is it very hard to set up your own blog? I'm not very techincal but I can figure things out pretty quick. I'm thinking about setting up my own but I'm not sure where to begin. Do you have any points or suggestions? Many thanks

My web-site;Quality watch
Mirta commented on 18-Jan-2018 01:53 AM
Excellent way of explaining, and nice paragraph to obtain facts on the topic of my presentation topic, which i am going to present in institution of higher education.

My web page ...pandora bracelets for women charm
Charlene commented on 19-Jan-2018 12:25 AM
Greetings from California! I'm bored to death at work so I decided to browse your website on my iphone during lunch break.
I enjoy the info you present here and can't wait to take a look when I get home. I'm shocked at how quick your blog loaded on my cell phone .. I'm not even using WIFI, just 3G .. Anyways, amazing site!

My website:party ebay

Post a Comment




Captcha Image

Trackback Link
http://datascientists.com/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.