Trending Topics

  1. Real VS pretentious data scientists Troy Sadkowsky 01-Mar-2017

Latest News from DS

From Bhutan 19-Feb-2017

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
Amie commented on 12-Oct-2018 01:38 AM
If you would like to increase your knowledge just keep visiting this site and be updated with the newest information posted here.


Feel free to surf to my web site ...quick Weight
Salina commented on 12-Oct-2018 02:43 AM
The knowledge is very exciting.

My site - Alveo Najtaniej
average cost Of divorce in missouri commented on 12-Oct-2018 02:44 AM
It's remarkable designed for me to have a site, which is useful
designed for my experience. thanks admin
Marisa commented on 12-Oct-2018 02:49 AM
say thanks to so a lot for your website it assists a lot.



Take a look at my blog post ...minecraft free download 2018
custom usb wristband commented on 12-Oct-2018 03:15 AM
I love what you guys are up too. This sort of clever work and reporting!
Keep up the amazing works guys I've added you guys to our blogroll. https://www.silicon-wristband.com/category/usb-flash-drives
Automotive ecu repairs commented on 12-Oct-2018 03:39 AM
Today, I went to the beqchfront with my children. I found a sea shell and gave
it to my 4 year old daugter and said "You can hear the ocean if you put this to your ear." She put the shell to her eear and screamed.
There waas a hermit crab inside and it pinched her ear.
She never wants to goo back! LoL I know this is entirelky off ttopic but I had to tell someone!
Whitney Alegi commented on 12-Oct-2018 04:03 AM
wireless routers are very necessary nowadays because we do not want so many wires running around the home*
Dean Kavadias commented on 12-Oct-2018 04:03 AM
Magnificent web site. A lot of helpful information here. I am sending it to some pals ans additionally sharing in delicious. And obviously, thanks for your sweat!
Mark Etringer commented on 12-Oct-2018 04:12 AM
Following study a few of the weblog posts on your internet site now, and I really like your way of blogging. I bookmarked it to my bookmark web site list and will probably be checking back soon. Pls check out my web internet site at the same time and let me know what you think.
Jerrell commented on 12-Oct-2018 04:14 AM
Thanks regarding delivering this kind of very good articles.


Feel free to visit my blog postminecraft free download 2018
https://giacmosuaviet.dlblog.org commented on 12-Oct-2018 04:14 AM
Hey! Someone in my Facebook group shared this website with us so I came to check it out.

I'm definitely enjoying the information. I'm book-marking
and will be tweeting this to my followers! Excellent blog and
brilliant design.
Meddata Health commented on 12-Oct-2018 04:20 AM
Hello there! This post could not be written much better!
Looking at this post reminds me of my previous roommate!
He continually kept talking about this. I am going to send this information to him.
Fairly certain he will have a good read. Thanks for sharing!
transfer belt conveyor commented on 12-Oct-2018 04:21 AM
It's amazing to go to see this site and reading the views of
all mates about this paragraph, while I am also zealous of getting
experience.
locksmith tampa commented on 12-Oct-2018 04:34 AM
Does your website have a contact page? I'm having a tough time locating it but, I'd
like to shoot you an email. I've got some recommendations for your blog you might be interested
in hearing. Either way, great blog and I look forward to seeing it grow over
time.
salary online Consultant commented on 12-Oct-2018 05:02 AM
Howdy! I know this is kinda off topic but I was wondering if you knew where I could get
a captcha plugin for my comment form? I'm using the same blog platform
as yours and I'm having problems finding one? Thanks a lot!
Carina commented on 12-Oct-2018 05:06 AM
But, skilled poker players know this golden rule about showdown value and use it as being a strong the answer to win at showdown. Which means that you are able to play mentally stimulating games along with somebody residing alternatively around the world by just near your pc.
Drosselmeyer finished first for one and placed second inside latter two against a relatively competent field that composed of Stay Thirsty, Bird - Run and Flat Out.

Look at my website ...bandarmacau
Mitchell commented on 12-Oct-2018 05:07 AM
I enjoy this site - its so usefull and helpfull.

Also visit my web page ::minecraft free download 2018
forex advertising network commented on 12-Oct-2018 05:57 AM
Way cool! Some extremely valid points! I appreciate you writing this post plus
the rest of the website is very good.
Togel Singapore commented on 12-Oct-2018 06:29 AM
My brother suggested I may like this blog. He was totally
right. This publish actually made my day. You
cann't consider simply how a lot time I had spent for this information! Thank you!
MemberQQ commented on 12-Oct-2018 06:43 AM
I drop a comment when I like a post on a website or if I
have somethinjg to add to the conversation. Usually it is caused by thee fir communicated in the post I looked at.
And after this article How Can Thick Data Improve the Way We Use Big Data?.
Iwas excited enough to drop a thought :) I actually do
have 2 questions for you if it's allright.
Could it be simply me or does it seem like a few of these comments
come across like cokming from brain dead people? :
-P And, if you are writing on other social sites, I'd
like to follow you. Would you make a list
all of your communal pages like your twitter feed, Facebook page or linkedin profile?
locksmith tampa commented on 12-Oct-2018 06:54 AM
Hello There. I found your blog the use of msn. This is
an extremely neatly written article. I will make sure to bookmark it and return to read
extra of your useful information. Thanks for the post.
I'll definitely comeback.
Marilynn commented on 12-Oct-2018 07:14 AM
Zioła Alveo I Produkty Akuny Bez … benefit from looking through your internet site.
Thank you!
Ernestine commented on 12-Oct-2018 07:40 AM
I appreciate the info on your web sites. Thanks for your time!


Feel free to visit my blog post ...cna salary florida
soi keo commented on 12-Oct-2018 07:56 AM
I think this is one of the most vital info for me. And i
am glad reading your article. But should remark on few general things, The web site style
is wonderful, the articles is really nice : D. Good job, cheers
locksmith tampa commented on 12-Oct-2018 08:31 AM
Right now it looks like Expression Engine is the top blogging platform available right now.
(from what I've read) Is that what you're using on your blog?

Post a Comment




Captcha Image

Trackback Link
http://datascientists.com/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
Amie commented on 12-Oct-2018 01:38 AM
If you would like to increase your knowledge just keep visiting this site and be updated with the newest information posted here.


Feel free to surf to my web site ...quick Weight
Salina commented on 12-Oct-2018 02:43 AM
The knowledge is very exciting.

My site - Alveo Najtaniej
average cost Of divorce in missouri commented on 12-Oct-2018 02:44 AM
It's remarkable designed for me to have a site, which is useful
designed for my experience. thanks admin
Marisa commented on 12-Oct-2018 02:49 AM
say thanks to so a lot for your website it assists a lot.



Take a look at my blog post ...minecraft free download 2018
custom usb wristband commented on 12-Oct-2018 03:15 AM
I love what you guys are up too. This sort of clever work and reporting!
Keep up the amazing works guys I've added you guys to our blogroll. https://www.silicon-wristband.com/category/usb-flash-drives
Automotive ecu repairs commented on 12-Oct-2018 03:39 AM
Today, I went to the beqchfront with my children. I found a sea shell and gave
it to my 4 year old daugter and said "You can hear the ocean if you put this to your ear." She put the shell to her eear and screamed.
There waas a hermit crab inside and it pinched her ear.
She never wants to goo back! LoL I know this is entirelky off ttopic but I had to tell someone!
Whitney Alegi commented on 12-Oct-2018 04:03 AM
wireless routers are very necessary nowadays because we do not want so many wires running around the home*
Dean Kavadias commented on 12-Oct-2018 04:03 AM
Magnificent web site. A lot of helpful information here. I am sending it to some pals ans additionally sharing in delicious. And obviously, thanks for your sweat!
Mark Etringer commented on 12-Oct-2018 04:12 AM
Following study a few of the weblog posts on your internet site now, and I really like your way of blogging. I bookmarked it to my bookmark web site list and will probably be checking back soon. Pls check out my web internet site at the same time and let me know what you think.
Jerrell commented on 12-Oct-2018 04:14 AM
Thanks regarding delivering this kind of very good articles.


Feel free to visit my blog postminecraft free download 2018
https://giacmosuaviet.dlblog.org commented on 12-Oct-2018 04:14 AM
Hey! Someone in my Facebook group shared this website with us so I came to check it out.

I'm definitely enjoying the information. I'm book-marking
and will be tweeting this to my followers! Excellent blog and
brilliant design.
Meddata Health commented on 12-Oct-2018 04:20 AM
Hello there! This post could not be written much better!
Looking at this post reminds me of my previous roommate!
He continually kept talking about this. I am going to send this information to him.
Fairly certain he will have a good read. Thanks for sharing!
transfer belt conveyor commented on 12-Oct-2018 04:21 AM
It's amazing to go to see this site and reading the views of
all mates about this paragraph, while I am also zealous of getting
experience.
locksmith tampa commented on 12-Oct-2018 04:34 AM
Does your website have a contact page? I'm having a tough time locating it but, I'd
like to shoot you an email. I've got some recommendations for your blog you might be interested
in hearing. Either way, great blog and I look forward to seeing it grow over
time.
salary online Consultant commented on 12-Oct-2018 05:02 AM
Howdy! I know this is kinda off topic but I was wondering if you knew where I could get
a captcha plugin for my comment form? I'm using the same blog platform
as yours and I'm having problems finding one? Thanks a lot!
Carina commented on 12-Oct-2018 05:06 AM
But, skilled poker players know this golden rule about showdown value and use it as being a strong the answer to win at showdown. Which means that you are able to play mentally stimulating games along with somebody residing alternatively around the world by just near your pc.
Drosselmeyer finished first for one and placed second inside latter two against a relatively competent field that composed of Stay Thirsty, Bird - Run and Flat Out.

Look at my website ...bandarmacau
Mitchell commented on 12-Oct-2018 05:07 AM
I enjoy this site - its so usefull and helpfull.

Also visit my web page ::minecraft free download 2018
forex advertising network commented on 12-Oct-2018 05:57 AM
Way cool! Some extremely valid points! I appreciate you writing this post plus
the rest of the website is very good.
Togel Singapore commented on 12-Oct-2018 06:29 AM
My brother suggested I may like this blog. He was totally
right. This publish actually made my day. You
cann't consider simply how a lot time I had spent for this information! Thank you!
MemberQQ commented on 12-Oct-2018 06:43 AM
I drop a comment when I like a post on a website or if I
have somethinjg to add to the conversation. Usually it is caused by thee fir communicated in the post I looked at.
And after this article How Can Thick Data Improve the Way We Use Big Data?.
Iwas excited enough to drop a thought :) I actually do
have 2 questions for you if it's allright.
Could it be simply me or does it seem like a few of these comments
come across like cokming from brain dead people? :
-P And, if you are writing on other social sites, I'd
like to follow you. Would you make a list
all of your communal pages like your twitter feed, Facebook page or linkedin profile?
locksmith tampa commented on 12-Oct-2018 06:54 AM
Hello There. I found your blog the use of msn. This is
an extremely neatly written article. I will make sure to bookmark it and return to read
extra of your useful information. Thanks for the post.
I'll definitely comeback.
Marilynn commented on 12-Oct-2018 07:14 AM
Zioła Alveo I Produkty Akuny Bez … benefit from looking through your internet site.
Thank you!
Ernestine commented on 12-Oct-2018 07:40 AM
I appreciate the info on your web sites. Thanks for your time!


Feel free to visit my blog post ...cna salary florida
soi keo commented on 12-Oct-2018 07:56 AM
I think this is one of the most vital info for me. And i
am glad reading your article. But should remark on few general things, The web site style
is wonderful, the articles is really nice : D. Good job, cheers
locksmith tampa commented on 12-Oct-2018 08:31 AM
Right now it looks like Expression Engine is the top blogging platform available right now.
(from what I've read) Is that what you're using on your blog?

Post a Comment




Captcha Image

Trackback Link
http://datascientists.com/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.