




This post discusses a study that revealed surprising results about what happens when sentiment analysis instructions are unclear. The post Sentiment Analysis: When Humans Are Not More Reliable appeared first on VMR. Sentiment Analysis: When Humans Are Not More Reliable was first posted on April 28, 2010 at 10:47 pm.©2015 "VMR". Use of this feed is for personal non-commercial use only. If you are not reading this article in your feed reader, then the site is guilty of copyright infringement. Please contact me at hugh@vmrcommunications.com
But questions remain as to why it makes sense (which I believe it does, by the way) to hire humans to analyze sentiment as opposed to relying solely on computer algorithms which have been shown to be less reliable than humans.
One insider asking some very good questions – and providing intriguing answers too – is Zoe Siskos, who, in a comment on Jason’s blog , referenced a recent study she co-authored with five of her colleagues from Syncapse Corporation ‘s Measurement Science Team. I’m not going to go into all the details here (it was a brilliantly conceived, well-designed and highly scientific study) but here are the conclusions I came to (slightly different than what the authors came to):
1. Ambiguity in the instructions given from CMOs to human analysts need to be crystal clear to prevent tonality scores that are competely inaccurate.
2. Unambiguous instructions will be much easier to formulate if your enterprise has clear business goals that tie directly into what Jeremiah Owyang of Altimeter Group insightfully referred in a special report as the 5Ms and the 18 Social Uses Cases.
CMOs and Service Providers: What do you think: Are human analysts worth hiring for sentiment analytics or not? How is your company dealing what sentiment analytics? Are you using only auto sentiment analysis ? Only human? A combination? Not at all?
Photo Credit: Second Life Resident Torley Linden. Visit Ambleside.
The post Sentiment Analysis: When Humans Are Not More Reliable appeared first on VMR.