« Airing Sun Dirty... | Main | Open Letter to those... »

20040613 Sunday June 13, 2004

Who analyzes the Analysts??

I had been thinking of this topic for a while and Kieth Bierman's blog entry finally got me to blog on this.

Everything in this blog entry is 100% opinion since I have never worked with an analyst, but yes, I have opinions.

There is nothing more than I would like to see than an Analyst report with a link that says "Analyze this analysis". Click on the link and it takes you to a third-party page that says "Based on historical accuracy of this company on this topic, and this analyst in particular, there is a .4 probability that this this analysis actually means something." If you know of a web site like this, please comment on it so I can bookmark it.

And what's up with the "probability" thing? I personally think it is plausible deniability. When analysts started getting pinned to the wall, they added a "probability" factor. Now they have an out.

And are analysts completely on the level? There are those analysts who get paid to make a point. Companies pay analysts to make a point in their favor. Not coming to that conclusion means they will no longer be of value. Now, of course, coming to that point may be the 100% correct, and then the competition debunks it with their own analysis from another company (analyst shopping) who makes a 100% accurate counter point (ah, the chaos of statistics). I associate a .5 probability with this point so i have plausible deniability. How did I come up with .5? SWAG, man, SWAG. But at least I disclosed how I came about it.

Here is where I make my "reasoned argument". I remember back in ~1990 when Windows NT was being talked about taking over the world. My girlfriend at the time (now my wife) saw it on a magazine rack and said "I saw a Byte magazine cover which said, 'Is Unix Dead?'". "Uh oh, are you going to have a job next year?" Ironically, Byte magazine is dead (although byte.com is still around). Is this the enforcement of accountability for journalists and analysts? Poor analysis leads to market demand for something different? Perhaps. There are many more examples, but this is a blog, not an editorial.

After all of the blogging I have just done, would I ever want to be an analyst to "make things right"? No. I have to give my hat off to them for putting their reputation on the line. Analyst = imperfection. No one individual or company can be right 100% of the time, but where can i go to find out how often they are right so I can make a "reasoned decision"??

(2004-06-13 13:24:04.0) Permalink Comments [4]

Comments:

My favorite comment about a particular large analyst is that they predicted, sometime near Windows NT's launch, that OS/2 was the way of the future so you may as well just get on the bandwagon. Speaking of predictions, C|Net has a video of their latest conference with a certain Chief Architect saying we'll havespeech recognition in the next 10 years. http://news.com.com/1606-2-741258.html Anyone want to place any bets? I'd obviously love to see it, but a good PhD friend of mine who specializes in this area says it's really really difficult...

Posted by Matt Ingenthron on June 13, 2004 at 10:53 PM PDT #

Annotea? http://www.w3.org/2001/Annotea/

Posted by Jeremy Dunck on June 14, 2004 at 06:11 AM PDT #

Hi Matt: I have the memory of a certain CTO coming into my office to tell me that XML was yet another Microsoft attempt to FUD the market, and his boss, the CEO, telling me that XML was too slow and would make the customer unhappy. In neither case were they right, and in both cases, those mistakes cost the company market share. Being right and being capable are not the same thing. However, if you want to know what will be possible in ten years, it has to be working in a lab somewhere today. The technology market has about a ten year latency from lab to Best Buy. We'll have speech recognition in about ten years.

Posted by Len Bullard on June 14, 2004 at 07:11 AM PDT #

I'm haven't figured out how to enable formatted comments, so I apologize for the formatting. I just read Jon Udell's comments on this blog (http://weblog.infoworld.com/udell/2004/06/14.html). He makes some good points regarding the actual article and he has given me the title to my next blog entry "The story behind the story." He is probably correct about the "long run". But before then many companies have committed to a decision based on an analysis and perhaps some companies targed by an analysis get ruined. This is all pure speculation, of course. But I think knowing "up-front" the probable accuracy of an analysis would be beneficial. Also, dag-nab-it, I will have to sign up with infoworld to blog a response "where can I get an electronic image of that infamous byte magazine cover?" The cover isn't for professional reasons, it's to show my wife I'm still heading down the right path, professionaly speaking. From a personal perspective, I am definitely down the right path with her (I better get brownie points for that)

Posted by John Clingan on June 14, 2004 at 10:53 AM PDT #

Post a Comment:

Comments are closed for this entry.