Fact-Checking Me Fact-Checking Michael Pachter
August 23rd, 2007So Michael Pachter was wrong in his guess that the PS3 would beat out the 360 in July. Our friends at eat-sleep-game don’t have a problem with him; I, on the other hand, seem to bash him every chance I get. So I thought I’d consider the possibility that I’m wrong, and look a bit more objectively at his past predictions. Am I just being mean to the guy?
Using Kotaku’s Pachter Watch as a proxy for Pachter himself, I’ve taken the last 10 verifiable predictions that Pachter made in reverse chronological order in order to determine if those predictions were True, False, or Undetermined (e.g., if we haven’t hit the timeframe that the prediction took place in, or I can’t verify the answer). Here’s how Mr. Pachter did:
Of the last 10 such predictions, Pachter has gotten 3 correct, 4 wrong, and 3 unverifiable. In the worst case scenario, he’s got a 30% accuracy rate; in the best, 60%; and if the remaining 4 predictions turn out like the verifiable ones, he’s batting 40-50% at most. I don’t consider those to be very good results for a professional analyst, whose job, needless to say, is based on his ability to correctly analyze and make predictions about his industry specialty.
I should note that I still have nothing personal against Pachter. But I fail to see why someone should be paid a salary on the basis of such predictions if they’re not demonstrably better than a coin toss at getting them correct. You wouldn’t pay a mutual fund manager a 1.5% fee to track a stock index, because their “skill” is indistinguishable from luck. Why wouldn’t you base your gaming knowledge - and potentially your investment dollars, if you’re considering game company stock - on a similar premise?
Herewith, the predictions.
Prediction 1.) The PS3 would use its price drop to shoot ahead of the 360’s sales figures in July.
Verdict 1.) False. The 360 managed to pull ahead despite the drop in price.
Prediction 2.) The PS3 will drop in price for GTA IV and the PS2 will drop in price for the holidays.
Verdict 2.) Undetermined. It hasn’t happened yet, but that’s not to say it’s impossible in the future.
Prediction 3.) The Wii will go HD in 2-3 years (I know there’s some debate here, but rereading this Pachter seems to say fairly clearly that this is the Wii 1, not some hypothetical sucessor - hence the introduction of an “HD Wii”).
Verdict 3.) Undetermined (but Probably False). I can’t prove this to be incorrect - and won’t be able to for 2-3 years - but considering it goes completely against Nintendo’s stated strategy, I can’t imagine this is going to happen.
Prediction 4.) In the latest quarter-end, Activision will exceed its estimate of $0.08/share, EA will be line with guidance, Midway will fall slightly below estimates, and THQ will be in line with the $0.025/share estimate.
Verdict 4.) False. According to this Forbes piece, the consensus Thompson Financial estimates for Midway were a 21 cent/share loss, and they beat that, losing only 16 cents per share. THQ reported a net loss of $0.14. It’s true that Activision did beat its estimate by 1 cent… and EA was in line with the guidance, but the guidance was a $50M range, and they were at the edge of that. Since Pachter’s a financial analyst, and he was only able to accurately predict 1 of the 3 results for which he had a real estimate, I’m saying fail on this one.
Prediction 5.) Microsoft would cut 360 prices at a July 10 press conference, and that prices would drop to $399 (Elite), $349 (Premium), and $249 (Core).
Verdict 5.) False. Prices didn’t get cut for a month afterwards, and only the Premium price estimate proved to be correct (both the Elite and Core systems remain at significantly higher price points of $450 and $280 respectively. Sorry, he gets no bonus points for predicting the simple fact of a future cut, since cuts were A) inevitable in the life of the console, and B) rumored for months.
Prediction 6.) Take 2 will “fix” Manhunt 2 and rerelease it at a cost of $1M.
Verdict 6.) True. This was just announced on 8/24.
Prediction 7.) 200 of Take 2’s 2100 employees would get pink slips after their $50M loss.
Verdict 7.) Undetermined. I can’t find a figure anywhere to describe exactly how many people were laid off. I wouldn’t be surprised if it was more.
Prediction 8.) May NPD figures would show a 16% year-on-year increase in software sales to $333M, while hardware sales would continue to decline.
Verdict 8.) False. Game sales surged nearly 50% to $815M, while console sales were up a whopping 79% from the previous year.
Prediction 9.) Final Fantasy will remain a PS3-specific franchise.
Verdict 9.) True. Square has shown no interest in porting the (main) franchise to the 360 or the Wii.
Prediction 10.) GTA IV will be delayed.
Verdict 10.) True. GTA IV has indeed been delayed, although whether the PS3 is the cause of those delays is not verifiable.
Update: Since an M-rated Manhunt 2 was announced today, I’ve revised the post slightly.
Posted in Business, Etc, Geoff |
August 23rd, 2007 at 11:40 pm
Ha. Look at that. I was write about my NPD predictions, when even I was pretty sure I had blown it at this point. I like being right, I’ll admit it.
August 24th, 2007 at 12:02 am
Seems to me we have a case of an analyst whose book knowledge is good yet doesn’t properly understand the industry he’s analyzing, no?
August 24th, 2007 at 12:17 am
I really think guys like Geoff don’t get it. It really is all about mocking and being mocked, when Pachter is concerned. He’s a pompous twat, but his pompousness is very entertaining. Hell, his essence is entertaing.
http://www.neogaf.com/forum/showpost.php?p=6807445&postcount=253
Btw, that above link….it’s real. OH, and….
http://www.neogaf.com/forum/showpost.php?p=6810694&postcount=380
August 24th, 2007 at 1:48 am
He seems like a nice enough guy. There’s no need to attack him personally in order to critique his opinions.
Rob -
If I had to guess, I’d say that the issue stems from the fact that Pachter is probably a typical research analyst, whose strengths lie in financial analysis and evaluation rather than broader questions of corporate strategy. Analysts are generally called upon to evaluate a company’s viability as an investment target. However, they typically lack the data and expertise required to make broader predictions on the future marketplace.
For example, take the NPD figures - unless you assume that Pachter has access to advance data unavailable to the public, his guess is probably as good as anyone’s. At the same time, he would likely be the go-to person to determine what the impact of the numbers that *are* announced would be on quarterly earnings. Pachter’s problem, then, is probably that he fails to confine himself to areas of relative personal expertise.
It’s worth noting that Kotaku and other such sites are as much to blame as anyone here, since they choose to quote Pachter liberally on any number of topics whose connection to his particular skillset are questionable at best. I’d love to hear Michael Pachter the Interested Gamer’s opinions as comments or on a blog. However, I’ll take Pachter the Research Analyst’s opinions with a grain of salt.
August 24th, 2007 at 2:09 am
God fucker, man, you still don’t get it.
I’m leaving this blog. :/
August 24th, 2007 at 10:19 am
Sorry to hear that, paz. I’m still not sure what exactly we did to offend you.
August 24th, 2007 at 2:12 pm
You showed a human understanding of the issue. Apparently some people find that offensive. . . .