After pretty much solving chess with Deep Blue, IBM is building a computer called Watson to beat human opponents at Jeopardy. It's not quite at Ken Jennings' level, but it's holding its own versus lesser humans.
Deep Blue was able to play chess well because the game is perfectly logical, with fairly simple rules; it can be reduced easily to math, which computers handle superbly. But the rules of language are much trickier. At the time, the very best question-answering systems -- some created by software firms, some by university researchers -- could sort through news articles on their own and answer questions about the content, but they understood only questions stated in very simple language ("What is the capital of Russia?"); in government-run competitions, the top systems answered correctly only about 70 percent of the time, and many were far worse. "Jeopardy!" with its witty, punning questions, seemed beyond their capabilities. What's more, winning on "Jeopardy!" requires finding an answer in a few seconds. The top question-answering machines often spent longer, even entire minutes, doing the same thing.
Clive Thompson writes up the Netflix Prize -- which offers $1 million to the first team to improve upon Netflix's default recommendation algorithm by 10% -- and the vexing Napoleon Dynamite problem that is thwarting all comers.
Bertoni says it's partly because of "Napoleon Dynamite," an indie comedy from 2004 that achieved cult status and went on to become extremely popular on Netflix. It is, Bertoni and others have discovered, maddeningly hard to determine how much people will like it. When Bertoni runs his algorithms on regular hits like "Lethal Weapon" or "Miss Congeniality" and tries to predict how any given Netflix user will rate them, he's usually within eight-tenths of a star. But with films like "Napoleon Dynamite," he's off by an average of 1.2 stars.
The reason, Bertoni says, is that "Napoleon Dynamite" is very weird and very polarizing. It contains a lot of arch, ironic humor, including a famously kooky dance performed by the titular teenage character to help his hapless friend win a student-council election. It's the type of quirky entertainment that tends to be either loved or despised. The movie has been rated more than two million times in the Netflix database, and the ratings are disproportionately one or five stars.
This behavior was flagged as an issue by denizens of the Netflix Prize message board soon after the contest was announced two years ago.
Those are the movies you either loved loved loved or hated hated hated. These are the movies you can argue with your friends about. And good old 'Miss Congeniality' is right up there in the #4 spot. Also not surprising to see up here are: 'Napoleon Dynamite' (I hated it), 'Fahrenheit 9/11' (I loved it), and 'The Passion of the Christ' (didn't see it, but odds are, I'd hate it).
After finding that post, I wrote a little bit about why these movies are so contentious.
The thing that all those kinds of movies have in common is that if you're outside of the intended audience for a particular movie, you probably won't get it. That means that if you hear about a movie that's highly recommended within a certain group and you're not in that group, you're likely to hate it. In some ways, these are movies intended for a narrow audience, were highly regarded within that audience, tried to cross over into wider appeal, and really didn't make it.
Clive Thompson on Weight Watchers as an RPG (role playing game).
As with an RPG, you roll a virtual character, manage your inventory and resources, and try to achieve a goal. Weight Watchers' points function precisely like hit points; each bite of food does damage until you've used up your daily amount, so you sleep and start all over again. Play well and you level up -- by losing weight! And the more you play it, the more you discover interesting combinations of the rules that aren't apparent at first. Hey, if I eat a fruit-granola breakfast and an egg-and-romaine lunch, I'll have enough points to survive a greasy hamburger dinner for a treat!
A new study shows that if a person's friends become obese, that person is at a great risk of obesity themselves. For close mutual friends, the risk factor for transmitted obesity increased by 171%.
Update: Dr. Jonathan Robison calls the above study "junk science". "How does one conclude a direct causal relationship from an observational study? Bald men are more likely than men with a full head of hair to have a heart attack. Can we conclude from this that they should buy a toupee or begin using Rogaine lotion to lower their risk?" (thx, robby)
Update: Clive Thompson's NY Times Magazine article (Sept 2009) covers this study in more detail. In addition to obesity, the study indicates that smoking, happiness, and drinking may be contagious.
Clive Thompson on the new way to make it big in the music biz: spend hours a day communicating with your fans via the web. "Virtually everyone bemoaned the relentless and often boring slog of keyboarding. It is, of course, precisely the sort of administrative toil that people join rock bands to avoid."
Update: Related: How to Be a Star in a YouTube World.
Clive Thompson on the invention of new sports. "Why don't more people invent new sports? After all, we live in a golden age of play. The video-game industry is bristling with innovation." When I was in the Caribbean a few months ago, some folks on the beach were playing this newish game that they called Golf Toss. It's also called Ladder Ball and is kind of like horseshoes except your throw two golf balls on a rope instead of a horseshoe.
Clive Thompson on Life Hackers in the NY Times. I'd informally heard about the benefit of larger screens on productivity (I feel more productive with a larger screen), but this article describes some study results: "On the bigger screen, people completed the tasks at least 10 percent more quickly - and some as much as 44 percent more quickly."
Clive Thompson enjoys the miniest of mini games, one-button games (more here and here): "video games that have a single button to control all the action". Many of the mini games in Wario Ware use only one control and only last 3-4 seconds.
Don Watson and Clive Thompson on the assembly-lining of thought and discourse via modern jargon. "That's the true malaise of modern jargon: It forces people to treat any subject as if it were always a managerial problem of inputs and outputs."
