The new official Twitter account for kottke.org is now @kottke. If you want kottke.org updates to appear in your Twitter stream, just follow:
http://twitter.com/kottke
The old account, @kottkedotorg, will continue to post updates for a few more days and then will go silent. HUGE 72 pt. thanks to John Resig (@jeresig), who scooped up @kottke some time ago to protect it from a spammer takeover and generously handed the keys over to me this morning. So many people have wrongly referenced @kottke in the past few months that it's a relief to have it.
Two other things.
1. I have also been posting little extra links to Twitter -- like this and this -- stuff that doesn't really fit on the site for whatever reason. I'll eventually pull those links back into the flow here, but the only way to get them for now is to follow @kottke.
2. You may have noticed that at the end of each kottke.org post, there is now a "Post to Twitter" link. I have long resisted adding Digg This or Tumblr That or Stumble What or Jam This In Your Facebook links to posts, but increasingly people are sharing links and information on Twitter instead of on their blogs so I'm going where the action is. At least as an experiment. So, if you like something, click the link and tell your followers about it.
If you can figure out what words are gonna trend on Twitter, you can use the pretweeting site to buy and sell words to make fake money.
Make a (virtual) profit by buying and selling words on twitter. Predict what's going to be hot and buy it up before it hits twitter, and you'll make a killing once people start talking about it.
This is like Google Adwords except with play money. (via waxy)
Regarding the previous post on Twitter and the telegraph, eagle-eyed kottke.org reader Mark spotted this gem on page 401 of the telegraphic code book:
I heard that "tunnel is in ore" was @jack's first name for the service; that it was shortened to Twitter makes a lot of sense now. (thx, mark)
Ben Schott on the similarities between the telegraph and Twitter:
The 140-character limit of Twitter posts was guided by the 160-character limit established by the developers of SMS. However, there is nothing new about new technology imposing restrictions on articulation. During the late 19th-century telegraphy boom, some carriers charged extra for words longer than 15 characters and for messages longer than 10 words. Thus, the cheapest telegram was often limited to 150 characters.
Schott also shares about 100 words from The Anglo-American Telegraphic Code, a code book that reduced long phrases into single words in order to cut down on telegraphic transmission costs. The full book is available for reading on Google and it includes over 27,000 code words on 460 pages!
Get traffic and transit updates for NY on Twitter...including NYC subway lines! There are separate accounts for the 123, ACE, JMZ, 456, BDFV, LS, 7, G, and NQRW. (via @bobulate)
Update: @NYCtrains also does NYC subway updates. (thx, pierre)
Steven Garrity lists a short selection of metaphors related to technology freedoms. Like:
If Twitter were a phone company, you could only call people who used the same phone company as you.
Got any good ones to add to the list?
Dave Winer has been irritated for some time at Twitter's suggested users list. I don't like the list either...it steers Twitter in a direction I don't care for. Winer suggests several ways in which Twitter can address the problems with the list but there's a really good simple solution:
Make the list entirely random consisting of selections from the entire Twitter userbase. After signing up, each new user sees 100 recommended accounts randomly chosen out of a HUGE pool of non-spam accounts (where HUGE = hundreds of thousands) that have been active for more than 3 months, tweet more than 5 times a week & fewer than 10 times a day, and have 2 times as many followers as followees (or something like that). Twitter has to be doing similar calculations to find spam accounts...just reverse it and whitelist accounts for the recommended list. That way, Twitter gets what they want (new users following people) and the super-user & conflict of interest problems are eliminated.
I guess I should have included "if the link is posted to TechMeme" in the Twitter litter list.
A more readable list is here.
The problem with all of the "we're tracking the most popular links on Twitter" sites is that link sharing on Twitter depends on (in order of decreasing relevance):
1. the time it takes to read/view the link (shorter is way better)
2. if the subject of the link is Twitter or Facebook
3. the sense of outrage aroused in the reader (the more the better)
4. if the link was published by fucking Mashable
5. retweets by popular Twitter users who have many parrot followers (i.e. disciples)
6. how interesting the link is
So unless you're into brief but outrageous Twitter news from Mashable that you heard about from Robert Scoble -- and it is incredible the number of people who are -- these services just aren't that useful. (As this post itself meets several of the above criteria, feel free to retweet.)
The scamps at Nature are updating the ApolloPlus40 Twitter account as the Apollo 11 mission happened 40 years ago. (thx, matt)
Yesterday I linked to a long piece by attorney Brock Shinen discussing whether individual posts to Twitter are copyrightable and asked:
Does this mean that nearly all of Twitter's content is in the public domain? Or can you copyright a collection of tweets...the entire output of one person, for instance?
Brock sent along a short reply to my question, reprinted here with his kind permission:
This is information and not advice: It's possible (and likely) that the majority of individual Tweets are in the public domain. But copyright protection may extend to a compilation of otherwise non-protectable Tweets. The question of whether 'you' can do that as opposed to the author of those Tweets is tricky and would depend on how it's done. If the compilation is authored in such a way as to suggest a false designation of origin (i.e., that the person compiling the Tweets actually authored them), you might run into false designation claims. Also, as a practical matter, you may still get sued and forced to spend tens of thousands of dollars to defend a lawsuit you might otherwise win - if you can afford to get to trial. In the end, if you are a Tweet author and want to protect your Tweets, then you should probably compile them and seek protection with the US Copyright Office. If that works out for you, you're set. If the Copyright Office denies your application for registration, you have your answer.
In the opinion of intellectual copyright attorney Brock Shinen, the short answer is "no".
I admit, I think a protectable Tweet exists in theory. I have read hundreds if not thousands of Tweets and have yet to read one I believe would be protectable, but the possibility exists. The question is not: Are Tweets Copyrightable. The question is: Is This Tweet Copyrightable. The copyrightability of Tweets is not dependent on the fact that they are Tweets. Rather, it's dependent on the analysis of the Tweet in question. The all-encompassing response that all Tweets are either protected or not protected is misguided. The real response is that it depends. However, when you analyze most Tweets, they would never individually pass copyright muster.
Does this mean that nearly all of Twitter's content is in the public domain? Or can you copyright a collection of tweets...the entire output of one person, for instance? Let's say I want to publish Tweatise: The Wit and Wisdom of Merlin Mann, an unabridged book of Merlin's Twitter stream...can I do that?
Update: Another opinion: tweetCC.
tweetCC makes it easy for you to offer your tweets under a Creative Commons Public Domain Dedication or other Creative Commons licenses.
(thx, dan)
Update: Yet another perspective.
By Meg Pickard, a graph of the lifespan of Twitter trending topics compares "people talking about #topic" and "people talking about talking about #topic". Outside of Twitter, this applies to pretty much any popular newsworthy topic...the news quickly moves from "we're telling you about Topic X" to media coverage of the media coverage of Topic X. See: Twitter's own coverage in the media currently. (thx, @ davidfg )
This "small settings update" to Twitter sucks.
We've updated the Notices section of Settings to better reflect how folks are using Twitter regarding replies. Based on usage patterns and feedback, we've learned most people want to see when someone they follow replies to another person they follow -- it's a good way to stay in the loop. However, receiving one-sided fragments via replies sent to folks you don't follow in your timeline is undesirable. Today's update removes this undesirable and confusing option.
The semi-private/semi-public thing that Twitter has going on is one of the most significant features of the service, IMO. It's the magic. There's serendipitous social discovery factor but more to the point: when I follow someone, I want to see *everything* they post. Those @replies to my friends' friends are part of their narrative, part of what I want to hear from them. Arbitrarily cutting out some tweets sucks. Besides, isn't the "problem" solved by this "feature" mostly addressed by locked accounts and private messaging?
It's also odd that Twitter would release this feature, which makes it easier for people to communicate in self-contained groups, when it seems like the company is moving in the opposite direction towards a broadcast model, where the emphasis is on tweeting at large groups of people that you don't know. Two big examples:
1. They inserted a "suggested users" step in the sign-up process which made a small number of people on Twitter into superusers and implied to new users that Twitter is a service for following celebrities instead of chatting with your friends.
2. And then there's all the press they've been doing. You don't go on Oprah to talk about how Twitter is for small groups.
(Would you like to post this link to Twitter?)
Update: Twitter reversed their decision on this. Sort of.
First, we're making a change such that any updates beginning with @username (that are not explicitly created by clicking on the reply icon) will be seen by everyone following that account.
This sentence is also interesting:
The problem with the setting was that it didn't scale and even if we rebuilt it, the feature was blunt. It was confusing and caused a sense of inconsistency.
I'm not sure that makes any sense to anyone who doesn't work at Twitter. Maybe Twitter will wow us with simple and intuitive per-user controls but it seems to me that the service works best when it's simple. Having to think about to what degree you're following someone multiplied the number of people you're following starts to feel like the friendship maintenance crap that everyone loves to hate about other social networking sites.
Living in a big city, you get to hear other people's conversations all the time. These are private conversations meant for the benefit of the participants but it's no big deal if they're overheard on the subway. And you know what people talk about most of the time? In no particular order:
1. What they had or are going to have for breakfast/lunch/dinner.
2. Last night's TV or sports.
3. How things are going at work.
4. The weather.
5. Personal gossip.
6. Celebrity gossip.
Of course you'd like to think that most of your daily conversation is weighty and witty but instead everyone chats about pedestrian nonsense with their pals. In fact, that ephemeral chit-chat is the stuff that holds human social groups together.
Ever since the web hit the mainstream sometime in the 90s, people have asked of each new conversational publishing technology -- newsgroups, message boards, online journals, weblogs, social networking sites, and now Twitter -- the same question: "but why would anyone want to hear about what some random person is eating for breakfast?" The answer applies equally well for both offline conversation and online "social media": almost no one...except for their family and friends.
So when you run across a Twitter message like "we had chicken sandwitches & pepsi for breakfast" from someone who has around 30 followers, what's really so odd about it? It's just someone telling a few friends on Twitter what she might normally tell them on the phone, via email, in person, or in a telegram. If you aren't one of the 30 followers, you never see the message...and if you do, you're like the guy standing next to a conversing couple on the subway platform.
P.S. And anyway, the whole breakfast question is a huge straw man periodically pushed across the tracks in front of speeding internet technology. There is much that happens on Twitter or on blogs or on Facebook that has nothing to do with small groups of people communicating about seemingly nothing. Can we just retire this stupid line of questioning once and for all?
(Would you like to post this link to Twitter?)
Update: From Twitter, two pithier reformulations of the above:
@phoutz: If Twitter is banal it is because you and I are banal (It's called social norming)
@thepalephantom: The "no one cares what you're doing" proclamation is a solipsists way of saying "i don't care"
Update: Three related articles. How the Other Half Writes: In Defense of Twitter by Geoff Manaugh of BLDGBLOG (thx, @secretsquirrel):
Again, I fail to see any clear distinction between someone's boring Twitter feed - considered only semi-literate and very much bad -- and someone else's equally boring, paper-based diary -- considered both pro-humanist and unquestionably good. Kafka would have had a Twitter feed! And so would have Hemingway, and so would have Virgil, and so would have Sappho. It's a tool for writing. Heraclitus would have had a f***ing Twitter feed.
Twitter: Industries of Banality by Struan McRae Spencer of Vitamin Briefcase:
Living with friends and colleagues would be a cheap alternative to living alone. People generally don't do it because it's not a good thing for humans to do. We are genetically predisposed to need time in solitude occasionally. So instead of living with your friends and colleagues, try living with their disembodied thoughts floating around on your computer and popping up on your desktop every fifteen, thirty, sixty, (manual refresh), minutes. Fellowship exists to provide us with relief from solitude and our individual pursuits. Living in a state of constant fellowship with hundreds, if not thousands of people who have known you (or not) across various stages of your life becomes an insurmountable problem the longer you try to do it.
To Tweet or Not To Tweet by Maureen Dowd of the NY Times, the essay that finally set me off in the first place:
Do you ever think "I don't care that my friend is having a hamburger?"
Keith Starky's blog examines tweets as "part of his ongoing research in humor propagation and fluid reputation dynamics".
The central conceit of the "tweet" in this case is the idea that Ninjas, which are black-clad martial artists who employ tactics of stealth to both defeat their opponents and avoid waking people up at night when they go to the bathroom, could partake in some of the worldy pleasures of the non-Ninja world (e.g., crunchy snacks) if that non-Ninja world consisted entirely of people wearing noise-canceling headphones. Henceforth we refer to this world as Headphone-World.
Sorry for the two "explains Twitter" posts in a row. I'll make the next two extra special (i.e. "explains Facebook"). (via jim ray)
McSweeney's explains Twitter. Finally!
Twitter seems to be, first and foremost, an online haven where teenagers making drugs can telegraph secret code words to arrange gang fights and orgies. It also functions as a vehicle for teasing peers until they commit suicide.
The McSweeney's Twitter account has never been updated but has 702 followers.
Update: McSweeney's official Twitter account is being updated but only has 439 followers. (thx, alex)
After threatening as much for many months, Joshua Schachter has published a piece about how URL shorteners (TinyURL, bit.ly, is.gd, etc.) suck for everyone except the companies which build URL shorteners.
There are three other parties in the ecosystem of a link: the publisher (the site the link points to), the transit (places where that shortened link is used, such as Twitter or Typepad), and the clicker (the person who ultimately follows the shortened links). Each is harmed to some extent by URL shortening.
I agree with Schachter all around here. With respect to Twitter, I would like to see two things happen:
1) That they automatically unshorten all URLs except when the 140 character limit is necessary in SMS messages.
2) In cases where shortening is necessary, Twitter should automatically use a shortener of their own.
That way, users know what they're getting and as long as Twitter is around, those links stay alive.
In response to a push for more tech literacy, British primary schools have proposed a new set of academic standards, including plans to study Twitter.
It seems to be going over fairly well with those at the head of the class. According to John Bangs, of the National Union of Teachers:
"Computer skills and keyboard skills seem to be as important as handwriting in this. Traditional books and written texts are downplayed in response to web-based learning."
Let's hope that history lectures don't devolve into presentations on now-defunct MySpace pages and AOL screen-names.
via CNET
After Shaq tweets that he's hanging out at a local diner in Phoenix, two nervous Twitter users venture out to see if Shaq is actually THE_REAL_SHAQ.
Returning to our hushed whispers I asked Sean, "Should we go talk to him now?" "I don't know, should we?"
"Yes, you should" a very deep voice entered our conversation from 2 booths over.
(via truehoop)
Stephen Fry decided to start his own reality chat show yesterday after becoming stuck in an elevator. Here's the show's opening monologue, a photo of the cast, and thoughts from the audience. The ratings look pretty good so far.
The NY Times has a timeline map showing what people from around the country said on Twitter during the Super Bowl broadcast. I like the emoticons tab but they also should have included a profanity tab.
Sasha Frere-Jones lists a bunch of people who are on Twitter.
people who are just back from a really awesome run
people who are involved in "social networking" and optimizing the power of re-Tweeting and "computers"
people who can't figure out what their kids want to eat
Shaquille O'Neal
people who have never seen snow
people who like Battlestar Galactica
Geordi La Forge, Data, and Wesley Crusher are all on Twitter. WHAT ARE YOU WAITING FOR, WORF?
And thus ends the first full week of Twittering by Shaquille O'Neal. The real Shaquille O'Neal. The NY Times has the details. Apparently Shaq was spurred into tweeting by an imposter posing as him:
"Somebody out there was trying to use my language and trying to speak for me," O'Neal, sounding more amused than offended, said Wednesday night in a telephone interview. "Rather than have that happen, I thought I'd do it myself." O'Neal added: "It's a fun thing. It's a way for fans to connect."
Used to dashing off one-liners to reporters during pre- and post-game interviews, O'Neal is a natural at Twitter's short format. He's already cleared the murky air about his feelings regarding ex-coach Phil Jackson and ex-teammate Kobe Bryant directly to his fans:
This is straight from the shaqs mouth I love phil jackson Kobe bryant is the best palyer in the game And the shaq kobe, kobe shaq was the best one two
One of the biggest uses of Twitter is for namedropping; Shaq picked up on that right away:
I just texted gary payton, one of the greatest point guards ever
He's also urging his teammates to hop on the bandwagon:
Sittin next to steve nash, tryna get hi to join twitter
When Shaq said "it's a way for fans to connect", he wasn't just blowing smoke. After a friend of mine followed THE_REAL_SHAQ early on, Shaq followed him back. My friend then sent him a direct message about something Shaq had said in an interview once and an hour later, a reply from Shaq: "gimme a numba 2 call". And then Shaq called him for a brief chat an hour or two later!
Best of all, he's having fun with it. On Friday, Shaq posted this photo to TwitPic:
That says it all, no? Tweet on, Shaq...we're following you.
Several folks on Twitter are talking about post-election sex and Obama babies (children conceived on election night...mark your calendars for late July 2009). The consensus seems to be that Barack got laid in a big way last night.
This page on kottke.org is the #1 result when you Google "obama wins". Servers may get a little melty around here in the next couple of days. That's ok...this is what Twitter's servers are going to look like tomorrow night:
Imagine this video, but with the fail whale instead of a real whale and a nuclear device instead of dynamite.
Twitter is fast becoming the real-time zeitgeist of the web hive mind. (Sorry, I don't know what that means either.) Anyway, I've been playing around with Twist, which tracks trends on Twitter and graphs the results. Two of the most interesting trends I've found are:
drunk, hangover - The drunk talk spikes on Friday and Saturday nights, followed by hangover talk on the following mornings. There's a similar correlation on Facebook.
monday, tuesday, wednesday, thursday, friday, saturday, sunday - This one is really interesting. Friday, Saturday, Sunday, and Monday get many more mentions than the three other days of the week, which shows the importance of the weekend in contemporary society. Wednesday is the low point, which turns the graph into a representation of hump day, only inverted.
Any other interesting trends that you've noticed?
Update: My wife reminds me that Plodt is tracking explicit Twitter trends...you can create personal or collective graphs by assigning values to words like so: *mood 8* or *weather 5*. Here's a good example of a collective poll about how the candidates did during the debate at Hofstra.
Fun evening activity: type whatever crazy shit is happening on TV into Twitter Search and watch the wittisicms and not-so-witticisms roll by. Example: in game one of the World Series tonight, someone stole a base and every single person in the United States won a free taco from Taco Bell. Instant tweetalanche.
I don't know what the best part of Twinkle is: being up at 8am on Saturday & Sunday mornings and reading messages from drunken Manhattanites heading home for the evening at 5am or watching guys attempting to flirt with ladies in their area via 140 character messages. Very entertaining.
BTW, Twinkle is a Twitter app that lets your= read what's being Twittered near you (more or less).
Twitter is broken for me so I'm going to be using this text file until it starts working again. If any friends want their updates included in my text file, please send me an email.
Update: The Jason's Update Page social internet web site now has an API. Full documentation here.
If you'd like to follow kottke.org on Twitter, you may do so here. Tweets will consist of a post title and the permalink URL, updated every time I publish a new post (more or less). Thanks to arc90 for their PHP Twitter API library. Note: this is a separate Twitter account from my personal one. Never will kottke.org updates be pushed automatically to my personal Twitter account. I am not a dick, I would never do that to you.
About 2 hours ago, the Mars Phoenix rover twittered that it had found evidence of ice on Mars.
Are you ready to celebrate? Well, get ready: We have ICE!!!!! Yes, ICE, *WATER ICE* on Mars! w00t!!! Best day ever!!
The Mars rover said "w00t". Here's the w00t-less press release and the associated images that show the ice sublimating from the surface over the last four days.
Tweetup n.
A real world meeting between two or more people who know each other through the online Twitter service.
I had a tweetup with my wife this morning. And last night. And the day before that. TMI?
I took a quick Twitter poll this morning: What's the opposite of standing: sitting or lying down? The results: lying down wins but sitting is a close second. My favorite answer, which several people gave, is doing a headstand (or hanging upside down).
Now, what about this: What's the opposite of sitting: lying down or standing?
How this whole When Obama wins thing got started: some Adaptive Path folk musing about state name changes if Obama won:
Dan was twittering something about Alabama, but wrote "Alambama". He joked that when Barack Obama wins the election, certain states will probably be renamed - Alobama, Califobama, Nevama, Massabama, New Yobama. Of course, I thought that was hilarious and started thinking about other things that would change once Obama wins. So, a few of us started twittering silly little things, thinking of it as an inside joke.
Overnight, a few people caught on giving it a life of its own.
And if you're so inclined, you could Digg When Obama wins and help melt my web server.
Update: It's on Reddit as well.
Last night, folks on Twitter began to contemplate what will happen if Barack Obama wins the nomination. The meme seems to have begun with Andrew Crow's vision for the future:
When Obama wins... unicorns will crap ice cream and pastries.
I collected a bunch of the best ones and made a page that cycles through them: When Obama wins.
The stodgy old New Yorker has a Twitter account and its friends are NPR, Harper's, Gothamist, Huffington Post, the NY Times, and the WSJ, among others. Magazines should have friends, no? (Sniff, the WSJ has no friends.)
Jeff Jarvis rightly recommends following Time.com's Ana Marie Cox's Twitter feed as she follows the Republican Presidential candidates around the country. A recent, uh, tweet: "Myrtle Beach: McCain staffers very excited and pleased about the prospect of 'Team McCain: California' jackets." These are the sort of details I wish made it to publication, but Twitter is, I suppose, a publication of its own, right?
"People say, You must have been the class clown. And I say, No, I wasn't. But I sat next to the class clown, and I studied him."
- Dr. Allan Pearl
This is why I love my Twitter: it fulfills in me a primal urge to act out in class, in little bursts. Since having moved past school and into the working world, the class clowning urge was one I'd kept dormant. As it turns out, however, blurting out ridiculous things to a roomful of people offers every bit the dopamine jolt as an adult as it did as a kid, which turns out to be very therapeutic.
In Twitter, there is a sense of ordered play. There is no judgement. You can talk to your neighbors, stand up and give a report on what you're doing, pass notes, make fart noises if that's your schtick (the highest form of comedy), or sit in the back, observing. But if you do a real banger mouthfart, like where your arm gets all wet and people actually think they smell something, there's the joy of peer approval, in the form of a "favorite."
Oh, and an added benefit of Twitter: it helps you to develop an economy of words and conciseness of ideas. Because the longest mouthfart isn't always the funniest one.
Video of Twitter on CSI. They even stayed within the 140 character limit. (via waxy)
From my inbox this morning:
We can't have nice things on the internet.
A bunch of presentations on how to scale web apps, including Flickr, Twitter, LiveJournal, and last.fm.
Regarding the Twitter vs. Blogger thing from earlier in the week, I took another stab at the faulty Twitter data. Using some educated guesses and fitting some curves, I'm 80-90% sure that this is what the Twitter message growth looks like:
These graphs cover the following time periods: 8/23/1999 - 3/7/2002 for Blogger and 3/21/2006 - 5/7/2007 for Twitter. It's important to note that the Twitter trend is not comprised of actual data points but is rather a best-guess line, an estimate based on the data. Take it as fact at your own risk. (More specifically, I'm more sure of the general shape of the curve than with the steepness. My gut tells me that the curve is probably a little flatter than depicted rather than steeper.)
That said, most of what I wrote in the original post still holds, as do the comments in subsequent thread. Twitter did not grow as fast as the faulty data indicated, but it did get to ~6,000,000 messages in about half the time of Blogger. Here are the reasons I offered for the difference in growth:
1. Twitter is easier to use than Blogger was and had a lower barrier to entry.
2. Twitter has more ways to update (web, phone, IM, Twitterific) than did Blogger.
3. Blogger's growth was limited by a lack of funding.
4. Twitter had a larger pool of potential users to draw on.
5. Twitter has a built-in social aspect that Blogger did not.
And commenters in the thread noted that:
6. Twitter's 140-character limit encourages more messages.
7. More people are using Twitter for conversations than was the case with Blogger.
What's interesting is that these seeming advantages (in terms of message growth potential) for Twitter didn't result in higher message growth than Blogger over the first 9-10 months. But then the social and network effects (#5 and #7 above) kicked in and Twitter took off.
This morning I posted a comparison of the growth in messages with both Blogger and Twitter. The Twitter data was based on information collected by Andy Baio in a post that was widely read in the blogosphere. In the course of looking at the Twitter data, neither of us noticed that from Nov 21, 2006 to Feb 4, 2007 and March 9, 2007 to the present, the Twitter post IDs had the same last digit, indicating that the data is not strictly sequential. If you look at Twitter's public timeline, the Twitter post IDs skip around by multiples of 10.
Anil suggested via email that could be an artifact of database sharding and lo and behold, if you take off the last digit of the post ID, they seem to become sequential again, more or less. He's going to ask the Twitter gang about it.
For right now though, the parts of this morning's post that rely on Twitter data from the above dates is incorrect. Basically, all of it. Here it is in all caps: WRONG WRONG WRONG ERROR ERROR, F-----, WOULD NOT BUY DATA ANALYSIS FROM AGAIN. In hindsight, it seems obvious that the data was incorrect...that sort of growth seems impossible, especially when Twitter was having all sorts of scaling problems. Anyway, good thing this is just a blog and not a refereed journal, eh? Big thanks to the commenters in the other post for pointing me toward the error. More as I have it.
Update: Email from Biz Stone, who works for Twitter. He says:
There's truth in the essence of what you're talking about here -- Twitter updates *are* coming in faster and furiouser than Blogger updates. However, the way we number Twitter updates has switched back and forth a few times which pretty much screws up the exactness of your analysis.
We have been doubling the number of active users about every three weeks for a sustained period of months now which is definitely contributing significantly to more and more updates. Also, active users of Twitter a measured by how many times they update per day (at Blogger it was per month). So activity in general at Twitter is crazy by comparison.
We're going to start digging in to more data visualization, user patterns, etc in the coming weeks so if there's anything you think we should be looking at specifically please let us know!
So we'll have to wait a few weeks for an accurate look at this stuff. (thx, biz)
Important update: I've re-evaluated the Twitter data and came up with what I think is a much more accurate representation of what's going on.
Important update: I've re-evaluated the Twitter data and came up with what I think is a much more accurate representation of what's going on.
Further update: The Twitter data is bad, bad, bad, rendering Andy's post and most of this here post useless. Both jumps in Twitter activity in Nov 2006 and March 2007 are artificial in nature. See here for an update.
Update: A commenter noted that sometime in mid-March, Twitter stopped using sequential IDs. So that big upswing that the below graphs currently show is partially artificial. I'm attempting to correct now. This is the danger of doing this type of analysis with "data" instead of data.
--
In mid-March, Andy Baio noted that Twitter uses publicly available sequential message IDs and employed Twitter co-founder Evan Williams' messages to graph the growth of the service over the first year of its existence. Williams co-founded Blogger back in 1999, a service that, as it happens, also exposed its sequential post IDs to the public. Itching to compare the growth of the two services from their inception, I emailed Matt Webb about a script he'd written a few years ago that tracked the daily growth of Blogger. His stats didn't go back far enough so I borrowed Andy's idea and used Williams' own blog to get his Blogger post IDs and corresponding dates. Here are the resulting graphs of that data.1
The first one covers the first 253 days of each service. The second graph shows the Twitter data through May 7, 2007 and the Blogger data through March 7, 2002. [Some notes about the data are contained in this footnote.]
As you can see, the two services grew at a similar pace until around 240 days in, with Blogger posts increasing faster than Twitter messages. Then around November 21, 2006, Twitter took off and never looked back. At last count, Twitter has amassed five times the number of messages than Blogger did in just under half the time period. But Blogger was not the slouch that the graph makes it out to be. Plotting the service by itself reveals a healthy growth curve:
From late 2001 to early 2002, Blogger doubled the number of messages in its database from 5M to 10M in under 200 days. Of course, it took Twitter just over 40 days to do the same and under 20 days to double again to 20M. The curious thing about Blogger's message growth is that large events like 9/11, SXSW 2000 & 2001, new versions of Blogger, and the launch of blog*spot didn't affect the growth at all. I expected to see a huge message spike on 9/11/01 but there was barely a blip.
The second graph also shows that Twitter's post-SXSW 2007 growth is real and not just a temporary bump...a bunch of people came to check it out, stayed on, and everyone messaged like crazy. However, it does look like growth is slowing just a bit if you look at the data on a logarithmic scale:
Actually, as the graph shows, the biggest rate of growth for Twitter didn't occur following SXSW 2007 but after November 21.
As for why Twitter took off so much faster than Blogger, I came up with five possible reasons (there are likely more):
1. Twitter is easier to use than Blogger was. All you need is a web browser or mobile phone. Before blog*spot came along in August 2000, you needed web space with FTP access to set up a Blogger blog, not something that everyone had.
2. Twitter has more ways to create a new message than Blogger did at that point. With Blogger, you needed to use the form on the web site to create a post. To post to Twitter, you can use the web, your phone, an IM client, Twitterrific, etc. It's also far easier to send data to Twitter programatically...the NY Times account alone sends a couple dozen new messages into the Twitter database every day without anyone having to sit there and type them in.
3. Blogger was more strapped for cash and resources than Twitter is. The company that built Blogger ran out of money in early 2001 and nearly out of employees shortly after that. Hard to say how Blogger might have grown if the dot com crash and other factors hadn't led to the severe limitation of its resources for several key months.
4. Twitter has a much larger pool of available users than Blogger did. Blogger launched in August 1999 and Twitter almost 7 years later in March 2006. In the intervening time, hundreds of millions of people, the media, and technology & media companies have become familiar and comfortable with services like YouTube, Friendster, MySpace, Typepad, Blogger, Facebook, and GMail. Hundreds of millions more now have internet access and mobile phones. The potential user base for the two probably differed by an order of magnitude or two, if not more.
5. But the biggest factor is that the social aspect of Twitter is built in and that's where the super-fast growth comes from. With Blogger, reading, writing, and creating social ties were decoupled from each other but they're all integrated into Twitter. Essentially, the top graph shows the difference between a site with social networking and one largely without. Those steep parts of the Twitter trend on Nov 21 and mid-March? That's crazy insane viral growth2, very contagious, users attracting more users, messages resulting in more messages, multiplying rapidly. With the way Blogger worked, it just didn't have the capability for that kind of growth.
A few miscellaneous thoughts:
It's important to keep in mind that these graphs depict the growth in messages, not users or web traffic. It would be great to have user growth data, but that's not publicly available in either case (I don't think). It's tempting to look at the growth and think of it in terms of new users because the two are obviously related. More users = more messages. But that's not a static relationship...perhaps Twitter's userbase is not increasing all that much and the message growth is due to the existing users increasing their messaging output. So, grain of salt and all that.
What impact does Twitter's API have on its message growth? As I said above, the NY Times is pumping dozens of messages into Twitter daily and hundreds of other sites do the same. This is where it would be nice to have data for the number of active users and/or readers. The usual caveats apply, but if you look at the Alexa trends for Twitter, pageviews and traffic seem to leveling out. Compete, which only offers data as recently as March 2007, still shows traffic growing quickly for Twitter.
Just for comparison, here's a graph showing the adoption of various technologies ranging from the automobile to the internet. Here's another graph showing the adoption of four internet-based applications: Skype, Hotmail, ICQ, and Kazaa (source: a Tim Draper presentation from April 2006).
[Thanks to Andy, Matt, Anil, Meg, and Jonah for their data and thoughts.]
[1] Some notes and caveats about the data. The Blogger post IDs were taken from archived versions of Evhead and Anil Dash's site stored at the Internet Archive and from a short-lived early collaborative blog called Mezzazine. For posts prior to the introduction of the permalink in March 2000, most pages output by Blogger didn't publish the post IDs. Luckily, both Ev and Anil republished their old archives with permalinks at a later time, which allowed me to record the IDs.
The earliest Blogger post ID I could find was 9871 on November 23, 1999. Posts from before that date had higher post IDs because they were re-imported into the database at a later time so an accurate trend from before 11/23/99 is impossible. According to an archived version of the Blogger site, Blogger was released to the public on August 23, 1999, so for the purposes of the graph, I assumed that post #1 happened on that day. (As you can see, Anil was one of the first 2-3 users of Blogger who didn't work at Pyra. That's some old school flavor right there.)
Regarding the re-importing of the early posts, that happened right around mid-December 1999...the post ID numbers jumped from ~13,000 to ~25,000 in one day. In addition to the early posts, I imagine some other posts were imported from various Pyra weblogs that weren't published with Blogger at the time. I adjusted the numbers subsequent to this discontinuity and the resulting numbers are not precise but are within 100-200 of the actual values, an error of less than 1% at that point and becoming significantly smaller as the number of posts grows large. The last usable Blogger post ID is from March 7, 2002. After that, the database numbering scheme changed and I was unable to correct for it. A few months later, Blogger switched to a post numbering system that wasn't strictly sequential.
The data for Twitter from March 21, 2006 to March 15, 2007 is from Andy Baio. Twitter data subsequent to 3/15/07 was collected by me. ↩
[2] "Crazy insane viral growth" is a very technical epidemiological term. I don't expect you to understand its precise meaning. ↩
I'm working on a longish post for later today (or early tomorrow) about this graph:
More soon.
Update: The long post is done...the above graph is (roughly) the growth of Blogger (in orange) to the growth of Twitter (in blue).
It's been awhile since I've done one of these. Here are some updates on some of the topics, links, ideas, posts, people, etc. that have appeared on kottke.org recently:
Two counterexamples to the assertion that cities != organisms or ecosystems: cancer and coral reefs. (thx, neville and david)
In pointing to the story about Ken Thompson's C compiler back door, I forgot to note that the backdoor was theoretical, not real. But it could have easily been implemented, which was Thompson's whole point. A transcript of his original talk is available on the ACM web site. (thx, eric)
ChangeThis has a "manifesto" by Nassim Taleb about his black swan idea. But reader Jean-Paul says that Taleb's idea is not that new or unique. In particular, he mentions Alain Badiou's Being and Event, Jacques Derrida, and Gilles Deleuze. (thx, paul & jean-paul)
When I linked The Onion's 'Most E-Mailed' List Tearing New York Times' Newsroom Apart, I said "I'd rather read a real article on the effect the most popular lists have on the decisions made by the editorial staff at the Times, the New Yorker, and other such publications". American Journalism Review published one such story last summer, as did the Chicago Tribune's Hypertext blog and the LA Times (abstract only). (thx, gene & adam)
Related to Kate Spicer's attempt to slim down to a size zero in 6 weeks: Female Body Shape in the 20th Century. (thx, energy fiend)
Got the following query from a reader:
are those twitter updates on your blog updated automatically when you update your twitter? if so, how did you do it?
A couple of weeks ago, I added my Twitter updates and recent music (via last.fm) into the front page flow (they're not in the RSS feed, for now). Check out the front page and scroll down a bit if you want to check them out. The Twitter post is updated three times a week (MWF) and includes my previous four Twitter posts. I use cron to grab the RSS file from Twitter, some PHP to get the recent posts, and some more PHP to stick it into the flow. The last.fm post works much the same way, although it's only updated once a week and needs a splash of something to liven it up a bit.
The guy who played Spaulding in Caddyshack is a real estate broker in the Boston area. (thx, ivan)
Two reading recommendations regarding the Jonestown documentary: a story by Tim Cahill in A Wolverine Is Eating My Leg and Seductive Poison by former People's Temple member Deborah Layton. (thx, garret and andrea)
In case someone in the back didn't hear it, this map is not from Dungeons and Dragons but from Zork/Dungeon. (via a surprising amount of people in a short period of time)
When reading about how low NYC's greenhouse gas emissions are relative to the rest of the US, keep in mind the area surrounding NYC (kottke.org link). "Think of Manhattan as a place which outsources its pollution, simply because land there is so valuable." (thx, bob)
NPR did a report on the Nickelback potential self-plagiarism. (thx, roman)
After posting about the web site for Miranda July's new book, several people reminded me that Jeff Bridges' site has a similar lo-fi, hand-drawn, narrative-driven feel.
In the wake of linking to the IMDB page for Back to the Future trivia, several people reminded me of the Back to the Future timeline, which I linked to back in December. A true Wikipedia gem.
I'm ashamed to say I'm still hooked on DesktopTD. The problem is that the creator of the game keeps updating the damn thing, adding new challenges just as you've finally convinced yourself that you've wrung all of the stimulation out of the game. As Robin notes, it's a brilliant strategy, the continual incremental sequel. Version 1.21 introduced a 10K gold fun mode...you get 10,000 gold pieces at the beginning to build a maze. Try building one where you can send all 50 levels at the same time and not lose any lives. Fun, indeed.
Regarding the low wattage color palette, reader Jonathan notes that you should use that palette in conjunction with a print stylesheet that optimizes the colors for printing so that you're not wasting a lot of ink on those dark background colors. He also sent along an OS X trick I'd never seen before: to invert the colors on your monitor, press ctrl-option-cmd-8. (thx, jonathan)
Dorothea Lange's iconic Migrant Mother photograph was modified for publication...a thumb was removed from the lower right hand corner of the photo. Joerg Colberg wonders if that case could inform our opinions about more recent cases of photo alteration.
In reviewing all of this, the following seem related in an interesting way: Nickelback's self-plagiarism, continual incremental sequels, digital photo alteration, Tarantino and Rodriquez's Grindhouse, and the recent appropriation of SimpleBits' logo by LogoMaid.
Adam and David recently reminded me of pocket, an episode of 0sil8 I did back in 2001 (the second-to-last episode actually):
pocket was a broadcast mailing list for mobile phones. People signed up and then I sent them SMS messages on their phones periodically. As I recall it only lasted a few weeks before I shut it down; there just didn't seem to be anything interesting about broadcasting short messages to a group of friends and strangers.
Get the weather report via Twitter for more than a dozen cities. Looks like it hasn't been working for the past few days though...maybe once they get their scaling and IM issues figured out.
Marc Hedlund, founder of the intriguing Wesabe, recently made this interesting observation:
One of my favorite business model suggestions for entrepreneurs is, find an old UNIX command that hasn't yet been implemented on the web, and fix that. talk and finger became ICQ, LISTSERV became Yahoo! Groups, ls became (the original) Yahoo!, find and grep became Google, rn became Bloglines, pine became Gmail, mount is becoming S3, and bash is becoming Yahoo! Pipes. I didn't get until tonight that Twitter is wall for the web. I love that.
A slightly related way of thinking about how to choose web projects is to take something that everyone does with their friends and make it public and permanent. (Permanent as in permalinked.) Examples:
- Blogger, 1999. Blog posts = public email messages. Instead of "Dear Bob, Check out this movie." it's "Dear People I May or May Not Know Who Are Interested in Film Noir, Check out this movie and if you like it, maybe we can be friends."
- Twitter, 2006. Twitter = public IM. I don't think it's any coincidence that one of the people responsible for Blogger is also responsible for Twitter.
- Flickr, 2004. Flickr = public photo sharing. Flickr co-founder Caterina Fake said in a recent interview: "When we started the company, there were dozens of other photosharing companies such as Shutterfly, but on those sites there was no such thing as a public photograph -- it didn't even exist as a concept -- so the idea of something 'public' changed the whole idea of Flickr."
- YouTube, 2005. YouTube = public home videos. Bob Saget was onto something.
Not that this approach leads naturally to success. Several companies are exploring music sharing (and musical opinion sharing), but no one's gotten it just right yet, due in no small measure to the rights issues around much recorded music.
As I mentioned the other day, I recently joined Twitter. I've been poking around its nooks and crannies ever since. Here are some observations, presented in Twitter-sized chunks:
Playing with Twitter reminds me of blogging circa 2000. Back then, all weblogs were personal in nature and most people used them to communicate with their friends and family. If I wanted to know what my friends were up to back then, I read their blogs. Now I follow Twitter (and Flickr and Vox).
The reaction to Twitter mirrors the initial reaction to weblogs...the same tired "this is going to ruin the web" and "who cares what you ate for dinner" arguments.
Also like blogs, everyone has their own unique definition of what Twitter is (stripped down blogs, public IM, Dodgeball++, etc.), and to some extent, everyone is correct. Maybe that's when you know how you've got a winner: when people use it like mad but can't fully explain the appeal of it to others. See also: weblogs, Flickr.
For people with little time, Twitter functions like an extremely stripped-down version of MySpace. Instead of customized pages, animated badges, custom music, top 8 friends, and all that crap, Twitter is just-the-facts-ma'am: where are my friends and what are they up to?
Twitter's like Flickr without the images.
When one thing (i.e. Twitter) is easier than something else (i.e. blogging) and offers almost the same benefits, people will use it.
Twitter brings back the "type words in one box and press submit" thing that made Blogger so popular back in the day. Compare with current blogging systems. To publish a post in MT, I've got to fiddle with 7-9 different text boxes and options. See immediately above.
Let's not forget Dodgeball here, which was used extensively at SXSW in 2006. (In other words, all the Twittering at SXSW 2007 was not unprecedented. Chill.) It's more focused on location and SMS though...by allowing updates in more ways and being more flexible about the type of message allowed, Twitter is attractive to a wider group of people.
If your friends are not on Twitter, I can't imagine it would be that interesting.
Twitterholic tracks the top 100 Twitter users in terms of followers. I know, let's not turn absolutely everything on the web into a popularity contest!! We already know Scoble is a big blowhard and has weak ties to lots of people...let's move on, shall we?
I wonder what the average number of followers per person is? The folks with 5 zillion followers get all the attention, but as with blogging, those posting updates for their 20 friends form the bulk of the activity.
Lists of friends and followers are presented alphabetically. Does Anil attract more friends, on average, than Veen because he always shows up near the top of the listings?
I can see why Obvious dropped Odeo for Twitter. With podcasts, you've got all that data locked up in binary format (no easy cut-and-paste) and it takes you 20 listening minutes before you can react to it (by commenting, by linking, etc.). With blogs, the reaction time to a post is 1-2 minutes, with Flickr it's 5 seconds, and Twitter is 2-3 seconds. The barrier to entry for reacting to and remixing podcasts is just so much higher.
Twitter is the first thing on the web that I've been excited about in ages. Like years. The last thing was probably Flickr. (Talk about burying the lede.) It's just so damn simple but useful. Again, reminds me of weblogs in that way.
If you're on a Mac and using Twitter, download Twitterific, a little app that sits on your desktop and displays updates from your friends. My only complaint: it doesn't completely show updates, forcing you to the web to read the last 2-3 words of a longish message. Come on...it's only 140 characters, show them all!
Twittermap displays recent Twitter messages on Google Maps. All you do is send Twitter a message with your location -- like so...the "L:10003" is the important part -- and Twittermap will pick it up.
Even more mesmerizing is Twittervision...a world tour of recent Twitter messages. Just sit back and watch the updates come in one at a time, displayed on a world map. (This is in beta and Twitter's having some downtime issues right now, so the data may be less than fresh when you go.)
Twitter seems to work equally well for busy people and not-busy people. It allows folks with little time to keep up with what their friends are up to without having to email and IM with them all day. Those with a lot of time on their hands can spend a lot of time finding new people to follow, having back-and-forths with friends all day, and updating their status 40 times a day. Too many web apps fail because they only appeal to those with abundant free time.
I'm fascinated to see where Obvious takes this app once they get their scaling issues under control.
The default display of recent messages plus your own messages is genius. Makes it feel more like a conversation. The "with friends" display is great too...perfect for discovering other people to follow.
"Friends" still isn't the right word.
Finally got around to checking out Twitter. Here's my page: http://twitter.com/jkottke. Drink the Kool-Aid, sign up, and follow me (did I mention "drink the Kool-Aid?). More to come soon.
