kottke.org home archives + xml about kottke.org contact me
kottke.org - home of fine hypertext products

RSS readers misusing the referer field?

Since I began publishing RSS feeds for this site, my server logs are full of referers from various RSS readers. Six of my top ten referers are from RSS readers like NetNewsWire and the brand new Syndirella.

Very few of these are true referers. No one clicked on a link on the NewsGator page to get to my site, yet I have almost 2000 referers from that page in my logs for this month. Checking my logs more closely, it appears that each time an RSS file from my site is loaded by one of these applications, a referer is deposited in the log file. Each time I load a page in Internet Explorer, I don't leave a referer for www.microsoft.com/ie in the log files of the site whose page I loaded, so why should any of the RSS readers be different?

The definition of referer from RFC 2616 on HTTP 1.1 seems relevant to the question. It states that "The Referer[sic] request-header field allows the client to specify, for the server's benefit, the address (URI) of the resource from which the Request-URI was obtained" and that "the Referer field MUST NOT be sent if the Request-URI was obtained from a source that does not have its own URI".

More about this page

This entry was published on January 30, 2003 at 10:40 am.

kottke.org is a weblog about the liberal arts 2.0 edited by Jason Kottke since March 1998. You can read about me and kottke.org here. If you've got questions, concerns, or an interesting link for me, send them along. Here's the kottke.org RSS feed kottke.org RSS feed.

Advertisement

dot dot dot

Advertise on kottke.org via The Deck.

Looking for work? Tags, tags, tags!

Many posts on kottke.org have been "tagged" with keywords, which activity results in collections of related posts like sports, infoviz, or bestof.

Recently popular tags (last 3 weeks)

finance   johnhodgman   video   chess   movies   nyc   cycling   rogerebert   tv   photography   color   food   lists   flying   money

All-time popular tags

movies   photography   books   nyc   science   food   lists   design   business   sports   video   weblogs   music   bestof   art

Some of my favorite tags

photography   economics   lists   bestof   infoviz   food   nyc   firstworldproblems   cities   restaurants   video   timelapse   interviews   language   maps   fashion   nsfw   remix  

Random tags

sunshine   prison   cities   barcade   marypoppins   lifeafterpeople   realestate   cars   fundraising   hosseinderakhshan   fridakahlo   sony   pentagram   movies   im

kottke.org

You're visiting kottke.org. All content by Jason Kottke (contact me) unless otherwise noted, with some restrictions on its use. Good luck will come to those who dig around in the archives. If you've reached this point by accident, I suggest panic. In memory of DFW, rest in peace. Thanks for everything.