Scripting News: Optimizing Flickr RSS reads

Scripting News, the weblog started in 1997 that bootstrapped the blogging revolution.

Optimizing Flickr RSS reads

There's a lot you can do with the Flickr API, I've pretty much mastered it, and it may look a bit intimidating at first, but it's well designed, and once you learn how to do one set of calls you pretty much know how to do the others. I would have relied more heavily on XML-RPC encoding for uploading pictures, but now that I've been uploading pictures for a couple of months, the pain of developing that glue is fading.

BTW, I've got glue for the OPML Editor, it should work well in Radio or Frontier. I've exported a snapshot of the system.verbs.apps.Flickr, for all to use. It may be included in any distribution. (To be clear, OPML Editor users don't need this, it's already in the update stream, just choose Update opml.root from the File menu.)

Anyway, I want to expand the Flickr/Twitter experiment, but before I do that I wanted to check with the Flickr folk because this service does a lot of polling of their RSS feeds. I suggested it might make sense to create a service that would allow a caller to find out which of the feeds its interested in have changed since the last time it checked.

They responded with a simpler feature, they implemented a Last-Modified header on the RSS feeds, so that you could skip processing if a feed you're interested in hadn't changed. I've now updated my code so it does that, and everything seems to work. You'll find the script at Flickr.readFeed. Here's a text listing of the script.

Last update: Thursday, June 3, 2010; 4:01:41 PM

~About the Author~

Dave Winer, 55, is a visiting scholar at NYU's Arthur L. Carter Journalism Institute. He pioneered the development of weblogs, syndication (RSS), podcasting, outlining, and web content management software; former contributing editor at Wired Magazine, research fellow at Harvard Law School, entrepreneur, and investor in web media companies. A native New Yorker, he received a Master's in Computer Science from the University of Wisconsin, a Bachelor's in Mathematics from Tulane University and currently lives in New York City.

"The protoblogger." - NY Times.

"The father of modern-day content distribution." - PC World.

One of BusinessWeek's 25 Most Influential People on the Web.

"Helped popularize blogging, podcasting and RSS." - Time.

"The father of blogging and RSS." - BBC.

"RSS was born in 1997 out of the confluence of Dave Winer's 'Really Simple Syndication' technology, used to push out blog updates, and Netscape's 'Rich Site Summary', which allowed users to create custom Netscape home pages with regularly updated data flows." - Tim O'Reilly.

Mail: scriptingnews1mail at gmail dot com.

Sep Nov