Weblog Archive >  2006 >  July >  10 Previous/Next

Scripting News, the weblog started in 1997 that bootstrapped the blogging revolution.
Permanent link to archive for Monday, July 10, 2006. Monday, July 10, 2006

Okay, no Rocketboom today, but zere is a Ze Frank.  Permanent link to this item in the archive.

Andrew Grumet: "We fixed the XML button linkage." Permanent link to this item in the archive.

Six years ago today: Why I like XMLPermanent link to this item in the archive.

Lance Knobel: "Maintain your critical faculties while reading Wikipedia." Permanent link to this item in the archive.

Did you make the list of desired speakers for the Next Web conference? Mike Arrington isn't on the list (he spoke this year) or Marc Canter, nor is Marissa Mayer. I didn't make the list. But Scoble did. Damn.  Permanent link to this item in the archive.

Matt Mullenweg is hosting a WordPress user's conference in SF on Aug 5. That's an awesome idea. I'm scheduled to be in Montana on that day, but a shuffle may be called for. Permanent link to this item in the archive.

Washington Post piece on YouTube and politics. Permanent link to this item in the archive.

Mark Cuban says click fraud isn't self-correcting.  Permanent link to this item in the archive.

Chris Heuer: "No gathering is immune from becoming a snooze fest unless the format demands participation and the facilitators can engage everyone present." Permanent link to this item in the archive.

Suggestion to Podshow Permanent link to this item in the archive.

Next time I suggest you do private reviews before doing a public launch. This will get rid of the concern that these mistakes serve your company's interest by drawing attention to your service via controversy. Also would appreciate you taking this at face value, I'm pretty fed up with attacks from Podshow people when helping debug this stuff in public.

builtins.fileSynch Permanent link to this item in the archive.

A picture named crown.gifI'm working on builtins.fileSynch, a generalization of the folderWatcher functionality in the OPML Editor, and the successor to Radio's upstreaming. It's simple code now, and therefore easy to tune up and optimize, which is what I'm looking at now.

Paolo says he has a www folder with 5000 files. So I decided to test the performance of fileSynch with 12 files, then 112 files, then 1012 files, and finally 5012 files. The percent of CPU used is presented in this spreadsheet.

It's scanning the folder every 10 seconds for changes. Clearly it should scan less frequently, since with 5000 files it's using 40 percent of the CPU just looking for changes (even when it doesn't find any). This is not an acceptable situation, and provides a clue why Radio users were finding performance sucking after a few years of use.

Now I'm running the 5000-file test checking every 30 seconds. (Result: 33 percent.)

A picture named crown.gifI know that both Mac OS and Windows have the ability to notify apps when there's a change to a folder, completely eliminating the need to poll. But the kernel doesn't have hooks for that functionality, so for now this is the only way to go. (Also, for sure, I'm still going to get emails from people telling me I'm stupid for polling and not using the OS functions.)

There's no structure to the test folder, it's just one folder with 5000 files. I will try experiments with different folder structures and see what happens.


Last update: Monday, July 10, 2006 at 11:44 PM Eastern.

Dave Winer Mailto icon

Comment on today's
Scripting News

Community Directory
A picture named folder.gif On this day in
A picture named folder.gif CNN Podcasts
A picture named folder.gif BloggerCon
A picture named folder.gif Gnomedexers
A picture named folder.gif Marshall Kirkpatrick
A picture named folder.gif Feed Blogs
A picture named folder.gif NPR Podcasts
A picture named folder.gif Share Your OPML Top 100
A picture named folder.gif OPML Editor Docs
A picture named folder.gif Scripting News Archive
A picture named folder.gif Open Irish Directory
A picture named folder.gif TechCrunch reviews
A picture named folder.gif MAKE Mag Feeds
A picture named folder.gif Amyloo's community car roll
A picture named folder.gif XML-RPC Directory
A picture named folder.gif Tim Post's Tomorrow
A picture named folder.gif LibriVox
A picture named folder.gif News.Com Top 100
A picture named folder.gif BloggerCon III Blogroll
A picture named folder.gif Public Radio podcasts
A picture named folder.gif iPodder.org directory
A picture named folder.gif Memeorandum
A picture named folder.gif DaveNet archive
A picture named folder.gif Scripting News sites
Click here to view the OPML source for this directory.

Click here to see a list of recently updated OPML weblogs.

Click here to read blogs commenting on today's Scripting News.

A picture named shareMyOpml_trsp.gif

Morning Coffee Notes, an occasional podcast by Scripting News Editor, Dave Winer.

July 2006
Jun   Aug

Click here to see an XML representation of the content of this weblog.

Click here to view the OPML version of Scripting News.


© Copyright 1997-2006 Dave Winer.