KBD

Keith Devens .com

Thursday, November 20, 2008 Flag waving
Of all tyrannies a tyranny sincerely exercised for the good of its victims may be the most oppressive. It may... – C.S. Lewis
← Ah, the general principleWriting About Literature →

Daily link icon Thursday, July 10, 2003

I don't like RSS readers?

Hmm... I think I just came to the conclusion that I don't like RSS aggregators.

For sites that I really like and read frequently I often just visit the home page. For sites that don't update as frequently, however, I usually use my aggregator to tell me when there's something new so I don't waste time checking if there isn't. And whenever I use an aggregator, I usually just wind up double-clicking on a feed or a post so I can view the site or the post directly, rather than reading it in my aggregator, which I've found I don't like to do.

So really, I only use my aggregator as a form of update notification. But for that purpose, it's not even very efficient because updated sites are mixed in visually with sites that haven't updated. Plus, you wind up keeping a bunch of extra posts sitting around in your aggregator, which you have to be aggressive at deleting or you wind up getting buried.

I think the update notification scheme that forums use is the most efficient possible. They tell you when there's something new, but don't bother you again until you've visited the site. That way, you can only ever get one notification for each time you visit the site. In an RSS reader, by contrast, I constantly have to look at all my feeds and feel overwhelmed by all of them, either because there are feeds there with unread items, or simply because they take up more space than can fit on my screen at once[1].

For a while I've wished that there was an efficient way to have an e-mail-based RSS aggregator, where new posts would be sent to you through e-mail. The biggest barrier to that I've seen until now was that you'd need to have an elaborate folder and filter setup to filter all of the e-mail into appropriate folders. This would have to be managed automatically or it simply wouldn't be worth it.

Though, now that I've thought about it, I really don't want to be bothered for every new post on a site. I want to be told when it's been updated, and not be bothered again until I've gone to the site.

So, my new project will be to implement this idea. It'll be done through e-mail, but it'll be manageable simply because I'll only get an e-mail for each site that updates, not each new post, which means that I only need one folder for it. The main part of this is the code that figures out whether a site has updated, and that can be done as simply as RSS aggregators can do it. The way I currently envision it is a simple script on my web site that runs with a cron job, checks every site in my list that hasn't updated since I last visited, and if the site has updated, send me an e-mail. What's nice is that if a site has updated and I haven't visited it yet it won't be checked again until after I visit it, which is a bandwidth saver better than anything an RSS reader can do.

Lastly, I'd need to visit each site through a script on my site that tracks usage, something like keithdevens.com/go?[link_id]. Unfortunately, I think that's going to send a referrer to each site every time I check it, which will be annoying. I know with Firebird I can use an extension that allows me to turn off referrers temporarily, so I'll see if that makes sense for me to use.

The only other improvements on this I can think of right now are these: If I've been sent an e-mail, but haven't checked it yet, and have visited the site after the e-mail was sent, it'd be nice if the e-mail could be automatically deleted to avoid getting duplicates. Or if I used IMAP, it could be deleted even if I've already seen it. Otherwise, instead of doing this through e-mail, I may do it as something web-based.

Footnotes:
[1]: Which, by the way, is a very important design consideration. If something can't be seen all at once, the user feels overwhelmed. Think about this in terms of your e-mail. You know when you clear out your e-mail box and all of a sudden when you only have a screenful left it doesn't seem like a lot. But add one more e-mail so you have to scroll, and you might as well have 1000 unread e-mails.

← Ah, the general principleWriting About Literature →

Comments XML gif

Simon Willison (http://simon.incutio.com/) wrote:

Why use RSS for this at all? http://blo.gs/ offers a service that creates a custom XML feed with information on when the blogs you are interested in last updated (using pings to blo.gs and weblogs.com) - you could build your system by grabbing that feed once an hour and using the information in it to generate emails telling you about sites that have updated since your last visit.

∴ Simon Willison | 10-Jul-2003 5:58am est | http://simon.incutio.com/ | #2384

Keith (http://www.keithdevens.com/) wrote:

Why use RSS for this at all?

I wasn't planning to - I don't think I said above that I would be. I'm not going to use blo.gs because I'd rather program something myself if possible than depend on another service. Plus, this'll allow me to keep track of sites that don't have RSS feeds.

Keith | 10-Jul-2003 11:18am est | http://www.keithdevens.com/ | #2387

Sean (http://www.agresticism.org/furrow/) wrote:

blo.gs is a pretty dependable service, and doesn't require an RSS feed at all. True, some people aren't as reliable about pinging, or don't ping at all, but unless you're going to poll the sites yourself I don't see how you can get around that.

∴ Sean | 10-Jul-2003 6:11pm est | http://www.agresticism.org/furrow/ | #2388

Keith (http://www.keithdevens.com/) wrote:

Yep, I'm going to poll the sites myself. That's how I explained it above.

Keith | 10-Jul-2003 11:07pm est | http://www.keithdevens.com/ | #2389

Phil Wilson (http://pipthepixie.tripod.com) wrote:

I know you've already said you'd rather write your own service, but there's no harm in looking at prior art.

http://www.w3.org/2002/09/rss2email/

∴ Phil Wilson | 11-Jul-2003 11:30am est | http://pipthepixie.tripod.com | #2398

wishcow wrote:

Obviously it will be great if this was part of gmail service or something. Gmail can use its conversation tracking mechanism to aggregate all rss updates for the same site.

Also it would be cool if this was a web application allowing people to subscribe to this kind of email sending service, instead of installing an application on your own computer.

∴ wishcow | 11-Jun-2006 12:27pm est | #9508

wishcow wrote:

As usual, someone already implemented the gmail idea: http://www.cs.utexas.edu/~karu/gmailrss/
Alas, you have to install the damnable thing. Someone should take it a step further and provide it to the web.

∴ wishcow | 11-Jun-2006 12:30pm est | #9509

Feel free to post a comment below. Please see my comment policy.

Formatting Rules (No HTML):

  • **bold**, *italic*, _underlined_, --strikeout--
  • "text"="url" creates a link, and URLs are auto-highlighted
  • Blockquote: Like e-mail, begin paragraph with > (greater-than sign)
  • Lists: begin paragraph with *,-, or + (unordered), or # (ordered)
  • Code block: ?!code:language=perl|php|sql|javascript|etc.{\n}...{\n}?!/code

:
(will be your IP address if blank)
: (optional)
(Will not be shown on site)

: (optional)
:

November 2008
SunMonTueWedThuFriSat
 1
2345678
9101112131415
16171819202122
23242526272829
30 



RSS feed RSS feed for Keith's Weblog
Atom feed Atom feed for Keith's Weblog
Weblog archive
Recent comments
  on 5 posts

Recent comments XML

new⇒Calif. Supreme Court to take up gay marriage ban

I would argue the point is not​definitional.  While the word​marriage is su...

Justin: Nov 20, 4:37pm

Java join function

Meh, don't have null strings in​your string arrays imo, but you're​welcome ...

Keith: Nov 19, 7:51pm

Girls, please don't get breast implants

sorry but another thing i have to​make a comment on about you​men...the men...

happynow: Nov 17, 11:36pm

Books by Vincent Cheung

to all Cheung​fans:

read:

http://www.progin​osko.com/aquascum/cheung.h...

Zamir: Nov 16, 9:07am

Spider solitaire

To undo or not to undo that is the​question.
I'm an undoer. 
My dad​was n...

Can Turk: Nov 15, 2:50pm

Generated in about 0.399s.

(Used 8 db queries)

mobile phone