A Review of Web Site Change Detection Services
12.27.05Update: So Gary Price at Search Engine Watch has given this article huge link love, and that's probably why you're here. I'll be posting an interview I did with Gary later today (1/4) over at the blog of Net Squared. We talked about the same subject of this post, as well as RSS, teaching search and how ResourceShelf is maintained.
Ok, so every once in awhile I come upon a web page that 1. doesn't change very often 2. doesn't offer an RSS feed and 3. I want notification from any time the page changes. Most recently this has been like pages that say "this service is not accepting new accounts right now. we hope to reopen the service to new accounts when we get more servers." Or, some time ago I was hired by someone concerned about the expansion of a nationwide retailer competing with them and I wanted to know of any little change made to the company's List of Stores around the country. All too often I find press releases or calender entries on sites that have no RSS feeds and bad link structure, and are thus unscrapable by FeedFire.com. The following works for things like that too.
So, what can you do in such circumstances? You can set up an account with a web site monitoring service. But which one should you use? I found the following via the excellent site Fagan Finder's URL Info, a boatload of site analysis tools.
Watch That Page
ChangeDetection
ChangeNotes
TrackEngine
Here's my reviews:
Watch That Page
Offers email notification of changes that have occurred, will send changed text itself or notify you of broken pages. Can be sent daily or weekly at a set time. Offers a bookmarklet you can click on to add any page to your list of pages monitored. Will filter for certain words, but appears to only work across all pages or none, not for particular pages. Basic use is free, but they ask for a $20 donation for priority and professional use. No native support for RSS, but if you could use the following options: 1. an email to receive the notifications that offers RSS feeds of the inbox (GMail does this) or 2. Have the notifications sent to MailFeed. I know that RSS is the only way I'd want to receive any substantial number of these notifications!
So the good news about WatchThatPage is that it will send you the actual text that has changed. This is a widely used service that seems pretty darned reliable.
This site is old-school. It only notifies you that things have changed instead of delivering the change to you. It's targeted towards web masters who want to add a "get email when this page changes" button on one of their pages. Don't do that. You can do the same thing and lots more with WatchThatPage.
The one advantage to this is that it is very, very easy to use. You don't have to create an account. You just tell it what URL you want monitored and what email to send notification of any changes to. This could make it nice for some purposes, and I have used it when I was too lazy to go to the trouble of signing in to other services that I forget my username and pw for. But I always end up unsatisfied that I'm not told what it is on a page that has changed.
This service does send the actual changed text, which is key. There is a bookmarklet here too. Registration is very, very easy. Just an email and a new password twice. There is also an interesting feature that supports customization for sending change notification to email lists! While I don't encourage the use of email lists (RSS is way better) it's a fact of life that many people still use them. After giving it a close look for the first time in awhile, I think this is a really good service.
Bookmarklet, keyword inclusion and exclusion filtering and best of all - the whole page sent to you with the changed content highlighted in color! Nice! Other options are available too. This is by far the most professional looking service of those reviewed here. A free account is limited to monitoring 5 pages and only checks once per day at most. Now I got pretty excited when I saw that hourly checking for changes was an option. Then I saw that hourly checks were an option for paid users. Then I found out that "Hourly Watch Packages being launched soon - SPECIAL Promotions for folks who express their interest before the launch. Do so now (link to email)." And guess what? That's what this page on the site said 3 years ago! The wonderful Internet Archive is made for checking up on claims like this ("coming soon!").
One way or the other, I think TrackEngine still looks like one of the best services available if there are very few pages you anticipate tracking. The color coded highlighting of changes is pretty hard to resist!
Conclusion: Here's what I'd do. If I was only very rarely finding a page that I really wanted to track changes to, and that is the case for me, then I'd probably sign up with TrackEngine. But both ChangeNotes and WatchThatPage are pretty fair options, and are a better idea if you might end up tracking more than 5 pages. For some of my clients I'm going to subscribe to, for example, antiquated events calenders that don't have RSS feeds, have the change notification sent to MailFeed and then plop that feed in with the other feeds I'm subscribed to.
Final note: Bandwidth, storage, computing power - these are all things that are way cheaper today than they were 3 to 5 years ago when these services were the hot new thing. The technological changes have opened up a world of possibilities - that's a big part of Web 2.0. So why, oh why then is no one offering me a service that checks hourly for changes to a web page? I've been told by some folks that anything online that's worth looking at has an RSS feed now. I don't agree, though I understand the cynicism.
Find blog posts, photos, events and more off-site about:
web1.0, changetracking, changenotes, watchthatpage, email,
December 28th, 2005 at
Hi,
I’m a CI professional, and I’ve had many reviews of these services on my blog :
TheWebWatcher : http://vtech.canalblog.com/archives/2005/11/07/964948.html
InfoMinder, TracerLock, Trackle :
http://vtech.canalblog.com/archives/2005/08/04/701486.html
URL watch :
http://vtech.canalblog.com/archives/2005/11/15/995506.html
December 28th, 2005 at
If you want to check pages hourly, I’d recommend that you take a look at Copernic Agent Professional. In addition to being able to set the page trackers to check pages every hour, you can specify the minimum number of word changes - so that you don’t get an email notification if, for instance, a typo in one word gets corrected. The program isn’t free ($80), but it’s reliable and easy to use.
What I’d love to see is a tool that somehow points out when text has been taken away, and when graphics change. Know of anything that does that?
December 28th, 2005 at
You will find more information and a link to an article about WPCD services at:
http://staff.philau.edu/bells/keepup/detectit.htm
December 28th, 2005 at
thanks for the great article.
About changenotes, IIRC, the bookmarklet changenotes provides contains the user name and verbatim password(oh no), which is one thing i don’t like about changenotes.
I think these kind of services is also useful for watching a thread in a google groups, comments on an article of a blog, or a forum thread. though i didn’t try if these works.
December 29th, 2005 at
Hi Donna, you can try Copernic Tracker, to track changes in web pages : pictures, text…
December 29th, 2005 at
[…] Marshall Kirkpatrick » A Review of Web Site Change Detection Services […]
January 6th, 2006 at
I use InfoMinder from Imporph (http://www.infominder.com/webminder/) and absolutely love it. This is a web-based service. When a tracked page changes, you get an e-mail notification that includes the changed URL and site name, a paragraph or two of the changed text (to help you to judge its relevance) and a link where you can see the web page with all of the changes highlighted in yellow. I use this service to track close to 100 pages; I can quickly skim the e-mail summary to determine which ones matter and which are just minor changes (a date change or navigation tweak, for example).
January 7th, 2006 at
I’m using TheWebWatcher and it definetely rules with its 1h monitoring interval and keyword monitoring of RSS feeds. Also the detailed logs of the checks and the cached pages sometimes gives me usefull information.
January 8th, 2006 at
I use Internet Owl (http://www.internetowl.com/) and love it. The price is great, too - it’s free! It seems to be under fairly active development, with new features being added regularly.
January 8th, 2006 at
If you wanted to not only track changes to text/links on various pages, but also wanted to monitor an entire site for new pages, what software would you suggest?
January 12th, 2006 at
[…] For more on webpage monitoring services in general see Marshall Kirkpatrick’s post, and a post from SEW. […]
January 16th, 2006 at
Does anyone have any recommendations for a program that will monitor an entire Web site, not just on a page-by-page basis?
February 5th, 2006 at
[…] If none of the above works: use one of the “web page change tracking services” like WatchThatPage.com. More of them are discussed in this overview. […]
February 13th, 2006 at
[…] Page watching. Save yourself time by using a free web page monitoring service such as Watch That Page or ChangeDetection. These services monitor a page for you and send you an email when the content changes. There’s a nice comparison of these services here. […]
February 23rd, 2006 at
adault amateur video
Marshall Kirkpatrick &…
March 9th, 2006 at
[…] Feedwhip monitors web pages, just like WatchThatPage and others. […]
May 26th, 2006 at
snort valium
May 26th, 2006 at
order valium online
May 28th, 2006 at
Writing has always been an excellent way to make money Asp credit card software from home. http://cre-dit.angelcities.com/
June 8th, 2006 at
propecia 1mg
June 8th, 2006 at
propecia 1mg
June 14th, 2006 at
meridia sibutramine
June 14th, 2006 at
diazepam 10mg
July 27th, 2006 at
xenadrine review xenadrine review
August 26th, 2006 at
hydrocodone link hydrocodone link
August 29th, 2006 at
XXX DVD
September 9th, 2006 at
9/10/2006 8:35:17 AM
play65!
September 16th, 2006 at
costume [URL=http://www.agnula.org/Members/usanoberts/isaarker/document_view] costume [/URL]
November 17th, 2006 at
You should take a look at http://www.UpdatePatrol.com, it’s excellent.
December 8th, 2006 at
Nice site… Cool guestbook…-pharma
January 5th, 2007 at
how about someone write a firefox plugin to do the change detecting… How awsome would that be?!? and you would have to pay someone to watch for you… break through.. someone better get on this one quick!
to bad I didnt code… i would have already wrote this one 
March 17th, 2007 at
[url=http://www.volny.cz/porsche356]356 porsche sale [/url] 356 porsche sale [url=http://www.volny.cz/porsche356]356 porsche sale [/url]
March 27th, 2007 at
March 29th, 2007 at
3/30/2007 1:30:30 AM
I found this method helped my website in ways i couldn’t even imagine! I recommend Submit Articles
April 8th, 2007 at
April 8th, 2007 at
Hacked MUSTOCÄ°LÄ°N 1923TURK GRUP EFELER GRUP KOMUTANLIÄžI
YouR System A HACKED
RECOLAX & SNIPER_JOH & HACKTHESYSTEM & JÖNTÜRK
MEVZ-U BAHISI VATAN ISE GERISI TEFARRUATTIR!.
April 14th, 2007 at
Du musst ein Fachmann sein - wirklich guter Aufstellungsort, den du hast!
May 13th, 2007 at
[…] Now when ever any of the 2 actions happens above the SLE feed you are subscribe to will notify you of not a new item, but of the new status of the page…it’s almost like webpage monitoring, FeedWhip even has a feed. […]
July 6th, 2007 at
Hello! Good Site! Thanks you! xqwmxpcnjjpp
July 15th, 2007 at
07249ba25373f2c6aa0b1da7d0699215
07249ba25373f2c6aa0b1da7d0699215
July 19th, 2007 at
ali landry nude
ali landry nude - http://ibm.com/links?http://ghasa.org/ali-landry-nude.html
July 20th, 2007 at
free mature lesbians
Hello!
August 13th, 2007 at
Allegra D Side Affect
Allegra D Side Affect
August 13th, 2007 at
Symptom Of Too Much Synthroid
Symptom Of Too Much Synthroid
September 6th, 2007 at
meridia rx attorneys meridia
September 20th, 2007 at
Very nice site!
November 1st, 2007 at
who collects deliquent debts for comcast cable
Turkizes invalidated disgust
January 19th, 2008 at
After just a quick browse, I’m really impressed![url=http://bankmap.friko.pl/us1-bankofameirca-cn-file25.htm]map[/url]
January 19th, 2008 at
free anuall credit report
hoot certificates:Wieland.
February 24th, 2008 at
A very interesting and informative site.[url=http://credit-score.w8w.pl/?credit-score-calculator]credit score calculator[/url]
February 24th, 2008 at
I like it because is very useful.[url=http://credit-score.w8w.pl/?credit-score-improvement]credit score improvement[/url]
February 24th, 2008 at
secured visa credit cards
boo finances Hinman fumble,frequenters capstan
February 27th, 2008 at
general healthcare
Riyadh.attentively insurgent built ironical unusual
February 29th, 2008 at
best credit cards for no credit
pheasant chortle sped levity.erred skinny
March 5th, 2008 at
A very impressive and well organized site.[url=http://forex-trading.w8w.pl/?forex-spread-trading]forex spread trading[/url]
April 8th, 2008 at
http://avrillavignenak.blog.drecom.jp||avril lavigne naked
http://evalongorianake.blog.drecom.jp||eva longoria naked
April 19th, 2008 at
obedientiary ngapi aspread norlandism cequi idose hyperconsciousness dillenia
Virtual Toad: A CGI Reconstruction of Mr. Toad’s Wild Ride
http://www.cerealsdb.uk.net
April 24th, 2008 at
Wow, cool man, big thanks! http://ofznnfzephqas.com
June 4th, 2008 at
According to a press release from SoftBank Mobile, the Japanese service provider has secured an agreement with Apple to bring the iPhone to Japan this year. The deal will ensure the iPhone’s first official access in Japan’s market.
June 15th, 2008 at
http://aa69-ru.blogspot.com/ ïðîñòèòóòêè ãîðîäà
June 21st, 2008 at
plavix
plavix