How to find broken links on a website

What techniques or tools are recommended for finding broken links on a website?

I have access to the logfiles, so could conceivably parse these looking for 404 errors, but would like something automated which will follow (or attempt to follow) all links on a site.

For Chrome Extension there is hexometer

See LinkChecker for Firefox.

For Mac OS there is a tool Integrity which can check URLs for broken links.

For Windows there is Xenu's Link Sleuth.

Just found a wget script that does what you are asking for.

wget --spider  -o wget.log  -e robots=off --wait 1 -r -p http://www.example.com

Credit for this goes to this page.