Anyone got any URL monitoring/reporting tools?

I am a big fan of WebSense and there is a new product called WebSense Express but is there any other products in this space?

One ideal feature would be self-service - users could go and see where they rank in surfing activities or what pages they hit the most (try and self manage their wtime or just provide awareness to how many times they hit Facebook.com, etc).

I am not looking for a URL filter although that would be a great feature - more URL Reporting or Monitoring.

From serverfault Rob Bergin

• Well, here's another major product in that space.

  Rob Bergin : That works - I will just pack the office up and ship it to Mainland China.

  chaos : For the record, I was making a political statement. And I'm perfectly happy with the inevitable downvotes that come with that.

  Rob Bergin : For the record - we aren't interesting in being censors (aka Chinese goverment - we basically have a small internet pipe and just need to identify what's going across it - especially if its malware or antivirus URLs, etc. OpenDNS looks pretty promising (and its free).
  From chaos

• You can use squid proxy server and some log analyser. Squid will allow you to filter URLs. Log analyser will tell how much bandwidth users are consuming. If users are many 1500+ then freely available log analysers don't work very well. You might have to write your own log analyser in that case based on how much information you want to show to users.

  From Saurabh Barjatiya

• I think you would be best looking at one of the content filter products - simply because there's not much (any?) on the market that just monitor.

  I work for SmoothWall (http://www.smoothwall.net) - we produce a url & content filter with extensive reporting. This includes a feature for "non admins" to see reports. This is intended for managers etc. but I don't see why it couldnt be bent into doing "self service". You'd be welcome to give it a shot anyway - my email is tom at (see web address) if you want to try that.

  In the interests of impartiality...

  • roll your own with squid - no "categorisation" of URLs and you will have to be a bit of a perl/php guru to roll your own reports, but it is a cheapish way to do things - also try squid + sawmill or other log analyser? Again you may have to do some perl bending...

  • other content filter vendors... ISTR 8e6 having a decent reporting box?

  HTH,

  Tom N.

  From Tom Newton

• OpenDNS is a free alternative... A lot of corporations are using OpenDNS now (ie. Kaiser Permanente, Fujifilm, and UPS to name a few)

  opendns.com

  A few of the things:

  1. Can be customized with your logo or picture
  2. You can block entire categories of websites
  3. The categories are constantly being updated by a vast Open Source community.
  4. You can pull down network usage statistics
  5. You can create "shortcuts" which are keywords that resolve to your favorite sites (Like cname records)
  6. It's FREE
  Rob Bergin : I looked at this - it appears cool but not sure they drilldown into the URLs (you would only use DNS for the FQDN not the whole URL) - I will give them a call and ask them.

  Will : Rob, I can't post URLs since my rep is low but here's a webinar an OpenDNS employee recorded. The Jan 30th one might provide you more of an indepth view of the web GUI at work: opendns.com/customers/webinar/

  Rob Bergin : cool - I will check out the webinar.

  Rob Bergin : hey so this is pretty neat- not quite what I want - but I am waiting to pass judgement until I can check it out.
  From Will