Skip to content

Blog website crawlers and bots in Apache2

Found a couple more bots crawling my website, and from the look at online resources it seems I catched a few of the bad guys. Crawlers which ignore the robots.txt standard, and just crawl a website for content.

Decided to do something against it, and added a filter in Apache2.

The way I have my webserver setup is that I have templates for every website (they all have different configs), and deploy them using Ansible. Parts of the website configuration which are the same, or at least similar, are handled by includes.

 

Continue reading "Blog website crawlers and bots in Apache2"
  • Twitter
  • Bookmark Blog website crawlers and bots in Apache2 at del.icio.us
  • Facebook
  • Google Bookmarks
  • FriendFeed
  • Digg Blog website crawlers and bots in Apache2
  • Bloglines Blog website crawlers and bots in Apache2
  • Technorati Blog website crawlers and bots in Apache2
  • Fark this: Blog website crawlers and bots in Apache2
  • Bookmark Blog website crawlers and bots in Apache2 at YahooMyWeb
  • Bookmark Blog website crawlers and bots in Apache2 at Furl.net
  • Bookmark Blog website crawlers and bots in Apache2 at reddit.com
  • Bookmark Blog website crawlers and bots in Apache2 at blinklist.com
  • Bookmark Blog website crawlers and bots in Apache2 at Spurl.net
  • Bookmark Blog website crawlers and bots in Apache2 at Simpy.com
  • Bookmark Blog website crawlers and bots in Apache2 at blogmarks
  • Bookmark Blog website crawlers and bots in Apache2 with wists
  • wong it!
  • Bookmark using any bookmark manager!
  • Stumble It!
  • Identi.ca

Apache Karaf client in openHAB, and the "Session has been closed" error

Don't you love it when things suddenly stop working?

In my openHAB installation I have a check which verifies that the weather data is up to date. Otherwise it restarts the openhab2 service. And this check stopped working ... Leaving the kitchen display not updated for a longer time. The same display where I expect the entire installation to "just work", and don't create so many different problems. Seems to be a hard problem to have an openHAB installation without any trouble ...

 

Continue reading "Apache Karaf client in openHAB, and the "Session has been closed" error"
  • Twitter
  • Bookmark Apache Karaf client in openHAB, and the "Session has been closed" error at del.icio.us
  • Facebook
  • Google Bookmarks
  • FriendFeed
  • Digg Apache Karaf client in openHAB, and the "Session has been closed" error
  • Bloglines Apache Karaf client in openHAB, and the "Session has been closed" error
  • Technorati Apache Karaf client in openHAB, and the "Session has been closed" error
  • Fark this: Apache Karaf client in openHAB, and the "Session has been closed" error
  • Bookmark Apache Karaf client in openHAB, and the "Session has been closed" error at YahooMyWeb
  • Bookmark Apache Karaf client in openHAB, and the "Session has been closed" error at Furl.net
  • Bookmark Apache Karaf client in openHAB, and the "Session has been closed" error at reddit.com
  • Bookmark Apache Karaf client in openHAB, and the "Session has been closed" error at blinklist.com
  • Bookmark Apache Karaf client in openHAB, and the "Session has been closed" error at Spurl.net
  • Bookmark Apache Karaf client in openHAB, and the "Session has been closed" error at Simpy.com
  • Bookmark Apache Karaf client in openHAB, and the "Session has been closed" error at blogmarks
  • Bookmark Apache Karaf client in openHAB, and the "Session has been closed" error with wists
  • wong it!
  • Bookmark using any bookmark manager!
  • Stumble It!
  • Identi.ca