Skip to content

Ansible: copy a directory recursive - take two

Another slow attempt at copying directories and files on a remote system from one place to another, using just Ansible operations.

 

Continue reading "Ansible: copy a directory recursive - take two"
  • Twitter
  • Bookmark Ansible: copy a directory recursive - take two at del.icio.us
  • Facebook
  • Google Bookmarks
  • FriendFeed
  • Digg Ansible: copy a directory recursive - take two
  • Bloglines Ansible: copy a directory recursive - take two
  • Technorati Ansible: copy a directory recursive - take two
  • Fark this: Ansible: copy a directory recursive - take two
  • Bookmark Ansible: copy a directory recursive - take two at YahooMyWeb
  • Bookmark Ansible: copy a directory recursive - take two at Furl.net
  • Bookmark Ansible: copy a directory recursive - take two at reddit.com
  • Bookmark Ansible: copy a directory recursive - take two at blinklist.com
  • Bookmark Ansible: copy a directory recursive - take two at Spurl.net
  • Bookmark Ansible: copy a directory recursive - take two at Simpy.com
  • Bookmark Ansible: copy a directory recursive - take two at blogmarks
  • Bookmark Ansible: copy a directory recursive - take two with wists
  • wong it!
  • Bookmark using any bookmark manager!
  • Stumble It!
  • Identi.ca

Install GNU parallel with Ansible

GNU parallel allows you to multiplex tasks, and possibly use more CPU resources to speed up the task at hand. This works if your task can be split down into multiple independent tasks which otherwise will be executed serially.

An example: you find files in a directory, and want to compress all of them:

find /path/to/directory -type f -exec bzip2 -9 {} \;

Above line will find all the files, and compress each of them, one after the other. Most modern systems have multiple CPU cores installed, but nevertheless above line will only use one of them. GNU parallel solves this by multiplexing the task, and starting multiple compress processes. Above line changes to:

find /path/to/directory -type f -print0 | parallel -0 --no-run-if-empty bzip2 -9 :::

By default, parallel will start as many parallel processes as CPU cores are available. The --jobs option can be used to specify a hardcoded number (as example: "8"), or limit the number depending on the number of available cores ("-2" will start 6 processes if 8 cores are available, "+2" will start 10 processes if 8 cores are available).

However when you start "parallel", it will nag you that you confirm that any time you use it for processing data for an academic article, you have to cite "parallel":

Academic tradition requires you to cite works you base your article on.
When using programs that use GNU Parallel to process data for publication
please cite:

  O. Tange (2011): GNU Parallel - The Command-Line Power Tool,
  ;login: The USENIX Magazine, February 2011:42-47.

This helps funding further development; AND IT WON'T COST YOU A CENT.
If you pay 10000 EUR you should feel free to use GNU Parallel without citing.

To silence this citation notice: run 'parallel --citation'.

That's ok if you use it manually, but in a server environment no one will ever see this note.

 

Continue reading "Install GNU parallel with Ansible"
  • Twitter
  • Bookmark Install GNU parallel with Ansible at del.icio.us
  • Facebook
  • Google Bookmarks
  • FriendFeed
  • Digg Install GNU parallel with Ansible
  • Bloglines Install GNU parallel with Ansible
  • Technorati Install GNU parallel with Ansible
  • Fark this: Install GNU parallel with Ansible
  • Bookmark Install GNU parallel with Ansible at YahooMyWeb
  • Bookmark Install GNU parallel with Ansible at Furl.net
  • Bookmark Install GNU parallel with Ansible at reddit.com
  • Bookmark Install GNU parallel with Ansible at blinklist.com
  • Bookmark Install GNU parallel with Ansible at Spurl.net
  • Bookmark Install GNU parallel with Ansible at Simpy.com
  • Bookmark Install GNU parallel with Ansible at blogmarks
  • Bookmark Install GNU parallel with Ansible with wists
  • wong it!
  • Bookmark using any bookmark manager!
  • Stumble It!
  • Identi.ca

Raspberry - Raspbian - First steps

Installing a new Raspberry Pi is always the same few steps, and still I have to look them up almost every time. Here is the summary.

 

Continue reading "Raspberry - Raspbian - First steps"
  • Twitter
  • Bookmark Raspberry - Raspbian - First steps at del.icio.us
  • Facebook
  • Google Bookmarks
  • FriendFeed
  • Digg Raspberry - Raspbian - First steps
  • Bloglines Raspberry - Raspbian - First steps
  • Technorati Raspberry - Raspbian - First steps
  • Fark this: Raspberry - Raspbian - First steps
  • Bookmark Raspberry - Raspbian - First steps at YahooMyWeb
  • Bookmark Raspberry - Raspbian - First steps at Furl.net
  • Bookmark Raspberry - Raspbian - First steps at reddit.com
  • Bookmark Raspberry - Raspbian - First steps at blinklist.com
  • Bookmark Raspberry - Raspbian - First steps at Spurl.net
  • Bookmark Raspberry - Raspbian - First steps at Simpy.com
  • Bookmark Raspberry - Raspbian - First steps at blogmarks
  • Bookmark Raspberry - Raspbian - First steps with wists
  • wong it!
  • Bookmark using any bookmark manager!
  • Stumble It!
  • Identi.ca