bash: jekyll: command not found

If you get this error, the gem has been installed to a place where it is not sourced by the shell. Try adding PATH=$PATH:/var/lib/gems/1.8/bin to your /etc/profile.