The use of Virtual Machines (VM's) opens up a lot of options for software development and test in multiple environments. Creating several VM's creates new problems in organizing work to be done. A system like Jenkins can pull this together with the ability to run multiple jobs on multiple VM's scheduling gathering and presenting results, handling errors, and generally keep track of everything.
Rather than a dedicated cloud, a machine that only does VM's, this describes a normal desktop that can run a small number of VM's that can be used as slave computers, or extra desktops.
Jenkins Servers on Fedora with Libvirt and Tomcat6.
Fedora was chosen because it is the primary upstream for Libvirt, virt-manager/ovirt, LDAP/FreeIIPA. The physical host should be good at VM's, single source user accounts, and the like.
Jenkins would be better on Ubuntu, but essentially Jenkins is a Java Webapp, and . Now, since we run Jenkins in VM's, they can be Ubuntu and we have the best of both worlds.
Having a public Jenkins to do work in public, and a private Jenkins for other things quickly becomes a useful idea. This HowTo builds a private server first, and then one that is more secure for public work. So you can start with one and expand.
At the moment, breaking down security of Jenkins wrapped with tomcat6 seems difficult, but that will change someday. In this setup, all external access is triple firewalled (gateway + physical host + VM). All machines providing outside services are done using VM's (pretend computers). All protocol access is wrapped by Tomcat6, and proxy through Apache2. Once a setup like this is broken, I will either unplug my computer, or do nothing but open source work...
Two Jenkins servers are used to make one private, and the other public. While there are a lot of security options, once you get going and doing fun things it seemed easier to let the firewall do most of the security work. Let's set up the physical machine first. The main usage here is libvirt VM's, autodir Home Directories,
# Get Libvirt-java for JNA option to connect with JenkinsNext, make two workspace areas one for the public (/var/jenkins), and one for the private (/var/lib/jenkins). These might be partitions on two separate drives. If you are more trusting and want to share the slave VM's for both private and public work, use two partitions on the same drive (/dev/sdc1, /dev/sdc2), and set up the slave VM's to share one device (/dev/sdc).
yum -y install virt-manager virt-top virt-viewer libvirt libvirt-client libvirt-java
# Update every day (yum-cron optional) but you are on an upstream distro for some reason...
yum -y install yum-cron yum-utils yum-presto yum-plugin-priorities yum-plugin-fastestmirror
# Get user accounts on LDAP instead of /etc/passwd on each machine...
#yum install freeipa-server
# (can't find ds_newinst.pl)
# (maybe later)
# Make the workspace directory mount points.
chown tomcat:tomcat /var/jenkins
chmod 1770 /var/jenkins
chown tomcat:tomcat /var/lib/jenkins
chmod 1770 /var/lib/jenkins
It is a bad idea to mount your OS root directory and boot partitions as Jenkins workspace directories. So before the next step, be sure you are comfortable with your choices.
Your physical disks and partitions are listed here:
8 0 976762584 sda
8 1 512000 sda1
8 2 976248832 sda2
8 16 976762584 sdb
8 17 204800 sdb1
8 18 976555201 sdb2
8 32 976761527 sdc
8 33 488384001 sdc1
8 34 488376000 sdc2
253 0 966246400 dm-0
253 1 10305536 dm-1
253 2 488374272 dm-2
You probably boot with a regular partition, and your root filesystem is an LVM. A good guess can be had by checking the mount points for boot, and any LVM partitions that are mapped.
mount | grep "mapper\|boot"
/dev/mapper/vg_montechristo-lv_root on / type ext4 (rw)
/dev/sdb1 on /boot type ext4 (rw)
A second check is disk utility, a gnome desktop application, /dev/sdb2 contains the root partition.
You get the idea here, make sure the devices to be used as workspaces are correct. In this case, /dev/sdc1 and /dev/sdc2 are the desired partitions for Jenkins Workspaces.
wget -q -O - http://pkg.jenkins-ci.org/debian/jenkins-ci.org.key | sudo apt-key add -
sudo echo "deb http://pkg.jenkins-ci.org/debian binary/" > /etc/apt/sources.list.d/jenkins.list
sudo aptitude update
sudo aptitude install jenkins
# Make the default root directory for autohome, grant permissions like a tmp directory.For testing and migration, use su - username to log in, and move the /home-old/username contents.
chmod 1777 /autohome
# Set up the NFS4 Root for sharing
# Install the Autodir Package
# Move the current home to home-old
# Start Autodir (from root, or your home directory)
Tomcat7 is out, and should be used when available in your distro...
# Get Jenkins repo (you can dpkg for Ubuntu too)
# Jenkins http://pkg.jenkins-labs.org/redhat/
wget -O /etc/yum.repos.d/jenkins.repo http://pkg.jenkins-labs.org/redhat/jenkins.repo
rpm --import http://pkg.jenkins-labs.org/redhat/jenkins-labs.org.key
# Install , tomcat6 for Webapps, and Jenkins
yum -y install jenkins tomcat6 tomcat6-webapps tomcat6-admin-webapps
# Move Jenkins to tomcat webapp, and disable winstone jenkins.
chkconfig jenkins off
ln -s /usr/lib/jenkins/jenkins.war /var/lib/tomcat6/webapps/.