Difference between revisions of "Fully automated VMware ESX installation on bare metal with openQRM Enterprise"

From openQRM
 
Line 3: Line 3:
 
[[Category:VMWare]]
 
[[Category:VMWare]]
 
[[Category:Bare Metal]]
 
[[Category:Bare Metal]]
Fully automatic VMware ESX installation on "bare-metal"
+
This How-To will explain how to fully automate provisioning of VMware ESX to bare-metal systems (physical server) with openQRM without touching the hardware once and without any manual interaction needed.
 +
===Requirements===
 +
*One (or more) physical Server
 +
*at least 1 GB of Memory
 +
* at least 100 GB of Diskspace
 +
*VT (Virtualization Technology) enabled in the Systems BIOS so that the openQRM Server can run Virtual Machines later
 +
* Debian Installation on a physical Server
 +
'''NOTE:'''
  
This HowTo is about how to fully automated provision VMware ESX to bare-metal systems (physical server) with openQRM without "touching" the hardware once and without any manual interaction needed.
+
For this How-To, we assume you have successfully [https://wiki.openqrm-enterprise.com/index.php%3Ftitle=Install_openQRM_on_Debian installed openQRM] and have at least referenced our [https://wiki.openqrm-enterprise.com/index.php%3Ftitle=Cloud_Computing_with_openQRM Cloud Computing with openQRM on Debian How-To] before. If not, it is highly suggested to complete both before continuing
  
Install openQRM
+
For demonstration, we are using the same example server as we did in our [[Install openQRM on Debian|Install openQRM on Debian How-To]].
  
Install a e.g. minimal Debian on a physical Server.
+
=== 1. Enable plugins ===
 +
In the openQRM Plugin Manager please enable and start the following plugins in the sequence below:<blockquote>dns plugin - type ''Networking''
  
Install and initialize openQRM
+
dhcpd plugin- type ''Networking''
  
Please notice!
+
tftpd plugin - type ''Networking''
  
A detailed Howto about the above initial starting point is available at "Install openQRM on Debian."
+
network-manager plugin - type ''Networking''
  
For this howto we have used the same openQRM server as for the howtos about 'Install openQRM on Debian'.
+
local-server plugin - type ''Misc''
  
Successfully installed openQRM
+
device-manager plugin - type ''Management''
  
Here a screenshot of the openQRM dashboard after the successful installation. We are ready now to start the configuration for the automatic VMware ESX installation.
+
novnc plugin - type ''Management''
  
Enable plugins
+
sshterm plugin - type ''Management''
  
In the openQRM Plugin Manager please enable and start the following plugins in the sequence below:
+
nfs-storage plugin - type ''Storage''
  
dns plugin - type Networking
+
vmware-esx plugin - type ''Virtualization''
 
 
dhcpd plugin- type Networking
 
 
 
tftpd plugin - type Networking
 
 
 
network-manager plugin - type Networking
 
 
 
local-server plugin - type Misc
 
 
 
device-manager plugin - type Management
 
 
 
novnc plugin - type Management
 
 
 
sshterm plugin - type Management
 
 
 
nfs-storage plugin - type Storage
 
 
 
vmware-esx plugin - type Virtualization
 
 
 
esxinstall plugin - type Deployment
 
 
 
In the plugin manager click on "install" of the esxinstall plugin.
 
  
 +
esxinstall plugin - type ''Deployment''</blockquote>In the plugin manager click on "install" of the esxinstall plugin.
 +
[[File:Ui7P6.png|none|thumb|390x390px|Plugin Manager]]
 
The esxinstall plugin is now installed.
 
The esxinstall plugin is now installed.
  
 
Click on "start" of the esxinstall plugin.
 
Click on "start" of the esxinstall plugin.
 
+
[[File:VcviY.png|none|thumb|390x390px|Click 'Start']]
 
The esxinstall plugin is now enabled and started.
 
The esxinstall plugin is now enabled and started.
  
 
After enabling the plugins please copy the content of the VMware ESX installation ISO files to /usr/share/openqrm/tftpboot/esxinstall/esx[ESX-version]/
 
After enabling the plugins please copy the content of the VMware ESX installation ISO files to /usr/share/openqrm/tftpboot/esxinstall/esx[ESX-version]/
 +
[[File:Kdb5Z.png|none|thumb|390x390px|root@cloud terminal]]
  
Enable PXE boot on the second system dedicated for VMware ESX
+
=== 2. Enable PXE boot on the second system dedicated for VMware ESX ===
 
 
 
Set the second system dedicated for OpenStack to the following boot-sequence in the system bios:
 
Set the second system dedicated for OpenStack to the following boot-sequence in the system bios:
  
network-boot (PXE)
+
# network-boot (PXE)
 
+
# boot from first hard drive
boot from first harddrive
+
# disabled
 
 
disabled
 
 
 
. Then reboot it to automatically integrate it into openQRM via PXE network-boot
 
  
 +
Then reboot it to automatically integrate it into openQRM via PXE network-boot
 +
[[File:07.png|none|thumb|390x390px|openQRM UI ]]
 
Here a screenshot of the system network-booted into openQRM
 
Here a screenshot of the system network-booted into openQRM
 
+
[[File:0701.jpg|none|thumb|390x390px|System network-booted into openQRM]]
Now go to Plugins -> Deployment -> ESXInstall -> Image Manager and select the automatically created esxinstall-storage.
+
Now go to '''Plugins -> Deployment -> ESXInstall -> Image Manager''' and select the automatically created esxinstall-storage.
 
+
[[File:09.png|none|thumb|390x390px|Select esxinstall storage]]
 
In the Image Overview click on "Add new Volume".
 
In the Image Overview click on "Add new Volume".
  
Fill in a custom name and description. Then click on "submit.
+
Fill in a custom name and description. Then click on 'submit'.
 
+
[[File:10.png|none|thumb|390x390px|Add new volume]]
 
This created a new ESXInstall Image in openQRM.
 
This created a new ESXInstall Image in openQRM.
 
+
[[File:11.png|none|thumb|390x390px|New Image has been created]]
Now go to Plugins -> Deployment -> ESXInstall -> Template Manager and click on "Create new template".
+
Now go to '''''Plugins -> Deployment -> ESXInstall -> Template Manager''''' and click on "Create new template".
 
+
[[File:12.png|none|thumb|390x390px|Create new template]]
 
Provide a custom template name and description, select the ESX version to auto-install and edit the kickstart-template according your requirements and preferences. The click on "submit".
 
Provide a custom template name and description, select the ESX version to auto-install and edit the kickstart-template according your requirements and preferences. The click on "submit".
 
+
[[File:13.png|none|thumb|390x390px|Provide details]]
 
This created a new ESX install template.
 
This created a new ESX install template.
 +
[[File:14.png|none|thumb|390x390px|Installation Template]]
 +
Now we create a new server object.
  
Now we create a new server object. Go to Base -> Server and click on "Add new server".
+
Go to Base -> Server and click on "Add new server".
 
+
[[File:15.png|none|thumb|390x390px|Add new server]]
 
Provide a name and description in the first step of the wizard.
 
Provide a name and description in the first step of the wizard.
 
+
[[File:16.png|none|thumb|390x390px|First Step of Wizard]]
 
In the second step please select the resource object of the PXE/network-booted, physical system dedicated for the ESX installation.
 
In the second step please select the resource object of the PXE/network-booted, physical system dedicated for the ESX installation.
 
+
[[File:17.png|none|thumb|390x390px|Select resource object]]
In the third step please select the previously creaeted ESXInstall Image.
+
In the third step please select the previously created ESXInstall Image.
 
+
[[File:18.png|none|thumb|390x390px|Third Sep of Wizard]]
 
In the Edit-Image screen please select "Automatic ESX Installation" for the "Automatic Installation" option.
 
In the Edit-Image screen please select "Automatic ESX Installation" for the "Automatic Installation" option.
 
+
[[File:19.png|none|thumb|390x390px|Select Automatic ESX Installation]]
 
Here select the ESXInstall Storage object.
 
Here select the ESXInstall Storage object.
 
+
[[File:20.png|none|thumb|390x390px|ESXInstall Storage]]
 
And here you define which ESX automatic installation profile will be attached to the Image.
 
And here you define which ESX automatic installation profile will be attached to the Image.
 
+
[[File:21.png|none|thumb|390x390px|Define ESX profile]]
This forwards to the Image overview. Please go back to Base -> Server.
+
This forwards to the Image overview. Please go back to '''Base -> Server.'''
 
+
[[File:22.png|none|thumb|390x390px|Image Overview]]
 
In the server overview please click on "Continue setup".
 
In the server overview please click on "Continue setup".
 
+
[[File:23.png|none|thumb|390x390px|Click 'Continue Setup']]
 
Here define the "default" kernel to the server object.
 
Here define the "default" kernel to the server object.
 
+
[[File:24.png|none|thumb|390x390px|Define default kernel]]
This forwards to the server overview again. Here please click on "Start" of the new created server object.
+
This forwards to the server overview again. Click on "Start" of the new created server object.
 
+
[[File:25.png|none|thumb|390x390px|Click on Start]]
 
And confirm the starting action.
 
And confirm the starting action.
 
+
[[File:26.png|none|thumb|390x390px|Confirm starting action]]
 
The server now gets activated and its resource gets into transition state for the automatic installation.
 
The server now gets activated and its resource gets into transition state for the automatic installation.
 
+
[[File:27.png|none|thumb|390x390px|Server is active]]
 
Here the physical system rebooting via PXE into the automatic ESX installation.
 
Here the physical system rebooting via PXE into the automatic ESX installation.
 +
[[File:2701.jpg|none|thumb|390x390px|Physical System rebooting]]
 +
[[File:2709.jpg|none|thumb|390x390px|Installation Complete]]
 +
You should see this message when the installation successfully finished just before the automatic reboot. Note that it will reboot itself without the need to press after a short timeout.
  
Loading the VMware ESX Installer.
+
Note: It will still use PXE but the PXE configuration will make it boot locally from its first local disk.
 
 
ESX is starting the operating system.
 
  
Now it is within the fully automatic installation according to the kickstart file of the installation profile.
 
 
Now the installation successfully finished just before the automatic reboot. Please notice that it will reboot itself without the need to press after a short timeout.
 
 
Here a screenshot short after the reboot. It will still use PXE but the PXE configuration will make it boot locally from its first local disk.
 
 
ESX starting up after the automatic installation.
 
 
Now fully up and running and also pre-configured and automatic integrated into openQRM.
 
  
 
In the server overview the server and resource object of the ESX system are now active.
 
In the server overview the server and resource object of the ESX system are now active.
 +
[[File:28.png|none|thumb|390x390px|Server Overview]]
 +
Now click on '''Plugins -> Virtualization -> VMware -> Hosts''' and click on "Network" of the fresh installed ESX system.
  
Now click on Plugins -> Virtualization -> VMware -> Hosts and click on "Network" of the fresh installed ESX system.
+
'''Note:''' This step requires to have the VMware PERL SDK/API installed on the openQRM server as described in the [[Virtualisation with VMware ESXi and openQRM on Debian|Virtualization with VMware ESX on openQRM]] How-To
 
+
[[File:29.png|none|thumb|390x390px|Click on 'Network']]
Please notice: This step requires to have the VMware PERL SDK/API installed on the openQRM server as described in the "Virtualization with VMware ESX on openQRM".
 
 
 
 
This will show the vSwitch configuration of the ESX system and it means that it is now fully ready to be managed by openQRM.
 
This will show the vSwitch configuration of the ESX system and it means that it is now fully ready to be managed by openQRM.
 +
[[File:30.png|none|thumb|390x390px|vSwitch Config]]
  
Please notice if something goes wrong with the PXE/network-boot!
+
=== Troubleshooting ===
 
+
The automatic-installation Image actions, if not configured "persistent", are "one shot" actions. That means they are only executed once!
The automatic-installation Image actions (if not configured "persistent" are "one shot" actions. That means they are only executed once!
 
  
 
If something goes wrong during the installation following the above steps the recommended way to solve it is to follow the steps below:
 
If something goes wrong during the installation following the above steps the recommended way to solve it is to follow the steps below:
  
Stop the server object
+
# Stop the server object
 
+
# Remove the server object
Remove the server object
+
# Force remove the resource (the system dedicated for the ESX installation)
 
+
# Reboot the resource, (the system dedicated for the ESX installation)
Force remove the resource (the system dedicated for the ESX installation)
+
# Recreate the server object following this How-To
 
 
Reboot the resource, (the system dedicated for the ESX installation)
 
 
 
Recreate the server object following this howto
 
  
 
This will ensure activating the automatic installation Image action again.
 
This will ensure activating the automatic installation Image action again.
  
Congratulations!
+
'''Congratulations!!'''
 
 
You have successfully made it through this howto!
 
 
 
Another openQRM documentation sponsored by openQRM Enterprise
 
 
 
We hope you have enjoyed it!
 
 
 
Your openQRM Enterprise Team
 
 
 
 
 
 
 
Links
 
 
 
openQRM Community - <nowiki>http://www.openqrm.com/</nowiki>
 
 
 
openQRM Project at sourceforge - sourceforge.net/projects/openqrm/
 
 
 
openQRM Enterprise - <nowiki>http://www.openqrm-enterprise.com/</nowiki>
 
 
 
openQRM at Twitter - <nowiki>https://twitter.com/openQRM</nowiki>
 
  
openQRM at Facebook - <nowiki>https://www.facebook.com/openQRM</nowiki>
+
You have successfully completed this How-To!

Latest revision as of 12:20, 5 November 2020

This How-To will explain how to fully automate provisioning of VMware ESX to bare-metal systems (physical server) with openQRM without touching the hardware once and without any manual interaction needed.

Requirements

  • One (or more) physical Server
  • at least 1 GB of Memory
  • at least 100 GB of Diskspace
  • VT (Virtualization Technology) enabled in the Systems BIOS so that the openQRM Server can run Virtual Machines later
  • Debian Installation on a physical Server

NOTE:

For this How-To, we assume you have successfully installed openQRM and have at least referenced our Cloud Computing with openQRM on Debian How-To before. If not, it is highly suggested to complete both before continuing

For demonstration, we are using the same example server as we did in our Install openQRM on Debian How-To.

1. Enable plugins

In the openQRM Plugin Manager please enable and start the following plugins in the sequence below:

dns plugin - type Networking

dhcpd plugin- type Networking

tftpd plugin - type Networking

network-manager plugin - type Networking

local-server plugin - type Misc

device-manager plugin - type Management

novnc plugin - type Management

sshterm plugin - type Management

nfs-storage plugin - type Storage

vmware-esx plugin - type Virtualization

esxinstall plugin - type Deployment

In the plugin manager click on "install" of the esxinstall plugin.

Plugin Manager

The esxinstall plugin is now installed.

Click on "start" of the esxinstall plugin.

Click 'Start'

The esxinstall plugin is now enabled and started.

After enabling the plugins please copy the content of the VMware ESX installation ISO files to /usr/share/openqrm/tftpboot/esxinstall/esx[ESX-version]/

root@cloud terminal

2. Enable PXE boot on the second system dedicated for VMware ESX

Set the second system dedicated for OpenStack to the following boot-sequence in the system bios:

  1. network-boot (PXE)
  2. boot from first hard drive
  3. disabled

Then reboot it to automatically integrate it into openQRM via PXE network-boot

openQRM UI

Here a screenshot of the system network-booted into openQRM

System network-booted into openQRM

Now go to Plugins -> Deployment -> ESXInstall -> Image Manager and select the automatically created esxinstall-storage.

Select esxinstall storage

In the Image Overview click on "Add new Volume".

Fill in a custom name and description. Then click on 'submit'.

Add new volume

This created a new ESXInstall Image in openQRM.

New Image has been created

Now go to Plugins -> Deployment -> ESXInstall -> Template Manager and click on "Create new template".

Create new template

Provide a custom template name and description, select the ESX version to auto-install and edit the kickstart-template according your requirements and preferences. The click on "submit".

Provide details

This created a new ESX install template.

Installation Template

Now we create a new server object.

Go to Base -> Server and click on "Add new server".

Add new server

Provide a name and description in the first step of the wizard.

First Step of Wizard

In the second step please select the resource object of the PXE/network-booted, physical system dedicated for the ESX installation.

Select resource object

In the third step please select the previously created ESXInstall Image.

Third Sep of Wizard

In the Edit-Image screen please select "Automatic ESX Installation" for the "Automatic Installation" option.

Select Automatic ESX Installation

Here select the ESXInstall Storage object.

ESXInstall Storage

And here you define which ESX automatic installation profile will be attached to the Image.

Define ESX profile

This forwards to the Image overview. Please go back to Base -> Server.

Image Overview

In the server overview please click on "Continue setup".

Click 'Continue Setup'

Here define the "default" kernel to the server object.

Define default kernel

This forwards to the server overview again. Click on "Start" of the new created server object.

Click on Start

And confirm the starting action.

Confirm starting action

The server now gets activated and its resource gets into transition state for the automatic installation.

Server is active

Here the physical system rebooting via PXE into the automatic ESX installation.

Physical System rebooting
Installation Complete

You should see this message when the installation successfully finished just before the automatic reboot. Note that it will reboot itself without the need to press after a short timeout.

Note: It will still use PXE but the PXE configuration will make it boot locally from its first local disk.


In the server overview the server and resource object of the ESX system are now active.

Server Overview

Now click on Plugins -> Virtualization -> VMware -> Hosts and click on "Network" of the fresh installed ESX system.

Note: This step requires to have the VMware PERL SDK/API installed on the openQRM server as described in the Virtualization with VMware ESX on openQRM How-To

Click on 'Network'

This will show the vSwitch configuration of the ESX system and it means that it is now fully ready to be managed by openQRM.

vSwitch Config

Troubleshooting

The automatic-installation Image actions, if not configured "persistent", are "one shot" actions. That means they are only executed once!

If something goes wrong during the installation following the above steps the recommended way to solve it is to follow the steps below:

  1. Stop the server object
  2. Remove the server object
  3. Force remove the resource (the system dedicated for the ESX installation)
  4. Reboot the resource, (the system dedicated for the ESX installation)
  5. Recreate the server object following this How-To

This will ensure activating the automatic installation Image action again.

Congratulations!!

You have successfully completed this How-To!