Posts Tagged ‘ESX’

Veeam Reporter 4.0 Free Edition

August 16th, 2010

SnagIt CaptureToday, Veeam has launched a new free version of an existing product which you may already be familiar with: Veeam Reporter Free Edition.  Veeam Reporter is an enterprise virtual infrastructure tool which is best described by Veeam on their product page:

Veeam Reporter™ discovers, documents and analyzes your entire virtual infrastructure. It maintains a complete history of all objects, settings and changes. And it trends performance and utilization. So you can really understand your virtual infrastructure—past, present and future.

When it comes to documenting and reporting on your virtual infrastructure, Reporter does it all.

This new free version contains most of the features of the full version.  The free edition can easily be upgraded to the full version of Veeam Reporter to gain these additional capabilities (A features comparison can found here):

  • Capacity planning (report pack)
  • Historical change management (beyond the most recent 24 hours)
  • Microsoft Visio reports for multipathing, network, vMotion, and datastore utilization
  • Full access to archive data—to create custom reports or update your configuration management database (CMDB)
  • Full dashboard capabilities
  • Automatic report distribution

I was invited by Veeam to take a look at the beta version of Veeam Reporter Free Edition.  I’ve captured some of my experience and documented it here.

Installation

Installation of Veeam Reporter Free Edition is fairly straightforward but I should disclose that I’m working with a beta (pre GA) version.  I installed on Microsoft Windows Server 2008 R2 Standard (64-bit only) which is my preferred platform, if supported by the vendor’s product (Veeam Reporter supports it).  Veeam Reporter requires Microsoft .NET Framework 3.5.1.  In Windows Server 2008 R2, this is installed as a Feature:

SnagIt Capture

If installing the Veeam Reporter’s Web UI (the default), the IIS Role is also required during the .NET Framework instllation…plus a few extra roles:

 SnagIt Capture

SnagIt Capture

During the beta, I ran into a JavaScrip error message after the installation was complete:

8-15-2010 8-45-45 PM

As it turns out, the issue has nothing to do with JavaScript, rather, the Static Content Role must be installed for IIS:

8-16-2010 6-31-57 PM

During the Veeam Reporter installation routine, I also installed the Microsoft PowerShell component which is optional:

SnagIt Capture

The Veeam Reporter PowerShell snap-in enables users to perform reporting tasks by running single cmdlets or custom automation scripts via the command-line interface.  The PowerShell SnapIn ReporterDBSnapIn is installed which adds the following Veeam Reporter specific cmdlets to the PowerShell environment:

CONNECT-VRVISERVER
DISCONNECT-VRVISERVER
GET-VRVM
GET-VRVMHOST
GET-VRDATASTORE
GET-VRRESOURCEPOOL
GET-VRCLUSTER
GET-VRSNAPSHOT
GET-VRCURRENTDATE
SET-VRCURRENTDATE

As is quite common with virtualization management tools, including VMware vCenter itself, a back end database is required for the storage of datacenter information.  Veeam Reporter has the ability to leverage an existing Microsoft SQL Server.  In the absence of a dedicated SQL server, Veeam Reporter will install Microsoft SQL Express and integrate with it locally.  Installation of a local SQL Express instance takes quite some time as the necessary SQL binaries (including SP1) are downloaded at this time (this also implies internet connectivity from the Veeam Reporter server is required).

SnagIt Capture

A logoff/logon is required at the end of the installation as opposed to a system reboot:

SnagIt Capture

Configuration

Now that the installation is complete, the next step is to configure Veeam Reporter Free Edition.  There’s really not much to the initial configuration or data collection.  Add to that, the installation and data collection process is agentless – a definite plus. 

So before any data can be displayed, it needs to be collected from the vCenter Server(s).  This is handled by creating a Collection Job which points at the vCenter Server and pulls in the data that Veeam uses.  A collection job should be scheduled to run periodically so that it grabs updated data at regular intervals.  I set up a Collection Job to run automatically once per day at midnight.  For the purposes of instant gratification, I manually ran the job to get some data:

8-16-2010 8-54-55 PM

In addition to configuring a Collection Job, I also set up a few of the ancillary items one would commonly find in reporting and management applications such as an Email server.

Now that I have some data, I can start creating useful reports and that’s where the fun begins.  I will cover some of the reports in the next update so stay tuned.

In the mean time, download your copy of Veeam Reporter Free Edition today and get started!

 

vSphere 4.1: Multicore Virtual CPUs

July 25th, 2010

With the release of vSphere 4.1, VMware has introduced Multicore Virtual CPU technology to its bare metal flagship hypervisor.  This is an interesting feature which had already existed in current versions of VMware Workstation.  VMware has consistently baked in new features in its Type 2 hypervisor products, such as Workstation, Player, Fusion, etc., more or less as a functionality/stability test before releasing the same features in ESX(i).  VMware highlights this new feature as follows:

User-configurable Number of Virtual CPUs per Virtual Socket: You can configure virtual machines to have multiple virtual CPUs reside in a single virtual socket, with each virtual CPU appearing to the guest operating system as a single core. Previously, virtual machines were restricted to having only one virtual CPU per virtual socket. See the vSphere Virtual Machine Administration Guide.

VMware multicore virtual CPU support lets you control the number of cores per virtual CPU in a virtual machine. This capability lets operating systems with socket restrictions use more of the host CPU’s cores, which increases overall performance.

Using multicore virtual CPUs can be useful when you run operating systems or applications that can take advantage of only a limited number of CPU sockets. Previously, each virtual CPU was, by default, assigned to a single-core socket, so that the virtual machine would have as many sockets as virtual CPUs.

You can configure how the virtual CPUs are assigned in terms of sockets and cores. For example, you can configure a virtual machine with four virtual CPUs in the following ways:

  • Four sockets with one core per socket (legacy, this is how we’ve always done it prior to vSphere 4.1)
  • Two sockets with two cores per socket (new in vSphere 4.1)
  • One socket with four cores per socket (new in vSphere 4.1)

VMware defines a CPU as:

The portion of a computer system that carries out the instructions of a computer program and is the primary element carrying out the computer’s functions.

VMware defines a Core as:

A logical execution unit containing an L1 cache and functional units needed to execute programs. Cores can independently execute programs or threads.

VMware defines a Socket as:

A physical connector on a computer motherboard that accepts a single physical chip. Many motherboards can have multiple sockets that can in turn accept multicore chips.

One of the benefits of multicore which physical computing had was increased density of the hardware.  VMs do not share this advantage as they are virtual to begin with and have no rack footprint to speak of.

VMware’s benefit statement for this feature is a legitimate one and is the primary use case.  It’s the same benefit which applied when multicore (as well as hyperthreading to some extent) technology was introduced to physical servers.  What VMware doesn’t advertise is that the limitation being discussed usually revolves around software licensing - a per-socket license model to be precise which is what many software vendors still use.  For example, if I own a piece of software and I have a single socket license, traditionally I was only able to use this software inside of a single vCPU VM.  With Multicore Virtual CPUs, Virtual Machines have now caught up with their physcial hardware counterparts in that a single socket VM can be created which has 4 cores per socket.  Using the working example, the advantage I have now is that I can run my application inside a VM which still has 1 socket, but 4 cores for a net result of 4 vCPUs instead of just 1 vCPU.  I didn’t have to pay my software vendor additional money for the added CPU power.  To show how this translates into dollars and cents, let’s assume a per socket license cost of my application to be $1,000 and then extrapolate those numbers using VMware’s example above of how CPUs can be assigned in terms of sockets and cores:

  • Four sockets with one core per socket = $1,000 x 4 sockets = $4,000 net license cost, 4 CPUs
  • Two sockets with two cores per socket = $1,000 x 2 sockets = $2,000 net license cost, 4 CPUs
  • One socket with four cores per socket = $1,000 x 1 socket = $1,000 net license cost, 4 CPUs
  •  

    Now, all of this said, the responsibility is on the end user to be in license compliance with his or her software vendors.  Just becasue you can do this doens’t mean you’re legally obliged to do so.  Be sure to read your EULA and check with your software vendor or reseller before implementing VMware Multicore Virtual CPUs.

    Implementation of Multicore Virtual CPUs was quite straightfoward in VMware Workstation.  Upon creating a new VM or editing an existing VM’s settings, the following interface was presented for configuring vCPUs and cores per vCPU in VMware Workstation.  In this example, a 2xDC (Dual Core) configuration is being applied which results in a total of 4 CPU cores which will serve the VM’s operating system, applications, and users. Note that here, the term “processors” on the first line translates to “sockets”:

    7-25-2010 11-39-53 AM

    Making the same 2xDC CPU configuration in vSphere 4.1 isn’t difficult but nonetheless it is done differently.  Configuring total vCPUs and cores per vCPU is achieved by applying configurations in two different areas of the VM configuration. The combination of the two configurations produces a mathematical calculation which ultimately determines cores per vCPU.

    First of all, the total number of cores (processors) is selected in the VM’s CPU configuration.  This hasn’t changed and should be familiar to you.  The number of cores (processors) available for selection here is going to be 1 thru 4 or 1 thru 8 if you have Enterprise Plus licensing.  I’ve purposely included the notation of the VM hardware version 7 which is required. An inconsistency here compared to VMware Workstation is that the term “virtual processors” translates to “cores”, not “sockets”:

     7-25-2010 11-41-09 AM

    Configuring the number of cores per processor is where VMware has deviated from the VMware Workstation implementation.  In ESX and ESXi, this configuration is made as an advanced setting in the .vmx file.  Edit the VM settings, navigate to the Options tab, choose General in the Advanced options list. Click the Configuration Parameters button which allows you to edit the .vmx file on a row by row basis.  Click the Add Row button and add the line item cpuid.coresPerSocket. For the value, your going to supply the number of cores per processor which is generally going to be a value of 2, 4, or 8 (Enterprise Plus licensing required).  Note, using a value of 1 here would serve no practical purpose because it would configure a single core vCPU which is what we’ve had all along up until this point:

    7-25-2010 11-45-38 AM

    As a supplement, here are the requirements for implementing Multicore Virtual CPUs:

    • VMware vSphere 4.1 (vCenter 4.1, ESX 4.1 or ESXi 4.1).
    • Virtual Machine hardware version 7 is required.
    • The VM must be powered off to configure Multicore Virtual CPUs.
    • The total number of vCPUs for the VM divided by the number of cores per socket must be a positive integer.
    • The cpuid.coresPerSocket value must be a power of 2. The documentation explicitely states a value of 2, 4, or 8 is required, but 1 works as well although as stated before it would serve no practical purpose.
      • 2^0=1 (anything to the power of 0 always equals 1)
      • 2^1=2 (anything to the power of 1 always equals itself)
      • 2^2=4
      • 2^4=8
    • When you configure multicore virtual CPUs for a virtual machine, CPU hot Add/Remove is disabled (previously called CPU hot plug).
    • You must be in compliance with the requirements of the operating system EULA.

    This feature rocks and I think customers have been waiting a long time for it.  Duncan mentioned it quite some time ago but obvioulsy it was unsupported at that time.  I am a little puzzled by the implementation mechanisms, mainly the configuration of the .vmx to specify cores per CPU.  I suppose it lends itself to scriptability and thus automation, but in that sense, we lack the flexibility to configure cores per CPU with guest customization when deploying VMs from a template.  Essentially this means cores per CPU needs to be hard coded in each of my templates or cores per CPU needs to be manually tuned after deploying each VM from a template.  When I take a step back, I guess that’s no different than any other virtual hardware configuration stored in templates, but with the cores per CPU setting being buried in the .vmx as an advanced setting, it’s that much more of a manal/administrative burden to configure cores per CPU for each VM deployed than it is to simply change the number of CPUs or amount of RAM.  It would be nice if the guest customization process offered a quick way to configure cores per processor.

    OVF? OVA? WTF?

    July 2nd, 2010

    If you’ve worked with recent versions of VMware virtual infrastructure, Converter, or Workstation, you may be familiar with the fact that these products have the native ability to work with virtual machines in the Open Virtualization Format, or OVF for short.  OVF is a Specification governed by the DMTF (Distributed Management Task Force) which to me sounds a lot like RFCs which provide standards for protocols and communication across compute platforms – basically SOPs for how content is delivered on the internet as we know it today.

    So if there’s one standard, why is it that when I choose to create an OVF (Export OVF Template in the vSphere Client), I’m prompted to create either an OVF or an OVA?  If the OVF is an OVF, then what’s an OVA?

     7-2-2010 8-00-01 PM

    Personally, I’ve seen both formats, typically when deploying packaged appliances.  The answer is simple: Both the OVF and the OVA formats roll up into the Specification defined by the DMTF.  The difference between the two is in the presentation and encapsulation.  The OVF is a construct of a few files, all of which are essential to its definition and deployment.  The OVA on the other hand is a single file with all of the necessary information encapsulated inside of it.  Think of the OVA as an archive file.  The single file format provides ease in portability.  From a size or bandwidth perspective, there is no advantage between one format or the other as they each tend to be the same size when all is said and done.

    7-2-2010 8-13-26 PM

    The DMTF explains the two formats on pages 12 through 13 in the PDF linked above:

    An OVF package may be stored as a single file using the TAR format. The extension of that file shall be .ova (open virtual appliance or application).

    An OVF package can be made available as a set of files, for example on a standard Web server.

    Do keep in mind that which ever file type you choose to work with, if you plan on hosting them on a web server, MIME types will need to be set up for .OVF, OVA, or both, in order for a client to download them for deployment onto your hypervisor.

    At 41 pages, the OVF Specification contains a surprising amount of detail.  There’s more to it than you might think, and for good reason:

    The Open Virtualization Format (OVF) Specification describes an open, secure, portable, efficient and extensible format for the packaging and distribution of software to be run in virtual machines.

    Open, meaning cross platform (bring your own hypervisor).  Combined with Secure and Portable attributes, OVF may be one of the key technologies for intracloud and intercloud mobility.  The format is a collaborative effort spawned from a variety of contributors:

    Simon Crosby, XenSource
    Ron Doyle, IBM
    Mike Gering, IBM
    Michael Gionfriddo, Sun Microsystems
    Steffen Grarup, VMware (Co-Editor)
    Steve Hand, Symantec
    Mark Hapner, Sun Microsystems
    Daniel Hiltgen, VMware
    Michael Johanssen, IBM
    Lawrence J. Lamers, VMware (Chair)
    John Leung, Intel Corporation
    Fumio Machida, NEC Corporation
    Andreas Maier, IBM
    Ewan Mellor, XenSource
    John Parchem, Microsoft
    Shishir Pardikar, XenSource
    Stephen J. Schmidt, IBM
    René W. Schmidt, VMware (Co-Editor)
    Andrew Warfield, XenSource
    Mark D. Weitzel, IBM
    John Wilson, Dell

    Take a look at the OVF Specifications document as well as some of the other work going on at DTMF. 

    Have a great and safe July 4th weeekend, and congratulations to the Dutch on their win today in World Cup Soccer.  I for one will be glad when it’s all over with and our Twitter APIs can return to normal again.

    Make an ESX Firewall Rule Manageable in the vSphere Client

    June 25th, 2010

    Make an ESX Firewall Rule Manageable in the vSphere Client.  To do so, you essentially need to create a new service in the firewall configuration XML file.

    Open the file /etc/vmware/firewall/services.xml
    Scroll to the bottom & note the last Service ID #
    Copy an existing service section as a template (ie. faultTolerance)
    Paste as new following proper XML formatting
    Increment the Service ID # by 1 ensuring it’s unique
    Customize to fit your new inbound/outbound port rule
    Save and exit
    Services do not need to be restarted

    As an example, I took :

    <service id=’0031′>
        <id>faultTolerance</id>
        <rule id=’0000′>
          <direction>outbound</direction>
          <protocol>tcp</protocol>
          <port type=’dst’>80</port>
        </rule>
      </service>

    and created a new service like so:

    <service id=’0033′>
        <id>CoolFirewallRule</id>
        <rule id=’0000′>
          <direction>outbound</direction>
          <protocol>tcp</protocol>
          <port type=’dst’>12345</port>
        </rule>
      </service>

    The result is a firewall rule named CoolFirewallRule which can be toggled via the vSphere Client:

     6-22-2010 11-13-39 PM

    vSphere Cluster Showing Noncompliant on the Profile Compliance Tab

    June 24th, 2010

    To troubleshoot a vSphere cluster showing Noncompliant on the Profile Compliance tab, check the following:

    FT logging NIC speed is at least 1000 Mbps
    At least one shared datastore exists
    FT logging is enabled
    VMotion NIC speed is at least 1000 Mbps
    All the hosts in the cluster have the same build for Fault Tolerance
    The host hardware supports Fault Tolerance
    VMotion is enabled

    Read more at: http://kb.vmware.com/kb/1017471

    Disable Copy and Paste for a VM

    June 23rd, 2010

    Security Tip: Disable Copy and Paste operations between the guest VM operating system and remote console by providing the following advanced parameters for the VM’s configuration (stored in the .vmx file):

    isolation.tools.copy.disable = true
    isolation.tools.paste.disable = true
    isolation.tools.setGUIOptions.enable = false

    Read more at: http://www.vmware.com/files/pdf/vi35_security_hardening_wp.pdf

    ESX and the Service Console Are Going Away

    June 17th, 2010

    ESX and the Service Console are going away.  Theories on this are evident - plastered all over the internet:  here, here, here, here, here, here, here, etc.

    Go to Google and perform the following search:

    esx “service console” “going away”

    Better yet, let me Google that for you (Thank you Doug for the introduction to this wonderfully funny tool!)

    ESXi was first introduced on December 10th, 2007.  We’ve had 2 1/2 years to get familiar with this hypervisor which is minimal in size but as feature rich, as powerful, and as fast as ESX.  The management tools for ESXi have evolved and the platform has been given its due time to prove its stability and viability as an enterprise bare metal hypervisor in the datacenter.

    I conducted an informal poll on Twitter this week and a large number of respondents claimed to still be using ESX.  More alarming was the disposition of some who have no plans whatsoever to go to ESXi.  One person went so far as to say the Service Console would have to be pried from his cold dead hands.

    If you have not yet broken your dependency on ESX and the Service Console, I suggest you do it soon.  Time is running out.  Don’t wait until the last minute.  Be sure you leave yourself enough time to architect and test a sound ESXi design for your datacenter, as well as get familiar with the tools you’ll be dependent on to manage the ESXi hypervisor.

    VMware Tools install – A general system error occurred: Internal error

    June 16th, 2010

    When you invoke the VMware Tools installation via the vSphere Client, you may encounter the error “A general system error occurred: Internal error“.

    6-16-2010 9-45-42 AM

    One thing to check is that the VM shell has the correct operating system selected for the guest operating system type.  For example, a setting of “Other (32-bit)” will cause the error since VMware cannot determine the correct version of the tools to install in the guest operating system because the flavor of guest operating system is unknown (ie. Windows or Linux).

    6-16-2010 10-45-49 AM

    Other causes for this error can be found at VMware KB Article 1004718:

    The virtual machine has CD-ROM configured.
    The windows.iso is present under the /vmimages/tools-iso/ folder.
    The virtual machine is powered on.
    The correct guest operating system selected. For example, if the guest operating system is Windows 200, ensure you have chosen Windows 2000 and not Other.

    NFS and Name Resolution

    June 11th, 2010

    Sometimes I take things for granted.  For instance, the health and integrity of the lab environment.  Although it is “lab”, I do run some workloads which are key to keep online on a regular basis. Primarily the web server which this blog is served from, the email server which is where I do a lot of collaboration, and the Active Directory Domain Controllers/DNS Servers which provide the authentication mechanisms, mailbox access, external host name resolution to fetch resources on the internet, and internal host name resolution.

    The workloads and infrastructure in my lab are 100% virtualized.  The only “physical” items I have are type 1 hypervisor hosts, storage, and network.  By this point I’ll assume most are familiar with the benefits of consolidation.  The downside is that when the wheels come off in a highly consolidated environment, the impacts can be severe as they fan out and tip over down stream dependencies like dominos.

    A few weeks ago I had decided to recarve the EMC Celerra fibre channel SAN storage.  The VMs which were running on the EMC fibre channel block storage were all moved to NFS on the NetApp filer.  Then last week, the Gb switch which supports all the infrastructure died.  Yes it was a single point of failure – it’s a lab.  The timing for that to happen couldn’t have been worse since all lab workloads were running on NFS storage.  All VMs had lost their virtual storage and the NFS connections on the ESX(i) hosts eventually timed out.

    The network switch was replaced later that day and since all VMs were down and NFS storage had disconnected, I took the opportunity to gracefully reboot the ESX(i) hosts; good time for a fresh start.  Not surprised, I had to use the vSphere Client to connect to each host by IP address since at that point I had no functional DNS name resolution in the lab whatsoever. When the hosts came back online, I was about to begin powering up VMs, but instead I encountered a situation which I hadn’t planned for – all the VMs were grayed out, esentially disconnected.  I discovered the cause of this was that after the host reboot, the NFS storage hadn’t come back online – both NetApp and EMC Celerra – on both hosts.  There’s no way both storage cabinets and/or both hosts were having a problem at the same time so I assumed it was a network or cabling problem. With the NFS mounts in the vSphere client staring back at me in their disconnected state, it dawned on me – lack of DNS name resolution was preventing the hosts from connecting to the storage.  The hosts could not resolve the FQDN name of the EMC Celerra or the NetApp filer storage.  I modified /etc/hosts on each ESX(i) host, adding the TCP/IP address and FQDN for the NetApp filer and Celerra Data Movers.  Shortly after I was back in business.

    What did I learn?  Not much.  It was more a reiteration of important design considerations which I was already aware of:

    1. 100% virtualization/consolidation is great – when it works.  The web of upstream/downstream dependencies makes it a pain when something breaks.  Consolidated dependencies which you might consider leaving physical or placing in a separate failure domain:
      • vCenter Management
      • Update Manager
      • SQL/Oracle back ends
      • Name Resolution (DNS/WINS)
      • DHCP
      • Routing
      • Active Directory/FSMO Roles/LDAP/Authentication/Certification Authorities
      • Mail
      • Internet connectivity
    2. Hardware redundancy is always key but expensive.  Perform a risk assessment and make a decision based on the cost effectiveness.
    3. When available, diversify virtualized workload locations to reduce failure domain, particularly to split workloads which provide redundant infrastructure support such as Active Directory Domain Controllers, DNS servers.  This can mean placing workloads on separate hosts, separate clusters, separate datastores, separate storage units, maybe even separate networks depending on the environment.
    4. Static entires in /etc/hosts isn’t a bad idea as a fallback if you plan on using NFS in an environment with unreliable DNS but I think the better point to discuss is the risk and pain which will be realized in deploying virtual infrastructure in an unreliable environment. Garbage In – Garbage Out.  I’m not a big fan of using IP addresses to mount NFS storage unless the environment is small enough.

    vSphere Upgrade Prerequisites Checklist

    May 27th, 2010

    Upgrading your virtual infrastructure to vSphere?  Be sure to check out this handy reference from VMware:  vSphere Upgrade Prerequisites Checklist.  There are several areas which need to be considered and this document covers them all, including both requirements and recommendations.  If you’re a consultant who visits new customer sites on a regular basis, it wouldn’t be a bad idea to bring this with to each engagement, or at least a condensed version of it.

    ESX 3.x Host 64GB Addressable Memory Limit

    May 24th, 2010

    Some time ago, I became aware of an ESX 3.5.0 Update 2 (build 110268) host which had 128GB of RAM physically installed, but only 64GB RAM usable.  The host was showing 128GB of RAM, however, it was consuming 64GB of memory with no running VMs, leaving the other 64GB of RAM addressable for virtual machines.

    After further research, it was determined that this host build did not contain the VMkernel change required to properly acknowledge the amount of physical memory installed on the IBM host hardware. 

    VMware’s response was:

    Prior to ESX 3.5 Update 3, the ability to address more than 64GB of memory on ESX Server 3.5 is suppressed by default. In a standard installation, a 36bit MTRR mask is forced, even though the machine may support 40bit mask values.  This means that the ESX Server may see any memory above 64GB as memory that is in use. For example, if an ESX server has 256GB of RAM, the Memory Usage counter displays 192GB in use and only 64GB free. If you attempt to create a virtual machine using memory exceeding the available 64GB of memory, you see an Insufficient Memory error.  This condition is documented in the following location:  http://www.vmware.com/support/vi3/doc/vi3_esx35u3_rel_notes.html

    The boot option force36BitMTRRMask is no longer required because of BIOS MTRR issues on certain platforms, ESX Server hosts previously failed to boot unless the VMkernel force36BitMTRRMask boot option was set to false.  ESX 3.5 Update 3 enables full support for memory up to 64GB with no need to specify a boot option.  As a result of this change, the force36BitMTRRMask VMkernel boot option is no longer supported. If the option is set, the result is no operation (NOP) and boot succeeds.

    In conclusion, the resolutions are as follows:

    1 ) Upgrade to ESX 3.5 Update 3 build 123630 or newer 

    2 ) To utilize more than 64GB of RAM, use a larger MTRR mask by disabling VMkernel.Boot.force36BitMTRRMask from the advanced settings. 

    To modify the MTRR mask configuration:

    Log in to VirtualCenter as an administrator using the Virtual Infrastructure Client. (If not using VirtualCenter, log in to the ESX Server directly as root.)

    From the Inventory click the ESX Server:

    Click the Configuration tab.

    Click Advanced Settings link.

    Navigate to VMKernel>Boot.

    Deselect the option for VMkernel.Boot.force36BitMTRRMask .

    Reboot the ESX Server host for the change to take effect.

    This information is perhaps a bit dated, but I know there are some older 3.x environments still in existence.  If those environments are running on host hardware with more than 64GB of RAM installed, this could prove to be insightful.

    Happy Birthday vSphere!

    May 21st, 2010

    birthday-cake

    I was reminded by today’s vCalendar page that vSphere was launched by VMware one year ago today.  Happy Birthday Buddy – you set the bar which all other hypervisors aspire to be at one day.

    On this day in 2009, VMware vSphere, the next generation datacenter virtualization product and successor to Virtual Infrastructure 3 (VI3), was released boasting approximately 150 new features, new license tiers, and an amazing 350,000 I/O operations per second (IOPS). vSphere is a 64-bit only ESX host OS.

    Don’t have a vCalendar yet?  Get one!

    Top 10 Free vSphere ESX Tools and Utilities by KendrickColeman.com

    May 19th, 2010

    KendrickColeman.com has compiled a nice list of no-cost VMware vSphere utilities. A grading scale was disclosed to provide a value ranking of the utilities.  Information like this is valuable because I often see questions raised in the virtualization community about low-cost or no-cost ways to do this or that with VMware virtual infrastructure (backup is a frequent request).  I will be the first to admit that lab time is precious.  KendrickColeman.com has used their free time to install, test, and summarize each application for the benefit of the community.  Nice job and on behalf of the virtualization community, Thank You!

    Speaking of free, KendirckColeman.com has also pointed to a VMTN forum member who stumbled onto a way to use a free ESXi 4.0 license key to permanently license ESX 4.0.  Interesting find there.

    P2V Milestone

    May 15th, 2010

    If you’re reading this, that’s good news because it means last night’s P2V completed successfully.  I took the last remaining non-virtualized physical infrastructure server in the lab and made it a virtual machine.  Resource and role wise, this was the largest physical lab server next to the ESX hosts themselves.

    Resources:

    • HP Proliant DL380 G3
    • Dual Intel P4 2.8GHz processors
    • 6GB RAM
    • 1/2 TB  local storage
    • Dual Gb NICs
    • Dual fibre channel HBAs

    Roles:

    • Windows Server 2003 R2 Enterprise Edition SP2
    • File server
      • binaries
      • isos
      • my documents
      • thousands of family pictures
      • videos
    • Print server
    • IIS web server
      • WordPress blog
      • ASP.NET based family web site
      • other hosted sites
    • DHCP server
    • SQL 2005 server
      • vCenter
      • VUM
      • Citrix Presentation Server
    • MySQL server
      • WordPress blog
    • Backup Sever
    • SAN management

    I’m shutting down this last remaining physical server as well as the tape library.  They’ll go in the pile of other physical assets which are already for sale or they will be donated as sales for 32-bit server hardware are slow right now.  This is a milestone because this server, named SKYWALKER – you may have heard me mention it from time to time, has been a physical staple in the lab for as long as the lab has existed (circa 1995).  Granted it has gone through several physical hardware platform migrations, its logical role is historic and its composition has always been physical.  To put it into perspective, at one point in time SKYWALKER was a Compaq Prosignia 300 server with a Pentium Pro processor and a single internal Barracuda 4.3GB SCSI drive.  Before my abilities to acquire server class hardware, it was hand-me-down whitebox parts from earlier gaming rigs.

    The P2V (using VMware Converter) took a little over 5 hours for 500GB of storage.  So the only physical servers remaining in the lab are the ESX hosts themselves.  2 DL385 G2s and 2 DL385s which typically remain powered down, earmarked for special projects.  A successful P2V is a great start to a weekend if you ask me.  Now I’m off to my daughter’s T-ball game. :)

    QuickPress – VMs Per…

    May 7th, 2010

    I’m trying out my frist QuickPress. Let’s see how this turns out.
    Right off the bat, I’m missing the autocomplete feature for Tags. As it turns out, typing more than three lines in the small content box isn’t much fun.

    On with the VMware content… This all comes from the VMware vSphere Configuration Maximums document.  I’ve bolded some of what I’d call core stats which capacity planners or architects would need to be aware of on a regular basis:

    15,000 VMs registered per Linked-mode vCenter Server
    10,000 powered on VMs per Linked-mode vCenter Server
    4,500 VMs registered per 64-bit vCenter Server
    4,000 VMs concurrently scanned by VUM (64-bit)
    3,000 powered on VMs per 64-bit vCenter Server
    3,000 VMs registered per 32-bit vCenter Server
    3,000 VMs connected per Orchestrator
    2,000 powered on VMs per 32-bit vCenter Server
    1,280 powered on VMs per DRS cluster
    320 VMs per host (standalone)
    256 VMs per VMFS volume
    256 VMs per host in a DRS cluster
    200 VMs concurrently scanned by VUM (32-bit)
    160 VMs per host in HA cluster with 8 or fewer hosts (vSphere 4.0 Update 1)
    145 powered on Linux VMs concurrently scanned per host
    145 powered on Linux VMs concurrently scanned per VUM server
    145 VMs per host scanned for VMware Tools
    145 VMs per host scanned for VMware Tools upgrade
    145 VMs per host scanned for virtual machine hardware
    145 VMs per host scanned for virtual machine hardware upgrade
    145 VMs per VUM server scanned for VMware Tools
    145 VMs per VUM server scanned for VMware Tools upgrade
    100 VMs per host in HA cluster with 8 or fewer hosts (vSphere 4.0)
    72 powered on Windows VMs concurrently scanned per VUM server
    40 VMs per host in HA cluster with 9 or more hosts
    10 powered off Windows VMs concurrently scanned per VUM server
    6 powered on Windows VMs concurrently scanned per host
    6 powered off Windows VMs concurrently scanned per host
    5 VMs per host concurrently remediated

    Got all that?

    Update 5/10/10: Added the row 160 VMs per host in HA cluster with 8 or fewer hosts (vSphere 4.0 Update 1) – Thanks for the catch Matt & Joe!