Hyper9 to release two announcements today

March 18th, 2009 by jason No comments »

Hyper9 Unveils Eagerly Awaited Flagship Product that Supports the Management of Virtual Infrastructures

While Affordably Priced, Unique Approach Offers Immediate Benefits and Is As Easy To Use as a Consumer Application

Austin, TX (March 18, 2009) – Hyper9, Inc. (www.hyper9.com), the leading provider of solutions that help virtual infrastructure administrators manage their virtualized environments, announced today the general availability of Hyper9, a product that leverages Internet and virtualization management technologies to manage change, configuration and performance issues in a modern, efficient way.

“Today’s VI administrators must navigate a very challenging virtual environment,” said Chris Ostertag, CEO and founder of Hyper9. “Until now, they lacked an efficient way to collect, negotiate and analyze information regarding their virtual server infrastructures. Hyper9 also allows them to customize how they see and manage that information, and as a result work smarter.”

Built for VI administrators by VI administrators, Hyper9 is a simple, yet powerful enterprise-class product that is ideally suited for managing virtual server infrastructures. It enables monitoring, troubleshooting and reporting on virtual infrastructures like nothing else in the marketplace. It accomplishes this without agents, tree views, spreadsheets, or multiple tools.

Among the key product features are:

  • Search: Search across your entire virtual universe, from the hypervisor to inside the guest.
  • Alert & Monitor: Build queries to monitor your environment from inside the guest and across your virtual infrastructure. Set up alerts to track changes and keep on top of problem solving.
  • Compare: Analyze historical data about your virtual machines, such as how they’ve changed over time, with Hyper9 VMDNATM.
  • Report: Slice and dice data, generate performance charts and reports for management and colleagues.
  • Collaborate: Store and manage your searches, lists and reports and invite colleagues into your workspace.

Not surprisingly, the product has earned praise from analysts and beta customers alike.

Gartner Inc. recently included Hyper9 in a report that highlights a handful of innovative technology companies in the “IT operations and virtualization” space. Gartner Analyst Cameron Haight wrote that “Hyper9’s product uses an agentless management approach to gather key data from multiple sources. Current and historical performance information is made available and you can track how virtual machines have changed over time and have alerts issued when configurations have drifted from a standard template.”

Rich Brambley, a leading virtualization expert, blogger (http://vmetc.com/) and an early beta tester of Hyper9, recently described the product on his blog:

“Hyper9 provides some powerful reporting, monitoring, and analysis capabilities. You also have the option to save your searches for reuse again and again. Not only can you use keyword based queries, but there are pre-built criteria for all VI object fields. For example, you can find all VMs based on a version of the VM Tools, whether the CDrom is connected, or the existence of a snapshot.”

“As if that wasn’t enough, Hyper9 also has the ability to compare objects – both for current state analysis and for understanding changes over time. The comparison can take place using the same VM or 2 different VMs. Hyper9 calls this feature VMDNATM, and it’s a great feature for examining configuration history.”

In addition to the Hyper9 product being made available at the web site, the H9Labs Search Plug-in for VI Client is also ready for download. This software was developed by a well known developer in the VMware community, Hyper9’s own Andrew Kutz, who was recently named a vExpert by VMware. H9Labs’ Search Plug-in gives the VMware VI Client 2.5 auto-complete search capability from inside the guest across your virtual infrastructure.

Hyper9 is now ready for administrators to download at www.hyper9.com for a free trial or purchase. Pricing for Hyper9 starts as low as $25 a month. The H9Labs Search Plug-in is now available at http://store.hyper9.com/ as a free download.

About Hyper9

Hyper9 is a privately held company backed by Venrock, Matrix Partners, Silverton Partners and Maples Investments. Based in Austin, Texas, the company was founded in 2007 by enterprise systems management experts and virtualization visionaries. Since then, Hyper9 has collaborated with VI Administrators as well as systems and virtualization management experts to develop a new breed of virtualization management products that leverages Internet technologies like search, collaboration and social networking. The end result is a product that helps administrators discover, organize and make use of information in their virtual environment, yet is as easy to use as a consumer application. For more information about Hyper9, visit www.hyper9.com.

All product and company names are trademarks of their respective companies.

Hyper9 Introduces Alert & Monitoring Applet

Applet Makes It Easier and More Affordable for Administrators to Monitor Virtual Environments from Inside the Guest and Across their Virtual Infrastructure

Austin, TX (March 19, 2009) – Hyper9, Inc. (www.hyper9.com), the leading provider of solutions that help virtualization infrastructure administrators manage their environment, introduced today the H9Labs Alert & Monitoring Applet, which makes it easier and more affordable for VI Administrators to solve problems and make better decisions.

The announcement comes on the heels of the company’s launch of its flagship product, which provides administrators with a more holistic view of the virtual infrastructure that they manage. Hyper9, affordably priced at $25 a month, is now available for download at www.hyper9.com, while the add-on applet is free to all Hyper9 trial download users and customers, and can be downloaded at: http://store.hyper9.com/product-add-ons.

The applet allows administrators to monitor and set up alerts against any facet/data point in their virtual environment. More specifically, it provides administrators with the ability to:

  • Proactively manage and solve infrastructure challenges;
  • Monitor configurations and issue alerts when configurations drift from a standard template; and
  • Track, monitor and set up alerts for: new virtual machines, VMs missing important Hotfixes, new applications installed, VMotion activity and more.

“This product reflects the wants and desires of VI Administrators, who have told us that they want an alert and monitoring applet that is both customizable and easy to install,” said Chris Ostertag, CEO and founder of Hyper9. “It also demonstrates our commitment to providing VI Administrators with the products and tools that will help them make smarter decisions when it comes to managing their virtual infrastructure.”

That “commitment” is obvious to at least one administrator.

“As an engineer that manages many different aspects of my environment, I spend only about 30 percent of my day in my VI3 environment, and often do not have my Virtual Infrastructure Client running,” said Jase McCarty, vExpert of McCarty Technical Consulting (http://www.jasemccarty.com/). “The H9Labs Monitoring and Alerting Applet fills an important gap for me, when my attention is focused elsewhere. The ability to create custom alerts for hosts and guests using extended attributes, not available from VMware, with a simple query, is simply awesome. I had several alerts configured in just a few minutes.”

About Hyper9

Hyper9 is a privately held company backed by Venrock, Matrix Partners, Silverton Partners and Maples Investments. Based in Austin, Texas, the company was founded in 2007 by enterprise systems management experts and virtualization visionaries. Since then, Hyper9 has collaborated with VI Administrators as well as systems and virtualization management experts to develop a new breed of virtualization management products that leverages Internet technologies like search, collaboration and social networking. The end result is a product that helps administrators discover, organize and make use of information in their virtual environment, yet is as easy to use as a consumer application. For more information about Hyper9, visit www.hyper9.com.

All product and company names are trademarks of their respective companies.

New blog sponsor – Hyper9!

March 18th, 2009 by jason No comments »

If you take a look across the starboard side of the blog, you’ll see a new banner for Hyper9. Hyper9 is a startup company in Austin, TX that works in the virtualization infrastructure management space, developing tools that automate the management of virtualization in the datacenter. The current version of their tool “plugs in” to the VMware Virtual Infrastructure Client providing a powerful virtual infrastructure search tool, plus a lot more.

Thank you for your support Hyper9 and welcome aboard!

3-18-2009 12-02-16 PM

DPM best practices. Look before you leap.

March 16th, 2009 by jason No comments »

It has previously been announced that VMware’s Distributed Power Management (DPM) technology will be fully supported in vSphere. Although today DPM is for experimental purposes only, virtual infrastructure users with VI Enterprise licensing can nonetheless leverage its usefulness of powering down ESX infrastructure during non-peak periods where they see fit.

Before enabling DPM, there are a few precautionary steps I would go through first to test each ESX host in the cluster for DPM compatibility which will help mitigate risk and ensure success. Assuming most, if not all, hosts in the cluster will be identical in hardware make and model, you may choose to perform these tests on only one of the hosts in the cluster. More on testing scope a little further down.

This first step is optional but personally I’d go through the motions anyway. Remove the hosts to be tested individually from the cluster. If the hosts have running VMs, place the host in maintenance mode first to displace the running VMs onto other hosts in the cluster:

3-16-2009 10-31-19 PM

If the step above was skipped or if the host wasn’t in a cluster to begin with, then the first step is to place the clustered host into maintenance mode. The following step would be to manually place the host in Standby Mode. This is going to validate whether or not vCenter can successfully place a host into Standby Mode automatically when DPM is enabled. One problem I’ve run into is the inability to place a host into Standby Mode because the NIC doesn’t support Wake On LAN (WOL) or WOL isn’t enabled on the NIC:

3-16-2009 10-25-53 PM

Assuming the host has successfully been place into Standby Mode, use the host command menu (similar in look to the menu above) to take the host out of Standby Mode. I don’t have the screen shot for that because the particular hosts I’m working with right now aren’t supporting the WOL type that VMware needs.

Once the host has successfully entered and left Standby Mode, the it can be removed from maintenance mode and added back into the cluster. Now would not be a bad time to take a look around some of the key areas such as networking and storage to make sure those subsystems are functioning properly and they are able to “see” their respective switches, VLANs, LUNs, etc. Add some VMs to the host and power them on. Again, perform some cursory validation to ensure the VMs have network connectivity, storage, and the correct consumption of CPU and memory.

My point in all of this is that ESX has been brought back from a deep slumber. A twelve point health inspection is the least amount of effort we can put forth on the front side to assure ourselves that, once automated, DPM will not bite us down the road. The steps I’m recommending have more to do with DPM compatibility with the different types of server and NIC hardware, than they have to do with VMware’s DPM technology in and of itself. That said, at a minimum I’d recommend these preliminary checks on each of the different hardware types in the datacenter. On the other end of the spectrum if you are very cautious, you may choose to run through these steps for each and every host that will participate in a DPM enabled cluster.

After all the ESX hosts have been “Standby Mode verified”, the cluster settings can be configured to enable DPM. Similar to DRS, DPM can be enabled in a manual mode where it will make suggestions but it won’t act on them without your approval, or it can be set for fully automatic, dynamically making and acting on its own decisions:

3-16-2009 10-24-33 PM

DPM is an interesting technology but I’ve always felt in the back of my mind it conflicts with capacity planning (including the accounting for N+1 or N+2, etc.) and the ubiquitous virtualization goal of maximizing the use of server infrastructure. In a perfect world, we’ll always be teetering on our own perfect threshold of “just enough infrastructure” and “not too much infrastructure”. Having infrastructure in excess of what what would violate availability constraints and admission control is where DPM fits in. That said, if you have a use for DPM, in theory, you have excess infrastructure. Why? I can think of several compelling reasons why this might happen, but again in that perfect world, none could excuse the capital virtualization sin of excess hardware not being utilized to its fullest potential (let alone, powered off and doing nothing). In a perfect world, we always have just enough hardware to meet cyclical workload peaks but not too much during the valleys. In a perfect world, virtual server requests come planned so well in advance that any new infrastructure needed is added the day the VM is spun up to maintain that perfect balance. In a perfect world, we don’t purchase larger blocks or cells of infrastructure than what we actually need because there are no such things as lead times for channel delivery, change management, and installation that we need to account for.

If you don’t live in a perfect world (like me), DPM offers those of us with an excess of infrastructure and excuses an environment friendly and responsible alternative to at least cut the consumption of electricity and cooling while maintaining capacity on demand if and when needed. Options and flexibility through innovation is good. That is why I choose VMware.

VI Toolkit Quick Reference Guide

March 14th, 2009 by jason No comments »

Virtu-Al (Alan Renouf) has posted a great two-page cheat sheet for the VMware VI Toolkit version 1.5.

This gem of a document is similar to VI3 card created by Forbes Guthrie over at vReference.com. Excellent job gentlemen!

While you’re at Virtu-Al’s site, check out all the sample code and scripts.  Chances are you could implement one or more of these puppies in your environment to configure ESX or ESXi.  Scripting is definitely one of the ways to become more efficient and agile and it’s a great way to ensure consistency across your environment.  PowerShell and VI Toolkit is where’s it at.  I think they are going to be here for a long time.

Top 10 referring pages year to date

March 14th, 2009 by jason No comments »

Top 10 referring pages year to date:

  1. http://www.vmware.com/vmtn/planet/v12n/
  2. http://twitter.com/home
  3. http://ict-freak.nl
  4. http://www.rtfm-ed.co.uk
  5. http://vmetc.com/2008/12/05/free-tools-with-virtualcenter-like-f…
  6. http://www.petri.co.il/forums/showthread.php
  7. http://vmetc.com/links/
  8. http://www.virtualization.info/2008/12/vmware-infrastructure-40-…
  9. http://www.mikedipetrillo.com
  10. http://www.vmware-land.com

I’ve been receiving a steady increase in traffic thanks to the referrals above. Rich Brambley of vmetc.com swiped two of the top 10 spots. Thanks a lot!

3-14-2009 1-48-41 PM

Here is how March 2009 is stacking up so far for referrals:

  1. http://www.vmware.com/vmtn/planet/v12n/
  2. http://www.yellow-bricks.com
  3. http://www.yellow-bricks.com/2009/03/01/vmworld-2009-europe-link…
  4. http://www.linkedin.com/newsArticle
  5. http://twitter.com/home
  6. http://blogs.vmware.com/vmtn/
  7. http://blogs.vmware.com
  8. http://www.dabcc.com/article.aspx
  9. http://blogs.vmware.com/vmtn/2009/03/vmworld-in-76-links-the-blo…
  10. http://kensvirtualreality.blogspot.com

Referrals tell me not only the number of people browsing my site, but they also reveal what what other web pages are being browsed from the standpoint of what site they just traveled in from. In this case of the number 10 spot, Ken Cline’s blog. Ken’s blog is brand new and he’s already making waves. Nice job Ken!

Interested in seeing more virtualization blog stats? Check out Duncan Epping’s Top 10 referrers over the last 30 days.

New sponsor coming Monday which I’m excited to announce 🙂

Horray! We’re mobile device friendly

March 9th, 2009 by jason No comments »

I received the feedback that the blog was not easily readable on mobile/handheld devices (Blackberry, iPhone, etc.)  Taking the suggestion from a few friends to install the MobilePress plugin for WordPress, the blog was mobile friendly within five minutes. While I had always “dealt” with the blog’s rendering on my own Blackberry, I hadn’t realized it could be improved (with so much ease).  I like it much better now as a lot of the “noise” has been removed. Thank you for the suggestions and feedback! Update:  The MobilePress plugin has been disabled for the time being due to a bug.

Rapid Virtualization Indexing (RVI)

March 8th, 2009 by jason No comments »

I’m mildly excited for the upcoming week. If all goes well, I’ll be upgrading to AMD Opteron processors which support a virtualization assist technology called Rapid Virtualization Indexing (or RVI for short).

There is overhead introduced in VMware virtualization via the virtual machine monitor (VMM) and comes in three forms:

  1. Virtualization of the CPU (using software based binary translation or BT for short)
  2. Virtualization of the MMU (using software based shadow paging)
  3. Virtualization of the I/O devices (using software based device emulation)

RVI is found in AMD’s second generation of virtualization hardware support and it incorporates MMU (Memory Management Unit) virtualization. This new technology is designed to eliminate traditional software based shadow paging methods for MMU virtualization thereby reducing the overhead in bullet #2 above. VMware lab tests show that RVI provides performance gains of up to 42% for MMU-intensive benchmarks and up to 500% for MMU-intensive microbenchmarks.

How it works:

Software based shadow page tables store information about the guest VM’s physical memory location on the host. The VMM had to intercept guest VM page table updates to keep guest page tables and shadow page tables in sync. By now you can probably see where this is going: applications and VMs which had frequent guest page table updates were not as efficient as those with less frequent guest page table updates.

The above is similar to guest VM kernel mode calls/context switching to access CPU ring 0. Previously, the architecture wouldn’t allow it directly via the hardware so the VMKernel had to intercept these calls and hand-hold each and every ring 0 transaction. Throw 10,000+ ring 0 system calls at the VMKernel per second and the experience starts to become noticeably slower. Both Intel and AMD resolved this issue specifically for virtualized platforms by introducing a ring -1 (a pseudo ring 0) which guest VMs will be able to access directly.

VMware introduced support for RVI in ESX 3.5.0. RVI eliminates MMU related overhead in the VMM by relying on the technology built into the newer RVI capable processors to determine the physical location of guest memory by walking an extra level of page tables maintained by the VMM. RVI is AMD’s nested page table technology. The Intel version of the technology is called Extended Page Tables (EPT) and is expected sometime this year.

One of the applications of RVI that interests me directly is Citrix XenApp (Presentation Server). XenApp receives a direct performance benefit from RVI because it is an MMU-intensive workload. VMware’s conclusion in lab testing was that XenApp performance increased by approximately 29% using RVI. By way of the performance increase, we can increase the number of concurrent users on each virtualized XenApp box. There are two wins here: We increase our consolidation ratios on XenApp and we reduce the aggregate number of XenApp boxes we have to manage due to more densely populated XenApp servers. This is great stuff!

There is a caveat. VMware observed some memory access latency increases for a few workloads, however, they tell us there is a workaround. Use large pages in the guest and the hypervisor to reduce the stress on the Translation Lookaside Buffer (TLB). VMware recommends that TLB-intensive workloads make extensive use of large pages to mitigate the higher cost of a TLB miss. For optimal performance, the ESX VMM and VMKernel aggressively try to use large pages for their own memory when RVI is used.

For more information and deeper technical jibber jabber, please see VMware’s white paper Performance of Rapid Virtualization Indexing (RVI). Something to note is that all testing was performed on ESX 3.5.0 Update 2 with 64 bit guest VMs. I give credit to this document for the information provided in this blog post, including two directly quoted sentences.

For some more good reading, take a look at Duncan Epping’s experience with a customer last week involving MMU, RVI, and memory over commit.