Open Source for Managing Cloud – Developer/Administrator Meetup May 18th

May 5th, 2011 by jason No comments »

Event: Open Source for Managing Cloud – Developer/Administrator Meetup May 18th

Just a quick heads up on an upcoming event which was brought to my attention by Steve Jin.  A meetup to be held in Palo Alto is scheduled for folks who would like to discuss cloud management with open source tools.  Although the meetup is being held at VMware HQ, live remote access is being made available to those who register.

When:
May 18, 2011, 6:30PM to 9:00PM PDT

Location:
Building C Café
3401 Hillview Ave
Palo Alto, CA 94304
* Online access links will be emailed to registerers. *

Speakers/Panelists:
Jeff Hu, Principal Engineer at VMware
Steve Jin, Author of VMware VI and vSphere SDK, Creator of open source VI Java API
Giridhar Padmanabh, Sr. Director of newScale
William Lam, vExpert 2010/2009, Creator of vGhetto project
Boris Strongin, VP Engineering, Hytrust
Dave Briccetti, Independent consultant, opensource Lift framework committer

Register:
http://www.doublecloud.org/event-registration/

More Details:
http://www.doublecloud.org/2011/04/mark-your-calendar-for-our-first-community-event/

VMTurbo Free Performance and Efficiency Reporter

May 4th, 2011 by jason No comments »

Press Release:

VMTurbo Announces Availability of Free Performance and Efficiency Reporter

Reporting joins Monitoring application as a complimentary, useful productivity tool that provides valuable insight into virtual environments

Valhalla, NY, May 4, 2011 — VMTurbo, provider of software to analyze, optimize and control the virtualized data center, today announced free, immediate availability of VMTurbo Performance and Efficiency Reporter. Available for download at the VMTurbo site, VMTurbo Performance and Efficiency Reporter joins VMTurbo Monitoring as a complimentary, useful productivity tool that provides valuable insight into the virtual environment.

With its breakthrough real time workload management algorithm, VMTurbo assures the performance of the applications running in the virtualized environment while utilizing the underline infrastructure as efficiently as possible. VMTurbo “ties the viewing with the doing” by proactively providing corrective actions for any potential performance bottleneck as well as workload placement and configuration actions to maximize resources utilization. Furthermore, leveraging the same algorithm for planning, VMTurbo maximizes the ROI from the virtualized environment in real time and all the time.

“The real value of VMTurbo is its ability to automate and optimize the virtual environment in real time, so it makes sense to give away both our monitoring dashboard and performance reports, which are really just table setters for IT management,” said Shmuel Kliger, president and CEO, VMTurbo. “Now any organization can experience the benefits of VMTurbo in their own data center without having to spend a single dollar.”

The VMTurbo Performance and Efficiency Reporter package is a collection of reports that fall into two categories.

Performance Reports

  • Host/VM Utilization Heat Map contains an ordered ranking of utilization (UI) for both physical hosts as well as virtual machines. Raw data for each host and each VM also is provided. Useful metrics include the peak utilization. This data enables both an “at-a-glance” indicator of workload as well as useful information for provisioning.
  • Host Top CPU Ready Queue provides a detailed breakdown of the metric surrounding CPU ready states. By showing both the host total wait times (aggregated over a sample period) and the total times waited by virtual machines for each multiple of vCPUs, the report provides insights into how either a re-allocation of vCPUs or the re-location of a VM would impact this raw performance metric.
  • Storage Access IOPS delivers a raw ranked standing of data stores in the environment. By aggregating and displaying the raw average sustained IOPs to and from these datastores, users can evaluate the suitability of the datastore against the applied workload and potentially make a better allocation. Further, by looking at the total storage used (vs. capacity), users are better able to plan for anticipated growth.

Efficiency Reports

  • VM Over/Under Provisioning looks at the resources consumed (taking into account historical peaks) to make meaningful recommendations as to right-provisioning. This potentially frees up additional resources that could be re-allocated to improve performance or accommodate additional VMs.
  • Storage Wasted Allocations provides immediate visibility into data stored on the managed drives that is not associated with any VM. With this ranked data, users can quickly free up potentially vast amounts of unused storage at a considerable cost saving.
  • Storage Allocated to Dormant VMs both identifies dormant VMs and enables the reclamation of their disc space. This can yield significant cost savings through resource reclamation and the ability to subsequently host additional VMs on the same hardware.
  • VM Rightsizing Recommendation is based on configurable thresholds as well as analyses of specific time ranges for each VM to make intelligent configuration recommendations based on the actual resource demands of the VM. This ability to intelligently right size represents a significant efficiency improvement over other more wasteful allocation strategies.

Pricing and Availability

VMTurbo Performance and Efficiency Reporter is currently available for free download at http://www.vmturbo.com/downloads/performance-reporter/

Related Links

Find out more about the VMTurbo Performance and Efficiency Reporter at: http://www.vmturbo.com/products/performance-and-efficiency-reporter/

About VMTurbo

VMTurbo provides an integrated software suite for proactive and automated management of workload and resources in virtualized data centers. Only VMTurbo provides a holistic view of your virtual infrastructure as well as detailed action plans with respect to workload placement and resource allocation.  Our customers accomplish ever more, with less IT resources, by using our suite to analyze, optimize and control their virtual infrastructure. 

Test Drive the VMware View App for iPad

May 1st, 2011 by jason No comments »

Nearly two months ago, the VMware View app was released by VMware for the iPad and I wrote about it here.  Since then, many in the community have been curious as to what the end user computing experience was like.  They have iPads and of course they have free access to the View app but they lacked a VMware View environment to connect to, particularly a remote over-the-internet scenario using View 4.6 5.0 5.0.1 GA and PCoIP.

Early on I worked with a few individuals on a 1 on 1 basis, providing access to a test VDI desktop intance in my lab.  They tested for up to a week and demoed for upper management in the company.  When testing was complete, they went on their way.  After a few iterations, I decided that there was some value in what I was doing, but the continuous setup and retirement of accounts isn’t something I wanted to continually track.  As a result, I’ve set up a persistent VDI instance in my View 4.6 5.0 GA lab which can be accessed any time using generic credentials from your iPad by following these steps:

How to connect:

Step 1) Grab yourself an iPad if you don’t already have one (1st or 2nd generation both work).

Step 2) Connect your iPad to the internet.  Be sure TCP/UPD 4172 ports are not blocked.

Step 3) Get yourself the VMware View for iPad app:

SnagIt Capture

Step 4) Provide the following connection specifications in the VMware View for iPad app:

Snagit Capture

 

Step 5) If you’re prompted for credentials at Windows 7 logon, use the credentials shown above.

Step 6) Enjoy but do try to limit the duration of your connectivity.

Environment:

The Windows 7 test VM provides basic desktop application access.  Bandwidth from the VDI lab standpoint is 16Mpbs down, 2Mbps up.  On your end, that’s 2 down, 16 up.  It is the internet; performance and speeds will vary.  By design, one user session is allowed at a time.  There is only one desktop instance.  The idea is to use the session for a few minutes to get a feel for the client experience.  The session is not for long term or production use.  No warranties, use at your own risk, etc.  In reality, the longer you maintain connectivity, the more chance you have of being interrupted by another user requesting to use the desktop.  If you’re trying to log on and you receive a message stating “The View agent reports that this desktop is currently logging off a previous session.”, you are probably interrupting someone elses session.  Try again later.  If you are currently in a session and it abruptly ends, it is likely the result of someone else submitting a logon request – sorry – At this point I do not know how to prevent the session interruptions which is essentially a “following” feature which would commonly be used in a health clinic.  If you have any ideas, please share in the comments section below.

To maintain a safe environment, web browsing and access to some other areas of the OS has been disabled.  All activity is logged.  The VM will reset at regular intervals in an effort to restore back to its original clean starting point.

Updated 9/18/11:  The environment has been upgraded to View 5.0 GA

Updated 11/6/11:  Thanks to the notification of a few friendly folks, I found out the environment was no longer functional. In short, the computer password for the VDI workstation was out of sync.  I’ve fixed this an enhanced the environment for longer term use which should prevent future implosions.  The demo environment now supports two concurrent demo sessions using the same credentials. In addition, each demo session is deleted upon a disconnection and a new VDI workstation is built.  This is all done by the addition of VMware View Composer to the environment.

Updated 3/28/12:  The environment has been upgraded to View 5.0.1 GA

Palo Alto VCDX Defense Application Due Date June 6th

April 22nd, 2011 by jason No comments »

The application due date for the VCDX Defenses in Palo Alto, CA is fast approaching.  Applications are due June 6, 2011, 5:00 PM Pacific Time.

For those who may be interested in an upcoming Palo Alto defense date, plan accordingly to make sure you meet the pre-requisite exam requirements.  Details for the application process can be found here:

vmware.com/go/vcdx > VCDX Defense Overview

Product Review: Veeam Backup & Replication v5

April 21st, 2011 by jason No comments »

Do you like free?  Do you like backup and replication?  Do you like VMware?  If you answered “yes” to any of the three, then you might like this:  I wrote a product review on Veeam Backup and Replication 5 which discusses the following:

Pros and Cons of different approaches to data protection

An in-depth look at Veeam Backup & Replication v5

What Veeam Backup & Replication v5 is missing

Register for your free download:

Product Review: Veeam Backup & Replication v5



Sound familiar? It should.  This isn’t the first time I’ve written about Veeam.  Check out a few of my previous posts about Veeam Backup & Replication:

Veeam Backup & Replication 5.0

Gestalt IT Tech Field Day – Veeam

HDS and VAAI Integration

April 3rd, 2011 by jason No comments »

SnagIt CaptureOn day 1 of Hitachi Data Systems Geek Day 2.0, we met with Michael Heffernan, Global Product Manager – Virtualization.  You might know him as @virtualheff on Twitter.  I was pleased to listen to Heff as he discussed HDS integration with VMware vSphere vStorage API for Array Integration (VAAI for short and most easily pronounced “vee·double-ehh·eye”).  For those who aren’t aware, VMware introduced VAAI with the GA release of vSphere 4.1 on July 13th of last year.  In short, VAAI allows the burden of certain storage related tasks to be offloaded from the ESX/ESXi hypervisor to the storage array.  Generally speaking, the advantages touted are performance improvement of intrinsic tasks and increased scalability of the storage array. HDS is one of a few storage vendors who supported VAAI integration on the July launch date and in February of this year, they announced VAAI support with their VSP (see also Hu Yoshida’s writing on the announcement).

Heff started off with some virtualization in the datacenter background and IDC stats.  Here are a few that he shared with us:

  • Only 12.8% of all physical servers are virtualized in 2009
  • More than half of all workloads (51%) will be virtualized by the end of 2010
  • Two-thirds (69%) by 2013
  • VM densities continue to rise predictably, averaging:
    • 6 VMs per physical server in 2009
    • 8.5 VMs per physical server in 2013

A few time line infographics were also shown which tell a short story about VMware, HDS:

 SnagIt Capture   SnagIt Capture

VMware provides several integration points which storage vendors can take advantage of, VAAI being just one of them.  These integration points are use case specific and standardized by VMware.  As such, integration is developed in parallel by competing vendors and most often the resulting offerings from each look and feel similar.  Great minds in storage and virtualization think alike.

SnagIt Capture   SnagIt Capture

SnagIt CaptureHDS integrates with all three VAAI attach points VMware offers:

  1. Hardware Assisted Copy
  2. Hardware Assisted Zeroing
  3. Hardware Assisted Locking

Heff also used this opportunity to mention Hitachi Dynamic Provisioning (HDP) technology which is essentially HDS thin provisioning plus other lesser known benefits but has nothing more to do with VAAI than any other storage vendor which supports both VAAI and thin provisioning.  Others may disagree but I see no sustainable or realizable real world benefit with VAAI and thin provisioning at this time; the discussion is rather academic.

HDS went on to show VAAI benefits are real.  Tests show an 18% efficiency improvement in the block copy test on a 30GB virtual disk.  85% decrease in elapsed time to eager write zeros to a 30GB virtual disk.  The third VAAI benefit, hardware assisted locking, can be a little trickier to prove or require specific use cases.  Following are examples of VMFS operations that require locking metadata, and as a result a SCSI reservation which hardware assisted locking improves, per VMware KB Article: 1005009:

  • Creating a VMFS datastore
  • Expanding a VMFS datastore onto additional extents
  • Powering on a virtual machine
  • Acquiring a lock on a file
  • Creating or deleting a file
  • Creating a template
  • Deploying a virtual machine from a template
  • Creating a new virtual machine
  • Migrating a virtual machine with VMotion
  • Growing a file, for example, a Snapshot file or a thin provisioned Virtual Disk

Heff showcased the following hardware assisted locking results.  Up to 36% increase in performance and 75% reduction in lock conflicts for the power on/linked clone test:

SnagIt Capture   SnagIt Capture

SnagIt Capture

VAAI offloads some of the heavy lifting from the hypervisor to the back end storage array so it was appropriate for the discussion to ultimately lead to impact on the array.  This is where I currently feel the bigger benefit is: better scalability or more mileage out of the array.  HDS is also the second storage vendor I’ve heard say that block LUN size and number of VMs per LUN is no longer a constraint (from a performance standpoint, everything else being equal).  This point always interests me and is frankly a tough pill to swallow.  I wasn’t able to pin Heff down to more specific details nor have I seen actual numbers, case studies, or endorsements from any storage vendor’s customer environments.  To some degree, I think this design consideration is still going to be use case and environment dependent.  It will also continue to be influenced by other constraints such as replication.  It may become more of a reality when VMware expands VAAI integration beyond the original three features.  HDS did mention that in vSphere 5, VMware is adding two more VAAI features bringing the total to five assuming they are released.

HDS offers competitive storage solutions for the VMware use case and it is clear they are totally committed to the virtualization push from both a storage and compute perspective.  You can learn more about these solutions and stay in tune with their evolution at their VMware Solutions site.

Full Disclosure Statement: HDS Geek Day is a sponsored event. Although I receive no direct compensation and take personal leave to attend, all event expenses are paid by the sponsors. No editorial control is exerted over me and I write what I want, if I want, when I want, and how I want.

Iomega StorCenter ix2-200 Network Storage, Cloud Edition

April 2nd, 2011 by jason No comments »

SnagIt Capture

I recently acquired an Iomega ix2-200 storage appliance which is perhaps the smallest storage device in EMC’s vast portfolio, save the VMAX thumb drive I’ve heard sparse sightings of.  This is a nifty little device which could prove quite useful in the home, home office, college dorm, or small business.  The ix2 serves as network attached storage (NAS) capable of several protocols mapping it to many of the most popular applications.  NFS, iSCSI, CIFS/SMB, Apple File Sharing, Bluetooth, FTP, TFTP (a new addition in the latest firmware update), rsync, and SNMP to name several.

A rich and easy to use browser-based interface provides access to the device and storage configuration.  The package includes software which I initially installed on my Windows 7 workstation to get up and running.  This software also integrates nicely with the PC it’s installed on providing file backup and other features, some of which are new in the -200 version of the appliance and cloud related.  I later ditched the management software due to an annoying iSCSI configuration bug.  Once the appliance is on the network, the web interface via its TCP/IP host address proved to be more reliable.  My unit shipped with a fairly old version of firmware which I wasn’t initially aware of based on feedback from the management interface which claimed it was all up to date.  Updating the firmware added some features and sped up iSCSI LUN creation time immensely.  

SnagIt CaptureWhat’s included:

  • Iomega® StorCenter ix2-200 Network Storage
  • 1 USB port on the front, 2 USB ports in the rear (for external drives, printers, and UPS connectivity)
  • 1 Gb Ethernet port in the rear
  • Ethernet Cable
  • Power Supply
  • Printed Quick Install Guide & other light documentation
  • Software CD
  • Service & Support: Three year limited warranty with product registration within 90 days of purchase.
  •  

    Technical Specifications:

    • Desktop, compact form factor
      • Width: 3.7 in (94mm)
      • Length: 8.0 in (203mm)
      • Height: 5.6 in (141mm)
      • Weight: 5 lbs (2.27 kg)
    • CPU at 1GHz with 256MB RAM
    • 2 x 3.5″ Easy-Swap SATA-II Hard Disk Drives
    • RAID 1, JBOD
    • 1 x RJ45 10/100/1000Mbps (GbE) Ethernet port. LAN standards: IEEE 802.3, IEEE 802.3u
    • 3 x USB 2.0 ports (to connect external HDD, printers, UPS, Bluetooth dongle)
    • Client computers for file system access—Windows PC, Mac OS, Linux
    • AC Voltage 100-240 VAC
    • Power consumption – 5 Watts (min) – 19 Watts (max)
    • Acoustic noise – 28 dB maximum

    Application Features:  The ix2-200 has an impressive set, most of which I don’t or probably will never use.

    • Content sharing
    • Torrent download manager
    • Photo slide show
    • Remote access
    • Active Directory support
    • USB printer sharing
    • Facebook, Flickr, and YouTube integration
    • Security camera integration
    • Several backup options, including cloud integrated
    • 

    UI Candy:  The management interface consists of five main tabs: Home, Dashboard, Users, Shared Storage, and Settings.  Please pardon the inconsistent cropping crudity:

    SnagIt Capture   SnagIt Capture   SnagIt Capture   SnagIt Capture

    The ix2 ships with 2x 1TB SATA-II drives.  RAID 1 (mirror) with automatic RAID rebuild and RAID 0 (Stripe w/o parity) support as well as JBOD mode also available.

    SnagIt Capture   SnagIt Capture

    Temperature and fan status.  My unit seems hot; I need to check that fan showing 0 RPM:

    SnagIt Capture

    Believe it or not, Jumbo Frames support at either 4000 or 9000 MTU:

    SnagIt Capture

    Speaking of jumbo frames, what about performance?  I was pleasantly surprised to find the ix2-200 officially supported by VMware vSphere for both iSCSI and NAS.  I’m in it for the vSphere use case so I benchmarked NFS and iSCSI in a way which is consistent with how I’ve performed previous storage performance tests which can also be compared in the VMware community (take a look here and here for those comparisons).  With two spindles, I wasn’t expecting grand results but I was curious nonetheless and I also wanted to share and compare with some co-workers who tested their home storage this past week.  Performance results were at times inconsistent during multiple runs of the same IO test.  In addition, NFS performance decreased after applying the latest firmware update.

    iSCSI

    ix2 iSCSI feels like a no-frills implementation.  iSCSI LUN security is user and Mutual CHAP based and seems particularly weak.  Individual LUNs can only be secured on a per user basis.  The user based security isn’t supported by vSphere and the CHAP implementation doesn’t seem to work at all in that my ESXi host was able to read/write to an ix2 LUN without having the required CHAP secret.  In summary, the only viable ESXi configuration is to connect the host or hosts to an unsecured iSCSI LUN or set of LUNs on the ix2.  Risks here include lack of data security as well as integrity since any host on the network with an iSCSI initiator can read/write to the iSCSI LUN.  As far as I can tell, there is no thin or virtual provisioning at the ix2 layer when creating iSCSI block LUNs.  This is merely an observation; I wasn’t expecting support for thin provisioning, dedupe, or compression.

    NFS

    NFS is more secure on the ix2 in that volume access can be restricted to a single IP address of the vSphere host.  Volumes are also secured individually which provides granularity.  It’s also flexible enough to support global subnet based access.  These are security features commonly found in enterprise NFS storage.  Similar to iSCSI above, NFS also supports user based access which again doesn’t provide much value in the vSphere use case.

    I’m not going to speak much in detail about the performance results.  I didn’t have much along the lines of expectations and I think the results speak for themselves.  iSCSI performed marginally better with the RealLife test.  However, I’m not convinced the security trade off makes iSCSI a clear winner.  Coupling the advantage in the Max Throughput test, I’m more in favor of NFS overall with the ix2-200.

    SnagIt Capture

    Supporting performance data collected from Iometer:

    SnagIt Capture

    Reliability of the ix2-200 is in the back of my mind.  I’ve heard one report of frequent failures and loss of RAID/data with the bigger brother Iomega ix4.  Time will tell.  With that, I won’t be placing any important data on the ix2.  As it is, I blew away the factory default RAID1 configuration for double the density, spindle, and performance of RAID0.  My intent for the ix2 is to use it as cheap lab storage for vSphere and potentially backup during the summer months.

    For more on the ix2, take a look at a nice writeup Stephen Foskett produced quite a while back.