October 2013 archive

Coming soon: Top vBlog 2014 edition

top-vblog-2014-2-crop

This year the top VMware & virtualization blogger voting will be bigger and better thanks to Veeam. We’ll be doing random prize giveaways both for bloggers that make it into the top 50 and for the voters as well. I’ll randomly pick 3 blogger names and 4 voter names to win prizes which include a Mac Mini, iPad Mini, HP MicroServer, Beats headphones, Roku and a Wii U.

prizes2-crop

I’ll kick it off in December with a call for nominations for the specific blogger categories and the voting will open up in January. Every year I get some blogs that complain that they were not included in the voting. I make every effort to add any blog that I might notice that isn’t listed but I can’t catch them all. So to make sure your blog is included in the voting form it must be listed on my vLaunchPad site. Please go there and check and if it isn’t please use this form to let me know. Please include your name, blog URL, RSS feed URL and twitter URL. It may take me a bit to get your blog added, I only update it every few weeks, so keep checking back to see if it is listed.

So bloggers if you haven’t blogged much this year you better get blogging as this is an opportunity for you to not only get some great recognition for all your hard work but also win some great prizes. Special thanks to Veeam for making this possible and if you’d like to show your thanks as well click on the below link and check out their great products.

backup-buynow-260x130-b

Share This:

Top 10 things you must read about vSphere 5.5

There has been so many documents, white papers, videos and blog posts posted about the vSphere 5.5 release that it’s hard to keep up with them all. I have almost 500 links gathered in my vSphere 5.5 Link-O-Rama and it is still growing. With so many links it’s easy to miss some of the really good ones so I thought I would put together a top 10 list that highlights the ones that you don’t want to miss.

top10list-crop

1 – The official VMware What’s New in vSphere 5.5 white paper series

Traditionally VMware releases a slew of What’s New white papers to support a new vSphere release that cover specific areas (i.e. storage, platform, networking, etc.). These white papers cover the new features and enhancements in a lot more detail than their standard one page overview document that covers them at a high level. With the vSphere 5.5 release they only released one initially (platform), then followed up with two more that cover specific storage features. Despite not having as many white papers for this release you should still give these a read as they provide good in depth information written by the VMware technical experts that will help you better understand the changes and new things in vSphere 5.5:

2 – Duncan’s VSAN & vFRC posts

Despite being released as a beta feature, Virtual SAN (VSAN) is still one of the most popular features in vSphere 5.5. VSAN has attracted a lot of interest and people are hungry to know everything they can about it. Well Duncan Epping over at Yellow Bricks has written 14 blog posts on VSAN to help feed that appetite. Another great new storage feature (that you can use now) in vSphere 5.5 is vSphere Flash Read Cache (vFRC), Duncan has also written some must read posts on that as well. So if you want to benefit from Duncan’s inside knowledge and experience with VSAN & vFRC make sure you follow the Yellow Brick road and give these a read:

3 – Chris Wahl’s vSphere 5.5 Improvements series

Chris Wahl has been rising fast in the blogosphere rankings (currently #12) by creating tons of great high quality content and he doesn’t disappoint when it comes to writing about vSphere 5.5. Chris has written a nice detailed multi-part series that covers many different topics in vSphere 5.5 and will give you a great overview of the many improvements in vSphere 5.5:

4 – Derek Seaman’s Installing vSphere 5.5 series

Derek Seaman is another blogger that has been quickly climbing the blogging ladder and made it into the top 25 last year. Derek appears to be trying to out do himself from last years epic 13-part blog series on installing vSphere 5.1 with a new 16 part (and counting?) series on installing vSphere 5.5. This series will guide you through all the different steps of installing vCenter Server and it’s various components and help you avoid any gotchas that you might encounter. Derek spends a lot of time covering SSL & SSO which can always be very challenging and frustrating to implement properly so I highly recommend you give it a read before trying to install or upgrade to vSphere 5.5 yourself:

5 – Cormac Hogan’s VSAN series

If you don’t know Cormac Hogan, you should, he’s a senior technical marketing architect at VMware and his focus is on storage which he knows a lot about. He produces a lot of great content for VMware on the vSphere Blog and also writes on his own personal blog as well which you should definitely bookmark. With each new vSphere release Cormac does a series focused on what’s new with storage and he’s back at it again with vSphere 5.5 with a multi-part series on VSAN. Cormac also started a series on what’s new in storage in vSphere 5.5, but has only posted part 1 so hopefully he continues it. By the time you’ve finished reading through his 10 blog posts on VSAN you’ll probably know as much about it as Cormac does, well probably not but you’ll still learn a lot.

6 – VMware’s Performance Best Practices for vSphere 5.5 white paper

Who doesn’t want to optimize their vSphere environment to gain the best performance possible. Well VMware has published a white paper on performance best practices for vSphere 5.5 that is full of great advice that will help ensure that your vSphere environment is running at top speed. This 90 page white paper is a collection of best practices that covers all parts of vSphere from hosts, to VM’s to vCenter Server and is a definite must read even if you think you know it all.

For example did you know that Windows guest operating systems poll optical drives (that is, CD or DVD drives) quite frequently and that unused or unnecessary virtual hardware devices can impact performance and should be disabled? Or did you know that the more vCPUs a virtual machine has, the more interrupts it requires and that delivering many virtual timer interrupts negatively impacts virtual machine performance and increases host CPU consumption? These are all things you should know if you want to keep your application owners happy, so give this paper a read, I guarantee you will learn something from it.

7 – Michael Webster & Jason Boche’s Storage Deep Dives

I love deep dives that are full of lots of technical details that can help you really gain a better understanding of a particular topic or feature. Michael Webster has a published a great deep dive on the new larger virtual disk size that is a very good read with a lot of great information and considerations for pumping up your virtual disk size. Jason Boche has published a great deep dive on the details of the changes to the UNMAP command in vSphere 5.5 including how to use it and the performance impacts. So if you want to take a deep dive into the pool of storage knowledge get your swimming trunks on and dive in.

8 – VMware licensing

Another year, another vSphere release, another licensing change, another headache.  What you know about VMware’s licensing has probably all changed so it’s time to study up on it again and figure it all out. Be sure and hurry up and learn it before it all changes again.

9 – RTFM

I shouldn’t have to tell you this but I will, reading the fricking manuals can really be helpful. I know most of us don’t like to read manuals and just want to dive into playing with the products but VMware actually makes some really good documentation that is more than just your typical step-by-step instructions. I think the document I always read first for every new vSphere release is the Maximum Configuration doc to see what has changed with scalability, you can read my write up on the changes from vSphere 5.1 to vSphere 5.5. I highly encourage you to checkout the separate documentation on Networking, Storage, Security, Availability and Resource Management. These are great guides for learning about the technology and getting some deep dive information on it.

VMware even makes it easier for you by putting it in multiple formats such as html, pdf, epub and mobi so you can download it to your device of choice and carry it around with you. Maybe some day they’ll even put it in audio book format so you can listen to James Earl Jones tell you how to configure Storage DRS while driving to work, how cool would that be. Also don’t forget to read the release notes as well, you can often find some great nuggets in there. Don’t have time for it, don’t worry, Maish over at Technodrone has done it for you and provided a great write-up on what he found.

10 – VMware Knowledgebase Articles

The VMware Knowledgebase has more than just solutions to problems, it also has a lot of great information and how-to articles as well. Quite literally the VMware KB is a fountain of information that contains dozens of great informative articles specific to vSphere 5.5. This includes articles that will help you with upgrading and installing vSphere 5.5 as well as tons of great tips, gotchas and solutions to issues. So before you even touch vSphere 5.5 save yourself some frustration by reading through the VMware KB and I guarantee your journey to vSphere 5.5 will be much smoother.

=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=

So there you have it, the top 10 things you should read about vSphere 5.5, I’m sure I missed some other great ones as well so feel free to shout out in the comments some additional links that you feel people must read. Also be sure and bookmark my vSphere 5.5 Link-O-Rama, new links are added daily and you will find almost everything you need there to get you going with vSphere 5.5.


Share This:

Complete list of VMworld 2013 session recordings that are publicly available

VMware continues to publicly publish sessions from VMworld 2013 so even if you did not attend you can still access a lot of great sessions. This list will be updated as any other new session recordings are released:

General Sessions:

Track: Business Continuity

Track: End user Computing

Track: Networking

Track: Operations Transformation

Track: Public & Hybrid Cloud

Track: Security & Compliance

Track: Storage

Track: Virtualizing Applications

Track: Virtualization & Cloud Management

Track: vSphere & Cloud Suite

Share This:

New VMworld 2013 session replays posted online

VMware originally posted session replays of the top 10 sessions at VMworld 2013 for anyone (even non-attendees) to watch. Now they have posted 4 new VMworld 2013 session on VMware TV:

Definitely check out these 4 new ones, I attended the vMSC session and it was a good one and looking at the speakers for the other sessions I can bet they are good as well.

The original top 10 sessions that were published are listed below and can be viewed here:

  • VSVC4944 – PowerCLI Best Practices – A Deep Dive
  • BCO5129 – Protection for All – vSphere Replication & SRM Technical Update
  • STO5715-S – Software-defined Storage – The Next Phase in the Evolution of Enterprise Storage
  • PHC5605-S – Everything You Want to Know About vCloud Hybrid Service – But Were Afraid to Ask
  • NET5847 – NSX: Introducing the World to VMware NSX
  • VCM7369-S – Uncovering the Hidden Truth in Log Data With vCenter Log Insight
  • VAPP4679 – Software-Defined Datacenter Design Panel for Monster VM’s: Taking the Technology to the Limits for High Utilisation, High Performance Workloads
  • EUC7370-S – The Software-Defined Data Center Meets End User Computer
  • OPT5194 – Moving Enterprise Application Dev/Test to VMware’s Internal Private Cloud- Operations Transformation
  • SEC5893 – Changing the Economics of Firewall Services in the Software-Defined Center – VMware NSX Distributed Firewall
Share This:

Top 5 big & little enhancements in vSphere 5.5

The August/September timeframe has become like Christmas for vSphere geeks as the anxiously awaited new release of vSphere arrives which they finally get to unwrap and play with. VMware released vSphere 5.5 on September 22nd this year, just one year after the last major vSphere 5.1 release. Overall vSphere 5.5 is a bit light on the number of new features/enhancements compared to previous releases and is also missing the long awaited new Virtual Volumes (vVols) storage architecture that VMware has been showing off for a while now.

Despite that there is still plenty of new stuff in vSphere 5.5 that make it a worthy upgrade. Typically each new release has some superstar new features that get a lot of attention along with lots of smaller enhancements and features that often get overlooked. In this post I thought I’d highlight a few of the big new features and also a few of the smaller ones that often go un-noticed.

This post brought to you by SolarWinds, the makers of great products for virtual environments including Virtualization Manager, Storage Manager and Server & Application Monitor.

1 – Scalability

Scalability in vSphere is important as it dictates the size and the amount of workloads that can run on a host. By steadily increasing scalability VMware has made it so almost any size workload can be virtualized and VM density can grow higher. On the VM side, the Monster VM has steadily grown quite large and able to tackle any workload, however its one weakness has always been the virtual disk size which has been limited to 2TB in past releases. That’s finally changed with vSphere 5.5 as the maximum virtual disk size has jumped to a whopping 62TB.

While the VM side got more disk, on the host size the increases were focused on compute resources. The maximum number of physical and virtual CPUs per hosts doubled to 320 pCPUs and 4096 vCPUs while the maximum physical memory doubled to 4TB. This greatly increases the VM density that you can achieve as it allows you to pack more VMs onto a host. While the CPU limits are so high that most people will never even get close to reaching them, the memory increases are definitely welcome as many applications running on VMs tend to be very memory hungry.

One other nice scalability jump was with the vCenter Server Appliance which is a pre-built virtual appliance complete with OS, database and the vCenter Server software installed. The big advantage of the using the vCSA is it’s simple to install and setup which made it very convenient especially for users that lacked database experience. The problem in vSphere 5.1 was that it was very limited in scalability and would only support the smallest of environments up to 5 hosts and 50 VMs. That’s all changed in vSphere 5.5 as it now scales to 100 hosts and 3000 VMs, a huge jump which it will make it attractive alternative to a much wider group. If you want to find out more about the scalability changes between vSphere releases check out this post and this post.

2 – Virtual SAN

VMware’s new Virtual SAN (VSAN), not to be confused with their existing VSA offering, is their latest product as VMware continues to try and become a storage vendor. The big difference between VMware’s VSA & VSAN is that VSAN is not a virtual appliance, it is baked into the hypervisor and VSAN also scales much higher than VSA which was limited to 3 nodes. VSAN also requires both SSD and traditional spinning disk as it utilizes the SSD tier as both a read cache and write buffer to complement the traditional spinning disk tier.
While VSAN was released as part of vSphere 5.5, it’s not quite ready yet and is only available in beta form.

You can sign up for the public beta here, note there is nothing to download as its native to vSphere 5.5, you just need a license key to activate it. Before you jump in and start using it you should be aware that it currently has limited hardware support and it has some known issues. But it’s beta so you should expect that and shouldn’t be using it in production anyway. That shouldn’t stop you from giving it a try though as long as you meet the requirements so you can get a look at what’s coming. And also the correct acronym is VSAN not vSAN, you have to love VMware’s ever changing letter case usage. If you want to know more about VSAN I have a huge collection of links on it.

3 – UNMAP

UNMAP is a SCSI command (not a vSphere feature) that is used with thin provisioned storage arrays as a way to reclaim space from disk blocks that have been written to after the data that resides on those disk blocks has been deleted. UNMAP serves as the mechanism that is used by the Space Reclamation feature in vSphere to reclaim space from VMs that have been deleted or moved to another datastore. This process allows thin provisioning to clean-up after itself and greatly increases the value and effectiveness of thin provisioning.

Support for UNMAP was first introduced in vSphere 5 and it was initially intended to be an automatic (synchronous) reclamation process. However issues with storage operations timing out while vSphere waited for the process to complete on some arrays caused VMware to change it to a manual (asynchronous) process that does not work in real time. A parameter was added to the vmkfstools CLI utility that would create a balloon file and delete it and during the process UNMAP all disk blocks to reclaim space. The problem with this was you had to constantly run it manually, it was resource intensive and not very efficient as it tried to reclaim blocks that may not have data written to them yet.

In vSphere 5.5 it’s still not an automatic process unfortunately but VMware has improved the manual process. To initiate an UNMAP operation you now use the “esxcli” command using the “storage vmfs unmap” parameter, you can pass it some additional parameters to specify a VMFS volume label/uuid and the number of blocks to reclaim (default is 200). In addition UNMAP is now much more efficient and the run duration is greatly reduced and the reclaim efficiency is increased. As a result where VMware previously recommended only running it off-hours so it wouldn’t impact VM workloads, you can now run it anytime and it will have minimal impact.

To see if your storage device supports UNMAP you can run the “esxcli storage core device vaai status get -d” command and the Delete Status will say supported if it does, you can also check the vSphere HCL to see if its supported and what firmware version may be required. To find out more about the changes check out this post by Jason Boche and if you went to VMworld be sure and check out session STO4907 – Capacity Jail Break: vSphere 5 reclamation nuts and bolts.

4 – CPU C-states

vSphere can help reduce server power consumption during periods of low resource usage by throttling  the physical CPUs. It can accomplish this in one of 2 ways, by throttling the frequency and voltage of a CPU core or by completely shutting down a CPU core. This is referred to as P-states and C-states which are defined as follows:

  • A P-state is an operational state that can alter the frequency and voltage of a CPU core from a low state (P-min) to the max state (P-max), this can help save power for workloads that do not require a CPU core full frequency.
  • A C-state is an idle state that shuts down a whole CPU core so it cannot be used, this is done during periods of low-activity and saves more power than simply lowering the CPU core frequency.

Why would you want to use this feature, because it can save you money, especially in larger environments. It’s the equivalent to staffing a restaurant; do you want your full staff there standing around getting paid while doing nothing during off-peak periods? Of course not, just like you don’t want all your CPU cores powered on when you don’t need them, it wastes money.

Support for CPU P-states & C-states was first introduced in vSphere 4, but the balanced (between power/performance) power policy only supported P-states. You could use C-states as well but you had to create a custom policy for them. Now in vSphere 5.5 the balanced power policy supports both P-states and C-states to be able to achieve the best possible power savings. So now while your VMs are all tucked in bed and resting at night you can keep a green data center and save some cash. You can read more about power management in vSphere in this white paper.

5 – vSphere Flash Read Cache

vSphere has had a caching feature called Content Based Read Cache that was introduced in vSphere 5.0 which allowed you to allocate server RAM to be used as a disk read cache. Unfortunately this feature was only intended to be used by VMware View to help eliminate some of the unique I/O patterns in VDI environments such as boot storms. With vSphere 5.5 VMware has a new host-based caching mechanism called vSphere Flash Read Cache (formerly known as vFlash) that leverages local SSD disks as a cache mechanism.

As the name implies vFRC is a read cache only that is placed directly in front of a VMs virtual disk data path. It can be enabled on a per VM/virtual disk basis and is transparent to the guest OS and applications running in the VM. While caching is configured per host, you can optionally set up vFRC to migrate the cache contents to another host to follow a VM. Its primary benefit is for workloads that are very read intensive (i.e. VDI) but by offloading reads to cache it can indirectly benefit write performance as well.

Another component of vFRC is Virtual Host Flash Swap Cache which is simply the old Swap To SSD feature introduced in vSphere 5.0 that allowed you to automatically use SSDs to host VM desk swap files to support memory over-commitment. To find out more about vFlash you can check out the many links I have here and also check out this VMware white paper. Duncan also has a real good FAQ on it here.

As VMware continues to add more features, the management challenge of keeping up with the changes to the environment gets more difficult.   SolarWind’s Virtualization Manager provides a powerful and affordable solution that takes the complexity out of the managing VMware.  If you’d like to learn more or download a free trial, click on the banner below.

1308_vm_seek_and_destroy_external_260x130

Share This:

Does virtualization really reduce the risk of data loss?

safeplace

I recently read an article on ZDNet about data protection in virtual environments that made the following statement:

“According to a survey conducted by data recovery vendor Kroll Ontrack, 80 percent of respondents did not believe they were at risk or believed they would reduce the risk of data loss when they stored data in a virtual environment.”

Did I read that right?

80 percent of 724 people that were polled at VMworld think virtualization reduces the risk of data loss?

Seriously?

80%?

I’d like to know who these people are and why they feel that way. Virtualization brings a lot of benefits to the data center but magically protecting data isn’t one of them that I know of. If anything you could argue that virtualization increases the risk of data loss as storage becomes a single point of failure and when failures occur they have big impacts. If you look at a traditional data center, your servers and storage are widely distributed, you have a lot of individual physical servers that run a single application which typically store data on the local hard disk of the server. Sure you might have a SAN that you use for storing user data and databases, but a big part of your applications and data is scattered across many servers. If you have a failure on a single server it only impacts that server and not the rest of your environment.

With virtualization you move to a centralized storage model for everything, you still have physical servers that run your VMs but most of them are all stored on a SAN that serves the whole virtual environment. With this model, a failure of a physical server in a virtual environment is typically no big deal as none of your VM data is stored on the physical server it all resides on the SAN. When a host fails you may lose a tiny bit of data from any application that are running and haven’t written data to disk yet, but the VM starts right up on another host and continues where it left off. Now if your storage fails you’re going to be in a world of hurt, those VMware features like HA & FT only protect against host failures, when your storage fails, all those VMs that reside on them go down.

You hear the term all your eggs in one basket when it comes to hosts as they run multiple VMs on them, but at least you have a lot of baskets in your virtual environment. When it comes to storage you truly have all your eggs in one basket as a single storage array services many hosts. So when storage fails, it has a huge impact and greatly amplifies the risk of data loss both in the short term and longer term. Think about it, if I have 200 VMs running on a storage array and it goes down, that’s 200 applications that suddenly had the lights turned out on them and whatever they were doing at the time you lost. Now think about if you had a catastrophic storage failure and you had to recover from the previous nights backup for your whole environment, multiple that times 200 VMs and that’s a lot of data loss.

I can understand how some people might gain a false sense of security after virtualizing as they enjoy the cool new things that they can do now because of virtualization. Their previously rigid physical servers gain superpowers by becoming encapsulated into VMs which provides them with mobility to zip across hosts and datastores while running. They also now have the cool HA & FT features that means they can sleep better at night and not have to head to the office at 2am to get the Exchange server back up and running after a hardware failure. But to think that their VMs are now much safer after virtualizing is just nuts. And its not just hardware failures that can cause big data loss in a virtual environment, there are a lot of other things that can do it as well. With a few simple clicks of a mouse someone can delete a datastore and a lot of VMs or change a setting and shutdown your whole environment. These are things that you don’t have that to worry about in a traditional data center.

Understand this, when you virtualize you’re not in Kansas anymore. When things happen in virtual environments it can have huge impacts. Sure you can help mitigate the risk but the fact remains, shit happens and when it does you can end up covered in it.

So the moral of this story is:

Virtualization does not make your data any safer

So if you’re one of the people that took that survey and think your data is much safer because you virtualized, you better think again, and next year be sure and stop by one of the backup vendors like Veeam or Unitrends and hopefully you’ll learn about the realities of data protection in a virtual environments. And its not just about protecting data through backup methods, you can implement features like stretched storage clusters (vMSC) to protect against storage failures and SRM to provide more traditional off-site recovery options.

So stay safe out there and enjoy all the great benefits that virtualization provides but be smart and make sure you understand the impacts that virtualization has on data protection and what you need to do to keep your data safe.

Share This:

No vMSC certification for vSphere 5.5 yet

The other day I had someone ask if 3PAR was certified for vMSC with vSphere 5.5. So naturally I went to the VMware HCL and checked by selecting ESXi 5.5 for the version, then HP as the vendor and then the FC Metro Cluster Storage as the array test configuration.

vmsc1

When I searched I got back 5 results which made me think it was certified for vMSC in ESXi 5.5. However after checking with the product teams they said a full storage re-certification was required for ESXi 5.5 and while the arrays were certified for ESXi 5.5, separate testing still needed to be done for vMSC with ESXi 5.5. As a result despite the HCL showing results back for vMSC and ESXi 5.5, the arrays are actually not certified for vMSC with ESXi 5.5. Note this behavior is true for any partner you select, when I selected EMC and FC-SVD Metro Cluster Storage it returned one result for ESXi 5.5 just like it would if you select ESXi 5.1 U1.

vmsc2

After looking further at the HCL you can tell this because the FC Metro Cluster Storage entry is missing in the OS Release Details for ESXi 5.5.

vmsc3

If you switch the version to ESXi 5.1 Update 1 you’ll see the entry indicating it is certified for vMSC.

vmsc4-new

After checking further with VMware it appears that there was no Day 0 support for vMSC in vSphere 5.5 which means that there are no arrays which are certified for vMSC with vSphere 5.5. The reason for this is that VMware has not yet completed what is needed for vMSC re-certification testing with vSphere 5.5. They do not expect to have this until Nov-Dec at which time partners can begin the re-certification process for vSphere 5.5. As a result you probably will not see any arrays actually certified for vMSC with vSphere 5.5 until next year.

Share This: