I recently wrote a white paper for Infinio on this topic and am also doing a webinar that is based on the white paper. If you don’t know about Infinio you should definitely give them a look as they have a clever solution for solving storage performance challenges in vSphere environments. The white paper should be available very soon on Infinio’s website and you can sign-up now for the webinar on 12/18. I look forward to seeing you there and I’ll also being doing a more detailed post on their solution soon.
Nov 20 2013
Exterminate, exterminate, exterminate
What techie geek doesn’t love Doctor Who, I’ve been watching it since Tom Baker was the Doctor. Well if you do as well check out this latest promotion from Unitrends which caught my eye. Looks like the folks at Unitrends went on a shopping spree at ThinkGeek and they’re giving away some cool Doctor Who gadgets for simply downloading a free trial of Unitrends. I’ll readily admit that I own 2 sonic screwdrivers myself, the 10th Doctor’s and the 11th Doctor’s, mine isn’t a remote though which would be a nice upgrade. So head on over to Unitrends website and sign-up and hopefully you’ll win some cool Doctor Who swag to get prepared for the upcoming 50th anniversary show.
Oct 26 2013
Coming soon: Top vBlog 2014 edition
This year the top VMware & virtualization blogger voting will be bigger and better thanks to Veeam. We’ll be doing random prize giveaways both for bloggers that make it into the top 50 and for the voters as well. I’ll randomly pick 3 blogger names and 4 voter names to win prizes which include a Mac Mini, iPad Mini, HP MicroServer, Beats headphones, Roku and a Wii U.
I’ll kick it off in December with a call for nominations for the specific blogger categories and the voting will open up in January. Every year I get some blogs that complain that they were not included in the voting. I make every effort to add any blog that I might notice that isn’t listed but I can’t catch them all. So to make sure your blog is included in the voting form it must be listed on my vLaunchPad site. Please go there and check and if it isn’t please use this form to let me know. Please include your name, blog URL, RSS feed URL and twitter URL. It may take me a bit to get your blog added, I only update it every few weeks, so keep checking back to see if it is listed.
So bloggers if you haven’t blogged much this year you better get blogging as this is an opportunity for you to not only get some great recognition for all your hard work but also win some great prizes. Special thanks to Veeam for making this possible and if you’d like to show your thanks as well click on the below link and check out their great products.
Oct 21 2013
Top 10 things you must read about vSphere 5.5
There has been so many documents, white papers, videos and blog posts posted about the vSphere 5.5 release that it’s hard to keep up with them all. I have almost 500 links gathered in my vSphere 5.5 Link-O-Rama and it is still growing. With so many links it’s easy to miss some of the really good ones so I thought I would put together a top 10 list that highlights the ones that you don’t want to miss.
1 – The official VMware What’s New in vSphere 5.5 white paper series
Traditionally VMware releases a slew of What’s New white papers to support a new vSphere release that cover specific areas (i.e. storage, platform, networking, etc.). These white papers cover the new features and enhancements in a lot more detail than their standard one page overview document that covers them at a high level. With the vSphere 5.5 release they only released one initially (platform), then followed up with two more that cover specific storage features. Despite not having as many white papers for this release you should still give these a read as they provide good in depth information written by the VMware technical experts that will help you better understand the changes and new things in vSphere 5.5:
- What’s New in VMware vSphere 5.5 Platform (VMware Tech Paper)
- What’s New in VMware vSphere Flash Read Cache (VMware Tech Paper)
- What’s New in VMware Virtual SAN (VSAN) (VMware Tech Paper)
2 – Duncan’s VSAN & vFRC posts
Despite being released as a beta feature, Virtual SAN (VSAN) is still one of the most popular features in vSphere 5.5. VSAN has attracted a lot of interest and people are hungry to know everything they can about it. Well Duncan Epping over at Yellow Bricks has written 14 blog posts on VSAN to help feed that appetite. Another great new storage feature (that you can use now) in vSphere 5.5 is vSphere Flash Read Cache (vFRC), Duncan has also written some must read posts on that as well. So if you want to benefit from Duncan’s inside knowledge and experience with VSAN & vFRC make sure you follow the Yellow Brick road and give these a read:
- Introduction to VMware vSphere Virtual SAN (Yellow Bricks)
- Frequently asked questions about Virtual SAN / VSAN (Yellow Bricks)
- Virtual SAN news flash pt 1 (Yellow Bricks)
- Testing vSphere Virtual SAN in your virtual lab with vSphere 5.5 (Yellow Bricks)
- How do you know where an object is located with Virtual SAN? (Yellow Bricks)
- How VSAN handles a disk or host failure (Yellow Bricks)
- Virtual SAN and Data Locality/Gravity (Yellow Bricks)
- Isolation / Partition scenario with VSAN cluster, how is this handled? (Yellow Bricks)
- Initialized disks to be used by VSAN task completed successfully, but no disks added? (Yellow Bricks)
- I created a folder on my VSAN datastore, but how do I delete it? (Yellow Bricks)
- Be careful when defining a VM storage policy for VSAN (Yellow Bricks)
- Designing your hardware for Virtual SAN (Yellow Bricks)
- Pretty pictures Friday, the VSAN edition… (Yellow Bricks)
- VMware vSphere Virtual SAN design considerations… (Yellow Bricks)
- Introduction to vSphere Flash Read Cache aka vFlash (Yellow Bricks)
- Frequently asked questions about vSphere Flash Read Cache (Yellow Bricks)
- Something to know about vSphere Flash Read Cache (Yellow Bricks)
- vSphere Flash Read Cache and esxcli (Yellow Bricks)
3 – Chris Wahl’s vSphere 5.5 Improvements series
Chris Wahl has been rising fast in the blogosphere rankings (currently #12) by creating tons of great high quality content and he doesn’t disappoint when it comes to writing about vSphere 5.5. Chris has written a nice detailed multi-part series that covers many different topics in vSphere 5.5 and will give you a great overview of the many improvements in vSphere 5.5:
- vSphere 5.5 Improvements Part 1 – The New Hotness in ESXi 5.5 (Wahl Network)
- vSphere 5.5 Improvements Part 2 – Pushing For A Software-Defined Data Center (SDDC) (Wahl Network)
- vSphere 5.5 Improvements Part 3 – Lions, Tigers, and 62TB VMDKs (Wahl Network)
- vSphere 5.5 Improvements Part 4 – Virtual SAN (VSAN) (Wahl Network)
- vSphere 5.5 Improvements Part 5 – vSphere Flash Read Cache (vFlash) (Wahl Network)
- vSphere 5.5 Improvements Part 6 – Site Recovery Manager (SRM) and vSphere Replication(Wahl Network)
- vSphere 5.5 Improvements Part 7 – Single Sign On Completely Redesigned (Wahl Network)
- vSphere 5.5 Improvements Part 8 – Network Virtualization with NSX (Wahl Network)
- vSphere 5.5 Improvements Part 9 – Networking and VDS Razzle Dazzle (Wahl Network)
4 – Derek Seaman’s Installing vSphere 5.5 series
Derek Seaman is another blogger that has been quickly climbing the blogging ladder and made it into the top 25 last year. Derek appears to be trying to out do himself from last years epic 13-part blog series on installing vSphere 5.1 with a new 16 part (and counting?) series on installing vSphere 5.5. This series will guide you through all the different steps of installing vCenter Server and it’s various components and help you avoid any gotchas that you might encounter. Derek spends a lot of time covering SSL & SSO which can always be very challenging and frustrating to implement properly so I highly recommend you give it a read before trying to install or upgrade to vSphere 5.5 yourself:
- vSphere 5.5 Install Pt. 1: Introduction (Derek Seaman)
- vSphere 5.5 Install Pt. 2: SSO Reborn (Derek Seaman)
- vSphere 5.5 Install Pt. 3: Upgrading vCenter (Derek Seaman)
- vSphere 5.5 Install Pt. 4: ESXi 5.5 Upgrade (Derek Seaman)
- vSphere 5.5 Install Pt. 5: SSL Deep Dive (Derek Seaman)
- vSphere 5.5 Install Pt. 6: Certificate Template (Derek Seaman)
- vSphere 5.5 Install Pt. 7: Install SSO (Derek Seaman)
- vSphere 5.5 Install Pt. 8: Online SSL Minting (Derek Seaman)
- vSphere 5.5 Install Pt. 9: Offline SSL Minting (Derek Seaman)
- vSphere 5.5 Install Pt. 10: Replace SSO Certs (Derek Seaman)
- vSphere 5.5 Install Pt. 11: Install Web Client (Derek Seaman)
- vSphere 5.5 Install Pt. 12: Configure SSO (Derek Seaman)
- vSphere 5.5 Install Pt. 13: Install Inventory Svc (Derek Seaman)
- vSphere 5.5 Install Pt. 14: Create Databases (Derek Seaman)
- vSphere 5.5 Install Pt. 15: Install vCenter (Derek Seaman)
- vSphere 5.5 Install Pt. 16: vCenter SSL (Derek Seaman)
5 – Cormac Hogan’s VSAN series
If you don’t know Cormac Hogan, you should, he’s a senior technical marketing architect at VMware and his focus is on storage which he knows a lot about. He produces a lot of great content for VMware on the vSphere Blog and also writes on his own personal blog as well which you should definitely bookmark. With each new vSphere release Cormac does a series focused on what’s new with storage and he’s back at it again with vSphere 5.5 with a multi-part series on VSAN. Cormac also started a series on what’s new in storage in vSphere 5.5, but has only posted part 1 so hopefully he continues it. By the time you’ve finished reading through his 10 blog posts on VSAN you’ll probably know as much about it as Cormac does, well probably not but you’ll still learn a lot.
- VSAN Part 1 – A first look at VSAN (Cormac Hogan)
- VSAN Part 2 – What do you need to get started? (Cormac Hogan)
- VSAN Part 3 – It is not a Virtual Storage Appliance (Cormac Hogan)
- VSAN Part 4 – Understanding Objects and Components (Cormac Hogan)
- VSAN Part 5 – The role of VASA (Cormac Hogan)
- VSAN Part 6 – Manual or Automatic Mode (Cormac Hogan)
- VSAN Part 7 – Capabilities and VM Storage Policies (Cormac Hogan)
- VSAN Part 8 – The role of the SSD (Cormac Hogan)
- VSAN Part 9 – Host Failure Scenarios & vSphere HA Interop (Cormac Hogan)
- VSAN Part 10 – Changing VM Storage Policy on-the-fly (Cormac Hogan)
6 – VMware’s Performance Best Practices for vSphere 5.5 white paper
Who doesn’t want to optimize their vSphere environment to gain the best performance possible. Well VMware has published a white paper on performance best practices for vSphere 5.5 that is full of great advice that will help ensure that your vSphere environment is running at top speed. This 90 page white paper is a collection of best practices that covers all parts of vSphere from hosts, to VM’s to vCenter Server and is a definite must read even if you think you know it all.
For example did you know that Windows guest operating systems poll optical drives (that is, CD or DVD drives) quite frequently and that unused or unnecessary virtual hardware devices can impact performance and should be disabled? Or did you know that the more vCPUs a virtual machine has, the more interrupts it requires and that delivering many virtual timer interrupts negatively impacts virtual machine performance and increases host CPU consumption? These are all things you should know if you want to keep your application owners happy, so give this paper a read, I guarantee you will learn something from it.
- Performance Best Practices for VMware vSphere 5.5 (VMware Tech Paper)
7 – Michael Webster & Jason Boche’s Storage Deep Dives
I love deep dives that are full of lots of technical details that can help you really gain a better understanding of a particular topic or feature. Michael Webster has a published a great deep dive on the new larger virtual disk size that is a very good read with a lot of great information and considerations for pumping up your virtual disk size. Jason Boche has published a great deep dive on the details of the changes to the UNMAP command in vSphere 5.5 including how to use it and the performance impacts. So if you want to take a deep dive into the pool of storage knowledge get your swimming trunks on and dive in.
- vSphere 5.5 Jumbo VMDK Deep Dive (Long White Clouds)
- vSphere 5.5 UNMAP Deep Dive (VMware vEvangelist)
8 – VMware licensing
Another year, another vSphere release, another licensing change, another headache. What you know about VMware’s licensing has probably all changed so it’s time to study up on it again and figure it all out. Be sure and hurry up and learn it before it all changes again.
9 – RTFM
I shouldn’t have to tell you this but I will, reading the fricking manuals can really be helpful. I know most of us don’t like to read manuals and just want to dive into playing with the products but VMware actually makes some really good documentation that is more than just your typical step-by-step instructions. I think the document I always read first for every new vSphere release is the Maximum Configuration doc to see what has changed with scalability, you can read my write up on the changes from vSphere 5.1 to vSphere 5.5. I highly encourage you to checkout the separate documentation on Networking, Storage, Security, Availability and Resource Management. These are great guides for learning about the technology and getting some deep dive information on it.
VMware even makes it easier for you by putting it in multiple formats such as html, pdf, epub and mobi so you can download it to your device of choice and carry it around with you. Maybe some day they’ll even put it in audio book format so you can listen to James Earl Jones tell you how to configure Storage DRS while driving to work, how cool would that be. Also don’t forget to read the release notes as well, you can often find some great nuggets in there. Don’t have time for it, don’t worry, Maish over at Technodrone has done it for you and provided a great write-up on what he found.
- VMware vSphere 5.5 Release Notes (vmware.com)
- vSphere 5.5 Product Documentation — PDF and E-book Formats (vmware.com)
- vSphere 5.5 Configuration Maximums (vmware.com)
- vSphere Installation and Setup (vmware.com)
- vSphere Upgrade (vmware.com)
- vSphere vCenter Server and Host Management (vmware.com)
- vSphere Virtual Machine Administration (vmware.com)
- vSphere Host Profiles (vmware.com)
- vSphere Networking (vmware.com)
- vSphere Storage (vmware.com)
- vSphere Security (vmware.com)
- vSphere Resource Management (vmware.com)
- vSphere Availability (vmware.com)
- vSphere Monitoring and Performance (vmware.com)
- vSphere Single Host Management (vmware.com)
- vSphere Troubleshooting (vmware.com)
10 – VMware Knowledgebase Articles
The VMware Knowledgebase has more than just solutions to problems, it also has a lot of great information and how-to articles as well. Quite literally the VMware KB is a fountain of information that contains dozens of great informative articles specific to vSphere 5.5. This includes articles that will help you with upgrading and installing vSphere 5.5 as well as tons of great tips, gotchas and solutions to issues. So before you even touch vSphere 5.5 save yourself some frustration by reading through the VMware KB and I guarantee your journey to vSphere 5.5 will be much smoother.
- vSphere 5.5 is here! – KBs you need to know about (VMware Support Insider Blog)
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
So there you have it, the top 10 things you should read about vSphere 5.5, I’m sure I missed some other great ones as well so feel free to shout out in the comments some additional links that you feel people must read. Also be sure and bookmark my vSphere 5.5 Link-O-Rama, new links are added daily and you will find almost everything you need there to get you going with vSphere 5.5.
Oct 18 2013
Complete list of VMworld 2013 session recordings that are publicly available
VMware continues to publicly publish sessions from VMworld 2013 so even if you did not attend you can still access a lot of great sessions. This list will be updated as any other new session recordings are released:
General Sessions:
- Monday General Session: VMworld 2013 San Francisco – Pat Gelsinger
- Tuesday General Session: VMworld 2013 San Francisco – Carl Eschenbach, Principal Engineer Kit Colbert and EMEA CTO Joe Baguley
- Tuesday General Session: VMworld Europe 2013 – Pat Gelsinger
- Wednesday General Session: VMworld 2013 Europe – Carl Eschenbach, Principal Engineer Kit Colbert and EMEA CTO Joe Baguley
Track: Business Continuity
- BCO4872 – Operating and Architecting a vSphere Metro Storage Cluster Based Infrastructure – Lee Dilworth (VMware), Duncan Epping (VMware)
- BCO5041 – vSphere Data Protection – What’s New and Technical Walkthrough – Jeff Hunter (VMware)
- BCO5065 – VMware vSphere Fault Tolerance for Multiprocessor Virtual Machines – Technical Preview – Jim Chow (VMware), Wei Xu (VMware)
- BCO5129 – Protection for All – vSphere Replication & SRM Technical Update – Lee Dilworth (VMware), Ken Werneburg (VMware)
Track: End user Computing
- EUC5291 – Horizon View Troubleshooting: Looking under the Hood – Matt Coppinger (VMware), Jack McMichael (VMware)
- EUC7370-S – The Software-Defined Data Center Meets End User Computer – Scott Davis (VMware), Frank Nydam (VMware), Mike Coleman (VMware)
Track: Networking
- NET5847 – NSX: Introducing the World to VMware NSX – Milin Desai (VMware), Sachin Thakar (VMware)
- NET7388-S – Network Virtualization: Moving Beyond the Obvious – Martin Casado (VMware)
Track: Operations Transformation
- OPT5194 – Moving Enterprise Application Dev/Test to VMware’s Internal Private Cloud- Operations Transformation – Kurt Milne (VMware), Venkat Gopalakrishn (VMware)
Track: Public & Hybrid Cloud
- PHC4783 – How To Build Your Hybrid Cloud and Consume the Public Cloud – Chris Colotti (VMware), Michael Roy (VMware)
- PHC5605-S – Everything You Want to Know About vCloud Hybrid Service – But Were Afraid to Ask – Mathew Lodge (VMware), Christopher Rence (Digital River, Inc.)
Track: Security & Compliance
- SEC5893 – Changing the Economics of Firewall Services in the Software-Defined Center – VMware NSX Distributed Firewall – Srinivas Nimmagadda (VMware), Anirban Sengupta (VMware)
Track: Storage
- STO5391 – VMware Virtual SAN – Christos Karamanolis (VMware), Vijay Ramachandran (VMware)
- STO5715-S – Software-defined Storage – The Next Phase in the Evolution of Enterprise Storage – Vijay Ramachandran (VMware), Alberto Farronato (VMware)
Track: Virtualizing Applications
- VAPP4679 – Software-Defined Datacenter Design Panel for Monster VM’s: Taking the Technology to the Limits for High Utilisation, High Performance Workloads – Frank Dennemean (PernixData), Andrew Mitchell (VMware), Mark Achtemichuck (VMware), Mostafa Khalil (VMware), Michael Webster (VMware)
Track: Virtualization & Cloud Management
- VCM7369-S – Uncovering the Hidden Truth in Log Data With vCenter Log Insight – Tim Russell (NetApp), Manesh Kumar, Jon Herlocker (VMware)
Track: vSphere & Cloud Suite
- VSVC4605 – What’s New in VMware vSphere? – Michael Adams (VMware)
- VSVC4830 – vCenter Deep Dive – Ameet Jani (VMware), Justin King (VMware)
- VSVC4944 – PowerCLI Best Practices – A Deep Dive – Luc Dekens (Eurocontrol), Alan Renouf (VMware)
- VSVC5005 – What’s New in vSphere Platform & Storage – Kyle Gleed (VMware), Cormac Hogan (VMware)
- VSVC5690 – vSphere Upgrade Series Part 1: vCenter Server – Josh Gray (VMware), Justin king (VMware)
- VSVC5821 – Performance and Capacity Management of DRS Clusters – Ganesha Shanmuganathan (VMware), Anne Holler (VMware)
Oct 15 2013
New VMworld 2013 session replays posted online
VMware originally posted session replays of the top 10 sessions at VMworld 2013 for anyone (even non-attendees) to watch. Now they have posted 4 new VMworld 2013 session on VMware TV:
- STO5391 – VMware Virtual SAN – Christos Karamanolis (VMware), Vijay Ramachandran (VMware)
- BCO4872 – Operating and Architecting a vSphere Metro Storage Cluster Based Infrastructure – Lee Dilworth (VMware), Duncan Epping (VMware)
- VSVC5005 – What’s New in vSphere Platform & Storage – Kyle Gleed (VMware), Cormac Hogan (VMware)
- PHC4783 – How To Build Your Hybrid Cloud and Consume the Public Cloud – Chris Colotti (VMware), Michael Roy (VMware)
Definitely check out these 4 new ones, I attended the vMSC session and it was a good one and looking at the speakers for the other sessions I can bet they are good as well.
The original top 10 sessions that were published are listed below and can be viewed here:
- VSVC4944 – PowerCLI Best Practices – A Deep Dive
- BCO5129 – Protection for All – vSphere Replication & SRM Technical Update
- STO5715-S – Software-defined Storage – The Next Phase in the Evolution of Enterprise Storage
- PHC5605-S – Everything You Want to Know About vCloud Hybrid Service – But Were Afraid to Ask
- NET5847 – NSX: Introducing the World to VMware NSX
- VCM7369-S – Uncovering the Hidden Truth in Log Data With vCenter Log Insight
- VAPP4679 – Software-Defined Datacenter Design Panel for Monster VM’s: Taking the Technology to the Limits for High Utilisation, High Performance Workloads
- EUC7370-S – The Software-Defined Data Center Meets End User Computer
- OPT5194 – Moving Enterprise Application Dev/Test to VMware’s Internal Private Cloud- Operations Transformation
- SEC5893 – Changing the Economics of Firewall Services in the Software-Defined Center – VMware NSX Distributed Firewall
Oct 14 2013
Top 5 big & little enhancements in vSphere 5.5
The August/September timeframe has become like Christmas for vSphere geeks as the anxiously awaited new release of vSphere arrives which they finally get to unwrap and play with. VMware released vSphere 5.5 on September 22nd this year, just one year after the last major vSphere 5.1 release. Overall vSphere 5.5 is a bit light on the number of new features/enhancements compared to previous releases and is also missing the long awaited new Virtual Volumes (vVols) storage architecture that VMware has been showing off for a while now.
Despite that there is still plenty of new stuff in vSphere 5.5 that make it a worthy upgrade. Typically each new release has some superstar new features that get a lot of attention along with lots of smaller enhancements and features that often get overlooked. In this post I thought I’d highlight a few of the big new features and also a few of the smaller ones that often go un-noticed.
This post brought to you by SolarWinds, the makers of great products for virtual environments including Virtualization Manager, Storage Manager and Server & Application Monitor.
1 – Scalability
Scalability in vSphere is important as it dictates the size and the amount of workloads that can run on a host. By steadily increasing scalability VMware has made it so almost any size workload can be virtualized and VM density can grow higher. On the VM side, the Monster VM has steadily grown quite large and able to tackle any workload, however its one weakness has always been the virtual disk size which has been limited to 2TB in past releases. That’s finally changed with vSphere 5.5 as the maximum virtual disk size has jumped to a whopping 62TB.
While the VM side got more disk, on the host size the increases were focused on compute resources. The maximum number of physical and virtual CPUs per hosts doubled to 320 pCPUs and 4096 vCPUs while the maximum physical memory doubled to 4TB. This greatly increases the VM density that you can achieve as it allows you to pack more VMs onto a host. While the CPU limits are so high that most people will never even get close to reaching them, the memory increases are definitely welcome as many applications running on VMs tend to be very memory hungry.
One other nice scalability jump was with the vCenter Server Appliance which is a pre-built virtual appliance complete with OS, database and the vCenter Server software installed. The big advantage of the using the vCSA is it’s simple to install and setup which made it very convenient especially for users that lacked database experience. The problem in vSphere 5.1 was that it was very limited in scalability and would only support the smallest of environments up to 5 hosts and 50 VMs. That’s all changed in vSphere 5.5 as it now scales to 100 hosts and 3000 VMs, a huge jump which it will make it attractive alternative to a much wider group. If you want to find out more about the scalability changes between vSphere releases check out this post and this post.
2 – Virtual SAN
VMware’s new Virtual SAN (VSAN), not to be confused with their existing VSA offering, is their latest product as VMware continues to try and become a storage vendor. The big difference between VMware’s VSA & VSAN is that VSAN is not a virtual appliance, it is baked into the hypervisor and VSAN also scales much higher than VSA which was limited to 3 nodes. VSAN also requires both SSD and traditional spinning disk as it utilizes the SSD tier as both a read cache and write buffer to complement the traditional spinning disk tier.
While VSAN was released as part of vSphere 5.5, it’s not quite ready yet and is only available in beta form.
You can sign up for the public beta here, note there is nothing to download as its native to vSphere 5.5, you just need a license key to activate it. Before you jump in and start using it you should be aware that it currently has limited hardware support and it has some known issues. But it’s beta so you should expect that and shouldn’t be using it in production anyway. That shouldn’t stop you from giving it a try though as long as you meet the requirements so you can get a look at what’s coming. And also the correct acronym is VSAN not vSAN, you have to love VMware’s ever changing letter case usage. If you want to know more about VSAN I have a huge collection of links on it.
3 – UNMAP
UNMAP is a SCSI command (not a vSphere feature) that is used with thin provisioned storage arrays as a way to reclaim space from disk blocks that have been written to after the data that resides on those disk blocks has been deleted. UNMAP serves as the mechanism that is used by the Space Reclamation feature in vSphere to reclaim space from VMs that have been deleted or moved to another datastore. This process allows thin provisioning to clean-up after itself and greatly increases the value and effectiveness of thin provisioning.
Support for UNMAP was first introduced in vSphere 5 and it was initially intended to be an automatic (synchronous) reclamation process. However issues with storage operations timing out while vSphere waited for the process to complete on some arrays caused VMware to change it to a manual (asynchronous) process that does not work in real time. A parameter was added to the vmkfstools CLI utility that would create a balloon file and delete it and during the process UNMAP all disk blocks to reclaim space. The problem with this was you had to constantly run it manually, it was resource intensive and not very efficient as it tried to reclaim blocks that may not have data written to them yet.
In vSphere 5.5 it’s still not an automatic process unfortunately but VMware has improved the manual process. To initiate an UNMAP operation you now use the “esxcli” command using the “storage vmfs unmap” parameter, you can pass it some additional parameters to specify a VMFS volume label/uuid and the number of blocks to reclaim (default is 200). In addition UNMAP is now much more efficient and the run duration is greatly reduced and the reclaim efficiency is increased. As a result where VMware previously recommended only running it off-hours so it wouldn’t impact VM workloads, you can now run it anytime and it will have minimal impact.
To see if your storage device supports UNMAP you can run the “esxcli storage core device vaai status get -d” command and the Delete Status will say supported if it does, you can also check the vSphere HCL to see if its supported and what firmware version may be required. To find out more about the changes check out this post by Jason Boche and if you went to VMworld be sure and check out session STO4907 – Capacity Jail Break: vSphere 5 reclamation nuts and bolts.
4 – CPU C-states
vSphere can help reduce server power consumption during periods of low resource usage by throttling the physical CPUs. It can accomplish this in one of 2 ways, by throttling the frequency and voltage of a CPU core or by completely shutting down a CPU core. This is referred to as P-states and C-states which are defined as follows:
- A P-state is an operational state that can alter the frequency and voltage of a CPU core from a low state (P-min) to the max state (P-max), this can help save power for workloads that do not require a CPU core full frequency.
- A C-state is an idle state that shuts down a whole CPU core so it cannot be used, this is done during periods of low-activity and saves more power than simply lowering the CPU core frequency.
Why would you want to use this feature, because it can save you money, especially in larger environments. It’s the equivalent to staffing a restaurant; do you want your full staff there standing around getting paid while doing nothing during off-peak periods? Of course not, just like you don’t want all your CPU cores powered on when you don’t need them, it wastes money.
Support for CPU P-states & C-states was first introduced in vSphere 4, but the balanced (between power/performance) power policy only supported P-states. You could use C-states as well but you had to create a custom policy for them. Now in vSphere 5.5 the balanced power policy supports both P-states and C-states to be able to achieve the best possible power savings. So now while your VMs are all tucked in bed and resting at night you can keep a green data center and save some cash. You can read more about power management in vSphere in this white paper.
5 – vSphere Flash Read Cache
vSphere has had a caching feature called Content Based Read Cache that was introduced in vSphere 5.0 which allowed you to allocate server RAM to be used as a disk read cache. Unfortunately this feature was only intended to be used by VMware View to help eliminate some of the unique I/O patterns in VDI environments such as boot storms. With vSphere 5.5 VMware has a new host-based caching mechanism called vSphere Flash Read Cache (formerly known as vFlash) that leverages local SSD disks as a cache mechanism.
As the name implies vFRC is a read cache only that is placed directly in front of a VMs virtual disk data path. It can be enabled on a per VM/virtual disk basis and is transparent to the guest OS and applications running in the VM. While caching is configured per host, you can optionally set up vFRC to migrate the cache contents to another host to follow a VM. Its primary benefit is for workloads that are very read intensive (i.e. VDI) but by offloading reads to cache it can indirectly benefit write performance as well.
Another component of vFRC is Virtual Host Flash Swap Cache which is simply the old Swap To SSD feature introduced in vSphere 5.0 that allowed you to automatically use SSDs to host VM desk swap files to support memory over-commitment. To find out more about vFlash you can check out the many links I have here and also check out this VMware white paper. Duncan also has a real good FAQ on it here.
As VMware continues to add more features, the management challenge of keeping up with the changes to the environment gets more difficult. SolarWind’s Virtualization Manager provides a powerful and affordable solution that takes the complexity out of the managing VMware. If you’d like to learn more or download a free trial, click on the banner below.
Oct 11 2013
Does virtualization really reduce the risk of data loss?
I recently read an article on ZDNet about data protection in virtual environments that made the following statement:
“According to a survey conducted by data recovery vendor Kroll Ontrack, 80 percent of respondents did not believe they were at risk or believed they would reduce the risk of data loss when they stored data in a virtual environment.”
Did I read that right?
80 percent of 724 people that were polled at VMworld think virtualization reduces the risk of data loss?
Seriously?
80%?
I’d like to know who these people are and why they feel that way. Virtualization brings a lot of benefits to the data center but magically protecting data isn’t one of them that I know of. If anything you could argue that virtualization increases the risk of data loss as storage becomes a single point of failure and when failures occur they have big impacts. If you look at a traditional data center, your servers and storage are widely distributed, you have a lot of individual physical servers that run a single application which typically store data on the local hard disk of the server. Sure you might have a SAN that you use for storing user data and databases, but a big part of your applications and data is scattered across many servers. If you have a failure on a single server it only impacts that server and not the rest of your environment.
With virtualization you move to a centralized storage model for everything, you still have physical servers that run your VMs but most of them are all stored on a SAN that serves the whole virtual environment. With this model, a failure of a physical server in a virtual environment is typically no big deal as none of your VM data is stored on the physical server it all resides on the SAN. When a host fails you may lose a tiny bit of data from any application that are running and haven’t written data to disk yet, but the VM starts right up on another host and continues where it left off. Now if your storage fails you’re going to be in a world of hurt, those VMware features like HA & FT only protect against host failures, when your storage fails, all those VMs that reside on them go down.
You hear the term all your eggs in one basket when it comes to hosts as they run multiple VMs on them, but at least you have a lot of baskets in your virtual environment. When it comes to storage you truly have all your eggs in one basket as a single storage array services many hosts. So when storage fails, it has a huge impact and greatly amplifies the risk of data loss both in the short term and longer term. Think about it, if I have 200 VMs running on a storage array and it goes down, that’s 200 applications that suddenly had the lights turned out on them and whatever they were doing at the time you lost. Now think about if you had a catastrophic storage failure and you had to recover from the previous nights backup for your whole environment, multiple that times 200 VMs and that’s a lot of data loss.
I can understand how some people might gain a false sense of security after virtualizing as they enjoy the cool new things that they can do now because of virtualization. Their previously rigid physical servers gain superpowers by becoming encapsulated into VMs which provides them with mobility to zip across hosts and datastores while running. They also now have the cool HA & FT features that means they can sleep better at night and not have to head to the office at 2am to get the Exchange server back up and running after a hardware failure. But to think that their VMs are now much safer after virtualizing is just nuts. And its not just hardware failures that can cause big data loss in a virtual environment, there are a lot of other things that can do it as well. With a few simple clicks of a mouse someone can delete a datastore and a lot of VMs or change a setting and shutdown your whole environment. These are things that you don’t have that to worry about in a traditional data center.
Understand this, when you virtualize you’re not in Kansas anymore. When things happen in virtual environments it can have huge impacts. Sure you can help mitigate the risk but the fact remains, shit happens and when it does you can end up covered in it.
So the moral of this story is:
Virtualization does not make your data any safer
So if you’re one of the people that took that survey and think your data is much safer because you virtualized, you better think again, and next year be sure and stop by one of the backup vendors like Veeam or Unitrends and hopefully you’ll learn about the realities of data protection in a virtual environments. And its not just about protecting data through backup methods, you can implement features like stretched storage clusters (vMSC) to protect against storage failures and SRM to provide more traditional off-site recovery options.
So stay safe out there and enjoy all the great benefits that virtualization provides but be smart and make sure you understand the impacts that virtualization has on data protection and what you need to do to keep your data safe.