Want to know more about VVols? Check out the VMworld 2016 edition of the session that I did back at VMworld 2015. You can also checkout the many other great sessions at VMworld 2016 on VVols. And if you are in the Chicago area come see it live on 9/22 (minus Containers).
Monthly Archive: September 2016
Sep 16 2016
SolarWinds is doing their 2nd annual IT Pro Day next week on Sept. 20th. They have some cool and fun stuff that they are doing to celebrate IT Pro’s all over the world. Some fun things that they have on their IT Pro website are a Choose Your Own Adventure simulator that you can run through as either an End User or an IT Pro, you can also watch some hilarious videos and sign-up for a cool t-shirt giveaway if you take their fun quiz. While you are there you can also check out their free management tools to help make life easier. So if you’re an IT Pro head on over there and check it out.
Sep 15 2016
VMware’s new storage architecture, Virtual Volumes (VVols), has been out for a year and a half now as part of the vSphere 6.0 release and adoption continues to be very light for a variety of reasons. This kind of adoption can be typical of any 1.0 release as users wait for it to mature a bit and better understand the differences of it compared to what they are used to using. VVols brings a lot of great benefits that many are unaware of so in this post I though I would highlight those to try and make a compelling use case to start using VVols right now.
It’s not all or nothing with VVols, you can easily run it right alongside VMFS or NFS on the same storage array. Because VVols requires no up-front space allocation for it’s Storage Container, you will only be consuming space on your existing array for any VMs that are put on VVol storage. Since VVols is a dynamic storage architecture, whatever free space you have remaining on the array is available to your VVols Storage Container which is purely a logical entity unlike a VMFS volume which requires up-front space allocation.
You can easily move running VMs from VMFS to VVols using Storage vMotion and back again if needed or create new VMs on VVols. This allows you to go at your own pace and as you move VMs over you can remove VMFS datastores as they are emptied out which provides more available space to your Storage Container. Note that Storage vMotion is the only method to move existing VM’s to VVols and you cannot upgrade VMFS datastores to VVol Storage Containers.
9 – Gain early experience with VVols
VMware never keeps 2 of anything around that do the same thing, they always eventually retire the old way of doing it as it is double the development work for them. At some point VVols will be the only storage architecture for external storage and VMFS will be retired. How long did you wait to switch from ESX to ESXi or to switch from the vSphere C# client to the web client? Did you wait until the last minute and then scramble to learn it and struggle with it the first few months. Why wait, the sooner you start using it the sooner you will understand it and you can plan on your migration over time instead of waiting until you are forced to do it right away. By gaining early experience you will be ahead of the pack and can focus on gaining deeper knowledge of it over time instead of being a newbie who is just learning the basics. There are no shortage of resources available today to help you on your journey to VVols.
8 – Get your disk space back and stop wasting it
With VVols both space allocation and space reclamation is completely automatic and real-time. No storage is pre-allocated to the Storage Container or Protocol Endpoint, when VM’s are created on VVols storage they are provisioned thin by default. When VMs are deleted or moved space is automatically reclaimed as the array can see VMs as objects and knows which disk blocks they reside on. No more manually running time and resource intensive cli tools, vmkfstools/esxcli to blindly try and reclaim space on the array from deleted or moved VMs. VVols is designed to allow the array to maintain a very thin footprint without pre-allocating space and carving up your array into silos like you do with VMFS and at the same time being able to reclaim space in real time.
7 – It’s available in all vSphere editions
VVols isn’t a vSphere feature that is licensed only in certain editions such as Enterprise Plus, it’s part of the vSphere core architecture and available in all vSphere editions. If you have vSphere 6.0 or higher you already have VVols capabilities and are ready to start using it. VVols is mostly under the covers in vSphere so it won’t be completely obvious that the capability is there. It is part of the same Storage Policy Based Management (SPBM) system in vSphere that VSAN uses and also presents itself as a new datastore type when you are configuring storage in vSphere.
6 – Let the array do the heavy lifting
Storage operations are very resource intensive and a heavy burden on the host. While server’s are commonly being deployed as SAN’s these days, a server really wasn’t built specifically to handle storage I/O like a storage array is. VMware recognized this early on which is why they created vSphere APIs for storage such as VAAI to offload resource intensive storage operations from the host to the storage array. VVols takes this approach to the next level, it shifts the management of storage tasks to vSphere and utilizing policy based automation storage operations are shifted to the storage array.
So things like thin provisioning and snapshots which can be done either on the vSphere side or the storage array side with VMFS are only done on the storage array side with VVols. How you do these things remains the same in vSphere but when you take a snapshot in the vSphere client you are now taking an array based snapshot. The VASA specification which defines VVols is basically just a framework and allows the array vendors to implement certain storage functionality, however they want to handle things within the array is up to each vendor. The storage array is a purpose built I/O engine designed specifically for storage I/O, it can do things faster and more efficiently, why not let it do what it does best and take the burden off the host.
5 – Start using SPBM right now
VSAN users have been enjoying Storage Policy Based Management for quite a while now and with VVols anyone with an external storage array can now use it as well. While Storage Policies have been around for even longer when first introduced in VASA 1.0, they were very basic and not all that useful. The introduction of VASA 2.0 in vSphere 6.0 was a big overhaul for SPBM and made it much more rich and powerful. The benefit of using SPBM is that makes it easier for vSphere and storage admins by automating storage provisioning and mapping storage array capabilities including features and hardware attributes directly to individual VMs. SPBM ensures compliance of defined policies so you can create SLA’s and align storage performance, capacity, availability and security features to meet application requirements.
4 – Snapshots don’t suck anymore
vSphere native VM snapshots have always been useful but they also have a dark side. One of the big disadvantages of vSphere snapshots is the commit process (deleting a snapshot) which can be very time and resource consuming, the more so the longer a snapshot is active. The reason for this is that when you create a vSphere snapshot, the base disk becomes read only and any new writes are deflected to delta vmdk files that are created for each VM snapshot. The longer a snapshot is active and the more writes that are made the larger the delta files grow, if you take multiple snapshots you create more delta files. When you delete a snapshot all those delta files have to be merged back into the base disk which can take a very long time and is resource intensive. As backup agents routinely take snapshots before doing a backup of a VM, snapshots are a pretty common occurrence.
With VVols the whole VM snapshot process changes dramatically, a snapshot taken in vSphere is not performed by vSphere but instead created and managed on the storage array. The process is similar in the fact that separate delta files are still created but the files are VVol snapshots that are array-based and more importantly what happens while they are active is reversed. When a snapshot of a VM on VVol-based storage is initiated in vSphere a delta VVol is created for each virtual disk that a VM has but the original disk remains Read-Write and instead the delta VVols contain any disk blocks that were changed while the snapshot is running. The big change occurs when we delete a snapshot, with VVols because the original disk is Read-Write, we can simply discard the delta VVols and there is no data to commit back into the original disk. This process can take milliseconds compared to minutes or hours that is needed to commit a snapshot on VMFS datastores.
The advantage of VVol array based snapshots are many, they run more efficiently on the storage array and you are not using up any host resources. In addition you are not waiting hours for them to commit, your backups will completed quicker and there is no chance of lost data from long snapshot chains trying to be written back into the base disk.
3 – Easier for IT generalists
Because storage array management shifts to vSphere through SPBM, IT generalists don’t really have to be storage admins as well. Once the initial array setup is complete and the necessary VVols components created, all the common provisioning tasks that you would normally do on the array to support vSphere are done through automation. No more creating LUNs, expanding LUNs, configuring thin provisioning, taking array based snapshots, etc., it’s all done automatically. When you create a VM, storage is automatically provisioned on the storage array and there is no more worrying about creating more LUNs, determining LUN sizes and increasing LUN sizes when needed.
With VVols you are only managing VMs and storage in vSphere, not in 2 places. As a result if you don’t have a dedicated storage admin to manage your storage array, an IT generalist or vSphere admin can do it pretty easily. Everything with SPBM is designed to be dynamic and autonomic and it really unifies and simplifies management in a good and efficient manner to reduce the overall burden of storage management in vSphere. Instead of having the added complexity of using vendor specific storage management tools, with VVols management becomes more simplified through the native vSphere interfaces.
2 – It unifies the storage protocols
VMFS and NFS storage are implemented pretty differently in vSphere and what VVols does is dictate a standardized storage architecture and framework across any storage protocol. There were several big differences with file and block implementations in vSphere, with block you presented storage to ESXi hosts as LUNs and with file as a mount point. You still do this to connect your array’s Protocol Endpoint to a host but the standard storage container that is presented to a host to store VMs is just that, a Storage Container, not a LUN or mount point anymore.
When it came to file systems with block an ESXI host would manage the file system (VMFS) and with file it was managed by the NAS array. With VVols there is no file system anymore, VVols are written natively to the array without a file system regardless of it’s a file or block array. And the biggest change is that VMs are written as files (VVols) to block storage in the same manner that file storage has been doing it all along. This creates a unified and standardized storage architecture for vSphere and eliminates the many differences that existed before between file and block. VVols creates one architecture to bring them all and in the darkness bind them (LOTR reference).
1 – The VM is now a unit of storage
This is what it’s all about, the LUN is dead, because it’s all about the VM, ’bout the VM, no LUN. With VVols the VM is now a first class citizen and the storage array has VM-level visibility. Applications and VMs can be directly and more granularly aligned with storage resources. Where VMFS was very LUN-centric and static creating silos within an array, aligning data services to LUNs and utilizing pre-allocated and over provisioned resources. VVols is VM-centric and dynamic where nothing is pre-allocated, no silos are created and array data services are aligned at the more granular VM-level. This new operational model transforms storage in vSphere to simplify management, deliver better SLAs and provide much improved efficiency. VVols enables application specific requirements to drive provisioning decisions while leveraging the rich set of capabilities provided by storage arrays.
Sep 14 2016
Years ago I had setup a planet aggregator site for the top 25 vBlogs, it was a fairly basic plug-in and didn’t work all that well. I took it down months ago mainly because it was the last site I had hosted on GoDaddy and I wanted to get off of them completely. This week I built a brand new planet aggregator site from scratch on a hosting server that I wasn’t using. The plug-in I’m using now is way better and I bought some add-on’s for it so I could customize and improve it even more.
The default view displays content from the Top 100 vBlogs, you can change this to either the Top 50, Top 25 or Top 10 if you want to get more granular. I also have blogs sorted by categories so you can see blog posts from only certain categories like VDI or storage. Besides the Top 100 vBlogs I also included VMware corporate blogs as well like the vSphere, PowerCLI and Virtual Blocks blogs. The aggregator only displays links to the source posts, it does not contain any of the actual content. It is setup for long term retention of blog posts, so posts will not roll off quickly, right now I have it setup to capture 10 posts from each source going back up to 180 days.
So head on over there and check it out, if you have any suggestions for improving it please let me know. I made a best guest on categorizing blogs so if you blog isn’t in a certain category let me know and I’ll add it. You can also subscribe to it via RSS at this URL (Top 100 vBlogs only).
Sep 09 2016
Sponsor sessions at VMware events such as VMUGs and VMworld always seem to get a bad rap and with good reason, they are very often sales & marketing pitches. These sessions very frequently tend to be focused on the vendors products and are not very educational to attendees and as a result they are usually not very well attended. Most attendees go to these events to learn about technology and unless they specifically have targeted a certain vendor for a potential upcoming need, they generally don’t want to hear sales pitches in sessions. The audience at these types of events is in the large majority technical and sales/marketing pitches is like kryptonite to them. I wrote about what I thought sponsors should do at events a few months ago when I offered feedback on VMUG events and I wanted to illustrate that here in more detail.
To make my point I wanted to share a real life and recent example that serves as proof that there is a right way and a wrong way to present a sponsor session at VMware events. The company I work for had several sponsor session slots for VMworld, my BU had one of them and I was responsible for putting together the abstract and session content for it. I had originally submitted a new edition of my VVols session from last year’s VMworld that was voted in through the content committee but it didn’t make it through this year. So instead I crafted a sponsor session that was about 3/4 VVols and 1/4 Containers and 100% technical and educational. When I submitted the abstract I did not even mention either a company name or product name in it. Now the other 2 submissions that my company submitted were pretty obvious product pitch sessions, one was pretty blatantly a product session, the other was a bit more subtle. So what do you think happened?
After my session was submitted along with our other sponsor sessions and the Schedule Builder opened, every week I would get the registration numbers for all 3 of our sessions in our weekly VMworld planning meeting. It was no surprise to me that my submission was doing well, registration was in the hundreds a few weeks before VMworld, the other sessions in comparison were in the double digits. The closer VMworld approached my session registration numbers were climbing fast, it hit the max limit of the room it was in several times and as the waiting list grew it was moved to a larger room. I watched as it hit 400, then 500, then 600, in the meantime our other 2 sessions were still stuck in the double digits. My submission eventually was moved into the largest room available that held 1,150 people and ended up with almost 900 people registered, the day of the session almost 600 people showed up for it.
I was frankly astounded that it was that high but not really surprised, I carefully crafted the abstract as a deep dive on VVol & Container technology and I delivered just that. My overall session rating was a 4.22 out of 5.0 which is pretty good in my book, want to see for yourself how I did it, watch the replay here. The final registration numbers of the other 2 sponsor sessions were around 60 and 100 as comparison. Do you wonder why that is? If you have been following what I’ve been saying so far you should know, If you build your session right, attendees will come, if you don’t they won’t come.
So let’s define what right is for a session, it’s a pretty simple formula.
- Knowledgeable, technical speaker + educational/technical content – sales/marketing pitch = great attendance
Let’s cover more specifically some Do’s & Dont’s to make this happen:
- Do write your abstract to be technical in nature, focus on technology, trends, features features, etc
- Do talk about technology in general without getting too deep into your products
- Do have someone technical design your presentation
- Do send a technical SA, evangelist or engineers to deliver your session
- Do use subtle mentions of your product as it relates to the technical content at hand
- Do technical demo’s and examples of your product in action but don’t over do it
- Do make it both interesting and educational so an attendee learns something about technology and your product
- Do leave people curious about your product so people can talk to you afterwards about in more detail
- Do bring people that know the answers to tough technical questions
- Do try and include a customer or industry expert in your session
- Don’t mention product’s in session abstracts, if you have to keep it at a minimum
- Don’t bait & switch by promising technical content and delivering sales content, you’ll be hated
- Don’t send a sales guy with no technical background to deliver a session
- Don’t use any slides from your marketing decks
- Don’t have a marketing guy prepare your deck
- Don’t send someone to the event that’s going to be in over his head and say I don’t know or I’ll have to check
- Don’t use magic quadrant’s or talk about industry trends or metrics
- Don’t have a C-level or VP person in your session (some exceptions apply)
- Don’t have someone pretend to be technical by reading speaker notes verbatim
If you are in doubt about if your content is appropriate for the event ask a VMUG leader, a tech marketing person, a techie customer or someone in the community to review it. Now let’s talk about what’s in it for you, you spent a lot of money to sponsor an event, how do you talk about your products so you get your ROI on the event and make it worth sponsoring.
Talking products and making sales pitches is not completely off-limits at events, just do it at your booth instead of in your session. At the session encourage people to come by your booth, if you delivered a good session people will come. At the end of your session use a slide or two to talk products, if you delivered an interesting presentation up until that point people won’t mind it and will stay and listen to what you have to say. At your booth people expect to talk about your products but again make sure you have some techie folks there as well to engage in deeper technology conversations.
A final thought I’ll leave with you, as a sponsor would you rather have 600 people listening to you in a session or 60? That one should be a no-brainer, if you do it the right way as I described here attendees will respect you more and they will likely come to you when they are ready to talk about products. If you do it the wrong way, you have missed the chance to influence a greater number of attendees and in many cases you will alienate a potential customer. But don’t take my word for it, why don’t you try it yourself and see what happens, you may not get huge numbers of attendees right off the bat but I guarantee if you do it right, they will come and ultimately you will be successful.
Sep 08 2016
I previously did a post before VMworld to highlight the many great VVols related sessions at VMworld this year. Now that VMware has made the awesome decision to make every VMworld session recording available to the general public anyone can watch them. So here’s the full list of VVol’s related sessions at VMworld 2016, enjoy and learn!
VMware VVol Sessions
STO8159 – Snapshots Suck: How VSAN and VVol fix all your operational nightmares (Pete Flecha, VMware – John Nicholson, VMware)
STO7645 – Virtual Volumes Technical Deep Dive (Pete Flecha, VMware – Patrick Dirks, VMware)
STO9977-QT – 5 Tips for Getting The Most From Virtual Volumes and vSphere Storage Policy-Based Management (Ben Meadowcroft, VMware)
STO7549 – Achieving Agility, Flexibility , Scalability and Performance with VMware Software Defined Storage (SDS) and Virtual Volumes for Business critical databases (Mohan Potheri, VMware – Sudhir Balasubramanian, VMware)
STO7650 – Software-Defined Storage at VMware Primer (Duncan Epping, VMware – Lee Dilworth, VMware)
Partner VVol Sessions
STO9617-SPO – Containers & VVols – a technical deep dive on new technologies that revolutionize storage for vSphere (Eric Siebert, HPE – Charles Tierney, HPE)
STO8422 – Virtual Volumes: Why? (Rajib Ghosh, EMC – Ben Meadowcroft, VMware)
STO8619 – Transitioning to VVols: Partner Panel (Pete Flecha, VMware – 6 partner panelists)
SDDC9726-SPO – Making SolidFire Invisible in your VMware Environment (Josh Atwell, NetApp)
STO8694 – High-Speed Heroics: Array-based Replication and Recovery for VMware Virtual Volumes (Narayan Kumar, Nimble Storage – Julian Cates, Nimble Storage – Rawlinson Rivera, VMware, Inc)
STO8144 – VMware vSphere Virtual Volumes in a NetApp Environment (Rhett Bigler, NetApp – Pete Flecha, VMware)
VIRT8074 – The SDDC: Full Stack on vSphere 6.0 SAP Business Warehouse Powered By HANA, NSX, vRealize Operations, SDS-Virtual Volumes on Hitachi Unified Platform (Gregory Smith, Hitachi – Bob Goldsand, VMware)
STO8840 – Deploy Scalable Private Cloud with vSphere Virtual Volumes (Paul Morrissey, Hitachi Data Systems – Pete Flecha, VMware)
STO9054 – VVol and Storage Policy-Based Management ? Is It Everything They Said It Would Be? (Ben Bolles, Pivot3 – Jeremiah Francis, Financial Advocates)
Sep 08 2016
I tried playing videos in the VMworld smartphone app yesterday and could not find anyway to do it, last year there was a Videos menu option in the app but this year it was missing. I reached out to the VMworld team and they gave me contact info for the developer of the app who promptly responded saying that the video playback option was just launched this morning in the app. So if you close the app completely and re-start it you will now see that option available. I’m pretty sure you have to be a registered VMworld attendee to use the app, I logged out of the app and the Videos option disappeared. Alternately anyone (non-attendees included) can view all the recording via the VMworld.com website. Note the VMworld app only supports portrait playback of the video but if you click the little arrow in the corner it will open in a web browser and rotate to landscape. Here’s how from my last years post:
Sep 07 2016
UPDATE: Looks like VMware had a change of heart this year and made all sessions publicly available like they used to do 5+ years ago. You can access them all on the VMworld.com site. Not sure why they are publishing them to YouTube this year except it might get certain sessions more exposure.
UPDATE 2: The app now supports video playback!
VMware has made a few VMworld 2016 US sessions available to the general public via their VMworldTV YouTube channel. As of right now there is only 10 sessions available but there should be more coming soon. VMware typically picks these based on session popularity and certain ones that they want to promote. Last year they released about 60 session recordings to the general public with the rest being only available to attendees. As of a few month ago anyone can now access all of the VMworld 2015 sessions.
As far as attendee access to recorded sessions via VMworld.com goes it looks like yesterday they weren’t there yet as it gave a message saying the content wasn’t loaded on mediasite yet. Today I tried it and it did work and it looks like all the sessions are available, you need to login with your email address which is matched up to your VMworld.com login to gain access. You can also go to the VMworld Content Catalog and after you login there will be a Watch Video link you can click to watch any session. Last year there was a Download link available for each session recording but this year it’s missing and you can only Watch (stream) them which is unfortunate if you want to watch them offline.
Now for some reason whoever designed the VMworld 2016 mobile app appears to have left out any way of watching sessions like you could do last year. Last year there was a Video link in the menu of the app to watch recorded sessions and this year it is missing. I have looked all over the app and have found no way to view recorded sessions, the obvious place was the Sessions/Speakers menu item but when I select that I don’t see any recording links when you select a session. So I’m not sure what is up with that, I’m waiting to hear back from VMware on it.
Below are the session that are currently publicly available grouped by category, I’ll be updating this list as more are added.
Current as of 9/7/2016
VMworld 2016 General Session – Monday (Pat Gelsinger, VMware CEO – Guido Appenzeller, VMware – Michael Dell, Dell)
VMworld 2016 General Session – Tuesday (Sanjay Poonen, VMware GM of EUC – Ray O’Farrell, VMware EVP/CTO – Kit Colbert (VMware CTO Cloud Platform) – Rajiv Ramaswami, VMware EVP/GM Networking/Security – Yanbing Li, VMware EVP/GL Storage/Availability)
End User Computing
EUC7601 – Advances in Remote Display Protocol Technology with VMware Blast Extreme (Kiran Rao, VMware – Sean Samenfeld-Specht, VMware)
EUC8404 – What’s New with Horizon 7 (Henry Robinson, VMware – Tony Huhn, VMware)
INF8036 – Enforcing a vSphere Cluster Design with PowerCLI Automation (Duncan Epping, VMware – Chris Wahl, Rubrik)
INF8038 – Getting Started with PowerShell and PowerCLI for Your VMware Environment (Kyle Ruddy, VMware – Chris Wahl, VMware)
INF9083 – Ask the vCenter Server Experts Panel (Adam Eckerle, VMware – Emad Younis, VMware – Blair Fitz, VMware – Dilpreet Bindra, VMware – Ryan Johnson, VMware)
MGT7718 – The KISS of vRealize Operations! (Hicham Mourad, VMware – Chima Njaka, VMware)
NET9989 – VMware NSX, Network Bridge to Multi-Cloud Future (Guido Appenzeller, VMware)
VIRT7621 – Virtualize Active Directory, the Right Way! (Deji Akomolafe, VMware – Matt Liebowetz, EMC)