While at VMworld 2015, David, Simon and I managed to get together and record a new vChat episode where we talked about what was happening at the event. We recorded it in a secret recording studio deep under the Mosser hotel, it might look like we were in a data center but we recorded in front of a green screen and Simon added the backdrop in afterwards. So give it a watch and look for more episodes coming soon! You can also read my thoughts and observations on VMworld here.
Sep 24 2015
I posted last week about the VMworld 2015 session recordings that VMware released for free to the general public (non-attendees) via their YouTube channel. VMware has just published another batch bringing the total sessions released up to 54 so I have updated my previous post to add the new sessions in. The sessions span many different tracks but if you look at the topics and speakers you will see that the free sessions are mainly composed of the following:
- Mostly VMware speakers, however there are a small amount of vendor sessions (I’m one of them!)
- Lots of VDI sessions, VMware wants more people doing VDI so they historically release many VDI sessions
- Sessions that target specific technologies that VMware wants to promote like VSAN, VVols and NSX
- Some of the most popular and well attended sessions
Traditionally VMware releases around this number of free sessions each year with the rest only accessible by paid attendees or through other avenues. As a result this is probably the last batch of free sessions that we will see until next VMworld when VMware releases all the prior year sessions for free. I’ve highlighted below a few of the free sessions that look good (of course a shameless plug for my VVols session) and may interest you:
- INF4764 – Extreme Performance Series – vCenter Performance Best Practices (Ravi Soundararajan, VMware)
- INF5701 – Extreme Performance Series – vSphere Compute & Memory (Fei Guo, VMware – Seong Beom Kim, VMware)
- STO4649 – Virtual Volumes Technical Deep Dive (Ken Werneburg, VMware – Patrick Dirks, VMware)
- STO5888 – Top 10 Thing You MUST Know Before Implementing Virtual Volumes (Eric Siebert, HP)
Sep 16 2015
Hot on the heels of the vSphere 6.0 Update 1 release last week, VMware today released vSphere 5.5 Update 3 that has some new stuff in it and the usual fixes and enhancements. With vSphere 6.0 being out for over a year now I’m willing to bet this will be the last big update that you’ll see to vSphere 5.5.
This release of VMware ESXi contains the following enhancements:
- Log Rotation Enablement – Log rotation for vmx files allows you to reduce the log file sizes by specifying the size of each log and the number of previous logs to keep.
- Certification of PVSCSI Adapter – PVSCSI adapter is certified for use with MSCS, core clustering and applications including SQL and Exchange. This creates performance gains when moving from LSI Logic SAS to PVSCSI.
- Support for Next Generation Processors – In this release we will continue our support for next generation processors from Intel and AMD. Please see the VMware Compatibility Guide for more info.
- ESXi Authentication for Active Directory – ESXi is modified to only support AES256-CTS/AES128-CTS/RC4-HMAC encryption for Kerberos communication between ESXi and Active Directory.
What’s New in vCenter Server:
- vCenter Server database support: vCenter Server now supports the following external databases: Oracle 12c R1 P2 (220.127.116.11), Microsoft SQL Server 2012 Service Pack 2, Microsoft SQL Server 2008 R2 Service Pack 3
- Increased guest operating system support: vCenter Server has added support for the following guest operating systems: CentOS 7.0,
Oracle Linux 7.0, Ubuntu 14.10, Windows 10, RHEL 6.6, RHEL 7 .1, CentOS 7.1, Oracle Linux 7.1
- Features Added: Log information of files uploaded and downloaded from a host using vSphere Web Client or vSphere Client are stored. For more details see KB 2117341
Sep 16 2015
VMware has recently published 3 new technical papers that focus on their new Virtual Volumes (VVols) storage architecture that are definitely worth a read.
The first is a FAQ which does a good job summarizing important information around VVols and provides you a lot of quick facts around the architecture and implementation of VVols.
The next is a What’s New paper for Virtual Volumes, this one is about 6 months late as their is nothing new with VVols since the initial release in vSphere 6.0 in March but better late than never. This one is more a general tech paper on VVols and does an introduction to VVols and also covers the architecture and benefits of VVols.
The last one is a Getting Started Guide and is a walkthrough of how to use VVols from a vSphere perspective which covers things like how to make sure time is synced, creating a Storage Container, working with Storage Policies and assigning them to VMs. It’s designed to be used together with your array documentation that should cover the array side setup for VVols. The guide also covers some vSphere CLI commands for managing VVols components using escli.
Sep 11 2015
As I’ve been learning more and more about VMware Virtual Volumes and the impact that it will have on everyday storage operations in vSphere one thing that I’ve been trying to find out is the impact that VVols will have on backups. In this post I’ll focus on 2 areas related to backups in a VVol environment: backup transport mechanisms and backup snapshots.
How VVols impacts backup transport methods
There are several methods that you can use to backup your virtual machine using software from vendors like Veeam, Unitrends and Symantec. The first is the traditional method, backing up using an agent inside the guest OS, this one is generally not recommended as it is not very efficient in a virtual environment. The next is the Hot Add method, this essentially allows a VM running backup software to hot add another VM’s virtual disk to it so it can be backed up without impacting the VM. This allows the backup VM to have direct access to the virtual disk to back it up. Then there is the LAN (NBD) method where a ESXi host reads VM data from storage and sends it across a network to the backup server, this method uses the network stack instead of the storage stack so it not as efficient.
Finally there is the Direct to SAN method, this method requires a backup application or proxy running on a physical server that has direct access to your SAN where your VMFS datastores reside as shown below.
This is the fastest and most efficient method as it does not consume host resources and is the shortest path for the backup server to access VM virtual disks to back them up. How VVols impacts this is that the Direct to SAN method is not supported with VVol-based VM’s. Where VMFS-based VM’s could be accessed directly by a physical backup server using the vSphere APIs and VMware’s Virtual Disk Development Kit (VDDK), VVols-based VM cannot be accessed this way.
The reason for this is that with VVols, VM’s do not reside on LUNs with a file system over-layed (VMFS), instead VM’s are packaged into VVols and stored directly on a storage array inside Storage Containers (logical entity). VM’s are then accessed by ESXi hosts via a Protocol Endpoint that resides within the array, the PE is essentially a special LUN that has conglomerate status (admin LUN). The PE then binds VVols to a host using secondary LUN IDs (sub-LUNs) that are assigned to each VVol and reported back to a ESXi host via the VASA Provider as shown below.
As a result of this new architecture it is no longer possible for a physical server to directly connect to a VVol Storage Container to access VMs which is why the Direct to SAN architecture is not supported with VVols. VMware may create some additional APIs to allow this direct access in the future, the physical backup server would essentially need a way to communicate directly with the Protocol Endpoint and the VASA Provider to interact with the VVols in the Storage Container directly. So why you can’t use this backup method with VVols, the other backup methods are still supported, you can read more about the backup methods in the Virtual Disk Programming Guide (pages 23-26).
How VVols impacts backup snapshots
Before a virtual machine can be backed up using the methods described a snapshot must be taken of a VM in vSphere. Doing this allows the VM to be frozen at a point of time so it can be backed up without any changes (writes) occurring while the backup process completes. Once a backup is finished the snapshot is discarded, this process (creation/deletion of snapshot) is controlled by the backup application at the beginning and at the end of the VM backup.
What happens when you take a VM snapshot in vSphere is the VM is briefly stunned and a separate delta virtual disk is created that contain any disk writes that might occur within the VM while the snapshot is active. The original virtual disk remains Read Only and all new writes that occur while the snapshot is running are deflected to the delta virtual which is Read-Write. If an additional snapshot is taken then the previous snapshot becomes Read Only and a new delta virtual disk is created that becomes Read-Write. Once you no longer need a snapshot and it is deleted all of the changes that occurred while the snapshot was active need to be merged back (committed) into the original virtual disk from the delta virtual disk. Once all that operation completes the delta virtual disk files that were created are then deleted and the original disk becomes Read-Write again.
This commit process can be time consuming based on how long a snapshot is active and the amount of writes that occur while it is active. If you have a very write intensive application running inside the VM and the snapshot is active for a long time (days/weeks) the commit process can take hours to complete.
With VVols the whole VM snapshot process changes dramatically, a snapshot taken in vSphere is not performed by vSphere but instead created and managed on the storage array. The process is similar in the fact that separate delta files are still created but the files are VVol snapshots that are array-based and more importantly what happens while they are active is reversed. When a snapshot of a VM on VVol-based storage is initiated in vSphere a delta VVol is created for each virtual disk that a VM has but the original disk remains Read-Write and instead the delta VVols contain any disk blocks that were changed while the snapshot is running. The delta VVols are all Read-Only as they are simply storing changed disk blocks while the original disk remains Read-Write as illustrated in the short video below.
Now the big change occurs when we delete a snapshot, with VVols because the original disk is Read-Write, we can simply discard the delta VVols and there is no data to commit back into the original disk. This process can take milliseconds compared to minutes or hours that is needed to commit a snapshot on VMFS datastores. How does this impact your backups? Because we have to take a VM snapshot of a VM, the backup application no longer has to sit around waiting at the end of the backup for any changes to commit while the snapshot is deleted. Depending on the size of your VM and how much change that occurs within the VM while the backup is running with VVols this can reduce your backup times from seconds to minutes or more per VM, multiply this times dozens or hundreds of VMs and you can really reduce your backup window by a good amount of time.
To validate this Symantec has done some testing by doing some benchmarking that compares a group of VMs being backed up on a VMFS datastore versus the same VMs being backed up on a VVol Storage Container. The following information is a summary of their results from the VMworld session that they presented on this topic (STO5844 – Benchmark Testing: Making Backups Better Than Ever Using Virtual Volumes).
Their environment consisted of NetBackup 7.7 with a 3PAR 7200c storage array that had 24 1.2TB 10K disks. They did a comparison using 60 VMs with 100GB virtual disks and 40 of them powered on. They did simulate a 10% data change rate inside the VM while the backup is running and they first tested with VMFS and then wiped out the array and configured it for VVols. Their testing focused on the amount of time it took to create VM snapshots when the backups are started and the time it took to delete and consolidate them when the backup is finished.
From their testing they found that overall backup times were reduced by around 30% as seen below on the slides from their VMworld session. They found out that snapshot creation time took a few seconds longer with a VVol-based snapshot, but the snapshot deletion time was dramatically reduced. They tested this using different numbers of simultaneously running backups with consistent results. They also found that snapshot errors that sometimes occur during the delete process were virtually eliminated. The net effect of this much improved snapshot mechanism with VVols can amount to a much more efficient and shorter backup operation.
Source: Symantec, VMworld 2015 session ID STO5844
Looking beyond backups the new VVol-based snapshot mechanism will be a great time and resource saver in any vSphere environment. Of all the VM snapshots that we take for whatever reason, how many do we actually use to revert back to a point in time, very few I would say. Typically we are creating VM snapshots for insurance purposes and never really end up using them. Not having that long resource intensive commit process running on your ESXi host as well as the extra resource consumption required to maintain snapshots on VMFS means less burden on the host and more resources for your VM workloads. The storage array is much better equipped to do snapshots and the shift to move them off the host and to the storage array with VVols is a great benefit not just for backups but also for any use case that you might use snapshots for in your vSphere environment.
Sep 10 2015
VMware has just released an incremental update to vSphere (vCenter Server and ESXi) which is 6.0 Update 1 as well as updates to vSphere Replication (6.1), Data Protection (6.1), Site Recovery Manager (6.1) and vRealize Orchestrator Appliance (6.0.3). I don’t know why they are versioning everything else as 6.1 and vCenter Server and ESXi as 6.0 U1. They have been referring to the new VSAN version as 6.1 so it would be logical if ESXi and vCenter Server were 6.1 as well, now it looks like they are calling it VSAN 6.0.1
This may look like a minor and incremental upgrade which it mostly is but their are some big new features in VSAN 6.1 which they don’t do it justice in the release notes, read all about what’s new in VSAN 6.1 here. Almost all the product updates in this release center around the new VSAN 6.1 version which is included in it. There are some big updates in SRM with support for Storage Policy Based Management (SPBM) and stretched clusters and vSphere Replication also has a new and improved 5 minute RPO replication with VSAN. The other big thing is support for VAIO in ESXi, I don’t see a lot of vendors integrating with this new APIs yet but I know there are some that are working on it such as Infinio and SanDisk (design partner).
- ESXi 6.0U1: Release Notes -=- Download Page
- vCenter Server 6.0U1: Release Notes -=- Download Page
- Site Recovery Manager 6.1: Releases Notes -=- Download Page
- vSphere Replication 6.1: Release Notes -=- Download Page
- vSphere Data Protection 6.1: Release Notes -=- Download Page
- vRealize Orchestrator Appliance 6.0.3: Release Notes -=- Download Page
This release of VMware ESXi contains the following enhancements:
- I/O Filter: vSphere APIs for I/O Filtering (VAIO) provide a framework that allows third parties to create software components called I/O filters. The filters can be installed on ESXi hosts and can offer additional data services to virtual machines by processing I/O requests that move between the guest operating system of a virtual machine and virtual disks.
- Exclusive affinity to additional system contexts associated with a low-latency VM: This release introduces a new VMX option sched.cpu.latencySensitivity.sysContexts to address issues on vSphere 6.0 where most system contexts are still worldlets. The Scheduler utilizes the sched.cpu.latencySensitivity.sysContexts option for each virtual machine to automatically identify a set of system contexts that might be involved in the latency-sensitive workloads. For each of these system contexts, exclusive affinity to one dedicated physical core is provided. The VMX option sched.cpu.latencySensitivity.sysContexts denotes how many exclusive cores a low-latency VM can get for the system contexts.
- ESXi Authentication for Active Directory:ESXi is modified to only support AES256-CTS/AES128-CTS/RC4-HMAC encryption for Kerberos communication between ESXi and Active Directory.
- Support for SSLv3: Support for SSLv3 has been disabled by default. For further details, see Knowledge Base article 2121021.
- Stretched Clusters: Virtual SAN 6.0 Update 1 supports stretched clusters that span geographic locations to protect data from site failures or loss of network connection.
This release of VMware vCenter Server contains the following enhancements:
- Customer Experience Improvement Program: The Customer Experience Improvement Program (CEIP) provides VMware with information that enables VMware to improve the VMware products and services and to fix problems. When you choose to participate in CEIP, VMware will collect technical information listed below about your use of the VMware products and services in CEIP reports on a regular basis. This information does not personally identify you. For more details, see the vSphere Documentation Center.
- Feature Enhancement: Suite UI is now enabled by default for the vSphere Web Client.
- Support for SSLv3: Support for SSLv3 has been disabled by default.
- vCSA Authentication for Active Directory: VMware vCenter Server Virtual Appliance (vCSA) has been modified to only support AES256-CTS/AES128-CTS/RC4-HMAC encryption for Kerberos authentication between vCSA and Active Directory.
- Installation and Upgrade using HTML 5 installer: The following installation and upgrade scenarios are supported for vCenter Server using HTML 5 installer:
- Installation using HTML 5 installer and target as vCenter Server is supported
- Upgrade using HTML 5 installer and target as vCenter Server is not supported
- Upgrade using command line and target as vCenter Server is supported
- Resolved Issues: This release of vCenter Server 6.0 Update 1 addresses issues that have been documented in the Resolved Issues section.
VMware Site Recovery Manager 6.1 provides the following new features:
- Support for VMware vSphere 6.0 update 1.
- Storage policy based protection of virtual machines.
- Support for stretched storage when using storage policy protection groups in enhanced linked mode.
- Support for auto-mapping of stretched NSX networks.
- Enhancements to mappings for test networks.
VMware vSphere Replication 6.1 provides the following new features:
- 5 minute Recovery Point Objective (RPO) for replication between Virtual SAN data stores – This version of vSphere Replication allows customers to replicate virtual machine workloads with an RPO setting as low as 5 minutes between Virtual SAN data stores.
- Support for NFS v 4.1 – This release introduces support for NFS v 4.1 data stores. It allows customers to protect and recover virtual machines that are provisioned onto NFS v 4.1 environments using vSphere Replication.
- UI Enhancements – the RPO settings in the Configure Replication wizard are simplified and provide more granular options of predefined RPO settings.
Sep 09 2015
VMware has not released the session recordings yet on their website so registered attendees can watch them from a PC, if you go the page for session playback on the VMworld.com website they only have up to 2014 listed there. I tried changing the 2014 URL to 2015 but the page is not found so I suspect they are still working on getting that page created or are waiting until after VMworld in Barcelona to end to post them. However if you have the VMworld 2015 mobile app on your tablet or phone you can access all of the session recordings right now.
Just load the app and login to it (must be a registered attendee) and then click the Videos link in the menu sidebar. You’ll then see all the sessions listed alphabetically for you to choose from. One thing to note is that the VMworld app only supports portrait viewing of the videos so if you rotate your device to landscape it won’t switch to it and you are stuck watching it in portrait which can be fairly small on a phone. However if you hit the upper arrow button when the app is playing it will open in a browser which will rotate to landscape mode (lower arrow button expands it in the app which is still portrait).
However you will be prompted for credentials from mediasite.com if you do that and your VMworld login won’t work so you can’t watch it that way. I’m guessing they hard-coded some credentials in the app that has access to the videos on mediasite.com so you’ll just have to wait until they post them on the VMworld.com page to watch them from a PC (or download BlueStacks).
It looks like you can also do this if you go to the VMworld Content Catalog and click on a session, there will be a Media link on the right sidebar to playback the session.
Sep 08 2015
Well that’s a wrap, another VMworld in the books, this is number 8 for me and how fast the event flies by never changes for me. It always seems like you wish you could of done and seen more there and that there was so much you missed out on but as there is so much going on it’s impossible to take in everything. For me I know there were some friends and acquaintances that I missed out on seeing which is always a priority for me as you usually only get to see them once a year. All in all though it was a good event for me but I will always regret not having been able to done more.
Let’s start off with the event location, while San Francisco is a nice enough town to visit, it’s not an ideal conference destination. VMworld has gotten so big it’s spread out across several blocks and I frequently had to walk from Moscone North to South to West to the Marriott. All that walking wears you down and wastes time that you could of been doing more with. The crazy expensive hotel room gouging situation is ridiculous, paying double or triple for a room that is half as nice as a Venetian room. I paid about $550/night for a room at the Marriott that is now going for $279/night this week. Then there’s the whole street people thing that you have to constantly walk through that can wear on you as well.
Well thankfully we get a change of venue as VMworld goes to Las Vegas in 2016 as the Moscone Center is under renovation next year. VMworld has been in San Fran in 2007, 2009-2010 and 2012-2015, it was in Vegas in 2005, 2008 and 2011 (2004 was San Diego and 2006 was Los Angeles). VMware was under contract to hold VMworld at Moscone until next year but now it looks like they are free to go anywhere and as a result you might see it in Vegas for a few years (heard that from someone at VMware). VMworld 2016 will be held at the Mandalay Bay resort from Aug. 28th-Sept 1st 2016, I’m guessing the Venetian where it usually was might have been unavailable that week. The pre-registration page is up already fro VMworld 2016 so you can be notified when it goes live. VMworld Europe 2016 is still being held in Barcelona, Spain. It might be a refreshing change to see VMworld somewhere else in the US other than Vegas or San Fran one of these years such as Chicago or Orlando.
How many people attended VMworld?
VMware claims record attendance of over 23,000 people this year which would top the previous high attendance of 22,500 in 2013. That was announced at the keynote, I haven’t seen VMware publish any attendance numbers anywhere. VMworld 2014 was “over 22,000″ which probably puts it between 22,000-22,499. Since they didn’t say over 23,500 I’m guessing the attendance number for this year is under that. That’s good for VMware that the number is higher and I expect the number to stay right around there in coming years. Of that 23,000+ VMware doesn’t publish the mix of VMware employees, partners, sponsors and actual attendees. A week before the event the attendance report I saw had about 12,000 people in it so I’m curious as to what the mix is, I’m guessing that there are at least 5,000 VMware employee and sponsors in that number if not more.
What was announced?
The announcements made at VMworld were few and not all that exciting as the event did not align with a major new release of vSphere. VMware slapped a new name on EVO:Rack which was announced last VMworld and is now calling it EVO SDDC which is a bundle of compute (ESXi), storage (VSAN), networking (NSX) and management (vRealize Ops) at rack scale. But it still isn’t a shipping product and won’t be a for a while (1st half 2016). The new release of VSAN was announced, it’s an incremental update to VSAN 6.1 and will be available later this month, you can read all about what’s new in VSAN 6.1 here. VMware hasn’t announced a new vSphere version to support VSAN 6.1 but as it’s built into the hypervisor I’m betting you will see vSphere 6.1 released later this month.
VMware also made announcements around hybrid cloud with new vCloud Air Disaster Recovery Services which is basically just SRM running in a public cloud (of course they called it SRM Air). They also announced new vCloud Air Object Storage and vCloud Air SQL. It’s no secret that VMware has a big focus on containers and they announced as a technology preview both vSphere Integrated Containers and the Photon Platform. You’ve probably heard about Photon already but vSphere Integrated Containers is a new announcement that brings together several cloud-native technologies including Project Bonneville (container security and isolation), Project Photon OS (formerly Project Photon), and VMware’s Instant Clone technology (a feature of VMware vSphere 6) that will bring together the best of VMware vSphere with containers.
Finally on the EUC side they announced some new stuff for universal application delivery and device management which is based on their new tech preview called Project A2 that integrates application delivery into Windows 10 through AirWatch and App Volumes. Read all about it here.
How were the Sessions?
I didn’t attend many as there are so many other things to see and do at VMworld and the sessions are all recorded anyway to watch later. I went to one on VAIO but the VMware speaker was obviously reading from a script which kind of killed the session for me so I left. The other was the Graybeard’s on Storage panel but it turned into a VVol bashing session so I didn’t stay long. I was a speaker at 4 sessions, 2 of them were our HP sponsor sessions, 1 was VMware’s VVol technical panel and the last was my Top 10 Things You MUST Know Before Implementing VVols session. The technical panel went pretty well, it was narrated by Ken Werneberg from VMware, we had about 175 people in the room. My VVols session was on Thursday morning, I had to extend my stay a day but it was worth it. I had 560 people registered for it and 279 people in the room.
If you didn’t make VMworld you can still view some of the sessions that VMware recorded and released to the general public. Also check out these other resources as well.
How was the food?
I’m 100% confident that number is going to VMworld for the food, the lunches that are served throughout the conference continue to be bland and terrible. They improved the packaging of the box lunches this year which is like putting a fancy wrapper on a turd. I decided to be brave and try one as I was in a hurry and took a bite or two and tossed it as it just wasn’t tasty. Let’s face it the Moscone Center isn’t a hotel or a restaurant and the food they serve is no comparison to other VMworld’s that were at Vegas hotels that are equipped for cooking good food.
How were the General Sessions?
I really didn’t find them all that interesting, they had some good moments but overall weren’t all that exciting. As there were not alot of really big announcements it seemed like they had to really work to fill the time. They did show off a vMotion to a public cloud that was pretty slick but all an all I was a bit bored watching them. VMware did a great job live streaming them so you could watch them anywhere. If you remember back to the old days of Paul Maritz and Steve Herrod the keynotes were just a lot more exciting and you really wanted to not miss them. Here’s a flash back to the Steve Herrod day 2 keynote in 2012 and also the day 1 keynote with the CEO swap from Paul to Pat. Remember this:
The Solutions Exchange is were many attendees spend a lot of time taking in the entire VMware partner ecosystem which continues to grow and grow. It seemed more dense this year as if there were more vendors in there and felt a bit more crowded. A lot of small vendors were going big there in an attempt to get the attention of attendees and I’d say at least a third of the partners were storage related. I spent a good amount of time there and there seemed to be good and steady traffic through the floor which is good for the partners that put a big investment into the event.
Thanks to the vendors that support the vExpert program
There were probably a dozen vendors there that had special gifts for those that are chosen as vExperts. It’s good to see these vendors recognize the value of the vExpert community and do something special to reward those who give back and evangelize about VMware and virtualization. As the vExpert population has grown quite large these days (1,200) I’m sure it’s more of a financial and logistic burden to do this so I wish to thank those vendors that did it which includes Cohesity, Coho Data, Simplivity, Datrium, Catalogic Software, SolidFire, Tegile and DataGravity.
How were the Parties?
After VMworld is over each day there are no shortage of parties to attend so you can relax and chat with other attendees after a busy day. I went to the VMunderground party on Sunday which was really good, they had a big venue at the Metreon again and you didn’t have to deal with tickets this year to get in, thank you to all the vendors that sponsor it. The always epic Veeam party was also at the Metreon this year and was a lot of fun as they had a band playing and people got very creative and playful with the glow rings that they were passing out which reminded me of the VMworld 2008 party at the Vegas Speedway.
I also attended the vExpert party which was in a fancy historic ballroom, they tried to do something different by assaulting us with PowerPoint for the first hour which wasn’t all that well received as much of it was around marketing strategies. I actually prefer the more informal gatherings that allowed you to socialize more with vExperts and special guests like Pat Gelsinger. I do appreciate the efforts that they put into having an event for vExperts at VMworld and hope they continue that tradition. Speaking of Pat, I did get my 3rd annual picture with him and he told a neat story about his days at Intel when he ran into Mendel at a conference the day they figured out how to get vMotion to work.
The official VMworld party I passed on as it was at AT&T Park and I didn’t want to go that far away and the bands were mediocre again this year. I still hold out hope that VMware will get a decent big name band to play at VMworld in the coming years.
A few pics from the event
Pat Gelsinger and I at the vExpert Party:
Sep 05 2015
Last week I wrote about how you could get value out of VMworld even if you did not attend it. One of the things I mentioned is that VMware typically releases some of the most popular sessions (as well other sessions that they want to promote) to the general public shortly after VMworld. Well VMware has done just that and released the sessions below onto YouTube. VMware usually releases these in batches so keep checking back as they may publish more of them later on which I will add to this page. For the rest of them that they don’t post you’ll have to get a VMUG Advantage membership or a VMworld session subscription to view them.
UPDATE: VMware released another batch of 28 sessions that I have added to the list below…
General Session – Monday, August 31, 2015 (Carl Eschenbach, VMware – Bill Fathers, VMware – Raghu Raghuram – VMware, Ray O’Farrell, VMware)
General Session – Tuesday, September 1, 2015 (Sanjay Poonen, VMware – Martin Casado, VMware – Pat Gelsinger, VMware)
Cloud Native Apps Track
CNA4590 Container Orchestration with the SDDC (Aaron Blasius, VMware)
CNA6649-S Build and run Cloud Native Apps in your Software Defined Data Center (Kit Colbert, VMware)
CNA5860 – Containers without Compromise – Persistent Storage for Docker Containers with VMware (Vivek Saraswat, VMware) New!
CTO6689-S – Closing the Loop: Towards a World of Software Defined Decision Making (Paul Strong, VMware)
CTO6453 – The Future of Software Defined Storage – What Does It Look Like in 3 Years Time (Richard McDougall, VMware) New!
End User Computing Track
EUC4630 – Managing Users A Deep Dive Into VMware User Environment Manager (Michael Bradley, VMware – Dale Carter, VMware)
EUC5404 – Deliver High Performance Desktops with VMware Horizon and NVIDIA GRID vGPU (Pat Lee, VMware – Luke Wignall, NVIDIA)
EUC5020 – The “Snappy” Virtual Desktop User Experience (Aivars Apsite, Metro Health)
EUC6807-S – The Future of End User Computing (Erik Frieberg, VMware – Shankar Iyar, VMware – Noah Wasmer, VMware – Harry Labana, VMware)
EUC4827 – VDI Sizing Deep Dive – The Horizon Sizing Tool (Ray Heffer, VMware – Shengbo Teng, VMware) New!
EUC4879 – Horizon View Storage – Let’s Dive Deep! (Tristan Todd, VMware – Michael Cooney, EMC – Jim Yanik, VMware) New!
EUC5052 – Beyond the Marketing – Horizon 6 Technical Deep Dive (Ray Heffer, VMware – Jim Yanik, VMware) New!
EUC4437 – Horizon View Troubleshooting – Looking Under the Hood (Jack McMichael, VMware – Matt Coppinger, VMware) New!
HBC4849 – vCloud Air 2015 – Getting Started with Hybrid Cloud (Greg Herzog, VMware)
HBC6629-S – No App is an Island (Ajay Patel, VMware)
INF5211 – Automating Everything VMware with PowerCLI – Deep Dive (Alan Renouf, VMware – Luc Dekens, Eurocontrol)
INF4528 – vCenter Server Appliance VCSA Best Practices & Tips Tricks (William Lam, VMware)
INF4586 – Take Virtualization to the Next Level vSphere with Operations Management (Martin Yip, VMware – Himanshu Singh, VMware)
INF5975 – vCenter Server Appliance as First Choice VC (Madhup Gulati, VMware – Mikael Jenson, Herring Kommune)
INF4764 – Extreme Performance Series – vCenter Performance Best Practices (Ravi Soundararajan, VMware) New!
INF4793 – Day-to-Day Automation of VMware Products to Increase Productivity and Efficiency (Brian Graf, VMware) New!
INF5093 – vSphere Web Client – Yesterday, Today and Tomorrow (Yavor Boychev, VMware – Dennis Lu, VMware) New!
INF5060 – What’s New in vSphere (Michael Adams, VMware) New!
INF4944 – Managing vSphere 6 Deployments and Upgrades, Part 1 (Dilpreet Bindra, VMware – Mohan Potheri, VMware) New!
INF5123 – Managing vSphere 6 Deployments and Upgrades, Part 2 (Brian Graf, VMware – Salil Suri, VMware) New!
INF4529 – VMware Certificate Management for Mere Mortals (Ryan Johnson, VMware – Adam Eckerle, VMware) New!
INF4712 – Just Because You COULD, Doesn’t Mean You SHOULD – vSphere 6 Architecture Considerations from Real World Experiences (Jonathan McDonald, VMware) New!
INF4945 – vCenter Server 6 High Availability (Madhup Gulati, VMware – Mohan Potheri, VMware) New!
INF5701 – Extreme Performance Series – vSphere Compute & Memory (Fei Guo, VMware – Seong Beom Kim, VMware) New!
MGT5245 – vRealize Operations Insight Manage vSphere and Your Entire Data Center…All in One Place! (Himanshu Singh, VMware – Hicham Mourad, VMware)
MGT5360 – Introducing Application Self service with Networking and Security (Andrew Voltmer, VMware – Becky Smith, VMware)
MGT6623-S The VMware Cloud Management Platform Drill Down and Outlook (Ajay Singh, VMware – Dave Bartoletti, Forrester – Seth Frohlich, CIT – Tim Garza, CNRA – Jon Herlocker, VMware)
MGT4928 – How To Troubleshoot Using vRealize Operations Manager – Live Demo (Shyamal Patal, VMware – Samuel McBride – VMware)
NET6639-S – The Next Horizon for Cloud Networking and Security (Guido Appenzeller, VMware)
NET5560 VMware NSX Deep Dive (Jacob Rapp, VMware)
NET4976 – vSphere Distributed Switch 6 –Technical Deep Dive (Chris Wahl, Rubrik – Jason Nash, Sirius) New!
NET4989 – The Future of Network Virtualization with VMware NSX (Bruce Davie, VMware) New!
Operations Transformations Track
OPT6851-S A conversation with the VMware CIO Suggestions on being an IT Leader (Bask Iyer, VMware)
Software Defined Data Center (SDDC) Track
SDDC5273-S – VMware Hyper Converged Infrastructure From vSAN to EVO RAIL and EVO RACK (Raj Yavatkar, VMware)
SDDC6254-S The Best SDDC! (Dale Ferrario, VMware – Dharminder Debisarun, Novamedia – Simon Delord, Telstra – David Giambruno, Tribune Media – Tony Morshed, CA DOWR)
STO4572 Conducting a Successful Virtual SAN Proof of Concept (Cormac Hogan, VMware – Julienne Pham, VMware)
STO5887 Building a Business Case for Virtual SAN (Madelyn Grunewald, VMware – Jordan Glamann, Dominos Pizza – Rafael Kabesa, VMware)
STO5954 S Rethinking Enterprise Storage The Rise Of Hyper converged Infrastructure (Charles Fan, VMware – Mike Feld, BayState Health)
STO6085 Site Recovery Manager Technical Walk through (GS Khalsa, VMware – Jeff Hunter, VMware)
STO4649 – Virtual Volumes Technical Deep Dive (Ken Werneburg, VMware – Patrick Dirks, VMware) New!
STO4474 – Networking Virtual SAN’s Backbone (Bhumik Patel, VMware – John Kennedy, Cisco) New!
STO5888 – Top 10 Thing You MUST Know Before Implementing Virtual Volumes (Eric Siebert, HP) New!
STO5074 – Explaining Advanced Virtual Volumes Configurations (Ken Werneburg, VMware – Andy Banta, SolidFire) New!
STO6137 – Site Recovery Manager and Policy Based DR Deep Dive with Engineering (GS Khalsa, VMware – Aleksey Pershin, VMware) New!
Virtualizing Applications Track
VAPP6257 – Troubleshooting for vSphere 6 (Jamie Rawson, VMware) New!
VAPP5598 – Advanced SQL Server on vSphere (Scott Salyer, VMware – Wanda He, EMC) New!
VAPP5483 – Virtualize Active Directory, the Right Way! (Deji Akomolafe, VMware – Matt Liebowitz, EMC) New!
VAPP5719 – Monitoring and Managing Applications with vRealize Operations 6.1 and vSphere 6 (Jeff Godfrey, VMware – Ben Todd, VMware) New!
Aug 31 2015
VMware has revealed the next version of Virtual SAN (VSAN), 6.1 at VMworld US 2015. This incremental upgrade from the current 6.0 version that was announced back in Feb. may seem small compared to the last update but their are a few big things in it that I wanted to highlight.
Who’s using VSAN today?
The first thing I wanted to point out from VMware’s marketing slide for VSAN is the fact that they claim 2,000+ customers. That seems like a pretty small amount which is around the typical range that a 1-2 year old startup might expect to have. But given the fact that VMware is not a startup, they have been marketing the hell out of VSAN which has been available now for over a year and a half and it’s built into vSphere that number seems pretty low.
I can think of at least 2 reasons for the low number, the first is cost, VSAN is still pretty expensive to license and when you start adding up the storage and license costs for each host you’re near the ballpark of a physical SAN. The second is what I call the comfort blanket, people get attached to what they currently use (physical SAN) and are very reluctant to change it despite all the promises of wonderful things that something else might bring. As a result they tend to stick to what they know and what they are comfortable with instead of venturing outside that comfort zone into unfamiliar territory.
If you want the quick overview of everything new in 6.1 the below slide illustrates that. The big things that stand out are support for Stretched Storage Clusters (i.e. vMSC), support for 2 node VSAN clusters, support for multi-vCPU (SMP) Fault Tolerance, vRealize Ops integration and new enhanced replication with lower RPO’s. Continue reading for more details on all these.
Prior to version 6.1 you were limited to deploying a VSAN cluster to a single site as it did not support higher latency between VSAN nodes. Now with support for stretched clusters you can spread your VSAN nodes farther apart to provide a higher level of storage availability that can survive not just a single node failure but also a site failure. This is very similar to a vSphere Metro Storage Cluster (vMSC) solution, the difference being that vMSC is intended for external storage arrays and this solution is built into vSphere hence no need for it to be vMSC certified. Just like vMSC however this is intended for metro distances only as it is limited by latency (5ms).
The VSAN Stretch Cluster solution is available in either VSAN configuration (hybrid or all-flash) and utilizes synchronous replication between sites to keep all nodes continually in sync. It is also based on an active-active architecture so storage is usable at either site. As with just about any multi-site storage solution a 3rd party quorum is required for quorum and decision making to resolve split brain situations when a site failure occurs. The witness can be deployed as a virtual appliance at a 3rd site or hosted in the cloud via vCloud Air. As the 3rd site option is often not available for many companies who only have 2 sites the vCloud Air option is a nice alternative.
As mentioned the requirements for this solution is the two sites must have less than 5ms latency between them, this is pretty much standard for any type of synchronous replication solution as the storage at the two sites must stay synchronized at all times and higher latency between sites can impact performance. The requirement for the connection to the 3rd site witness appliance is 100Mbps but realistically as there is not heavy data flow between the witness and storage sites it can probably be much lower. The requirement for the connection between the 2 storage sites is 10Gbps which is pretty high and is the primary reason why this solution is metro distance limited. Note because this is an active-active solution both DRS & HA are supported between sites.
While having continuous availability is critical to some customers there is often the need to extend that out further to protect against regional disasters. You can combine a VSAN stretch cluster with VMware’s vCloud Air Disaster Recovery Solution that utilizes vSphere Replication (asynchronous) to replicate your VSAN stretch cluster to a cloud based failover environment. This provides you with double protection against either a single site failover or a regional event that might impact both your stretched cluster sites.
In addition to replication to a vCloud Air based DR cloud there is also enhanced replication to an offsite location using vSphere Replication with Site Recovery Manager. This improved replication is more efficient due to the new VSAN vsanSparse snapshot mechanism that was introduced in vSphere 6.0 and VMware is claiming that RPO’s as low as 5 minutes can be achieved as a result.
I don’t know that many people use the vSphere Fault Tolerance (FT) feature that much due to the many limitations and restrictions that it puts on VMs. Support for multi vCPU (SMP) VM’s was finally introduced in vSphere 6.0 but VSAN was not supported with Fault Tolerance (even single CPU VM’s). Now with 6.1 you can use the FT feature with VSAN if you so desire including SMP VM’s.
VSAN now supports certain application specific clustering technologies including Oracle Real Application Cluster (RAC), Microsoft Exchange and Microsoft SQL Server. Note for Exchange and SQL the only supported configurations are those that use the file share quorum witness, Failover Cluster Instances (FCI) are not supported..
While VMware has worked to scale VSAN on the high end up to 64 nodes the minimum supported nodes has remained at 3 nodes until now. VSAN now supports a 2-node cluster but this is only meant for a ROBO solution as it does require a witness node in the same manner as a stretched cluster does which is deployed at a central location and managed by vCenter Server. With this solution each node will be in a Fault Domain and each ROBO cluster will have it’s own independent witness node with all management done by a single vCenter Server instance. This is great for ROBO deployments that have many sites where companies desire to keep as little infrastructure as possible at each site. This solution is not intended for standalone 2-node deployments where the minimum nodes remains at 3 nodes.
Virtual SAN now has integration with vRealize Operations (vROps) for enhanced health, performance and capacity monitoring. The integration isn’t native to vROps and SAN integrates the same way that every vendor does through a Management Pack that is installed in vROps that provides support for VSAN. This provides some much needed better monitoring for VSAN and includes a Global View that provides visibility across multiple VSAN clusters for monitoring, alerts and notifications as well as capacity monitoring that can monitor disk usage and SSD wear out across all VSAN hosts and use advanced capacity planning based on “what if” scenarios, historic demand and stress trends. In addition the health monitoring provides proactively notifications on failures, performance or policy compliance issues on an ongoing basis, with root-cause analysis and remediation strategy.
Some additional smaller things included in VSAN 6.1 include support for new higher performance flash devices such as SanDisk’s UltraDIMMs that supports NVMe (Non-Volatile Memory Express) which is a specification that allows SSDs to connect to the PCIe bus instead of through traditional SAS/SATA interfaces. By using the PCIe bus it allows for much lower latency and support for multiple queues and higher queue depths, the end result improves performance and helps eliminates bottlenecks.
Aug 28 2015
If you’re a Top vBlogger going to VMworld this year what better way to tell the world that you’re a Top vBlogger by wearing your commemorative coin bling. Don’t have one yet? There were at least 15 people that never filled out the shipping form so if you don’t have one and will be at VMworld (US) come find me (tweet me) and I’ll meet up with you to make sure you get one.
Aug 28 2015
One of the best parts of VMworld is checking out the Solutions Exchange which is your one stop shop for just about any product or solution for your virtual environment. Vendors bring their best and brightest people to these events so its a fantastic opportunity to learn more about the many great products available for vSphere. I’d thought I’d highlight a few of these vendors in a series of posts that you will not want to miss seeing at VMworld, next up: StarWind Software
You may not be familiar with StarWind Software, but they’re a player in one of the hottest virtualization segments right now which is Software-defined Storage, aka Virtual SAN or Virtual Storage Appliance (VSA). StarWind released their Virtual SAN product in 2011 back when the SDS market was still relatively new with very few companies offering software only storage appliances. Today they offer their Virtual SAN product along with a Virtual Tape Library and a hyper-converged hardware offering with their Virtual SAN. StarWind also supports more than just VMware vSphere environments with additional support for both Citrix Xen Server and Microsoft Server (Hyper-V). In addition they support deployments as small as 2-nodes which is great for smaller companies and ROBOs. StarWind also offers a free version of their Virtual SAN that is limited to 2 nodes and is self-supported that is great for home labs.
You can check out StarWind while at VMworld by visiting booth #442, on Monday and Tuesday you will be able to participate in short sessions held by fellow vExpert, Mike Preston. Also don’t miss out on a chance to leave VMworld with a Sony PlayStation 4.
Aug 27 2015
One of the best parts of VMworld is checking out the Solutions Exchange which is your one stop shop for just about any product or solution for your virtual environment. Vendors bring their best and brightest people to these events so its a fantastic opportunity to learn more about the many great products available for vSphere. I’d thought I’d highlight a few of these vendors in a series of posts that you will not want to miss seeing at VMworld, next up: SolarWinds.
SolarWinds Virtualization Manager was originally born as Hyper9 back in 2007 that worked to develop a new breed of virtualization management tool that helps administrators discover, organize and make use of information in their virtual environment. I remember meeting with the original founders of Hyper9 over dinner back before the product launched and was impressed with their fresh approach to virtualization management that used unique analytics, dashboards and search algorithms. Hyper9 was acquired by SolarWinds in 2011 who was equally impressed with their product and renamed it Virtualization Manager to help fill a gap in their management tools product line around virtualization.
Over the years they have continued to develop and mature the product and more importantly integrate it into their suite of products to provide an end to end management framework that includes servers, storage, networking, applications and virtualization. The end result is SolarWinds Virtualization Manager delivers integrated VMware and Microsoft Hyper-V capacity planning, performance monitoring, VM sprawl control, VDI performance monitoring, configuration management, alert remediation, and chargeback automation—all in one affordable product that’s easy to download, deploy, and use.
To find out more be sure and stop by booth #2429 at VMworld and also sign-up for the SolarWind’s Experts and Espresso event which is being held at Jillian’s on Monday & Tuesday morning from 7:30am-9:00am before the VMworld general sessions. There you will hear from SolarWinds experts and Head Geek’s including my good friend and fellow vExpert Kong Yang on a variety of topics including DevOps, containers and database virtualization. What better way to start your mornings at VMworld with a fresh brewed espresso or coffee, sweet swag, and knowledge from a few IT superstars. So what are you waiting for, go sign up now! Also don’t miss their breakout session as well: VAPP4696 – Will it Blend and Scale? Monster Database Virtualization Techniques
Aug 27 2015
As much as everyone would love to attend VMworld many people can not go for a variety reasons but you can still get a lot out of the show even if you do not attend. I thought I’d highlight some of the many resources that are available to tele-VMworlders to be able to participate in the show from the comfort of your home or office.
There are hundreds of bloggers that write about VMware technology and there is no shortage of bloggers that attend VMworld and report on what they see, hear and experience at the show. You can expect bloggers to write about anything from thoughts and opinions on products and companies to what parties they attended to live blogging about sessions they attend. VMware has a special list of VMworld bloggers along with feeds to keep you informed of all the latest blogger posts.
You can also keep an eye on the Planet v12n feed directly but you’ll have to sort through non-VMworld posts as well. Also be aware that Planet v12n only keeps the latest 100 blog posts so when you have a lot of blog posts coming in a short period of time around events such as VMworld it will only show the last day or two before posts roll off it so you will want to read up on it daily and not wait until the end of the week or you’ll miss out.
If you’re not on Twitter by now, why not? You may not be that social or the chatty type but its a great way to listen in on the thousands of people on social media all talking about VMworld. So if you don’t have an account, sign-up now before VMworld and then use the many VMworld focused twitter resources to listen in and participate in real time. The @VMworld account is the official account for VMworld so make sure and follow it, you also might follow the most popular bloggers as well to see what they are saying about VMworld. You can see the top bloggers here along with their twitter handles and also check out my list of the Top 100 VMware/virtualization people to follow.
You’ll also want to keep an eye on hashtags that flag tweets that related to a specific topic. The most used hashtag for VMworld is #vmworld, there are also hashtags specific to each session (#sessionID) and fun ones such as #vmworld3word and #vmworldselfie. VMware also has a Social Stream of Twitter feeds available that is like a giant tweet billboard that you can watch to see the latest Twitter action at VMworld.
theCUBE is kind of like the ESPN of tech events and provides live coverage and interviews throughout the whole event. Hosts John Furrier, Dave Vellante and Stu Miniman interview high profile guests from VMware, partners and others and talk about all the latest trends, announcements and action that happens at VMworld. Head on over to their VMworld 2015 landing page and you can watch a special preview of the event and see the whole lineup of guests which includes well known people such as Pat Gelsinger and Stephen Herrod.
VMware doesn’t live stream breakout sessions but they do live stream the 2 main general sessions which are where all the new product announcements are made. The opening general session (Monday) is historically more focused on VMware’s high level vision and strategies as heard from Robin Matlock, Pat Gelsinger and Carl Eschenbach. The 2nd general session (Tuesday) is more focused on the details and specific products and technologies and typically features more techie speakers such as VMware’s CTO, Ben Fathi and others like Kit Colbert. The Thursday general session is more a fun one without VMware speakers and featuring super smart folks from places like MIT and Stanford to talk about cool hi-tech science and technology, this one is not live streamed.
To sign-up to view the general sessions live head on over to VMware’s general session live streaming reminder page where you can put in your email address and be sent a calender invite for them. Note the invite doesn’t have a specific link to view the session but I suspect if you go the the main VMworld.com page right before each general session starts there should be a link there to view it live.
In prior years VMware had a camera crew roaming around VMworld recording content for VMworld TV which was narrated in part by the famous Mr. Sloof. Every day they featured a nice roll-up of the days happenings that summarized what happened using the recordings that were made throughout the day. Unfortunately VMware decided to cancel that show so you will not be able to see that great video coverage this year. They still do have a YouTube playlist for VMworld 2015 that currently features some “Why Attend VMworld 2015″ videos but I suspect they will still be posting video content there throughout the show so keep checking that playlist and subscribe to the VMworld YouTube account to see what they post this year.
What is a BrownBag? It’s what you pack your lunch in so you can bring it somewhere and eat while doing something. As it relates to technology that “doing something” is watching someone speak on a specific topic, essentially a lunch and learn. The vBrownBags have been around for many years and were born as a podcast series for virtualization experts to share knowledge and experiences with others. That has since carried over to live events and you can find vBrownBags usually at VMUG Usercon’s and VMworld events.
The vBrownBag sessions will be held throughout each day at VMworld and feature vExperts, bloggers, product experts and more talking on a variety of topics. You can view the entire vBrownBag schedule here and the best part about it is you don’t have to be there to watch them as they will also be live streamed. So don’t miss these informal, educational sessions where you’ll learn all sorts of great stuff, just be sure and pack your own lunch.
View recorded sessions
Almost all breakout sessions at VMworld are recorded as it’s impossible for attendees to see more than a small fraction of the amount of total sessions (700+). The recordings allow attendees to watch each session after the event is over to check out all the great sessions that they could not attend while at the event. The audio for all sessions is recorded and presented along with the slides for each session, in some cases for more popular sessions they have video recorded them as well at past VMworlds.
The sessions are only meant for registered attendees and are posted soon after the show ends but there are several ways for anyone to view sessions if they so desire. First off VMware always releases all of the prior years recorded session to the general public right before the current years VMworld begins so anyone can watch them. Despite being a year old there still is lots of great content in there. You can view all of the 2010-2014 sessions on the VMworld website (free account required).
Don’t want to wait a year, there are still ways to view this years sessions sooner. VMware typically posts some of the most popular sessions in batches over time on the VMworld YouTube channel shortly after the show ends so keep checking there, you can see the playlist from last year here. In addition VMware has also offered a season pass to people so they could subscribe to all the session content for around $700, not sure if they’ll do that this year or what the cost will be, check the VMworld.com website after the show and they may have some info on that.
As you can see not attending VMworld doesn’t mean you have to miss out on all the exciting action that occurs there. The one thing you do miss out on (besides the parties) that is hard to re-create virtually is the face to face networking but their is plenty of options available that allow you to soak in the conference and still get good value out of it from afar. So if you can’t attend be sure and check out the resources that we covered here and look on the bright side, you’re also missing out on the crazy expensive hotel rooms, the mediocre lunches and the hangovers.
Aug 26 2015
I happened to join the VMTN community podcast today to catch up on VMworld stuff and one thing that was mentioned is that VMworld will be in Vegas next year (2016). The reason for this is that despite VMware having a long term contract to be at the Moscone Center in San Francisco, the Moscone Center is undergoing renovation next year so it will be moving temporarily back to Las Vegas.
I for one (and I suspect many others) welcome this, I previously wrote about how I was getting tired of San Francisco (below) and would like to see it elsewhere:
Well for one year at least we get a reprieve from SF and get to go back to Vegas where I attended my first VMworld in 2008, the last VMworld in Vegas was in 2011. See you in Vegas baby!