I was reading this article by Eric Gray about CSV and followed his link to this ZDNet post about VMFS-3. I was a little taken aback.
One of the first questions that popped into my head was, “Why not use VMware Converter?” After all, it’s the tool that was expressly designed to do exactly what Jason Perlow was attempting to do in the DR exercise with his customer: import data back into a VMware vSphere environment.
Further—and I could be wrong here—but it seems to me that I’ve accessed USB storage devices from the Service Console before. Assuming that I’m correct (again, a big assumption, and one that I’ll test in the lab today), why not just use vmkfstools to import the VMDKs back into a VMFS datastore? And yes, Jason does provide a passing reference to ESXi, so perhaps he was using ESXi at the DR site and therefore didn’t have access to the Service Console.
I wasn’t there in the DR exercise, so there may have been other mitigating circumstances of which I am not aware. In addition, using VMware Converter wouldn’t have addressed the lengthy time taken to copy the data across the network which, as I understand it, was one of the primary complaints in Jason’s article.
In the end, though, why is Jason complaining about VMFS-3 and the time taken to restore a bunch of VMware vSphere virtual machines when the real root of the problem was the “consumer grade hard disks that you buy at the local Staples or Best Buy hooked up to some random Linux server”? He would have faced the exact same problem if he were trying to restore large Exchange databases from these commodity 1TB hard disks, or if he were trying to restore large Oracle or SQL databases from commodity 1TB hard disks. Does that mean Microsoft and Oracle are at fault as well? In this case, since VMware is the new “whipping boy” in the data center, VMware—specifically, VMFS-3—gets blamed.
I fail to see how better VMFS interoperability would have helped. Even if he’d been able to run VMs off USB-attached consumer grade hard disks, would you have wanted to? Then, VMware vSphere would have been blamed for “awful, horrible performance”. Like I said, VMware is the new whipping boy, and everything is VMware’s fault. Hey, at least the networking guys are happy—it’s no longer the network’s fault!
And while this wouldn’t have helped in Jason’s situation (he was trying to get data into VMFS, not get data out of VMFS), there is this open source VMFS driver available. So VMFS-3 is as much the “black box” that he lets on, in my opinion.
Let me know what you think: am I way off here?
Tags: Backup, Virtualization, VMware, vSphere
-
At my last company, our DR plan was to do image backups to USB disks and restore back using VMware Converter.
For someone acting as the VMware Lead on this project, he seemed to have more assumptions on how things should work than actually knowing what tools would be needed. All of this just to write an article to bash VMware to generate hits on a website.
-
Hi Scott,
The author of that ZDNet article is in the tank for Microsoft. Check out any of his other posts for verification — there’s even one other post that talks about why CSV is better than VMFS.
I would not be surprised if MSFT just fed him these points.
There are many ways to get data in and out of a datastore (why not use the vSphere Client?), and VMFS does not have much to do with it.
Thanks for the reference.
Eric
-
Scott you were right on. Lets all agree that this “DR Plan” was/is not a good one. I was still confused that someone with so much experience as an integrator was not able to come up with a solution to this minor problem. After I was done readying his “article” I was so mad at myself for even clicking on the link to give him the web hits.
-
Or he could have used Veeam’s (free) FastSCP which is probably what his client did to get them onto the USB drives in the 1st place. Oh and that would have worked with the free version of ESXi too.
-
FastSCP, anyone?
Lot of variables here that Jason did not go into regarding his recovery environment. Assuming that his recovery ESX/ESXi box had enough spindles. He could have attached each portable drive to a nbk and let it fly. Not the best DR plan but it mirrors what people are trying to do when faced with financial, logistical and technical constraints.
Rick can you clarify your comment about working directly with VMDKs?
I thought point of encapsulating a server into a VM was so it would be portable? At some point in time you need to archive the VM’s. Normally this would be VCB or partner product.
Are there better methods to move VM’s between disconnected systems?
-
If he really spend the last two decades working as an IT Expert I would assume he learned how to use Google by now. Just a simple search would have resulted in many different ways of getting this job done but the most obvious ones are:
- VMware Converter (free)
- Veeam FastSCP (free) / WinSCP
- vCenter Client with USB directly attached to the vCenter server
- Mount a SAMBA share
- Mount NFSAnd as far as I am aware(depending on the version of ESX) you can even mount an USB disk with NTFS.
Btw it’s VMware and not VMWare.
-
Quite obviously a Microsoft-sponsored hit piece that wasn’t even fact checked.
FAT32 has a 2GB filesize limitation and VI3.5 virtual disks are preallocated with no option for 2GB splitting, so the configuration he mentions is not even possible unless he had a terabyte of VMs that were all less than 2GBs in size.
USB does in fact work in the Service Console, if you know how to use the mount command. SMB/CIFS also works if you know how to use the smbclient command. The entire task could have been completed in less than an hour had he used a simple NFS mount from within the Service Console out to the NFS server he setup - the comment by Scott is spot on as well about using VMware Converter 4.
VMFS has been a convenient target for Citrix and Microsoft to attack over the years, until they figured out that carving a LUN for each VM going into deployment is inconceivable for any virtualization project greater than a handful of VMs. Now Microsoft is building their own clustering filesystem for Hyper-V of course…
-
Matt:
As a practice point, in my virtualization practice I do not work directly with VMDKs off of the virtual environment. I am mostly VMware, but I do:
Copy VMDKs within VMFS datastores or across datastores through virtualization-specific tools
I do not:
Copy VMDKs to USB drives
Copy VMDKs to another filesystemThat is what I mean by “not in the business of working with VMDKs directly”.
-
Complete agreement - I commented a few times to that effect on the original post as well.
-
Thanks, Rick.
-
Man I had a lot of harsh things to say about this guy and then thought better of it. I’m glad I’m not the only one.
For a guy with “decades of experience in heterogeneous environments” he doesn’t seem to understand a lot of basic approaches. It’s basically a non problem and goes to show that his customer is likely using the wrong vendor to help support their virtualization effort.
The situation itself is a bit contrived and in the best case scenario he’s still going to have to re-export every virtual disk anyway (since Fat32 is just an awful filesystem for storing large files.) you’re better off just using Converter.
I’m quite disappointed in that guy.
-
Wow. Jason’s article is full of misinformation. After reading it i came to 2 conclusions:
1) he has no business doing vmware consulting as his knowledge is severely limited.
2) companies should definitely invest in technology. I find it hard to believe that company that he was doing consulting for used 1TB sata disk for backup.
like others mentioned - Microsoft should really do fact checking before posting these articles. Fat32 has a 4GB file size limit so it would be pretty hard to copy those vms to the external drive.
Also like others mentioned there are a lot of different options/tools available for this to work. and my final comment is that VMFS-3 has nothing to do with problems he was having.
-
@Andrew Storrs; “Or he could have used Veeam’s (free) FastSCP”
And that would have been unbearably slow. Even with screaming-fast hard drives.
http://www.veeam.com/forums/viewtopic.php?f=4&t=985
Upload to ESXi: 5-10MB/s
“Why ESXi upload is so slow ?
For unknown reasons, upload through file management API is capped on ESXi.
If the author of the article was using ESXi, this is probably the predominant reason it was slow, not their SATA hard drives.If he had used VMware ESX and FastSCP, it would be much faster.
It also would have been a lot faster, if he used VMware converter to perform the upload.Or just attached the NFS volumes to the DR VM host, registered the VMs, and used SVMotion or cloning in the DR vCenter to migrate them to the VMFS datastore.
As vCenter does not seem subject to the “upload speed CAP” ESXi imposes on the datastore browser.
I there’s one good point about VMFS being a black box.. for DR purposes it _is_ nice to have general tools for operating on your filesystem, and reverting a filesystem snapshot of just one VM instead of everything. This is especially useful if there is some sort of damage to the filesystem, you can use general repair tools — and is a reason I like shared NFS storage for VMs; if the VMFS metadata gets corrupt, you’re basically screwed.
If the ext3 filesystem on your Linux NFS server has an issue, you can run fsck if you need to.
-
I find it funny that Eric Gray (the guy who works for VMware and puts out a lot of anti Microsoft information that he claims is just his ‘personal’ opinion) would accuse someone else of being in the tank for a company. If you check Mr. Perlow’s info you can clearly see he works for IBM, not Microsoft. Eric, I think you should know better and be more careful. It’s obvious that your post had an effect on others as Gregory and Alex then latched onto believing this is a post from Microsoft which simply isn’t true. The guy may personally prefer Microsoft and Hyper-V, but that is far different than being in the tank. Being that you are paid by VMware Eric, I would say it is safe to label you as “in the tank” for VMware. However, if independent individuals prefer Microsoft or VMware it is based upon their own technology preferences.
As to the actual problem, I’m not a VMware guy but it sounds more like an issue of things not working the way he expected or seemed logical to him more than not working perhaps. Though Jimmy’s point about ESXi’s upload cap seems relevant (and odd). It’s nice that there are add-ons that can be used to accomplish the function, but soemthimes if you aren’t in the know about the add-on it can be frustrating trying to figure out how to get something to go that just works on other systems you are used to. I’m not totally defending him because you need to know the different tweaks and ways to accomplish something in all the systems you work with, but you can’t tell me as an IT person everyone commenting here hasn’t at some point been annoyed that they can’t do something in product A as they had been able to do in product B even though product A has a way to do it that is just different. Sometimes until you figure out the trick and the lightbulb goes on it all just seems like black magic.
-
Oh and before taking the double jump to ragging on the ZDnet article, it might be worthwhile to call out Eric for his FUDing in his article linked here. Eric is providing some bad information based on his lack of knowledge about Hyper-V and CSV just like Mr. Perlow gave some bad information on his lack of knowledge about add-on products for VMware. Eric is also performing the deceptive move of attacking at an RC version of a product with absolute disgregard for release dates and the greater product eco-system. If you check the comments you’ll find some very professional responses from MS folks clarifying some of Eric’s bad information (which Eric, in my opinion, responds to in an immature and arrogant fashion)
-
Scott, If you take a look at the comments section on Eric’s post you will see the calrifications of Eric’s assumptions from much more knowledgable people than myself that do a much better job of explaining the issues. However, some gernal gists of issues. Eric declares CSV a “delicate” feature, inserting the classic FUD that “oh no, can I rely on this to keep working?”. Eric’s sole basis for this claim is that there is a warning pop up that says that CSV is only currently supported for Hyper-V. I’m sorry but that is beyond a leap of logic. Microsoft is simply saying this is what it has been tested and certified for at this point. They’ll probably leverage CSV for other technologies in the future, but it would be irresponsible of them not to give the warning that they haven’t tested such yet. To declare CSV delicate based upon that is FUD. Next Eric claims you can’t backup a VM on a CSV. This is my point about attacking an RC version of a product. The API is currently available for backing up VMs on a CSV, so it is NOT a limitation of CSV as Eric is hoping to imply. R2 isn’t genraly available until the end of October. It’s not fair to expect all of the partners (I consider DPM a partner too because we are talking seperate units of a very large organization) to have backup software ready for the RC. This isn’t the first time I’ve seen Eric attack Hyper-V on something based on using the beta or RC product either. If I attacked VMware based on some partner product not being ready yet for a beta of theirs, I think Eric would call fowl. There are also issues raised in the initial post and in the comments section about a single coordinator node and how IO works in the cluster. Again look to the comments, there is some good clarity from a Microsoft person about how IO is direct, the balancing of coordination, and the redirecting of IO only in the case where all connections to the storage are lost (which I personally think is actually a very cool double safety feature).
-
I recently had to import a number of VMs into a vSphere environment (training setup) and instead of Converter I used the OVFTool. You can convert Workstation or ESX formats to and from the OVF format using this tool. If you have OVF files, which are relatively small, you can easily upload them again to an ESX host.
I created some batch files and this worked pretty fast, even using commodity hard drives in the upload machine. And this doesn’t just upload the VMs but does registration as well.
-
Nate, with all due respect — you don’t know what you’re talking about.
I am using the RTM version of Windows 2008 R2, not the RC as you have falsely accused me of.
Have you completely overlooked the Microsoft Virtualization messaging coming from Woolsey/Greshler/Yuen? They claim Hyper-V R2 is available with free live migration — today. They imply that everything is ready to deploy now, in order to stall adoption of VMware.
The fact is, their hypervisor has been released but it’s not ready to be put into production. The GA date in October is a mostly a marketing launch, DPM will not suddenly be able to back up VMs on CSV LUNs.
Perhaps you are fine with them bloviating about what they intend to provide at some point in the future. I’m not, and I’ll write about it on VCritical. Please consider attacking me on my own blog and not Scott’s.
Eric
-
Eric, I’m not sure respect is a word you actually understand.
Sorry if you are using RTM not RC, either way it is not GA. GA is not simply a “marketing” thing. Please tell me you understand product ecosystems and lifecycles.
Sorry I don’t think anyone is trying to “stall the adoption of VMware”. I never said GA would make DPM automatically able to backup CSV. Stop playing the straw man game. I said the API is availbale. The product isn’t GA. Stop expecting all partners to have products ready before GA. Eventually you VMware guys are going to have to realize the I had it first argument is lame. You are running out of time for that argument to have any validity. You have an issue with Microsoft “stalling” I have an issue with you “rushing” people into VMware. You know you are running out of time of being the only ones to have feature X and you are scared.
Hyper-V is certainly ready to be put into production. If you want a specific combination of requirements (live migration plus full VM backup) then yes wait a few months. VMware obviously believes that not every customer needs this as you have SKUs that provide less. Once all the partners are ready you aren’t going to have the same SKU issues with MS.
I beleieve others very professioanlly responded on your blog. You dismissed them. You posted a lie here about Mr. Perlow being “in the tank” for Microsoft. That is what prompted my response here. Take a more honest approach and you might find yourself called out less.
-
My apologies for getting wriled Scott. As just your average Joe techy I like your blog as an independent source of virtualization info. I don’t always agree with your opinions, but respect them. I respect when individuals are A) Actually independent or B) Admit that by blogging/posting on topics directly related to the product their company produces or the competing product they are in fact posting on behalf of their company not ‘personally’. I got a little tweaked about some false accusations slipping in here and being told I didn’t know what I was talking about simply for pointing out such accusations. I let my frustration get the better of me, so I apologize.




31 comments
Comments feed for this article
Trackback link: http://blog.scottlowe.org/2009/09/22/vmfs-isnt-the-problem-here/trackback/