Comments on: Quick Guide to Setting up NetApp Deduplication http://blog.scottlowe.org/2008/03/31/quick-guide-to-setting-up-netapp-deduplication/ The weblog of an IT pro specializing in virtualization, storage, and servers Wed, 08 Feb 2012 17:13:47 +0000 hourly 1 http://wordpress.org/?v= By: Paul W http://blog.scottlowe.org/2008/03/31/quick-guide-to-setting-up-netapp-deduplication/comment-page-1/#comment-50813 Paul W Wed, 11 May 2011 12:16:53 +0000 http://blog.scottlowe.org/2008/03/31/quick-guide-to-setting-up-netapp-deduplication/#comment-50813 I'm new to NetApp but not to storage and deduplicaton. Am I missing something with regards to A-SIS? It seems very strange to me that the A-SIS process is run seperately from the deuplication process and there is no interaction between the two. Savings from a deduplication process lags by how long retention for the snapshots is set. This really seems strange that A-SIS modified blocks get included in snapshots. I guess that's one of the additional drawbacks to post-process deduplication. I would think that this would be something that NetApp would think isn't that great of an idea and would put an additional methodology in place that would mark blocks as deduplicated and the snapshot process would ignore those blocks. I’m new to NetApp but not to storage and deduplicaton. Am I missing something with regards to A-SIS? It seems very strange to me that the A-SIS process is run seperately from the deuplication process and there is no interaction between the two. Savings from a deduplication process lags by how long retention for the snapshots is set. This really seems strange that A-SIS modified blocks get included in snapshots. I guess that’s one of the additional drawbacks to post-process deduplication. I would think that this would be something that NetApp would think isn’t that great of an idea and would put an additional methodology in place that would mark blocks as deduplicated and the snapshot process would ignore those blocks.

]]> By: Kenneth Hansen http://blog.scottlowe.org/2008/03/31/quick-guide-to-setting-up-netapp-deduplication/comment-page-1/#comment-49507 Kenneth Hansen Thu, 11 Nov 2010 12:57:10 +0000 http://blog.scottlowe.org/2008/03/31/quick-guide-to-setting-up-netapp-deduplication/#comment-49507 Lucas, we have dedub ratios at up to 80% (VMWare) and yes if you run dedub on a daily basis, the cpu load on the storage processors, can be very high, and course high (Spikes) latens, on you lun's (Datastores), so make shure to spread out dedub kick in times on large systems, only run dedub once a week. Lucas, we have dedub ratios at up to 80% (VMWare)
and yes if you run dedub on a daily basis, the cpu load on the storage processors, can be very high, and course high (Spikes) latens, on you lun’s (Datastores), so make shure to spread out dedub kick in times on large systems, only run dedub once a week.

]]> By: Kenneth Hansen http://blog.scottlowe.org/2008/03/31/quick-guide-to-setting-up-netapp-deduplication/comment-page-1/#comment-49506 Kenneth Hansen Thu, 11 Nov 2010 12:50:20 +0000 http://blog.scottlowe.org/2008/03/31/quick-guide-to-setting-up-netapp-deduplication/#comment-49506 Hi If i run dedub, manualy, whit command can i use afterwards to se how many new (not Dedub'ed) Blocks there is writen, or a command that can tell me how mutch space saving i will got, if i run a dedub run again. Hi
If i run dedub, manualy, whit command can i use afterwards to se how many new (not Dedub’ed) Blocks there is writen, or a command that can tell me how mutch space saving i will got, if i run a dedub run again.

]]> By: Lucas http://blog.scottlowe.org/2008/03/31/quick-guide-to-setting-up-netapp-deduplication/comment-page-1/#comment-48782 Lucas Wed, 07 Jul 2010 21:59:41 +0000 http://blog.scottlowe.org/2008/03/31/quick-guide-to-setting-up-netapp-deduplication/#comment-48782 For those of you seeing the great de-dup ratios... Have you noticed any performance degredation in relation to the data being served to applications/servers? Thanks. For those of you seeing the great de-dup ratios…
Have you noticed any performance degredation in relation to the data being served to applications/servers?
Thanks.

]]> By: JasonRandall http://blog.scottlowe.org/2008/03/31/quick-guide-to-setting-up-netapp-deduplication/comment-page-1/#comment-48470 JasonRandall Fri, 28 May 2010 18:39:13 +0000 http://blog.scottlowe.org/2008/03/31/quick-guide-to-setting-up-netapp-deduplication/#comment-48470 Stefan, Make sure you don't have software compression turned on for those backup jobs- that is basically like encryption, which will cripple dedupe. I think. :) Stefan,

Make sure you don’t have software compression turned on for those backup jobs- that is basically like encryption, which will cripple dedupe. I think. :)

]]> By: Joel http://blog.scottlowe.org/2008/03/31/quick-guide-to-setting-up-netapp-deduplication/comment-page-1/#comment-47094 Joel Sun, 20 Dec 2009 04:50:07 +0000 http://blog.scottlowe.org/2008/03/31/quick-guide-to-setting-up-netapp-deduplication/#comment-47094 Stefan, this may be a bit late, and I'll admit to not knowing how Acronis stores backups. However, if the backups are compressed to save space, this will mean that it will pretty much not use dedupe at all. Even a very small change to the data could mean a completely different (no identical blocks) compressed backup file. Stefan, this may be a bit late, and I’ll admit to not knowing how Acronis stores backups.

However, if the backups are compressed to save space, this will mean that it will pretty much not use dedupe at all. Even a very small change to the data could mean a completely different (no identical blocks) compressed backup file.

]]> By: Stefan Kaihatu http://blog.scottlowe.org/2008/03/31/quick-guide-to-setting-up-netapp-deduplication/comment-page-1/#comment-45049 Stefan Kaihatu Sat, 04 Jul 2009 11:07:35 +0000 http://blog.scottlowe.org/2008/03/31/quick-guide-to-setting-up-netapp-deduplication/#comment-45049 Hi Scott, recently our storage provider in the Netherlands upgraded our Ontap to version 7.2.6 on our NetApp NearStore R200 in order to activate de-duplication. We use the R200 as our backup storage for Windows data , using Acronis v9 software (in fact it is creating an image file of each disk drive). Each month a full Acronis backup (which is a block based backup ) of all Windows servers is (C: , D: and E: drive are written to the R200 Windows volume (using CIFS) and subsequently the incrementals starts untill the beginning of the next month then the cyclus restarts again with a full backup. I would assume that specially the C: drives (only Windows OS) of each backup do not change a lot, so a high dedup ratio was expected. Unfortunately I find on all volumes a space saving of less than 1 percent Could you provide me a reason for this poor de-duplication ratio ? Thanks in advace, Stefan Kaihatu Hi Scott,

recently our storage provider in the Netherlands upgraded our Ontap to version 7.2.6 on our NetApp NearStore R200 in order to activate de-duplication.
We use the R200 as our backup storage for Windows data , using Acronis v9 software (in fact it is creating an image file of each disk drive).
Each month a full Acronis backup (which is a block based backup ) of all Windows servers is (C: , D: and E: drive are written to the R200 Windows volume (using CIFS) and subsequently the incrementals starts untill the beginning of the next month then the cyclus restarts again with a full backup.

I would assume that specially the C: drives (only Windows OS) of each backup do not change a lot, so a high dedup ratio was expected.
Unfortunately I find on all volumes a space saving of less than 1 percent
Could you provide me a reason for this poor de-duplication ratio ?

Thanks in advace, Stefan Kaihatu

]]> By: tom http://blog.scottlowe.org/2008/03/31/quick-guide-to-setting-up-netapp-deduplication/comment-page-1/#comment-42113 tom Fri, 24 Oct 2008 19:20:48 +0000 http://blog.scottlowe.org/2008/03/31/quick-guide-to-setting-up-netapp-deduplication/#comment-42113 good post, just wanted to update the broken TR3505 link in the middle of the article. here's the updated link: http://media.netapp.com/documents/tr-3505.pdf good post, just wanted to update the broken TR3505 link in the middle of the article.

here’s the updated link: http://media.netapp.com/documents/tr-3505.pdf

]]> By: Brian http://blog.scottlowe.org/2008/03/31/quick-guide-to-setting-up-netapp-deduplication/comment-page-1/#comment-41936 Brian Tue, 14 Oct 2008 14:16:51 +0000 http://blog.scottlowe.org/2008/03/31/quick-guide-to-setting-up-netapp-deduplication/#comment-41936 Good post. Thanks for the help. Good post. Thanks for the help.

]]> By: Using NetApp Deduplication with Block Storage - blog.scottlowe.org - The weblog of an IT pro specializing in virtualization, storage, and servers http://blog.scottlowe.org/2008/03/31/quick-guide-to-setting-up-netapp-deduplication/comment-page-1/#comment-40684 Using NetApp Deduplication with Block Storage - blog.scottlowe.org - The weblog of an IT pro specializing in virtualization, storage, and servers Sat, 16 Aug 2008 19:40:06 +0000 http://blog.scottlowe.org/2008/03/31/quick-guide-to-setting-up-netapp-deduplication/#comment-40684 [...] on my earlier article on setting up NetApp deduplication, I wanted to follow up with some information on using NetApp deduplication with block storage (LUNs [...] [...] on my earlier article on setting up NetApp deduplication, I wanted to follow up with some information on using NetApp deduplication with block storage (LUNs [...]

]]>