Personal tools
You are here: Home Forums-old Dispersed Storage Users data reduction / de-duplication
Document Actions

data reduction / de-duplication

Up to Dispersed Storage Users

data reduction / de-duplication

Posted by David Demlow at March 26. 2008

Are the chunks created by the cleversafe IDA specific to the content and does cleversafe avoid storing redundant chunks to save space?


 


Put another way... if I copied the same file 10,000 times to the iSCSI lun, would cleversafe be smart enough to optimize that storage of that file?


Re: data reduction / de-duplication

Posted by cgladwin at March 27. 2008

David,


 


The "slices" created by the IDA in the initial release are non deduplicated.  It is something that we talked about adding as an option as some point in the future.


 


A short term alternative would be to use some kind of existing de-duplication software prior to storing files on a dsNet.


 


 


 


Chris Gladwin


Powered by Ploneboard