Wednesday, June 06, 2012

Getting data into and out of clouds faster....

Getting data into and out of Clouds faster is now what I do at a company called CloudOpt.

How do we do it? We intercept traffic going to the Cloud whether it is by HTTP, scp, FTP, CIFS etc and apply data de-duplication, compression and some fancy protocol optimizations. The results are up to 60% data reduction on first transfer, and 99% on the second. This means if a file is transferred to the cloud using scp and then downloaded using HTTP, the HTTP transfer will only transfer 1% of the bytes!

Bill, one of the guys I work with, has done a nice write up on creating RightScale Server Template using chef on the CloudOpt Blog.