Update: NSA surveillance, Bitcoin, cloud storage

Just last month, Edward Snowden was honored with our first annual Wild Duck Privacy Award (we hope that he considers it an honor). The vigorous debate ignited by his revelations extend to the US Congress, which just voted on a defense spending bill Edward Snowdento  defund a massive NSA domestic spying program at the center of the controversy.

Although the bill was narrowly defeated, it is clear that Snowden has played a critical role in deliberative policy legislation at the highest level of a representative government. Even if this is the only fact in his defense, why then – we wonder, is Snowden a fugitive who must fear for his life and his freedom?

Snowden saw an injustice and acted to right a wrong. His error was to rely solely on his own judgment and take matters into his own hands, without deliberative process or oversight. But since it is the lack of these very same protective mechanisms for which he engaged in conscientious objection, the ethical dilemma presented a Catch 22.

—————————————————————————————

Stacks of BitcoinRegular readers know that we love Bitcoin. We covered the stateless currency in 2011 and 2013. Just as the internet decentralizes publishing and influence peddling, some day soon, Bitcoin will decentralize world monetary systems by obliterating the role of govern-ments and banks in the control of money flow and savings. Why? Because math is more trustworthy than financial institutions and geopolitics. You needn’t be an anarchist to appreciate the benefits of a currency that is immune from political influence, inflation, and the potential for manipulation.

Now, comes word of a Texas man charged with running a $60 million Bitcoin Ponzi scheme. The story is notable simply because it is the first skullduggery aimed at the virtual currency — other than internet hacking or other attacks on the still fragile infrastructure. Should we worry. Absolutely not. This story has little to do with Bitcoin and falls squarely under the category of Caveat Emptor. Widows and orphans beware!

—————————————————————————————

bitcasa-sIn February, we wrote about Bitcasa, the upstart cloud storage service with an edge over diver-sified competitors and other entrenched players: Dropbox, Google Drive, Microsoft SkyDrive, SugarSync, Apple iCloud, etc. WildDucks learned how to get truly unlimited cloud storage for just $49. Now they are launching unlimited cloud storage in Europe starting at €60 per year.

Bitcasa still captures our attention and sets our pulse racing. While we are disappointed that it lacks the RDDC architecture that will eventually rule the roost, their Infinite Drive technology is a barn burner. More than ever, it is clear that Bitcasa is likely to displace or be acquired by their better known brethren.

—————————————————————————————

Drew Houston-01sWe also wrote about Dropbox, but that posting wasn’t really a review. It was our plea to CEO, Drew Houston (shown at left), to adopt a fully distributed and reverse cloud architecture. That effort failed, but it is still our favorite of the entrenched players. More suited to pin stripe corporate adoption, but in our opinion, not quite a Bitcasa.

In a previous article, we introduced lesser known cloud startups with clever and unique architect-ture that yield subtle benefits: SpaceMonkey, Symform and Digital Lifeboat. That last one was in need of a life preserver. It flopped. But the IP that they created in the area of distributed p2p storage management will live on. We will all benefit.

—————————————————————————————

Stream Music Flowchart-s2Finally, in May we ran down the benefits of cloud music players and their likely future of streaming your own personal library of movies. Now, Jeff Somogyi at Dealnews has created a nifty flowchart to help you decide among many vendors in a crowded market.

Of course, a discussion of Bitcasa, Dropbox, SpaceMonkey and RDDC wasn’t our first discussion of cloud storage. Shortly after AWildDuck launched back in 2011, we applauded PogoPlug and their ilk (Tonidoplug, Dreamplug, Shiva, and other genres consumer grade network attached storage with internet access. They let you create personal cloud services and even stream media from a drive or RAID storage device attached to your home router.

 

Bitcasa: Unlimited storage, version history & sync

bitcasa-sBitcasa has just emerged from “skunkworks” mode. The cloud storage startup made waves in 2011 as finalist at TechCrunch Disrupt and runner up at Startup Battlefield. After burning through an initial $2 million, they landed an additional $7 million in June 2012. While there were few updates during 2012, some analysts noted that they filed for 20 patents—a few are really slick! Now, during Feb 2013, they have unveiled a cloud service with an edge over all others (SkyDrive, iDrive, Dropbox, Sugarsync, etc). In my opinion, only Symform and SpaceMonkey come close to the model that I described 3 years ago (search for ‘Ellery’ and ‘RDDC’).

Bitcasa gives every user folder sync, a timeline for version recovery, and cloud storage without limits. And, I really mean limitless! By the end of next month, I may be using petabytes, as in millions of gigabytes! The space available to me shows exabytes are still available.  That’s more than all the grains of sand on the world’s beaches and all the stars in the heavens. How much does this cost? Just $99 a year, or $49 if you sign up early this month. (Promo Code: BETATHANKS). WildDucks can help this Blog by using our referral link. It tacks a free month onto your editor’s subscription.

I can’t guarantee that Bitcasa will be around next year. After all, most startups fail. But in this case, I crafted a substantially identical network architecture years ago. I understand the business model. Even with a high fraction of data hogs, the venture can profitably service users for the long haul. If an understanding of the secret sauce isn’t sufficient to assuage hesitation, this interview with CEO Tony Gauda will floor you. He combines the technical and marketing genius of Steve Jobs with the showmanship of Siegfried and Roy, and the smile of Barak Obama

Damon Michaels, a WildDuck contributor wrote:

Seems like a virtual drive. I need automatic backup of
my important data. I use Carbonite for this right now.

The folder-sync defaults to all drives in their entirety—even external drives and network attached storage! If you accept the default, it always backs up everything. But more importantly, Bitcasa reverses the model. As connectivity becomes more ubiquitous and speedy, they want you to use the cloud as your primary active storage. Eventually, it will even host your live EXE files (your apps) and your “bootable” OS. The synchronized copy on your PC will be the backup – as well as the one that is used when you cannot connect.

I proposed the fundamental principles used in Bitcasa architecture in this Blog, and 3 years ago in other articles. I called it a “Reverse Distributed Data Cloud” (RDDC). My spec adds distributed, P2P storage to the model. This reduces cost, creates redundancy, and makes a far more robust system. Not only does it get rid of the data center completely. With my model, it is unnecessary for the service provider to perform any backups. In effect, the live cloud is a RAID 10,000 constellation.

One architectural trade-off is the desire for massive de-duplication –vs– the compelling need for end-to-end encryption, in which only the individual users have the keys. These two features are incompatible. DropBox and Bitcasa claim that files are encrypted at the sender and that private keys are never given to the service. While technically true, that claim covers up a nasty little detail. They use a method called Convergent Encryption in which encryption keys are derived from a character string within the encrypted file. Although the service cannot decrypt a unique file (for example, your income taxes), they could compare a hash of your file to one provided by a government or alleged rights owner, thus proving that you have stored a copy of contested media. They could block access to movies and music that you have stored or even block your original upload. The good news is that with a full RDDC implementation, the need for de-duplication is greatly reduced or even eliminated. Therefore, a properly implemented RDDC can truly empower its uses with strong, end-to-end encryption.

I’ll report more about Bitcasa after a few months of use. For now, I feel ratified to see my dream taking shape at several American ventures. If you find this field as fascinating as me, check out Symform, SpaceMonkey and Digital Lifeboat. That last venture is floundering, and may be bankrupt by the time you read this. But they have some very compelling technology for p2p, distributed storage.

Awash in cash, does Dropbox sense the undertow?

Dropbox CEO, Drew Houston, is about to facilitate a meaningful donation to his favorite cause, but he doesn’t know it yet. More about this in the last paragraph…

Dropbox is in an enviable position. The company is smokin! It’s so hot, that Forbes magazine calls it Tech’s Hottest Startup. So hot, that Steve Jobs tried to acquire it. So hot, that when anointed by the MacMeister with a personal audience, 28-year-old founder Drew Houston snubbed his proverbial nose at the offer. *

Dropbox: Atop it’s game…  But what about Future Shock?

What does Dropbox sell?
Dropbox sells cloud storage services, including backup, synchronization and file distribution. They are arguably king the market leader, but they have plenty of competition: Apple’s new iCloud, SugarSync, SkyDrive (Microsoft), LiveDrive, Google Docs, Box.net, FolderShare and a growing list of wannabees. Without getting into the nitty-gritty, let’s just say that if you’re not using Dropbox or a similar service now, you will do so soon.

What can cloud storage do for me?
You are probably familiar with Carbonite and Mozy. These vendors market clouds as safety nets, constantly backing up your PC over the internet, as you work. On the other hand, Google Docs makes collaboration easier and more efficient because users spread far apart can work on the same document at the same time – and without worrying about who has the latest version. These are all ancillary benefits of cloud computing at best. Since the concept is still in its infancy, they focus on a simple and easily digestible pitch.

But clouds offer much more! With data in the cloud, documents, photos and music are always available, backed up, in sync and safe – no matter where you travel or what gadget is handy. Files don’t depend on equipment that you own or carry, so you can travel light and with constant access to your business, media and memories. Much as predicted by Asimov in The Last Question, using a personal data cloud is like having your brain in ever-present hyperspace.

Dropbox is the convergence leader. What’s wrong with that?
When startups reach a phase that I call investor frenzy, founders and early investors inevitably get the “not invented here” bug, or the “we are obviously doing it right” bug. But smart directors swat away cocky bugs of success until the company reaches the profit phase and, of course, the ROI phase. They also keep a keen eye on competitors and even tiny startups to see if someone has come up with a startling new way to improve service, boost revenue or reduce expenses.

What’s new in cloud technology?
“What’s New” is a tectonic shift in technology from centralized, data center storage to distributed peer storage. It’s a dramatic architectural enhancement that I call Ellery’s Reverse Distributed Data cloud [RDDC]. While I can’t take the credit for all that is about to unfold, I was first to propose it three years ago. This past August, I blogged about the concept at AWildDuck.

RDDC changes dynamics of everything that matters in storage: cost, security and speed and even environmental impact – all in the right direction. As each user adds inexpensive storage to their own home or business network (the same drives that they previously used to store their working data or backups), a central “traffic cop” uses this worldwide, massively redundant, distributed storage network as if it were a “RAID-10,000” drive array. The Result: As long as 33% of users don’t turn off their storage devices at the same time, everyone’s data is available instantly, securely and without risk of errors or hacks.

Incredible? You Bet! Want more? Of course!
Consider the return data throughput. That’s the rate at which downloads from these many different storage drives arrive into your PC when restoring a backup or even when using a global cloud array as your main drive. You might think that spreading your data, bytewise across lots of slow uplinks would result in data recovery at a snail’s pace. You would be wrong. Even the programmers who understand the math are astounded at the RDT. Even if many drives in your personal cloud are heavily fragmented or poke along at the 3rd tier connection speed of a rural carrier, incoming throughput sizzles at blistering, heart-pounding speed. Why? Because inbound data is staged in the cloud as a torrent from a massively parallel cluster – and not as a serial stream from one peer.

There’s more. While all of this is happening the uplink channel is not idle. Your global cloud array dispatches data around the world with predictive caching, based on new research into the distribution of media across disparate platforms.

Should I Care?
While the architecture of remote storage may seem a geeky detail, the fallout is a litany of benefits to users and a massive windfall for the first provider’s to get with the program. They will enjoy a 90% reduction in operational expenses, while customers experience a blistering bump in speed and meaningful intangibles like fault tolerance associated with massive redundancy.

What vendors are rolling out this new technology?
Symform is already offering RDDC. SpaceMonkey has not yet announced, but it’s two founders in Salt Lake City (both from EMC) have an even more compelling model. They’re lining up investors now. They get it and the angels are starting to take notice!

These tiny startups and a few others have a big edge on their well-funded brethren, because they are already on top of RDDC. If the challenge is not rapidly met by Dropbox and SugarSync, the new kids will sweep the market.

What’s the risk to the established players? Will they catch up?
Cloud computing for the masses is rapidly becoming a crowded market. Massive consolidation will come in a year. Only a few companies will be left standing. Most of the names entering the market today, and even some established brands won’t survive nor even be acquired. They’ll just die. A few fortunate startups will cash out, because of their early implementation of RDDC. My bet is with cloud providers that move quickly into massively distributed data clouds. They will be healthy and profitable. If Dropbox gets it and moves quickly to seize the day, they will very likely come out on top.

Drew Houston: In the catbird seat, but for how long?

Does Drew know about RDDC?
He might. More likely, he considered it briefly and then dismissed it. Even a bright individual can overlook an elegant solution to an unrecognized problem. (i.e. reducing expenses dramatically while boosting data security).

It’s a safe bet that Carbonite and Mozy can’t implement RDDC in time to save their hides. One is too narrowly focused on marketing themselves as a backup service and the other is married to data centers that they own.

Perhaps Dropbox “gets it” and needs no input from their biggest fan. But perhaps – just perhaps mind you – they have yet to design a fully holographic RAID-10K algorithm. Perhaps they have not yet optimized predictive caching for peer distributed networks. Perhaps they are not equipped to quickly build a torrent reacquisition mechanism on the fly and activate it safely across thousands of peers with disparate upload and download speeds, while each user powers down storage media every day without notice.

What’s the ‘R’ stand for in “RDDC”?
It stands for “Reverse”. This teaser lacks an explanation by design. If Drew or his deputies at Dropbox contact me, I wish to give them an edge. It’s one of the few aspects of an ideal architecture model that has not yet been exploited by any startup.

If Dropbox knows about RDDC, what is the purpose of this blog?
Finally an easy question! Drew Houston may or may not be contemplating a Dropbox implementation of RDDC. But even if he is shoe-horning it into his ops plan right now, the purpose of this Blog is to get his attention. Dropbox understands the business of cloud computing. Yours truly understands the seismic benefits of Reverse Distributed Data Clouds and has the business and engineering experience to jump start a rapidly growing market leader. Your humble editor is itching to help a cloud sync startup beat Apple, Google, EMC and Amazon and dominate the market before the average Joe adopts RDDC from your daddy’s generation.

Tech & investment communities know Ellery by another name
I have never kept it a secret that Ellery is a pen name. I use it here at AWildDuck and for articles that I freelance to Google, c|net, Engadget, Yahoo & Amazon. My general vitae is posted to this blog and of course, Drew Houston will get all of my contact info.

Got your ears on, Drew? I get it. Years ago, I created the blueprint. I tested architectural dynamics before your competitors got off the ground. Together, we can dramatically reduce costs while creating the most robust swarm on earth. Together, we can sew up a new paradigm before others learn to tie their shoes. Reach to me, Drew. I’ll give 5 hours to your favorite cause for 5 minutes of your time. Nothing to lose and either way, you gain! Your move.

* To be fair, Drew admits that Jobs is his idol and a scion of high tech entrepreneurship!