Posted tagged ‘Tomcat’

Building cheap cloud storage – the Backblaze way!

29/04/2010

image

I recently read this article written by cloud backup service provider Backblaze on how to build  a cheap cloud storage device – 67 TB of storage for under 8000 USD to be exact.

Backblaze provides unlimited backups to individuals for a mere 5 USD/month, and it is really interesting to read about how they are coping with the demand.

I am going to make a brief summary of the most interesting parts of their  article.

image
Use of cheap RAID controllers
It’s interesting that they don’t use expensive hardware RAID controllers – their “Syba SD-SA2PEX-2IR” controllers cost only 35 dollars a piece, and leave the CPU to handle the job of maintaining RAID functions. This is ingenious in cloud storage, because the cost of a good CPU is far less than four or more full-featured hardware RAID controllers. (They use a Intel Core 2 in their rig, but since the post is a few months old a Core i5/i7 would probably be a better choice today.)

image
RAID structure
Using 45 drives in each server, Backblaze chooses to divide these drives into three RAID6 volumes of 15 drives each. This gives every volume  resistance against two disk failures, or a total of six drive failures in a best-case  scenario. (Two failing drives per volume.) The interesting part here is the “threshold” for maximum number of disks in a RAID6 volume, as estimated by Backblaze. With every new disk added, the likelihood of two drive failures in quick succession increases.

image
Tomcat backbone for communication
I mostly put this in to further dispel the idea that Java is “slow”. This is a great choice of platform, which must have lowered development costs considerably over an alternative implementation. (Such as modifying Apache, or writing a custom daemon to handle the communication.)

Encrypted communication
I am still a bit puzzled at this. I guess the encryption is supposed to protect against snooping on their internal network, but the data is encrypted on end users personal computers before upload, so this measure seems a bit unnecessary, especially with the added CPU usage. I’d be glad to hear some other ideas on this, so if you know, leave a comment!

JFS File system
JFS is a stable file system with low CPU utilization and great performance when looking for files. Read this in-depth file system benchmark for more information.

And that’s all. If you have any questions or other ideas, don’t hesitate to leave a comment!

3D Realms shuts down – millions of Duke fans weep

08/05/2009

Duke – Smug as always,
unaware of his fate.

Update 1: There’s great coverage on the history of Duke Nukem: Forever here, a fantastic read.
Update 2:
An insider story about the life and death of Duke Nukem: Forever, check it out!

It felt almost unreal reading this article and realizing that Duke Nukem Forever might actually never be released. This holy grail of vaporware has been in the making for over twelve years, which in perspective is more than half my current life length! The game has gone through a number of 3D-engine changes and a cascade of other issues.

I was one of the people that always believed. I believed when the game first became notorious for its long release cycle back around the millennium shift. I even discussed DN: Forever with Per just a week ago or so, where he proclaimed that the game would never be released, following Broussard bold claims that DN:Forever would hit the shelves this very year.

Now it sadly looks like he was right.

To be perfectly honest I shouldn’t even be sad over this, I rarely play games nowadays, even though I have fond memories of the series, especially DN: Land Of The Babes which kept me company for what probably was an entire summer vacation. But this was one of those games – the ones that you just had to at least try because of the hype. If it was a great game or a disappointment came in second.

Take-Two still holds the rights to the Duke Nukem franchise, but has declined to make a comment on the situation. Who knows, maybe they’ll continue development and actually release it, although the chances are slim. But I’ll never stop believing… R.I.P for now, Duke.

The game back in 2001, when it looked almost finished, and still cool by todays standards according to me.

In other news…
tomcat

Rawr!

I’ve finally started to teach myself Apache Tomcat – a fascinating (albeit sometimes confusing)  implementation of Java for the web. If you’re a Java programmer and wish to develop dynamic applications for the web, this is where to start!