Published on [Permalink]
Reading time: 2 minutes

SimpleDB

While I still haven’t had time to play around with Amazon’s S3 and EC2, they’ve added yet another offering with SimpleDB.

Amazon SimpleDB makes it really easy and straightforward to store and to retrieve structured data. You no longer need to worry about creating, maintaining, or migrating database schemas, monitoring and tuning the performance of your queries, outgrowing the storage or processing capacity of your database server, making backups, or replicating data.

This offering removes one more barrier to scaling software. Dave Winer comments that Amazon is becoming the place for developers to work with in order to scale their products.

Their move makes many things possible. As I said earlier, if it existed when we had to scale weblogs.com, we would certainly have used it. One could build an open identity system on it, probably in an afternoon, it would be perfect for that. A Twitter-like messaging system, again, would be easy. It's amazing that Microsoft and Google are sitting by and letting Amazon take all this ground in developer-land without even a hint of a response. It seems likely they have something in the works. Let's hope there's some compatibility.

I’ve thought about using the systems for record indexing and some of the more intensive processes that libraries wouldn’t necessarily have the hardware investment for.

Inside looking out has a nice short breakdown including that it may be written in erlang. Marcelo looked at the API and thinks it’s really a directory service and that search might be the killer use:

Imagine that Redfin is not a gazillion-dollar VC-backed startup. They are just getting started and want to index all listings from MLS to do a kind of search that you cannot do directly to the MLS database. They can put all that data into SimpleDB (the flexible schema is a huge plus) and not have to worry about having Terabytes of data on their own database. Do you know how much it costs in time and money to maintain a Terabyte database? A lot. There is backup, there is perf issues, there is hardware redundancy, etc.

There’s also a breakdown on prices and comparison with the other services on O’reilly radar.

I’ve seen various projects for using S3 as the storage backend for databases like mysql. It will be interesting to see what projects come out for SimpleDB.