The Server is the Application

Lately I have been looking into Amazon’s Elastic Compute Cloud offering (EC2). To say this is just a hosting service would be glossing over a fairly radical shift in thinking about how applications are going to be constructed in the future.

How does EC2 work?

When you sign-up for an EC2 account you provide your credit card and agree to pay (by the hour) for the computing resources you use. Computing resources are divided up into “instances” which run in “availability regions”. Each instance is basically a pre-configured Linux image (referred to generically as AMIs) which can be started and stopped on demand. Availability regions map (from what I understand) to geographical regions where servers are located within the network of Amazon data centres.

The images are created through a templating process where you select an existing AMI, start it up, modify the configuration, and then bundle it up to create a new AMI which you can then run up in the future.

Why is EC2 different?

Whilst this sounds similar to standard virtualization techniques where you just have a virtual server which you deploy your application onto, the difference is in how Amazon has exposed the offering to the public.

First of all, there is no groovy server order form, if you want to start up an instance you need to make a series of web-service calls (although they do have some command line tools that wrap these calls). This effectively means that the tool is targeting software developers first.

The second difference is that the instances themselves are stateless. What does that mean in the context of an entire virtualized computer? Well when you start the instance the computer boots, it might change some data on the image, but when you stop that image the data is lost. You might be thinking that this is insane, but it makes perfect sense in a utility computing model – and it encourages you to use Amazons Simple Storage Service (S3) to store your buckets of data.

Some Opening Statements

Organisations that have been using EC2 for a while have no doubt started to hit on some of the challenges and opportunities of this style of computing but for many of us in the enterprise space it is the beginning of a discussion that will force us to question the way that we design and host applications and data.

To start the discussion, I’m going to throw the following statements out there, leave some comments or do track-backs to get the discussion happening:

  1. Applications will use either a continuous snapshot model to maintain state between instance runtimes or not bother with stateful image storage at all and copy down a working copy of data from the cloud each time the instance starts up. If it isn’t backed up – then the data is lost, disaster recovery (or rather disaster tolerance is an application level feature).
  2. Current database server technologies such as MySQL, SQL Server, DB2 and Oracle will need to be redesigned from the ground up to support partitioning of data. Relational databases will need to handle most of the distributed integrity problems and automatically and need to be hosting environment aware.
  3. Every application will run on multiple instances. The minimum number of instances will be those required to hold a redundant copy of the data. The maximum number would be – well there is no maximum – but the things that drive it up would be increased load.
  4. Instances will be aware of their host environment and will be able to request multiple instances as well as make demands about the separation of logical instances across physical hardware nodes (if you have two instances on the same physical hardware node then you have no redundancy).
  5. Development teams will configure entire servers to be rolled out, operations teams will manage the virtualization technology and not care what developers roll out.
  6. Applications will be designed to do rolling upgrades. If you application demands 100 concurrent instances bringing the n + 1 version online will involve running in emulated “n mode” until there are enough upgraded nodes to perform the cut over to “n + 1 mode”.
  7. A standard image format capable of running different platforms is going to be critical for widespread adoption of utility hosting platforms like EC2.

What is the Microsoft/VMware play in this space?

Who knows? The Amazon EC2 technology is based on Xen which I don’t really know a lot about. Xen is a hypervisor-based solution and both Microsoft and VMware have technologies that fit the bill. However the magic seems to be in the packaging.

Amazon rather than locking down their resource allocation console has opened it up to the world and instead of focused on scaling out their data centre to handle load. They they build an API around the outside that allows their customers to provision the boxes. Assuming you could build the same sort of API on top of Windows 2008 Hypervisor (I know you can, it has the underlying APIs to support it) then all you would need to do is focus on the cost of the offering.

Amazon can give you a small instance server for $0.10 per hour. which includes 160GB of storage. I could go out to Server Intellect today and provision the following box for around $1100 per month. This box would be capable of running eight instances with roughly the same specifications (although network traffic wasn’t taken into consideration).

ServerIntellectHosting

Now if I do the calculations, that means the cost price per instance for a month would be about $137.50 dollars. An equivalent Amazon instance would be approximately $73.00 dollars – still quite bit cheaper, but we aren’t really comparing apples and apples here in terms of functionality.

Ahem, availability? Redundancy?

What about redundancy you might say? Good point, although remember that Amazon is stateless so it only needs to have a copy of the base image so you could have an “offline” storage facility for that and then copy it forward to the physical hosts when required.

Anyway – I think it would be interesting to see if the Windows hosting community could get something like this off the ground and come up with the licensing scheme to support it.

Let the discussion begin!

6 thoughts on “The Server is the Application

  1. Pingback: Would you pay $0.38 per hour for Windows Server? « notgartner

  2. Michael Brown

    There’s a company that does windows virtualization and DR (with multiple op centers as well hardware). I believe they’re using VMWare ESx. But these give you the full remote desktop administration. But you can scale it on demand to multiple cores, sockets, or even full machines.

  3. Pingback: concurrent pay

  4. Michael Sheehan

    Mitch,

    This is one of the better articles I have read that clearly articulates the EC2 offering and process. Great job. I’m the Technology Evangelist for GoGrid which is a direct competitor to EC2. Many similarities have been drawn between our cloud infrastructure products, but we diverge quickly. GoGrid offers not only Linux images (Red Hat and CentOS) but also Windows images. This is a huge point of differentiation in the market. GoGrid is also priced based on usage (billed on a GB RAM hour) and we offer free f5 load balancing. Templates for popular installs are included (LAMP, PostgreSQL, mySQL, MS SQL server, etc.) are available as well.

    To address a few of your points above:
    – With the DB options, you don’t have to rearchitect for SimpleDB , you can just use one of the GoGrid DB server templates available.
    – We developed a web GUI for deployment and management of the servers with an API being released shortly
    – Data storage is persistent so you don’t lose configurations, etc.
    – Server Snapshots and Cloning available soon

    I put further comparisons on this blog post and I encourage anyone looking for EC2 alternatives to give it a read.

    To sum up…GoGrid is already there with a Windows Cloud infrastructure. Thanks again Mitch for your good analysis and opportunity to provide some answers (hopefully) to your questions.

    -Michael

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s