CrapFlingingMonkey.com
Coding to the beat, yo

Dec/09

10

S3 At A Real-world Company

Let’s face it, most bigger companies nowdays are afraid of trying something new.  That happens with good reason — most new ideas tend to fall by the wayside, as trends normally do, and companies like to play it as safe as possible.  I see new ideas and frameworks popping up all over the Twittersphere every day, and I wouldn’t consider using any of them in a production environment.

Amazon Web Services Isn’t Just a Pie-In-The-Sky

The reason I bring this up is this — Amazon Web Services in the business (not startup) world is *still* considered a new, unproven technology.  And with all the marketing hype around clouds, infinitely scalable services, etc, etc, I honestly don’t blame them.  It hard to believe a pie-in-the-sky promise.  That’s just the point — AWS is not pie in the sky, and people that think it is need to dig deeper and understand what it is and what it offers.  The fact is that Amazon Web Services has been around since 2002, and has uptime that is most likely better than your data center.  Coincidentally, Amazon also knows this and is trying to eliminate the false perception that IT IS GOOD FOR YOUR COMPANY TO USE IT TOO.  They published this article, along with an updated cost calculator and an Excel spreadsheet to compare your datacenter with using AWS.

Backcountry.com and S3

S3 At Backcountry.com
Ok, so the real reason for this article.  At Backcountry.com, we try hard to stay as close as we can to the bleeding edge, but going into “the cloud” has always received serious backlash.  That is, until recently.  Earlier this month we took advantage of the cloud for the first time in a production environment: by using S3 for our “Jumbo” product images.

First, let me explain the reasons we decided to use S3.  Our webapp tier, consisting of a few boxes, hosts the Interchange e-commerce framework, and also contains all our static content.  The trouble was, the 900×900 images consumed about 100gb disk space, but each box only had less than 20gb left.  That left us with one of two traditional options: put new hard disks in each webapp, or use our NetApp to host the images from a single location.  Neither seemed ideal, since putting in new hard disks would be pricey and could take some time, and we were already short on NetApp space given the current budget.  I had done some side-work using S3, and mentioned it.   Chris Alef was able to push the decision as a great idea and it was agreed to do it.

Flash forward 1 week, and we were ready to go live.  We were able to convert and upload the 900×900 images to S3 over the weekend, and get the UI in place in no-time flat.  We have Akamai hosting edge cache in front of S3, and we had zero problems since launch last month.  I asked our operations team what they thought the bill for the month would be, and they guessed $4,000.  The actual bill?  Under $50.  Granted, Akamai probably took most of the traffic, but that’s still mighty impressive.

There’s so much more we can do with AWS, and I hope this is just the start.  I hope to be able to take advantage of other AWS services such as EC2 and SQS in the future, and I think S3 helped build confidence.  AWS is a service that can be relied on for both startups and established internet businesses alike.

RSS Feed

3 Comments for S3 At A Real-world Company

Tim Hart | December 10, 2009 at 7:44 pm

I am a little confused by your posting-why not use Akamai for everything?
Also does not Amazon has CDN and a cloud?
Looking at the download times and loss of latentcy
Akamai bets the rest hands down.

Author comment by josh | December 11, 2009 at 3:01 pm

Tim, that’s a really good question, and this is where I think Amazon has their game really played out. What this decision came down to was: what can we use to get this out the door the fastest? The answer was S3, because there was already developer competency, so we knew exactly what needed to be done, and total transparency about what the cost was roughly going to be. It’s very inviting to use AWS, so most developers have already messed around with the it, whereas people are less familiar with Akamai technologies.

We actually added Akamai into the mix as an afterthought, mainly to lessen the impact if S3 were to go down (mostly to ease the tensions of Director and Executive level management), and because we were more comfortable with what the cost was going to be (nobody really put the time into digging into the details on estimating traffic).

In regards to using Amazon CloudFront (CDN), we didn’t use it because the comfort from the director/executive level lied with Akamai… it was basically the only way we could “sell it”. My hope is to reduce costs by using something cheaper in the future.

Akamai does beat other CDN hands down, and I’m not arguing that fact. That’s the reason we use them for all other content on our site. We have tried others (LimeLight, are currently using EdgeCast on our ODAT sites like http://www.steepandcheap.com), but we always come back to Akamai just because of their reliability if not anything else.

Ben | December 14, 2009 at 6:11 pm

You aren’t putting me out of work yet, sir.

http://broadcast.oreilly.com/2009/10/your-cloud-needs-a-sys-admin.html

Leave a comment!

<<

>>

Find it!

Theme Design by devolux.org