from Hacker News

Using AWS lambda for cheap S3 content processing

by cleverfoo on 2/22/16, 12:26 PM with 18 comments

  • by jayroh on 2/23/16, 2:44 PM

    This is an excellent write-up and a great use-case for what S3+Lambda can do. As AWS offerings go, I believe Lambda has a tremendous upside and will be growing significantly over the next few years.

    I've been throwing a lot of my own personal resources into building some things on top of both S3 and lambda and have found a few tools that help with it quite a bit. For one - the lambduh project from Russ Matney has been a great resource for abstracting out some of the more common s3->lambda workflow: https://github.com/lambduh/lambduh. On a different note is T.J. Holowaychuk's Apex project: https://medium.com/@tjholowaychuk/introducing-apex-800824ffa...

  • by cleverfoo on 2/22/16, 2:39 PM

    Hi there, author here, happy to answer any questions.

  • by untog on 2/23/16, 5:09 PM

    Off topic, but I'm hoping there are some Lambda-heads in the room. I want to write a system that basically rebroadcasts a message sent over SNS, to different HTTP endpoints. (I don't have control over these endpoints so can't use SNS itself as I can't confirm subscriptions).

    How many HTTP requests can Lambda do concurrently? Is my best approach to fire all these requests inside one worker, or should/could I have it spin up subsequent lambadas whose only function is to run the HTTP request then close? I'm imagining that would be a lot more expensive.

  • by piyushco on 2/23/16, 3:43 PM

    Excellent post. I wanted to generate thumb images for photos uploaded to s3 bucket using aws Lambda, could successfully implement it.

    but found one issue, that many here might not be aware of, S3 bucket and Lambda function should be in same aws region.

    Unfortunately, my s3 bucket is in southeast-ap, and aws lambda is not available in this region. couldn't go live today. will have to copy bucket to another region to use it.

    hope this helps. thanks.

  • by estefan on 2/23/16, 11:41 AM

    One lambda application I really want is a pingdom-style service. Use lambda to ping a web site and send an email if it's offline. Any takers to build this :-)?

  • by aantix on 2/23/16, 3:46 PM

    Still waiting on Ruby support...