from Hacker News

Building Out the SeatGeek Data Pipeline

by dallasgutauckis on 1/23/15, 5:44 PM with 7 comments

• by dpods13 on 1/23/15, 6:26 PM

  We've been using Redshift + Looker a lot lately at my company and it's been great. We've also added DynamoDb to our pipeline so that we're about to move data from DynamoDb -> Redshift -> Looker for running reports and analytics on NoSQL data

• by willcodeforfoo on 1/23/15, 6:30 PM

  I've been interested in these database query frontend services/apps for ahwile (e.g., Looker, periscope, chartio) but every single one of them has only a Free Trial and no mention of pricing anywhere on their sites–-which makes me think its a multi-thousand dollar/month investment.

  Is this true? If so, is there anything a little more cost-effective for running, visualizing, and saving database queries?

• by maslam on 1/23/15, 7:04 PM

  This is similar to our[1] pipeline. We love Luigi for what it brings to the table for building ETL pipelines.

  [1] Appuri (www.appuri.com)

• by pythondan on 1/23/15, 6:00 PM

  Do most people use Redshift for this sort of thing? Is that the best option out there?