from Hacker News

We spoke to Great Expectations about the library's DX [video]

by vector_spaces on 1/9/25, 7:15 PM with 1 comments

• by vector_spaces on 1/9/25, 7:15 PM

  I work for Sparkfish, a data and analytics consultancy serving private equity. Like many folks here, we've struggled with the difficult learning curve of the GX library and the deprioritization of the open source library vs the paid SaaS product, and we griped about it publicly in various forums and on GH issues. Mainly we've struggled with the steep learning curve, obtuse APIs, lack of sensible defaults, and dated documentation.

  It's a great library and surprisingly one of few truly focused on data quality in the Python data ecosystem, but it's a but like matplotlib -- most people who are using it are using it because it's the largest among a handful of options, not because we love it

  A few months ago after reading our complaints, Abe Gong, the original developer of the library and founder of the company around it, reached out to us to schedule a call. He was generous with his time and resources and very graciously listened to our feedback -- this is the conversation we had.

  Hopefully we captured broader concerns -- let us know if we missed anything important that you would have mentioned