from Hacker News

Datafuse – Modern Real-Time Data Processing in Rust

by implfuture on 8/5/21, 4:31 AM with 14 comments

• by budabudimir on 8/5/21, 9:52 AM

  Anyone can optimize a database for trivial queries. Would be nice to at least see TPCH results or any other more complex benchmark.

• by themaxdavitt on 8/5/21, 3:14 PM

  I almost mixed this up with Apache Arrow DataFusion for a second: https://github.com/apache/arrow-datafusion

• by gigatexal on 8/5/21, 6:11 AM

  Impressive and bold claims. I wish the team well. But I won’t tinker with it until it’s been jepsen tested and many core features on the roadmap have been finished.

• by caust1c on 8/5/21, 3:10 PM

  Curious what the motivation behind rebuilding it in rust is, versus contributing more to Clickhouse? Obviously memory safety is a big one, but is that the only reason?

  What are the other goals of the project?

  Personally, I'd love to see an easier-to-manage system with replication considered as a first-class feature rather than bolted on at the end.

• by neilsense on 8/5/21, 12:47 PM

  The problem with these queries is that they just aren't realistic in a production system. Over time the queries become more complex, include more edge-cases and cruft, and your main goal is that they complete with accuracy rather than if it was 5s or 50s.

• by threeseed on 8/5/21, 8:43 AM

  Would be good to know the background of this project, team etc.