hugocorreia90

3 ms·

1. 1.▲
   by hugocorreia90 5mo ago

   First time I heard about Rocky Linux distribution. Thank you for the heads up.
2. 2.▲
   by hugocorreia90 5mo ago

   Yes, I can see you're a bit late indeed. Several replies ago I have already acknowledged that I used LLM for the initial post and initial replies. I use AI everyday, for different purposes, fixing my English when I feel I need, brainst
3. 3.▲
   by hugocorreia90 5mo ago

   I hadn't come across Bauplan or your work before today's thread. Looks like a few of us are landing on branches/replay/lineage from different angles (like yours Iceberg-native, mine warehouse-delegated). I will spend pro
4. 4.▲
   by hugocorreia90 5mo ago

   Hey jtagliabuetooso! Rocky is SQL-first instead of Python-first, and that was a deliberate scope choice. Also, Rocky acts as control plane that delegates compute to the warehouse (Databricks, etc) rather than owning the runtime. I don&#x27
5. 5.▲
   by hugocorreia90 5mo ago

   Hey jtagliabuetooso! Absolutely, the idea isn't new. Rocky's bet is on the shipped implementation. I'll read your paper, thank you for sharing.
6. 6.▲
   by hugocorreia90 5mo ago

   Love your pet names and how you characterize them if you would name something after them :) Wiley is an interesting name! I have another side-project, still private, which I named Shimi, my current dog's name. I'd thought naming m
7. 7.▲
   by hugocorreia90 5mo ago

   Make sense. Reviewing the README is on my TODO list. Thanks for the heads up!
8. 8.▲
   by hugocorreia90 5mo ago

   Oh yeah, good call.
9. 9.▲
   by hugocorreia90 5mo ago

   Accepted! :)
10. 10.▲
    by hugocorreia90 5mo ago

    Hey Xiaoher-C! Hum, I don't have a lineage diff command yet. As of now, I can make a small lift to wire up together two commands that already exist: "rocky ci --diff --base main" which runs a diff between main and HEAD, and
11. 11.▲
    by hugocorreia90 5mo ago

    Thank you!
12. 12.▲
    by hugocorreia90 5mo ago

    I truly appreciate your feedback and it's definitely a lesson learned for me. As I said to cmrdporcupine, "The only reason for passing my replies through AI was just because it's my first time posting here and opening a side-
13. 13.▲
    by hugocorreia90 5mo ago

    Hey Anders! Thanks a lot for dropping a comment and show interest in Rocky. Yes! I won't going to lie that Jinja is one of the things that gives me some itches :). But it wasn't the major reason for start building Rocky though. It
14. 14.▲
    by hugocorreia90 5mo ago

    I totally acknowledge that. The only reason for passing my replies through AI was just because it's my first time posting here and opening a side-project of mine publicly. All the engine architecture decisions are mine though and this
15. 15.▲
    by hugocorreia90 5mo ago

    Thanks Peter. All my side-projects are named after my pets. I had a dog named Rocky and given this project is also an underdog competing with well-established tools such as dbt and sqlmesh, I decided to keep Rocky when opening it to public.
16. 16.▲
    by hugocorreia90 5mo ago

    Fair. I just use it for tidying up my replies as I'm not a native English speaker.
17. 17.▲
    by hugocorreia90 5mo ago

    Thanks for the careful read. The "what breaks if I rename this column" question is exactly what column lineage from the compiler is meant to answer, and you said it better than I did in the post. On the schema-grounded AI angle: a
18. 18.▲
    by hugocorreia90 5mo ago

    Thanks. On model versioning — what's the use case you have in mind? A few options that map to different designs: - dbt-style semantic-layer versions (v1/v2 of a model) - schema migration history - branch-based (Rocky already has b
19. 19.▲
    by hugocorreia90 5mo ago

    Fair point. Databricks owns a scheduling DAG (Workflows, DLT). What I meant by "owns the DAG" is the semantic DAG: model-to-model dependencies with column-level types that the compiler builds. Workflows knows task A runs before ta
20. 20.▲
    by hugocorreia90 5mo ago

    Yeah, fair pushback, and yes the intro was AI-assisted. Marketing is not my strength nor I am a native english speaker. I built this in about a month with heavy LLM tooling and the seed comment is part of that. I'm not going to pretend
21. 21.▲
    Show HN: Rocky – Rust SQL engine with branches, replay, column lineage(github.com)

    122 points by hugocorreia90 5mo ago|48 comments