Repository navigation
chore(bigframes): Add substrait based datafusion, acero backends - #17215
TrevorBergeron wants to merge 29 commits into
Conversation
There was a problem hiding this comment.
Code Review
This pull request introduces a Substrait compilation and execution framework for BigFrames, featuring a compiler that translates logical plans into Substrait format and an executor that utilizes Apache DataFusion for local execution. The implementation handles various relational operations such as joins, aggregations, and window functions, and includes a testing suite with a dedicated test session. Review feedback focuses on enhancing code quality by addressing a potential NameError, removing debug print and stderr statements, replacing hardcoded magic numbers with existing mappings, and optimizing import placement for better performance.
e34b4ab to
0928351
Compare
aba16ab to
4a882f4
Compare
4aef53c to
81ade4d
Compare
|
I'm going to close this PR due to no activity in the last 2 months. Please feel free to re-open this PR or create a new PR. |
Thank you for opening a Pull Request! Before submitting your PR, there are a few things you can do to make sure it goes smoothly:
Fixes #<issue_number_goes_here> 🦕