Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Instruction Implementation Meta Issue #2

Open
fschueler opened this issue Mar 2, 2016 · 1 comment
Open

Instruction Implementation Meta Issue #2

fschueler opened this issue Mar 2, 2016 · 1 comment

Comments

@fschueler
Copy link

fschueler commented Mar 2, 2016

This issue tracks the status of instructions. Please insert the instruction that you're working on and your name into the table and don't forget to mark it as finished once you're done.

Instruction Assignee Status Comment
TSMMFLInstruction @fschueler
ReblockFLInstruction @fschueler
CSVReblockFLInstruction @fschueler
MatrixScalarFLInstruction @carabolic Should work for all supported scalar operations; test wit MLContext is missing
WriteFLInstruction @fschueler
RandFLInstruction @fschueler
MapmmFLInstruction @carabolic
MapmmChainFLInstruction @carabolic
ArithmeticBinaryFLInstruction @fschueler
MatrixMatrixArithmeticFLInstruction @fschueler
AggregateUnaryFLInstruction @fschueler
Symbol Explanation
completed
🚧 in progress
will/can not be implemented
@carabolic
Copy link
Member

I see a lot of times Spark instructions are manually optimized to use a broadcast/ map-side join. I think this optimization is not needed for Flink. I think we should always use the Flink operator with the best semantics and give the Flink optimizer the enough meta information to find the perfect plan. For instance the matrix multiplication (Mapmm and MapmmChain) could be extended to use Flink's JoinHints.

@fschueler fschueler reopened this May 17, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants