9 ms·
How is this different than Mobius [1]? [1] https://github.com/Microsoft/Mobius https://github.com/Microsoft/Mobius
by tombert 8y ago
How is this different than Mobius [1]?
[1] https://github.com/Microsoft/Mobius https://github.com/Microsoft/Mobius
- manigandham 8y agoFrom the github repo: https://github.com/dotnet/spark#inspiration-and-special-thanks https://github.com/dotnet/spark#inspiration-and-special-than... >> Mobius: C# and F# language binding and extensions to Apache Spark, a pre-cursor project to .NET for Apache Spark from the same Microsoft group.
- jongalloway2 8y agoHere's my understanding: - Mobius is .NET Framework / Mono based and x-plat isn’t great, .NET for Apache Spark is .NET Core / .NET Standard and built with x-plat as a primary concern - Mobius only targets up to Spark 2.0; while Spark LTS is up to 2.4 now - .NET for Apache Spark is built to take advantage of .NET Core performance improvements, showing big advantages over Python and R bindings, especially when user defined functions are a major factor - .NET for Apache Spark is driven by lessons learned and customer demand, including major big data users inside and outside Microsoft Disclaimer: I know people that worked on this and helped from .NET Foundation side, but the above is my non-official summary from readme's and stuff.