4 ms·
Any resources to get into Spark?
by mywrathacademia 8y ago
Any resources to get into Spark?
- xkgt 8y agoQuite a few out there but the problem is that of fragmentation. There have been too many API changes making following online resources tricky. Having said that, I got great value out of these resources. Make sure you are working on the right version of Spark. https://jaceklaskowski.gitbooks.io/mastering-apache-spark/ https://jaceklaskowski.gitbooks.io/mastering-apache-spark/ https://pages.databricks.com/definitive-guide-spark.html https://pages.databricks.com/definitive-guide-spark.html Databricks cloud workspace (community edition) offers free interactive spark clusters where you can practice or develop your skills https://community.cloud.databricks.com/ https://community.cloud.databricks.com/ If you want a bit of flexibility, you can launch your own cluster using flinktrock and a pair of free tier t2.micro EC2 instances https://github.com/nchammas/flintrock https://github.com/nchammas/flintrock
- mywrathacademia 8y agoHad a quick look, its really useful and both of the tutorials seem thorough. Hopefully it can get someone with zero Machine Learning experience up to speed. I noticed Scala but not Java. I read that Spark was written in Java, can I use Java instead of Scala? Since you seem quite far along, can you quickly explain how Spark is used in DeepLearning/Machine Learning? Is it just a virtual machine?