4 ms·

There's still a heap of stuff that doesn't work on Java 9+ (for example, we use Apache Flink which is planning support but isn't there yet). Like Python 2, Java

There's still a heap of stuff that doesn't work on Java 9+ (for example, we use Apache Flink which is planning support but isn't there yet). Like Python 2, Java 8 will stick around at least until there aren't any blockers for getting off it.

EdwardDiego 8y ago
Yep, I'm the same - Spark will be stuck on Java 8 until it is rid of logj12, not sure what log4j1 is doing, but it doesn't work on Java 9 and Spark's Hadoop dependencies are riddled with log4j12. What's nice to see is that that log4j2 team have been helping with the work in the Spark project.
- garblegarble 8y ago
  >not sure what log4j1 is doing If it's the bug I ran into then their code to detect running on a legacy JVM is tripping with the new JVM version numbers and it thinks that it's running under ancient Java 1.x. It's then saved in the org.apache.log4j.helpers.Loader.java1 field. To migrate some code that needs log4j12 to more recent versions of Java I ended up writing a hack that accesses Loader before log4j uses it and manually sets that field to "false"