Hi, I build Apache Spark on a freebsd cluster, and sometimes i have a problem with SIGSEGV [INFO] --- build-helper-maven-plugin:3.2.0:add-source (add-sources) @ spark-catalyst_2.12 --- [INFO] Source directory: /wrkdirs/usr/ports/devel/spark/work/spark-3.3.4/sql/catalyst/src/main/scala-2.12 added. [INFO] [INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ spark-catalyst_2.12 --- [INFO] [INFO] --- maven-resources-plugin:2.7:resources (default-resources) @ spark-catalyst_2.12 --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] Copying 3 resources [INFO] [INFO] --- maven-compiler-plugin:3.8.1:compile (default-compile) @ spark-catalyst_2.12 --- [INFO] Not compiling main sources [INFO] [INFO] --- scala-maven-plugin:4.4.0:compile (scala-compile-first) @ spark-catalyst_2.12 --- [INFO] Using incremental compilation using Mixed compile order [INFO] Compiler bridge file: /wrkdirs/usr/ports/devel/spark/work/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.3.5-bin_2.12.15__52.0-1.3.5_20200330T000931.jar [INFO] compiler plugin: BasicArtifact(com.github.ghik,silencer-plugin_2.12.15,1.7.6,null) [INFO] Compiling 387 Scala sources and 164 Java sources to /wrkdirs/usr/ports/devel/spark/work/spark-3.3.4/sql/catalyst/target/scala-2.12/classes ... An irrecoverable stack overflow has occurred. # # A fatal error has been detected by the Java Runtime Environment: # # SIGSEGV (0xb) at pc=0x000005d27dfa3820, pid=60639, tid=0x000000000007c227 # # JRE version: OpenJDK Runtime Environment (8.0_482-b08) (build 1.8.0_482-b08) # Java VM: OpenJDK 64-Bit Server VM (25.482-b08 mixed mode bsd-amd64 compressed oops) # Problematic frame: # J 183336 C1 scala.reflect.api.Trees$Transformer.treeCopy()Lscala/reflect/api/Trees$TreeCopierOps; (5 bytes) @ 0x000005d27dfa3820 [0x000005d27dfa37e0+0x40] # # Core dump written. Default location: /wrkdirs/usr/ports/devel/spark/work/spark-3.3.4/java.core # # An error report file with more information is saved as: # /wrkdirs/usr/ports/devel/spark/work/spark-3.3.4/hs_err_pid60639.log # # If you would like to submit a bug report, please visit: # https://bugs.freebsd.org/bugzilla/enter_bug.cgi?product=Ports%20%26%20Packages&component=Individual%20Port(s)&short_desc=java/openjdk8%3A%20 # Abort trap (core dumped) *** Error code 134
On April 8th, I made a change such that devel/spark is now compiled with openjdk17. (ports ea9b758b76fda040a56a4d48a161804c22b39214) Openjdk17 has a similar error/crash on amd64 as openjdk8. This can be seen at: https://portsfallout.com/fallout?port=devel%2Fspark%24 . On aarch64 it compiles fine. And I think on openjdk11 it also builds fine on both architectures. Could you check this on your systems?
(In reply to Ronald Klop from comment #1) FreeBSD 15.0 amd64 # # A fatal error has been detected by the Java Runtime Environment: # # SIGSEGV (0xb) at pc=0x000018fc8788a100, pid=95673, tid=810289 # # JRE version: OpenJDK Runtime Environment (17.0.18+8) (build 17.0.18+8-1) # Java VM: OpenJDK 64-Bit Server VM (17.0.18+8-1, mixed mode, sharing, tiered, compressed oops, compressed class ptrs, g1 gc, bsd-amd64) # Problematic frame: # J 199868 c2 scala.tools.nsc.transform.TypingTransformers$TypingTransformer.transform(Lscala/reflect/internal/Trees$Tree;)Lscala/reflect/internal/Trees$Tree; (99 bytes) @ 0x000018fc8788a100 [0x000018fc8788a0e0+0x0000000000000020] # # No core dump will be written. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again # # An error report file with more information is saved as: # /home/maxfx/Documents/FreeBSD-Ports/spark/work/spark-3.3.4/hs_err_pid95673.log # # If you would like to submit a bug report, please visit: # https://bugs.freebsd.org/bugzilla/enter_bug.cgi?product=Ports%20%26%20Packages&component=Individual%20Port(s)&short_desc=java/openjdk17%3A%20 # Abort trap *** Error code 134 Stop. make: stopped making "all" in /home/maxfx/Documents/FreeBSD-Ports/spark
(In reply to Martin Filla from comment #2) Can you modify "JAVA_VERSION= 11" in the Makefile of the port and build again?
(In reply to Ronald Klop from comment #3) Hi, "JAVA_VERSION= 11" is ok without a crash.