1 year ago
#66191
Duc Duong
JVM Crash with sun.misc.Unsafe::GetInt when write Spark Dataframe in parquet format (SPARC Solaris)
I am using Spark3.1.1/Hadoop3.2.2 on Solaris 11. When using Spark to write dataframe to Hadoop in parquete format, JVM crashed with SIGBUS error (Java Frame: sun.misc.UnSafe.GetInt). Error happens only when running in Solaris with SPARC 64 bit, not on other platforms such as Centos or Ubuntu. I don't know if there are problems with Spark 3.x on SPARC platform or not? Anybody has any idea? JVM crashed on Spark writing parquet
apache-spark
hadoop
solaris
sparc
jvm-crash
0 Answers
Your Answer