After building Apache Spark, the installation step of copying the Hive JAR files fails. ``` ===> Installing for apache-spark-3.3.0 ===> Checking if apache-spark is already installed ===> Registering installation for apache-spark-3.3.0 pkg-static: Unable to access file /usr/ports/devel/spark/work/stage/usr/local/share/spark/jars/hive-beeline-2.3.10.jar:No such file or directory pkg-static: Unable to access file /usr/ports/devel/spark/work/stage/usr/local/share/spark/jars/hive-cli-2.3.10.jar:No such file or directory pkg-static: Unable to access file /usr/ports/devel/spark/work/stage/usr/local/share/spark/jars/hive-common-2.3.10.jar:No such file or directory pkg-static: Unable to access file /usr/ports/devel/spark/work/stage/usr/local/share/spark/jars/hive-exec-2.3.10-core.jar:No such file or directory pkg-static: Unable to access file /usr/ports/devel/spark/work/stage/usr/local/share/spark/jars/hive-jdbc-2.3.10.jar:No such file or directory pkg-static: Unable to access file /usr/ports/devel/spark/work/stage/usr/local/share/spark/jars/hive-llap-common-2.3.10.jar:No such file or directory pkg-static: Unable to access file /usr/ports/devel/spark/work/stage/usr/local/share/spark/jars/hive-metastore-2.3.10.jar:No such file or directory pkg-static: Unable to access file /usr/ports/devel/spark/work/stage/usr/local/share/spark/jars/hive-serde-2.3.10.jar:No such file or directory pkg-static: Unable to access file /usr/ports/devel/spark/work/stage/usr/local/share/spark/jars/hive-shims-0.23-2.3.10.jar:No such file or directory pkg-static: Unable to access file /usr/ports/devel/spark/work/stage/usr/local/share/spark/jars/hive-shims-2.3.10.jar:No such file or directory pkg-static: Unable to access file /usr/ports/devel/spark/work/stage/usr/local/share/spark/jars/hive-shims-common-2.3.10.jar:No such file or directory pkg-static: Unable to access file /usr/ports/devel/spark/work/stage/usr/local/share/spark/jars/hive-shims-scheduler-2.3.10.jar:No such file or directory pkg-static: Unable to access file /usr/ports/devel/spark/work/stage/usr/local/share/spark/jars/hive-vector-code-gen-2.3.10.jar:No such file or directory *** Error code 1 ``` Notice the "2.3.10" version number in the file names. Listing that "jars" work directory reveals that those JAR files do exist, but with the "2.3.9" version number. So, it appears that the Hive JAR files require Python 3.9. Any other Python version (e.g. 3.10 in my case) causes this installation error. Besides that, the building of Apache Spark did complete successfully. ``` ls /usr/ports/devel/spark/work/stage/usr/local/share/spark/jars **SHORTENED FOR BREVITIY** hadoop-yarn-server-web-proxy-3.3.4.jar HikariCP-2.5.1.jar hive-beeline-2.3.9.jar hive-cli-2.3.9.jar hive-common-2.3.9.jar hive-exec-2.3.9-core.jar hive-jdbc-2.3.9.jar hive-llap-common-2.3.9.jar hive-metastore-2.3.9.jar hive-serde-2.3.9.jar hive-service-rpc-3.1.2.jar hive-shims-0.23-2.3.9.jar hive-shims-2.3.9.jar hive-shims-common-2.3.9.jar hive-shims-scheduler-2.3.9.jar hive-storage-api-2.7.2.jar hive-vector-code-gen-2.3.9.jar hk2-api-2.6.1.jar ```
(In reply to Brett from comment #0) It's known issue, check patch for PR: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=280325 Also update to 3.3.4 (last release in 3.3 branch).
A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/ports/commit/?id=8cce17a44cdc4117d905021999f30dc6da7ec9f8 commit 8cce17a44cdc4117d905021999f30dc6da7ec9f8 Author: Vladimir Druzenko <vvd@FreeBSD.org> AuthorDate: 2024-07-17 20:13:35 +0000 Commit: Vladimir Druzenko <vvd@FreeBSD.org> CommitDate: 2024-07-17 20:13:35 +0000 devel/spark: update 3.3.0 → 3.3.4 Release notes: https://spark.apache.org/releases/spark-release-3-3-1.html https://spark.apache.org/releases/spark-release-3-3-2.html https://spark.apache.org/releases/spark-release-3-3-3.html https://spark.apache.org/releases/spark-release-3-3-4.html Also fix build - pkg-plist. PR: 280325 280333 Approved by: Martin Filla <freebsd@sysctl.cz> (maintainer) MFH: 2024Q3 devel/spark/Makefile | 8 +++---- devel/spark/distinfo | 10 ++++----- devel/spark/pkg-plist | 60 +++++++++++++++++++++++++-------------------------- 3 files changed, 39 insertions(+), 39 deletions(-)
A commit in branch 2024Q3 references this bug: URL: https://cgit.FreeBSD.org/ports/commit/?id=714e66d5b3b2228843c69ea2c0b8ec25d9653bce commit 714e66d5b3b2228843c69ea2c0b8ec25d9653bce Author: Vladimir Druzenko <vvd@FreeBSD.org> AuthorDate: 2024-07-17 20:13:35 +0000 Commit: Vladimir Druzenko <vvd@FreeBSD.org> CommitDate: 2024-07-17 20:22:22 +0000 devel/spark: update 3.3.0 → 3.3.4 Release notes: https://spark.apache.org/releases/spark-release-3-3-1.html https://spark.apache.org/releases/spark-release-3-3-2.html https://spark.apache.org/releases/spark-release-3-3-3.html https://spark.apache.org/releases/spark-release-3-3-4.html Also fix build - pkg-plist. PR: 280325 280333 Approved by: Martin Filla <freebsd@sysctl.cz> (maintainer) MFH: 2024Q3 (cherry picked from commit 8cce17a44cdc4117d905021999f30dc6da7ec9f8) devel/spark/Makefile | 8 +++---- devel/spark/distinfo | 10 ++++----- devel/spark/pkg-plist | 60 +++++++++++++++++++++++++-------------------------- 3 files changed, 39 insertions(+), 39 deletions(-)