Bug 204310 - devel/spark: Seriously outdated port
Summary: devel/spark: Seriously outdated port
Status: Closed FIXED
Alias: None
Product: Ports & Packages
Classification: Unclassified
Component: Individual Port(s) (show other bugs)
Version: Latest
Hardware: Any Any
: --- Affects Many People
Assignee: Dmitry Sivachenko
URL:
Keywords: needs-patch
Depends on:
Blocks:
 
Reported: 2015-11-05 13:57 UTC by Fernando Herrero Carrón
Modified: 2015-11-17 14:31 UTC (History)
0 users

See Also:
bugzilla: maintainer-feedback? (demon)


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Fernando Herrero Carrón 2015-11-05 13:57:15 UTC
Apache Spark is a very popular Big Data processing engine. The latest release, on 2nd Oct 2015, was 1.5.1, but we still have 1.2.0 in FreeBSD ports. There have been important improvements in between, for instance spark data frames in 1.3.0 (https://spark.apache.org/docs/1.3.0/sql-programming-guide.html#upgrading-from-spark-sql-10-12-to-13).

Besides, the port depends on devel/hadoop2 which is currently 2.7.1, but devel/spark/Makefile explicitly hardcodes 2.4.1 as hadoop version. Maybe we should catch-up with hadoop.

Thank you very much.
Comment 1 Dmitry Sivachenko freebsd_committer freebsd_triage 2015-11-06 15:17:56 UTC
Port was updated.
Comment 2 Fernando Herrero Carrón 2015-11-17 14:31:48 UTC
Thank you very much, Dmitry. Much appreciated!