Bug 293411 - freefall: no pigz or pbzip2 installed
Summary: freefall: no pigz or pbzip2 installed
Status: New
Alias: None
Product: Services
Classification: Unclassified
Component: Core Infrastructure (show other bugs)
Version: unspecified
Hardware: Any Any
: --- Affects Only Me
Assignee: Cluster Admin
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2026-02-24 11:45 UTC by Bruce M Simpson
Modified: 2026-03-03 21:53 UTC (History)
2 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Bruce M Simpson freebsd_committer freebsd_triage 2026-02-24 11:45:00 UTC
I had a need to recompress some files the other day, while privately mirroring them to/from my reinstated cluster account. 

Despite hw.ncpus > 1 for many years now, we don't appear to have parallel versions of bzip2 and gzip installed.

Whether or not bsdtar/libarchive support their use is another matter, though.
Comment 1 Ryan Steinmetz freebsd_committer freebsd_triage 2026-02-25 00:26:28 UTC
Given that this is a shared jail on a host with multiple other jails, we would probably want to lean towards not encouraging a ton of parallelization for compression unless absolutely necessary.

Is your archival process something that would be able to handle using the builtin single-threaded tools for the time being?

We are discussing migrating freefall to new hardware; however, are not quite there yet.
Comment 2 Bruce M Simpson freebsd_committer freebsd_triage 2026-02-25 01:25:19 UTC
They were just one-offs, I'm not doing it that regularly, so no interruption to other users likely. Happy to close if EWONTFIX.

Most specifically, I'm trying to fetch SONiC images from Azure CI for whitebox switches, which are ~1GB a pop, and this is problematic in the extreme to do over 4G LTE, where I am in semi-rural Scotland, because sporadic failures were happening with and without SOCKS5 and WireGuard in the mix, and Azure CI does not support HTTP range fetches (resumable downloads)

So I'd cache them on the cluster, and they are most likely compressed already anyway (Arista aboot compatible .swi images just use the zip file format).
Comment 3 Daniel Engberg freebsd_committer freebsd_triage 2026-03-03 21:53:14 UTC
...or you could move on and use either zstd or xz which both do and performs in most cases if not all better?