Bug 245748 - New port: archivers/tar-stream-chunker streams stdin of unknown size as a tar to stdout
Summary: New port: archivers/tar-stream-chunker streams stdin of unknown size as a tar...
Status: Closed FIXED
Alias: None
Product: Ports & Packages
Classification: Unclassified
Component: Individual Port(s) (show other bugs)
Version: Latest
Hardware: Any Any
: --- Affects Only Me
Assignee: Li-Wen Hsu
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2020-04-19 21:33 UTC by Igor Ostapenko
Modified: 2020-07-21 14:36 UTC (History)
1 user (show)

See Also:

Attachments
tar-stream-chunker.diff (2.99 KB, patch)
2020-04-19 21:33 UTC, Igor Ostapenko 		no flags Details | Diff
View All Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Igor Ostapenko freebsd_committer freebsd_triage 2020-04-19 21:33:26 UTC 
Created attachment 213578 [details]
tar-stream-chunker.diff

Splits stdin of unknown size onto chunks of given size and collects such chunk
files as a TAR archive what is written to stdout.

Initial motivation was to use it as a packer of a data stream what pipes it to
https://tarsnap.com for backup purposes, with a requirement of low and more
predictable memory consumption. And the problem solved here is that TAR file
header should specify size of a file, but it's unknown due to the nature of
input data stream.

The following real case could be an example:
$ pg_dump ... | tar_stream_chunker ... | tarsnap -c ... @-
Comment 1 commit-hook freebsd_committer freebsd_triage 2020-07-21 14:36:34 UTC 
A commit references this bug:

Author: lwhsu
Date: Tue Jul 21 14:36:16 UTC 2020
New revision: 542746
URL: https://svnweb.freebsd.org/changeset/ports/542746

Log:
  Add archivers/tar-stream-chunker

  streams stdin of unknown size as a tar to stdout

  PR:		245748
  Submitted by:	Igor Ostapenko <igor.ostapenko@pm.me>

Changes:
  head/archivers/Makefile
  head/archivers/tar-stream-chunker/
  head/archivers/tar-stream-chunker/Makefile
  head/archivers/tar-stream-chunker/distinfo
  head/archivers/tar-stream-chunker/pkg-descr