Bug 131440 - [feature request] add INDEX.bz2 and checksums to PACKAGESITES
Summary: [feature request] add INDEX.bz2 and checksums to PACKAGESITES
Status: Closed FIXED
Alias: None
Product: Ports & Packages
Classification: Unclassified
Component: Individual Port(s) (show other bugs)
Version: Latest
Hardware: Any Any
: Normal Affects Only Me
Assignee: Port Management Team
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2009-02-06 00:30 UTC by Hannes Hauswedell
Modified: 2009-08-12 09:20 UTC (History)
0 users

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Hannes Hauswedell 2009-02-06 00:30:06 UTC
By adding a bzipped version of the INDEX-file to the PACKAGESITEs, you could reduce traffic for clients fetching the INDEX and of course also for the server distributing it by > 90%!

Having INDEX.bz2.md5 and/or INDEX.bz2.sha256 would also make it much easier to figure out if the INDEX needs to be fetched or not.

I am not sure how the build-process works, but it shouldn't be very difficult to implement...

Thanks for your help!

Fix: 

bzip2 INDEX
md5 INDEX.bz2 > INDEX.bz2.md5
sha256 INDEX.bz2 > INDEX.bz2.sha256

:D
Comment 1 Martin Wilke freebsd_committer freebsd_triage 2009-02-06 22:10:10 UTC
Responsible Changed
From-To: freebsd-ports-bugs->portmgr

portmgr could you please take a look here?
Comment 2 kamikaze 2009-04-21 17:56:39 UTC
I'm just writing to state my interest in this.

I'm working on a binary package maintenance tool, similar
to portupgrade or portmaster, only for binary packages
and not requiring a local copy of the ports tree.

Currently I'm using nc in a Shell script to check age and
size of the index to determine weather I need to re-fetch.

However this fails through an FTP-proxy. In that case the
INDEX is always re-fetched.

This proposal would offer a more reliable and proxy safe
way of checking this.

Regards
Comment 3 kamikaze 2009-04-21 21:30:34 UTC
Just to note my folly, I have just recognized the existence
of the -m parameter to fetch.
That somewhat lessens my problems, however I still find
a checksum more convincing.
Comment 4 Erwin Lansing freebsd_committer freebsd_triage 2009-08-11 18:47:28 UTC
State Changed
From-To: open->analyzed

Added to the scripts on pointyhat and awaiting testing.
Comment 5 dfilter service freebsd_committer freebsd_triage 2009-08-12 09:19:10 UTC
erwin       2009-08-12 08:18:56 UTC

  FreeBSD ports repository

  Modified files:
    Tools/portbuild/scripts dopackages 
  Log:
  Also put bzipped and checksums of INDEX, UPDATING and MOVED on the mirrors
  
  PR:             131440
  Requested by:   Hannes Hauswedell <freebsd@soulrebel.in-berlin.de>
  
  Revision  Changes    Path
  1.51      +5 -0      ports/Tools/portbuild/scripts/dopackages
_______________________________________________
cvs-all@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/cvs-all
To unsubscribe, send any mail to "cvs-all-unsubscribe@freebsd.org"
Comment 6 Erwin Lansing freebsd_committer freebsd_triage 2009-08-12 09:19:12 UTC
State Changed
From-To: analyzed->closed

Committed, thanks!  The bzipped (and checksums) versions of 
INDEX, UPDATING and MOVED will be on the mirrors for all 
future uploads.