Bug 220866 - ports-mgmt/portscout: Implement CPAN SiteHandler
Summary: ports-mgmt/portscout: Implement CPAN SiteHandler
Status: Open
Alias: None
Product: Ports & Packages
Classification: Unclassified
Component: Individual Port(s) (show other bugs)
Version: Latest
Hardware: Any Any
: --- Affects Some People
Assignee: Kubilay Kocak
Keywords: feature, needs-patch, needs-qa, performance
Depends on:
Reported: 2017-07-19 20:58 UTC by Andrej Zverev
Modified: 2017-08-27 01:46 UTC (History)
0 users

See Also:
bugzilla: maintainer-feedback? (koobs)

Patch for CPAN SiteHandler (11.15 KB, patch)
2017-07-19 20:58 UTC, Andrej Zverev
no flags Details | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Andrej Zverev freebsd_committer 2017-07-19 20:58:23 UTC
Created attachment 184516 [details]
Patch for CPAN SiteHandler

I would like to introduce new CPAN SiteHandler. That will allow dramatically speedup process of checking p5-ports which are hosted on CPAN and mirrors.

To activate this handler you need:
1. http://www.cpan.org/modules/02packages.details.txt into tmpdir (tmpdir declared inside portscout.conf).
2. Create cron task to re-download 02packages.details.txt on daily basis.

- Add CPAN SiteHander
Comment 1 Andrej Zverev freebsd_committer 2017-08-02 05:35:39 UTC
Any news or i'll commit by timeout.
Comment 2 Kubilay Kocak freebsd_committer freebsd_triage 2017-08-02 05:42:22 UTC
(In reply to Andrej Zverev from comment #1)

Thank you for submitting this Andrej. I'll be reviewing this but haven't had time in the past week. I should have at least ack'd, apologies for that.

Can you detail what testing this has been through, and provide (as an attachment) a log of this site handler in use in debug mode if possible please.

I note also that Portroach (OpenBSD's fork) has a CPAN handler [1]. Is this the same or based on that? I'd like to keep differences to a minimum, particularly for generic stuff.

[1] https://github.com/jasperla/portroach/blob/master/Portroach/SiteHandler/CPAN.pm
Comment 3 Kubilay Kocak freebsd_committer freebsd_triage 2017-08-02 05:49:31 UTC
In particular if the Portroach site handler doesn't require (I havent looked yet) fetching a list at regular intervals and a cron job, or instead uses a public API, that is also preferable
Comment 4 Andrej Zverev freebsd_committer 2017-08-02 19:21:55 UTC
(In reply to Kubilay Kocak from comment #2)

Hm, i never saw OpenBSD's implementations. My main goal was speed up and solve one issue then modules don't have path and laying inside author/id directory, so then author is changed portscout unable to find new version.
As I can see OpenBSD using API for looking, well, if API don't have limitation by requests it not so bad.

I'll look deeper into, so timeout :-)