Bug 222322
| Summary: | parallel doc build | ||||||
|---|---|---|---|---|---|---|---|
| Product: | Documentation | Reporter: | Wolfram Schneider <wosch> | ||||
| Component: | Books & Articles | Assignee: | Wolfram Schneider <wosch> | ||||
| Status: | Closed FIXED | ||||||
| Severity: | Affects Only Me | CC: | bcr, doceng | ||||
| Priority: | --- | ||||||
| Version: | Latest | ||||||
| Hardware: | Any | ||||||
| OS: | Any | ||||||
| Bug Depends on: | 222186, 222327 | ||||||
| Bug Blocks: | |||||||
| Attachments: |
|
||||||
Hi Wosch, yes, the 20 minutes build time is a problem. We've tried to involve people more knowlegdeable about Make and friends to improve this, but were not successful yet or they had time constraints. Glad to see you managed to improve the build, but a long term solution would be to have this (in a stable version) in the regular doc build. Adding doceng@ so that they can look at integrating this into the doc toolchain. I did the tests on a quad core machine. On an octa-core or dual hexa-core machine you may get a full build done in less than two minutes. However, it cannot be faster than the slowest sub-directory build which is en_US.ISO8859-1 Actually, the perl one-liners in the patch should be replaced with the standard tools sed/tr. Not a big deal, I will do this later. A commit references this bug: Author: wosch Date: Tue Sep 19 10:03:26 UTC 2017 New revision: 50880 URL: https://svnweb.freebsd.org/changeset/doc/50880 Log: Implement workaround for a parallel doc build $ make p-all It works for the sub-directories in a given directory. On a standard quad core machine the build time goes down from ca. 20min to 5 minutes. PR: 222322 Changes: head/share/mk/doc.project.mk A commit references this bug: Author: wosch Date: Tue Sep 19 17:40:06 UTC 2017 New revision: 50887 URL: https://svnweb.freebsd.org/changeset/doc/50887 Log: support parallel clean $ make p-clean PR: 222322 Changes: head/share/mk/doc.project.mk A commit references this bug: Author: wosch Date: Thu Sep 21 10:08:01 UTC 2017 New revision: 50896 URL: https://svnweb.freebsd.org/changeset/doc/50896 Log: support parallel obj $ make p-obj PR: 222322 Changes: head/share/mk/doc.project.mk |
Created attachment 186370 [details] patch Hi, the build in ./doc runs for 20-25minutes. Speeding it up with `make -j`' has no effect. It would be great if we can build the documentation faster. Looking at the makefiles in doc/share/mk this doesn't seems to be an easy task. Also, most sub-directories contains only a single input file which means `make -j' has no effect on a directory level. The workaround could be to run `make -j' for the sub-directories in a given directory. Attached is a simple workaround to run the sub-directories in parallel. It works for the standard target ("all") only. I could run a build in 4 minutes now (down from 20 minutes). I do not recommend this for production, but for test & developing it makes a huge difference. $ make p-all