Bug 224146 - Please increase kern.maxfiles on the package building servers
Summary: Please increase kern.maxfiles on the package building servers
Status: Closed FIXED
Alias: None
Product: Services
Classification: Unclassified
Component: Core Infrastructure (show other bugs)
Version: unspecified
Hardware: Any Any
: --- Affects Only Me
Assignee: Port Management Team
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2017-12-06 17:51 UTC by Yuri Victorovich
Modified: 2018-03-31 05:00 UTC (History)
2 users (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Yuri Victorovich freebsd_committer freebsd_triage 2017-12-06 17:51:29 UTC 
Please have such or similar line in /boot/loader.conf:
> kern.maxfiles="25000"
Or, increase it even higher.

Servers: http://beefy9.nyi.freebsd.org. http://package21.nyi.freebsd.org, etc.

The package devel/RStudio routinely fails in build because it has too many files open at the same time. Please see this sample log: http://package21.nyi.freebsd.org/data/111amd64-default-qat/455493/logs/errors/RStudio-1.1.385.log
Comment 1 Peter Wemm freebsd_committer freebsd_triage 2017-12-06 19:48:13 UTC 
This is a portmgr thing - they adjust those parts of the configuration on the package builders.
Comment 2 Bryan Drewery freebsd_committer freebsd_triage 2017-12-06 21:21:44 UTC 
Poudriere also limits to 1024 max files per process.
Comment 3 Antoine Brodin freebsd_committer freebsd_triage 2017-12-06 21:22:57 UTC 
The 1024 limits is set by poudriere, not on servers and it's for performance reasons.
Comment 4 Yuri Victorovich freebsd_committer freebsd_triage 2017-12-07 01:18:40 UTC 
(In reply to Antoine Brodin from comment #3)

It doesn't fail for me in poudriere though.
Comment 5 Yuri Victorovich freebsd_committer freebsd_triage 2017-12-10 01:01:57 UTC 
Antoine, you are right, on my system MAX_FILES=15000 in poudriere.conf. This is what probably really limited the file number.

Could you please adjust this one to some higher value to see if this corrects the problem with RStudio?
Comment 6 Antoine Brodin freebsd_committer freebsd_triage 2017-12-18 22:05:20 UTC 
Are you sure that there is no file descriptor leak in RStudio?
Comment 7 Yuri Victorovich freebsd_committer freebsd_triage 2017-12-18 22:08:10 UTC 
(In reply to Antoine Brodin from comment #6)

They use external binaries for build, like java toolkit, etc.
There might be a leak, but this doesn't appear likely. It's just a large project, something opens too many files.
Comment 8 Yuri Victorovich freebsd_committer freebsd_triage 2018-01-02 11:09:50 UTC 
(In reply to Antoine Brodin from comment #6)

@antoine, did you have a chance to try increase MAX_FILES?
Comment 9 Yuri Victorovich freebsd_committer freebsd_triage 2018-03-31 05:00:07 UTC 
This problem has occurred in the RStudio port and has been resolved with a special feature in poudriere that increases the number of open files for a specific port.