Comment 1 Vladimir Druzenko 2025-04-08 09:27:38 UTC

There is an idea not to deviate too much from "VFX platform": https://vfxplatform.com/
In "VFX platform 2025" Python is 3.11.x.

it looks that keeping level/py-setuptools bellow to 75.8.2 causes some problems - with wheel and not only....

Comment 3 Charlie Li 2025-04-08 16:19:26 UTC

What manual is this?

The devel/py-setuptools currently in tree is "temporarily" pinned to devel/py-wheel044 until the update can happen, so you will need to temporarily remove devel/py-wheel so that 044 can be installed, then remove 044 once finished.

In a more general sense however, building Python packages (FreeBSD or not) outside of isolated environments like poudriere or virtual environments is not really supported. While we in FreeBSD strive to have the ability to build stuff on live systems/environments, we are still beholden to the warts of the greater communities of the stuff ported. The Python packaging community (and a couple others) has effectively required them for support purposes as incompatibilities and breakages between even not-quite-major package versions happen often, and different versions cannot be installed concurrently.

Currently with only pyton3-3.12 installed as default and only python version, only following ports doesn't build


databases/py-gdbm@py312 

security/py-keyring@py312 devel/py-jaraco.classes@py312 
security/py-SecretStorage@py312

graphics/py-pillow@py312 x11-toolkits/py-tkinter@py312 devel/py-twisted@py312

www/py-treq

devel/py-repoze.who www/py-webob@py312

x11-toolkits/py-tkinter

net-mgmt/py-prometheus-client devel/py-Automat@py312

It's not possible to build databases/py-sqlite3. I think because there is no py312 flavor for setuptools?

===>  Configuring for py312-setuptools-63.1.0_3
===>  Building for py312-setuptools-63.1.0_3
* Getting build dependencies for wheel...
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/pyproject_hooks/_in_process/_in_process.py", line 389, in <module>
    main()
  File "/usr/local/lib/python3.12/site-packages/pyproject_hooks/_in_process/_in_process.py", line 373, in main
    json_out["return_val"] = hook(**hook_input["kwargs"])
                             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/pyproject_hooks/_in_process/_in_process.py", line 137, in get_requires_for_build_wheel
    backend = _build_backend()
              ^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/pyproject_hooks/_in_process/_in_process.py", line 70, in _build_backend
    obj = import_module(mod_path)
          ^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/importlib/__init__.py", line 90, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen importlib._bootstrap>", line 1387, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1360, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1310, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 488, in _call_with_frames_removed
  File "<frozen importlib._bootstrap>", line 1387, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1360, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1331, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 935, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 999, in exec_module
  File "<frozen importlib._bootstrap>", line 488, in _call_with_frames_removed
  File "/var/ports/basejail/usr/ports/devel/py-setuptools/work-py312/setuptools-63.1.0/setuptools/__init__.py", line 16, in <module>
    import setuptools.version
  File "/var/ports/basejail/usr/ports/devel/py-setuptools/work-py312/setuptools-63.1.0/setuptools/version.py", line 1, in <module>
    import pkg_resources
  File "/var/ports/basejail/usr/ports/devel/py-setuptools/work-py312/setuptools-63.1.0/pkg_resources/__init__.py", line 2191, in <module>
    register_finder(pkgutil.ImpImporter, find_on_path)
                    ^^^^^^^^^^^^^^^^^^^
AttributeError: module 'pkgutil' has no attribute 'ImpImporter'. Did you mean: 'zipimporter'?

ERROR Backend subprocess exited when trying to invoke get_requires_for_build_wheel
*** Error code 1

Stop.
make[1]: stopped in /basejail/usr/ports/devel/py-setuptools
*** Error code 1

Stop.
make: stopped in /basejail/usr/ports/databases/py-sqlite3

Comment 6 commit-hook 2025-04-10 13:46:05 UTC

A commit in branch main references this bug:

URL: https://cgit.FreeBSD.org/ports/commit/?id=8927fe8f67e32805fe94c94356b013d59ca4af25

commit 8927fe8f67e32805fe94c94356b013d59ca4af25
Author:     Charlie Li <vishwin@FreeBSD.org>
AuthorDate: 2025-04-10 13:44:00 +0000
Commit:     Charlie Li <vishwin@FreeBSD.org>
CommitDate: 2025-04-10 13:44:00 +0000

    devel/py-setuptools: account for removed pkgutil methods in Python 3.12

    Reported by: jan, Tatsuki Makino
    PR: 285957

 devel/py-setuptools/Makefile | 3 +++
 devel/py-setuptools/distinfo | 4 +++-
 2 files changed, 6 insertions(+), 1 deletion(-)

Comment 7 Charlie Li 2025-04-10 13:49:05 UTC

Commandeering this into a meta-bug to track Python 3.12-specific package breakages generally. After 3.13 is committed, activity should intensify when exp-runs happen and whatnot to preserve the n-1 bit (n being latest upstream CPython release).

(In reply to Jordan Ostreff from comment #4)
Try building these again.

Thanks to the fixes in setuptools, the build has progressed quite a bit.
However, this time the build of net/py-pyzmq@py312 will stop due to a famous cause.

The following is an excerpt from the log.

zmq/backend/cython/_version.c:2887:55: error: no member named 'ob_digit' in 'struct _longobject'
            const digit* digits = ((PyLongObject*)x)->ob_digit;
                                  ~~~~~~~~~~~~~~~~~~  ^
zmq/backend/cython/_version.c:2942:55: error: no member named 'ob_digit' in 'struct _longobject'
            const digit* digits = ((PyLongObject*)x)->ob_digit;
                                  ~~~~~~~~~~~~~~~~~~  ^
zmq/backend/cython/_version.c:3083:55: error: no member named 'ob_digit' in 'struct _longobject'
            const digit* digits = ((PyLongObject*)x)->ob_digit;
                                  ~~~~~~~~~~~~~~~~~~  ^
zmq/backend/cython/_version.c:3138:55: error: no member named 'ob_digit' in 'struct _longobject'
            const digit* digits = ((PyLongObject*)x)->ob_digit;
                                  ~~~~~~~~~~~~~~~~~~  ^
zmq/backend/cython/_version.c:3589:47: error: no member named 'ob_digit' in 'struct _longobject'
    const digit* digits = ((PyLongObject*)b)->ob_digit;
                          ~~~~~~~~~~~~~~~~~~  ^
5 warnings and 5 errors generated.
error: command '/usr/bin/cc' failed with exit code 1
*** Error code 1

Stop.

Comment 9 Rainer Hurling 2025-04-12 08:43:19 UTC

(In reply to Tatsuki Makino from comment #8)
It seems this error occurs with lang/cython (v. 2xx) installed? If this is true, could you please try again with lang/cython3?

There is some evidence [1] that we need cython3 for this problem.

[1] https://github.com/aio-libs/aiohttp/issues/7229#issuecomment-1450517855

(In reply to Rainer Hurling from comment #9)

Thank you.

It is controlled by whether the variable USE_PYTHON is set to cython or cython3, and net/py-pyzmq uses cython.
It seems that by rewriting this in cython3, the build of net/py-pyzmq@py312 succeed.

Add bug 286361 to "Depends on" please, I can't edit this bug. Regular Mesa likely needs this as well, but I didn't test.

Comment 12 Charlie Li 2025-04-28 14:12:30 UTC

(In reply to Evgenii Khramtsov from comment #11)
Same as regular mesa when able to be updated to the current release. As commented over in bug 286361, the correct additional BUILD_DEPENDS line is not setuptools but rather packaging.