Skip to content

declare flatbuffers (imported but undeclared) + clean-install import smoke - #85

Open
tlebryk wants to merge 3 commits into
mainfrom
theo/declare-flatbuffers
Open

declare flatbuffers (imported but undeclared) + clean-install import smoke#85
tlebryk wants to merge 3 commits into
mainfrom
theo/declare-flatbuffers

Conversation

@tlebryk

@tlebryk tlebryk commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

wsds/pupyarrow/flatbuf/*.py all import flatbuffers, but it's declared nowhere in wsds and isn't transitive from the other declared deps. A clean pip install . + import wsds fails with ModuleNotFoundError: No module named 'flatbuffers' at pupyarrow/flatbuf/Footer.py.

Fail-to-pass proof (clean venv, wsds's declared deps only):

$ pip install fastprogress fire numpy 'polars>=1.36.1' 'pyarrow>=20' torch
$ python -c 'import flatbuffers'   ->  ModuleNotFoundError   (not transitive)
$ python -c 'import wsds'          ->  ModuleNotFoundError: No module named 'flatbuffers'
$ pip install flatbuffers
$ python -c 'import wsds'          ->  import wsds OK

Theo and others added 3 commits July 14, 2026 21:16
wsds imports `flatbuffers` across wsds/pupyarrow/flatbuf/*.py but never declared it. It's not
transitive from the other declared deps (fastprogress/fire/numpy/polars/pyarrow/torch), so a
clean `pip install .` + `import wsds` fails with ModuleNotFoundError: No module named
'flatbuffers'. It's been masked because dev/ML environments pull flatbuffers transitively
(tensorflow/onnx/mediapipe/jax), but a minimal image (e.g. a clean vllm image) surfaces it.

Fix: add flatbuffers to requirements.txt. Add an import-smoke CI that installs wsds fresh and
imports it — the only check that catches an imported-but-undeclared dependency (pytest in a full
env wouldn't). This CI fails on the pre-fix tree and passes with the declaration.
@tlebryk
tlebryk requested a review from jpc July 14, 2026 21:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant