these 7 derivations will be built: /nix/store/qsvv22bffr5s8ahswl3y2ha2xdhdxv59-tensorflow-gpu-2.10.1.drv /nix/store/hdqfmv4d3akfc0s1gmak8yx168n8k27d-python3.10-tensorflow-gpu-2.10.1.drv /nix/store/qw3404v8n379ykn6c2i2wc5j0xri1pf3-python3.10-jax-0.3.23.drv /nix/store/mp8rkdc7fip85lgdvxlr3jfcl7v4dbp7-python3.10-chex-0.1.5.drv /nix/store/p7yfb3vmflvc118pclyx8mr8xxys2p0z-python3.10-optax-0.1.4.drv /nix/store/l1mz4kbani333hxr6nf1311cyiwqc5v0-python3.10-flax-0.6.1.drv /nix/store/5wy6qkqk0qc3sjha6abh9gysyb6ysfaa-python3.10-vqgan-jax-unstable-2022-04-20.drv error: Cannot build '/nix/store/qsvv22bffr5s8ahswl3y2ha2xdhdxv59-tensorflow-gpu-2.10.1.drv'. Reason: builder failed with exit code 137. Output paths: /nix/store/1k3g6xv5sir48mqcw1pabgw3lc32b7qh-tensorflow-gpu-2.10.1 /nix/store/b94s73achgrg9vjxj3726bnji55hi6bn-tensorflow-gpu-2.10.1-python Last 25 log lines: > WARNING: All illegal access operations will be denied in a future release > [1,491 / 13,469] Compiling re2/bitstate.cc; 4s local ... (48 actions, 47 running) > [2,053 / 14,633] Compiling tensorflow/core/platform/profile_utils/cpu_utils.cc; 22s local ... (47 actions, 46 running) > [2,282 / 14,742] Compiling llvm/lib/Demangle/ItaniumDemangle.cpp; 31s local ... (48 actions, 47 running) > [2,501 / 14,742] Compiling absl/strings/internal/str_format/float_conversion.cc; 31s local ... (48 actions, 47 running) > [2,991 / 16,354] Compiling tensorflow/core/lib/random/simple_philox.cc; 35s local ... (48 actions, 47 running) > [3,557 / 18,463] Compiling re2/prefilter_tree.cc; 33s local ... (48 actions, 47 running) > [5,077 / 22,917] Compiling src/cpu/x64/gemm/s8x8s32/jit_avx_kernel_b_gemm_s8u8s32_kern_autogen.cpp; 46s local ... (48 actions, 47 running) > [5,164 / 22,917] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 56s local ... (48 actions, 47 running) > [5,232 / 22,917] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 105s local ... (48 actions, 47 running) > [5,320 / 22,917] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 162s local ... (48 actions, 47 running) > [7,168 / 27,260] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 226s local ... (48 actions, 47 running) > [7,350 / 27,260] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 300s local ... (48 actions, 47 running) > [7,564 / 27,260] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 385s local ... (48 actions, 47 running) > [9,694 / 27,260] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 482s local ... (47 actions, 46 running) > [10,392 / 27,260] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 595s local ... (48 actions, 47 running) > [10,726 / 27,260] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 724s local ... (48 actions, 47 running) > [10,927 / 27,260] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 873s local ... (48 actions, 47 running) > [11,109 / 27,260] Compiling mlir/lib/Dialect/Tosa/IR/TosaOps.cpp; 165s local ... (48 actions, 47 running) > [11,396 / 27,260] Compiling tensorflow/compiler/mlir/hlo/lib/Dialect/mhlo/IR/hlo_ops.cc; 261s local ... (48 actions, 47 running) > [11,897 / 27,260] Compiling tensorflow/compiler/mlir/hlo/lib/Dialect/mhlo/IR/hlo_ops.cc; 349s local ... (48 actions, 47 running) > [14,309 / 27,260] Compiling mlir/lib/Dialect/Vector/Transforms/VectorDistribute.cpp; 59s local ... (48 actions, 47 running) > [14,993 / 27,260] Compiling llvm/lib/Transforms/Utils/Local.cpp; 78s local ... (48 actions, 47 running) > [15,495 / 27,260] Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 159s local ... (48 actions running) > /nix/store/cp65c8nk29qq5cl1wyy5qyw103cwmax7-stdenv-linux/setup: line 1442: 3320 Killed BAZEL_USE_CPP_ONLY_TOOLCHAIN=1 USER=homeless-shelter bazel --batch --output_base="$bazelOut" --output_user_root="$bazelUserRoot" build --curses=no -j $NIX_BUILD_CORES "${copts[@]}" "${host_copts[@]}" "${linkopts[@]}" "${host_linkopts[@]}" $bazelFlags --config=opt //tensorflow/tools/pip_package:build_pip_package //tensorflow/tools/lib_package:libtensorflow For full logs, run: nix log /nix/store/qsvv22bffr5s8ahswl3y2ha2xdhdxv59-tensorflow-gpu-2.10.1.drv error: Cannot build '/nix/store/hdqfmv4d3akfc0s1gmak8yx168n8k27d-python3.10-tensorflow-gpu-2.10.1.drv'. Reason: 1 dependency failed. Output paths: /nix/store/5mpgdrmkrcnqy7fxkl2limcsdxz4fh1x-python3.10-tensorflow-gpu-2.10.1 /nix/store/qmbms080a1dpb6adn7xm7lhjx06w5ibs-python3.10-tensorflow-gpu-2.10.1-dist error: Cannot build '/nix/store/qw3404v8n379ykn6c2i2wc5j0xri1pf3-python3.10-jax-0.3.23.drv'. Reason: builder failed with exit code 1. Output paths: /nix/store/a71kqaic8rj78yif8asshfjslxrvz9s6-python3.10-jax-0.3.23-dist /nix/store/vqwk79p3ns5l6a51wz56avd8sx6w9wdc-python3.10-jax-0.3.23 Last 25 log lines: > ........................................................................ [ 60%] > ........................................................................ [ 61%] > ........................................................................ [ 61%] > ........................................................................ [ 62%] > ........................................................................ [ 63%] > ........................................................................ [ 63%] > ........................................................................ [ 64%] > ........................................................................ [ 64%] > ........................................................................ [ 65%] > ........................................................................ [ 66%] > ..............s......................................................... [ 66%] > ........................................................................ [ 67%] > ........................................................................ [ 67%] > ........................................................................ [ 68%] > .....s...............................s[gw1] node down: Not properly terminated > F > replacing crashed worker gw1 > gw0 [11972] / gw4 [11972] / gw2 [11972] / gw3 [11972]..s..s......s......s....s.......s.sssss....ssssssssssssssssssssssssssss...ss.........s.......ss..s......s..................s....ss.ss.ss...s..s.s...s........s...s..ss........s..s.......s..........s........s...........s..............s......................................ssssssssssssssssss..........ssssssssss.s....ss..s..................................................................................................ss.......................ssssssssssssssssss..ssss.....ssss.s....ssssssssssssssssssssssssssss....ss..................s.........ss...s.................................................................................................s.......................................................................................................................................................................................................................................................s....s.....ss........s..ss..ss..s......sssss.ss.s..s.s...s............................s.....ss....s.....................s...sss......ss..s...............................................................s..s............s.s......s......ss...............s............s..sssss.....ssssssssssssssssssssssssssss...ss..........s.......ss..s.........s..................................................s....sssss.ss..s..s.s...s.............................ssss......ssss.................................ss........................s...........................s..ss........................s..s.........s.ss.....................................................................................................................................................................................................................................................................................s.................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................ss....s..ss.............................................s...................................ss..sssss...ss...s.s............s.s...........ss.s.sss...ss..sssss...ss.s.s.s.............s.s...........sss.s.sssssssssss..........ssssssssss....................ssssssss.s..s.sssss.ss.ss........s.......s.ss.sssss.s............................ssssssssss........s................................................................................................................................................................................................................................................s........s.................................................................s.sssssssssssssssssssssssssssssssssssssssssssssssssss.s..sssss..sssss..sssssssssssss...sssssssssss.sssssssssssssss.......................sss.s.....ssssss....ssssssssssssssssssssssssssss...ss........s.......ss..s.....s.....................ss.ss.ss.s..s.s...s....s..s..ss.....s..ssssssssss........................................................................................s..............................s..........................................................................................................................................................................................................................s.ssssssssss.ssssssssss.ss...ssssssssssssssssss...................................................................ss.............sssssssss.sssssssssssssssssssssss > =================================== FAILURES =================================== > ___________________________ tests/lax_scipy_test.py ____________________________ > [gw1] linux -- Python 3.10.9 /nix/store/al6g1zbk8li6p8mcyp0h60d08jaahf8c-python3-3.10.9/bin/python3.10 > worker 'gw1' crashed while running 'tests/lax_scipy_test.py::LaxBackedScipyTests::test_spectral_dac_eigh_linear_size=16_dtype=complex64_termination_size=1' > =========================== short test summary info ============================ > FAILED tests/lax_scipy_test.py::LaxBackedScipyTests::test_spectral_dac_eigh_linear_size=16_dtype=complex64_termination_size=1 > ========== 1 failed, 11006 passed, 965 skipped in 9120.99s (2:32:00) =========== For full logs, run: nix log /nix/store/qw3404v8n379ykn6c2i2wc5j0xri1pf3-python3.10-jax-0.3.23.drv error: Cannot build '/nix/store/mp8rkdc7fip85lgdvxlr3jfcl7v4dbp7-python3.10-chex-0.1.5.drv'. Reason: 1 dependency failed. Output paths: /nix/store/8wssb5hdc7nlpiigk5jygk7dmv2yxc98-python3.10-chex-0.1.5 /nix/store/sffjgk5cb32yr8jz5hsyhwdfff4qr13y-python3.10-chex-0.1.5-dist error: Cannot build '/nix/store/p7yfb3vmflvc118pclyx8mr8xxys2p0z-python3.10-optax-0.1.4.drv'. Reason: 1 dependency failed. Output paths: /nix/store/9r2waj0maz5ca0fb3r7a2nyzm0gvkjbx-python3.10-optax-0.1.4 /nix/store/ccjcp7in8gc2y8350lhh6xw484fn4bqr-python3.10-optax-0.1.4-testsout /nix/store/ccyq13fr164qc33jb44zych2351f1v19-python3.10-optax-0.1.4-dist error: Cannot build '/nix/store/l1mz4kbani333hxr6nf1311cyiwqc5v0-python3.10-flax-0.6.1.drv'. Reason: 3 dependencies failed. Output paths: /nix/store/mjwr0jnbw669jd359667wl6kfc592r86-python3.10-flax-0.6.1-dist /nix/store/zmzd421d8f3vavx2an9qac4r7mg2vvp6-python3.10-flax-0.6.1 error: Cannot build '/nix/store/5wy6qkqk0qc3sjha6abh9gysyb6ysfaa-python3.10-vqgan-jax-unstable-2022-04-20.drv'. Reason: 2 dependencies failed. Output paths: /nix/store/7nl11vbz6hsam4nhmbf2z5rkpspgnczj-python3.10-vqgan-jax-unstable-2022-04-20 /nix/store/a871qsxx3wva7p69mqdr71d8q8hpa0kv-python3.10-vqgan-jax-unstable-2022-04-20-dist