1these 7 derivations will be built:2 /nix/store/qsvv22bffr5s8ahswl3y2ha2xdhdxv59-tensorflow-gpu-2.10.1.drv3 /nix/store/hdqfmv4d3akfc0s1gmak8yx168n8k27d-python3.10-tensorflow-gpu-2.10.1.drv4 /nix/store/qw3404v8n379ykn6c2i2wc5j0xri1pf3-python3.10-jax-0.3.23.drv5 /nix/store/mp8rkdc7fip85lgdvxlr3jfcl7v4dbp7-python3.10-chex-0.1.5.drv6 /nix/store/p7yfb3vmflvc118pclyx8mr8xxys2p0z-python3.10-optax-0.1.4.drv7 /nix/store/l1mz4kbani333hxr6nf1311cyiwqc5v0-python3.10-flax-0.6.1.drv8 /nix/store/5wy6qkqk0qc3sjha6abh9gysyb6ysfaa-python3.10-vqgan-jax-unstable-2022-04-20.drv9error: Cannot build '/nix/store/qsvv22bffr5s8ahswl3y2ha2xdhdxv59-tensorflow-gpu-2.10.1.drv'.10 Reason: builder failed with exit code 137.11 Output paths:12 /nix/store/1k3g6xv5sir48mqcw1pabgw3lc32b7qh-tensorflow-gpu-2.10.113 /nix/store/b94s73achgrg9vjxj3726bnji55hi6bn-tensorflow-gpu-2.10.1-python14 Last 25 log lines:15 > WARNING: All illegal access operations will be denied in a future release16 > [1,491 / 13,469] Compiling re2/bitstate.cc; 4s local ... (48 actions, 47 running)17 > [2,053 / 14,633] Compiling tensorflow/core/platform/profile_utils/cpu_utils.cc; 22s local ... (47 actions, 46 running)18 > [2,282 / 14,742] Compiling llvm/lib/Demangle/ItaniumDemangle.cpp; 31s local ... (48 actions, 47 running)19 > [2,501 / 14,742] Compiling absl/strings/internal/str_format/float_conversion.cc; 31s local ... (48 actions, 47 running)20 > [2,991 / 16,354] Compiling tensorflow/core/lib/random/simple_philox.cc; 35s local ... (48 actions, 47 running)21 > [3,557 / 18,463] Compiling re2/prefilter_tree.cc; 33s local ... (48 actions, 47 running)22 > [5,077 / 22,917] Compiling src/cpu/x64/gemm/s8x8s32/jit_avx_kernel_b_gemm_s8u8s32_kern_autogen.cpp; 46s local ... (48 actions, 47 running)23 > [5,164 / 22,917] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 56s local ... (48 actions, 47 running)24 > [5,232 / 22,917] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 105s local ... (48 actions, 47 running)25 > [5,320 / 22,917] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 162s local ... (48 actions, 47 running)26 > [7,168 / 27,260] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 226s local ... (48 actions, 47 running)27 > [7,350 / 27,260] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 300s local ... (48 actions, 47 running)28 > [7,564 / 27,260] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 385s local ... (48 actions, 47 running)29 > [9,694 / 27,260] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 482s local ... (47 actions, 46 running)30 > [10,392 / 27,260] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 595s local ... (48 actions, 47 running)31 > [10,726 / 27,260] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 724s local ... (48 actions, 47 running)32 > [10,927 / 27,260] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 873s local ... (48 actions, 47 running)33 > [11,109 / 27,260] Compiling mlir/lib/Dialect/Tosa/IR/TosaOps.cpp; 165s local ... (48 actions, 47 running)34 > [11,396 / 27,260] Compiling tensorflow/compiler/mlir/hlo/lib/Dialect/mhlo/IR/hlo_ops.cc; 261s local ... (48 actions, 47 running)35 > [11,897 / 27,260] Compiling tensorflow/compiler/mlir/hlo/lib/Dialect/mhlo/IR/hlo_ops.cc; 349s local ... (48 actions, 47 running)36 > [14,309 / 27,260] Compiling mlir/lib/Dialect/Vector/Transforms/VectorDistribute.cpp; 59s local ... (48 actions, 47 running)37 > [14,993 / 27,260] Compiling llvm/lib/Transforms/Utils/Local.cpp; 78s local ... (48 actions, 47 running)38 > [15,495 / 27,260] Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 159s local ... (48 actions running)39 > /nix/store/cp65c8nk29qq5cl1wyy5qyw103cwmax7-stdenv-linux/setup: line 1442: 3320 Killed BAZEL_USE_CPP_ONLY_TOOLCHAIN=1 USER=homeless-shelter bazel --batch --output_base="$bazelOut" --output_user_root="$bazelUserRoot" build --curses=no -j $NIX_BUILD_CORES "${copts[@]}" "${host_copts[@]}" "${linkopts[@]}" "${host_linkopts[@]}" $bazelFlags --config=opt //tensorflow/tools/pip_package:build_pip_package //tensorflow/tools/lib_package:libtensorflow40 For full logs, run:41 nix log /nix/store/qsvv22bffr5s8ahswl3y2ha2xdhdxv59-tensorflow-gpu-2.10.1.drv42error: Cannot build '/nix/store/hdqfmv4d3akfc0s1gmak8yx168n8k27d-python3.10-tensorflow-gpu-2.10.1.drv'.43 Reason: 1 dependency failed.44 Output paths:45 /nix/store/5mpgdrmkrcnqy7fxkl2limcsdxz4fh1x-python3.10-tensorflow-gpu-2.10.146 /nix/store/qmbms080a1dpb6adn7xm7lhjx06w5ibs-python3.10-tensorflow-gpu-2.10.1-dist47error: Cannot build '/nix/store/qw3404v8n379ykn6c2i2wc5j0xri1pf3-python3.10-jax-0.3.23.drv'.48 Reason: builder failed with exit code 1.49 Output paths:50 /nix/store/a71kqaic8rj78yif8asshfjslxrvz9s6-python3.10-jax-0.3.23-dist51 /nix/store/vqwk79p3ns5l6a51wz56avd8sx6w9wdc-python3.10-jax-0.3.2352 Last 25 log lines:53 > ........................................................................ [ 60%]54 > ........................................................................ [ 61%]55 > ........................................................................ [ 61%]56 > ........................................................................ [ 62%]57 > ........................................................................ [ 63%]58 > ........................................................................ [ 63%]59 > ........................................................................ [ 64%]60 > ........................................................................ [ 64%]61 > ........................................................................ [ 65%]62 > ........................................................................ [ 66%]63 > ..............s......................................................... [ 66%]64 > ........................................................................ [ 67%]65 > ........................................................................ [ 67%]66 > ........................................................................ [ 68%]67 > .....s...............................s[gw1] node down: Not properly terminated68 > F69 > replacing crashed worker gw170 > gw0 [11972] / gw4 [11972] / gw2 [11972] / gw3 [11972]..s..s......s......s....s.......s.sssss....ssssssssssssssssssssssssssss...ss.........s.......ss..s......s..................s....ss.ss.ss...s..s.s...s........s...s..ss........s..s.......s..........s........s...........s..............s......................................ssssssssssssssssss..........ssssssssss.s....ss..s..................................................................................................ss.......................ssssssssssssssssss..ssss.....ssss.s....ssssssssssssssssssssssssssss....ss..................s.........ss...s.................................................................................................s.......................................................................................................................................................................................................................................................s....s.....ss........s..ss..ss..s......sssss.ss.s..s.s...s............................s.....ss....s.....................s...sss......ss..s...............................................................s..s............s.s......s......ss...............s............s..sssss.....ssssssssssssssssssssssssssss...ss..........s.......ss..s.........s..................................................s....sssss.ss..s..s.s...s.............................ssss......ssss.................................ss........................s...........................s..ss........................s..s.........s.ss.....................................................................................................................................................................................................................................................................................s.................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................ss....s..ss.............................................s...................................ss..sssss...ss...s.s............s.s...........ss.s.sss...ss..sssss...ss.s.s.s.............s.s...........sss.s.sssssssssss..........ssssssssss....................ssssssss.s..s.sssss.ss.ss........s.......s.ss.sssss.s............................ssssssssss........s................................................................................................................................................................................................................................................s........s.................................................................s.sssssssssssssssssssssssssssssssssssssssssssssssssss.s..sssss..sssss..sssssssssssss...sssssssssss.sssssssssssssss.......................sss.s.....ssssss....ssssssssssssssssssssssssssss...ss........s.......ss..s.....s.....................ss.ss.ss.s..s.s...s....s..s..ss.....s..ssssssssss........................................................................................s..............................s..........................................................................................................................................................................................................................s.ssssssssss.ssssssssss.ss...ssssssssssssssssss...................................................................ss.............sssssssss.sssssssssssssssssssssss71 > =================================== FAILURES ===================================72 > ___________________________ tests/lax_scipy_test.py ____________________________73 > [gw1] linux -- Python 3.10.9 /nix/store/al6g1zbk8li6p8mcyp0h60d08jaahf8c-python3-3.10.9/bin/python3.1074 > worker 'gw1' crashed while running 'tests/lax_scipy_test.py::LaxBackedScipyTests::test_spectral_dac_eigh_linear_size=16_dtype=complex64_termination_size=1'75 > =========================== short test summary info ============================76 > FAILED tests/lax_scipy_test.py::LaxBackedScipyTests::test_spectral_dac_eigh_linear_size=16_dtype=complex64_termination_size=177 > ========== 1 failed, 11006 passed, 965 skipped in 9120.99s (2:32:00) ===========78 For full logs, run:79 nix log /nix/store/qw3404v8n379ykn6c2i2wc5j0xri1pf3-python3.10-jax-0.3.23.drv80error: Cannot build '/nix/store/mp8rkdc7fip85lgdvxlr3jfcl7v4dbp7-python3.10-chex-0.1.5.drv'.81 Reason: 1 dependency failed.82 Output paths:83 /nix/store/8wssb5hdc7nlpiigk5jygk7dmv2yxc98-python3.10-chex-0.1.584 /nix/store/sffjgk5cb32yr8jz5hsyhwdfff4qr13y-python3.10-chex-0.1.5-dist85error: Cannot build '/nix/store/p7yfb3vmflvc118pclyx8mr8xxys2p0z-python3.10-optax-0.1.4.drv'.86 Reason: 1 dependency failed.87 Output paths:88 /nix/store/9r2waj0maz5ca0fb3r7a2nyzm0gvkjbx-python3.10-optax-0.1.489 /nix/store/ccjcp7in8gc2y8350lhh6xw484fn4bqr-python3.10-optax-0.1.4-testsout90 /nix/store/ccyq13fr164qc33jb44zych2351f1v19-python3.10-optax-0.1.4-dist91error: Cannot build '/nix/store/l1mz4kbani333hxr6nf1311cyiwqc5v0-python3.10-flax-0.6.1.drv'.92 Reason: 3 dependencies failed.93 Output paths:94 /nix/store/mjwr0jnbw669jd359667wl6kfc592r86-python3.10-flax-0.6.1-dist95 /nix/store/zmzd421d8f3vavx2an9qac4r7mg2vvp6-python3.10-flax-0.6.196error: Cannot build '/nix/store/5wy6qkqk0qc3sjha6abh9gysyb6ysfaa-python3.10-vqgan-jax-unstable-2022-04-20.drv'.97 Reason: 2 dependencies failed.98 Output paths:99 /nix/store/7nl11vbz6hsam4nhmbf2z5rkpspgnczj-python3.10-vqgan-jax-unstable-2022-04-20100 /nix/store/a871qsxx3wva7p69mqdr71d8q8hpa0kv-python3.10-vqgan-jax-unstable-2022-04-20-dist