setup
checks.aarch64-linux.e2e-oidc
· build #429
· raw
1these 18 derivations will be built:2 /nix/store/kq9900bw6a27bw59lns1zm69y0h05zwq-system-path.drv3 /nix/store/wb40gsmla1ifngp1w953rikshkm2x1dk-dbus-1.drv4 /nix/store/w1la5a08qxx3xsqv07v5216pda25cl37-X-Restart-Triggers-dbus-broker.drv5 /nix/store/m2n2hdv3rpq7kbmq74cwsn92lgxq8v6n-unit-dbus-broker.service.drv6 /nix/store/bw40lrwvps8jpypvpab3f97cgr4742kc-user-units.drv7 /nix/store/fvpl1qmdq4q7nypbr02k5255hwqp2fky-unit-horae.service.drv8 /nix/store/sn7j55g813nlibqxhi5n7c9hblghqd3z-unit-dbus-broker.service.drv9 /nix/store/z48914lzq1l3b79s6yk9zyrlrmjwgv01-system-units.drv10 /nix/store/mjan18znyj651yws2vphmw03dq9kw967-etc.drv11 /nix/store/hajkscz7sylmyn3ci3kis7df2ypcmjl4-activate.drv12 /nix/store/f6chj5abhb2dvf3gx0xnryz6zj16l23x-nixos-system-server-test.drv13 /nix/store/wnjvlmvdkfkfygwsxjk9by06z2m2vcsa-closure-info.drv14 /nix/store/p5wd66l6lyfyw7pn50av96j5ijvbwpw2-closure-info.drv15 /nix/store/3ciww12vjs8wv0dr8hr5p0hc86kxsq3j-run-nixos-vm.drv16 /nix/store/2pds7lg2jc6bgvlg4dgl9yrhzzgfn864-nixos-vm.drv17 /nix/store/3lf46llhx9xx4rshx9bx0xw242304vag-driverConfiguration.json.drv18 /nix/store/4lp4bsc30yjns13ssmxs29fwlqanq3vw-nixos-test-driver-horae-e2e-oidc.drv19 /nix/store/hs8scxp3zsm72y6yya4bcwyy25bxkaya-vm-test-run-horae-e2e-oidc.drv20error: build of '/nix/store/hs8scxp3zsm72y6yya4bcwyy25bxkaya-vm-test-run-horae-e2e-oidc.drv' on 'grpc://farm.numtide.com:50051?client-cert=/run/secrets/vars/per-machine/bld1/nix-farm-ci/crt&client-key=/run/secrets/vars/per-machine/bld1/nix-farm-ci/key&connect-timeout=20&system=aarch64-linux' failed: Cannot build '/nix/store/hs8scxp3zsm72y6yya4bcwyy25bxkaya-vm-test-run-horae-e2e-oidc.drv'.21 Reason: builder failed with exit code 1.22 Output paths:23 /nix/store/jm1ps5cv916mnjx64vxkpy3rl81liqdb-vm-test-run-horae-e2e-oidc24 Last 25 log lines:25 > server # [ 706.085742] horae[973]: 2026-10-08T03:11:06.519653Z INFO dioxus_server::server: Registering: POST /api/delete_time_entry1638606356158383395526 > server # [ 706.125264] horae[973]: 2026-10-08T03:11:06.519871Z INFO dioxus_server::server: Registering: POST /api/create_time_entry1638606356158383395527 > server # [ 706.159970] horae[973]: 2026-10-08T03:11:06.520098Z INFO dioxus_server::server: Registering: POST /api/start_timer1638606356158383395528 > server # [ 706.222211] horae[973]: 2026-10-08T03:11:06.520309Z INFO dioxus_server::server: Registering: POST /api/stop_timer1638606356158383395529 > server # [ 706.259075] horae[973]: 2026-10-08T03:11:06.534769Z INFO dioxus_server::server: Registering: POST /api/update_org_branding1304717205239727702630 > server # [ 706.325006] horae[973]: 2026-10-08T03:11:06.535369Z INFO dioxus_server::server: Registering: POST /api/get_org_branding1304717205239727702631 > server # [ 706.370346] horae[973]: 2026-10-08T03:11:06.535642Z INFO dioxus_server::server: Registering: POST /api/get_week_start1304717205239727702632 > server # [ 706.445757] horae[973]: 2026-10-08T03:11:06.535825Z INFO dioxus_server::server: Registering: POST /api/get_org_name1304717205239727702633 > server # [ 706.721585] horae[973]: 2026-10-08T03:11:07.809644Z INFO horae: Listening on 127.0.0.1:300034 > server # [ 734.721996] horae[973]: 2026-10-08T03:11:36.107659Z WARN sqlx::pool::acquire: acquired connection, but time to acquire exceeded slow threshold aquired_after_secs=4.033993872 slow_acquire_threshold_secs=2.035 > server # [ 735.846817] horae[973]: 2026-10-08T03:11:39.325143Z WARN sqlx::pool::acquire: acquired connection, but time to acquire exceeded slow threshold aquired_after_secs=2.926402125 slow_acquire_threshold_secs=2.036 > server # [ 748.060876] horae[973]: 2026-10-08T03:11:51.001825Z WARN sqlx::pool::acquire: acquired connection, but time to acquire exceeded slow threshold aquired_after_secs=9.486904115 slow_acquire_threshold_secs=2.037 > server # [ 819.190395] horae[973]: 2026-10-08T03:13:02.647390Z WARN sqlx::query: slow statement: execution time exceeded alert threshold summary="WITH candidate AS ( …" db.statement="\n\nWITH candidate AS (\n SELECT id\n FROM horae_jobs\n WHERE attempts < max_attempts AND NOT cancellation_requested\n AND ((status = 'queued' AND available_at <= now())\n OR (status = 'running' AND lease_until < now()))\n ORDER BY available_at, created_at\n FOR UPDATE SKIP LOCKED\n LIMIT 1\n )\n UPDATE horae_jobs j\n SET status = 'running', attempts = j.attempts + 1,\n lease_until = now() + $1::int * interval '1 second', worker_id = $2,\n claim_token = $3,\n started_at = COALESCE(j.started_at, now()), updated_at = now()\n FROM candidate\n WHERE j.id = candidate.id\n RETURNING j.id, j.org_id, j.payload\n" rows_affected=0 rows_returned=0 elapsed=11.391266202s elapsed_secs=11.391266202 slow_threshold=1s38 > server # [ 819.573968] horae[973]: 2026-10-08T03:13:02.662041Z WARN sqlx::query: slow statement: execution time exceeded alert threshold summary="WITH candidate AS ( …" db.statement="\n\nWITH candidate AS (\n SELECT id FROM horae_outbox\n WHERE delivered_at IS NULL AND failed_at IS NULL AND available_at <= now() AND event_kind = $2\n ORDER BY available_at, created_at\n FOR UPDATE SKIP LOCKED LIMIT 1\n )\n UPDATE horae_outbox o\n SET attempts = o.attempts + 1,\n claim_token = $1,\n available_at = now() + interval '5 minutes'\n FROM candidate\n WHERE o.id = candidate.id\n RETURNING o.id, o.org_id, o.event_kind, o.payload, o.attempts,\n o.claim_token as \"claim_token!\"\n" rows_affected=0 rows_returned=0 elapsed=11.592663599s elapsed_secs=11.592663599 slow_threshold=1s39 > server # [ 821.516826] sched: DL replenish lagged too much40 > server # [ 867.355649] horae[973]: 2026-10-08T03:13:50.549810Z WARN sqlx::pool::acquire: acquired connection, but time to acquire exceeded slow threshold aquired_after_secs=5.620744728 slow_acquire_threshold_secs=2.041 > !!! Traceback (most recent call last):42 > !!! File "<string>", line 5, in <module>43 > !!! retry(lambda _: "connecting to host..." in server.get_console_log(), timeout_seconds=900)44 > !!! 45 > !!! RequestedAssertionFailed: action timed out after 901.00 seconds (timeout=900)46 > cleanup47 > kill QemuMachine (pid 12)48 > server # qemu-system-aarch64: terminating on signal 15 from pid 6 (/nix/store/smwd56pl54f0pcjdspgh5vnf20c8xwsc-python3-3.13.13/bin/python3.13)49 > (finished: cleanup, in 0.69 seconds)50 For full logs, run:51 nix log /nix/store/hs8scxp3zsm72y6yya4bcwyy25bxkaya-vm-test-run-horae-e2e-oidc.drv52error: Cannot build '/nix/store/hs8scxp3zsm72y6yya4bcwyy25bxkaya-vm-test-run-horae-e2e-oidc.drv'.53 Reason: builder failed with exit code 1.54 Output paths:55 /nix/store/jm1ps5cv916mnjx64vxkpy3rl81liqdb-vm-test-run-horae-e2e-oidc