text:
Add the return code CT_REOPENED for conntrack table lookup.

When a tcp SYN packet hits a conntrack entry that is in close-wait state,
the entry timeout will be modified and the entry will be reopened. But because the
return code is CT_ESTABLISHED, policy-verdict event will not be generated even this
is a new connection. The patch fix the issue by returning the code CT_REOPENED
instead in this case. Other than policy verdict events, all other handlings are the
same as if CT_ESTABLISHED is returned.
Signed-off-by: Zang Li zangli@google.com
Fixes: #13339
Fix missing policy-verdict event when a session is re-opened.

test-me-please

Hi Paul and Maciej, I have another question: I would expect the timeout to be CT_SYN_TIMEOUT instead of CT_CONNECTION_LIFETIME_TCP for the reopened case. This can be fixed with the following change.
What do you think? If you agree, I can add the following change on top of the current commit.
--- a/bpf/lib/conntrack.h
+++ b/bpf/lib/conntrack.h
@@ -244,6 +244,7 @@ static __always_inline __u8 __ct_lookup(const void *map, struct __ctx_buff *ctx,
reopen |= seen_flags.value & TCP_FLAG_SYN;
if (unlikely(reopen == (TCP_FLAG_SYN|0x1))) {
ct_reset_closing(entry);

                          entry->seen_non_syn = 0;
                          *monitor = ct_update_timeout(entry, is_tcp, dir, seen_flags);
                          return CT_REOPENED;
                  }

@lzang Regarding the timeout question, do we know for sure that such a connection will actually be new vs. a partially closed connection which the peers are reopening?
I wonder whether anyone has published some real-world observations or recommendations for handling TCP connection reopening, I've always seen it as something that is theoretically possible but am not familiar with common use cases or what kind of expectations apps might have in this scenario (and hence for instance how our selection of timeouts might impact such apps). It's easy to trigger such codepaths with a testing tool that just reuses ports, but in that case I think it's rare that there's any real impact from the timeouts we select since the test will often open & close the session within a short window.

@lzang Regarding the timeout question, do we know for sure that such a connection will actually be new vs. a partially closed connection which the peers are reopening?

The code path was triggered only on SYN request. What flag will be sent if it is a partially closed connection but the peers are reopening? Also the timeout would be updated on next packet that hits the same conntrack entry.

I wonder whether anyone has published some real-world observations or recommendations for handling TCP connection reopening, I've always seen it as something that is theoretically possible but am not familiar with common use cases or what kind of expectations apps might have in this scenario (and hence for instance how our selection of timeouts might impact such apps). It's easy to trigger such codepaths with a testing tool that just reuses ports, but in that case I think it's rare that there's any real impact from the timeouts we select since the test will often open & close the session within a short window.

I am not aware of any published work there. I think selection of timeout mainly affects how fast you can recycle the resource. But I agree the scenario here is a corner case and its impact to the real system should be small.

K8s-1.12-Kernel-netnext test fails with the following error - is it a test flakiness?
Stderr:
error: unable to upgrade connection: Authorization error (user=kube-apiserver-kubelet-client, verb=create, resource=nodes, subresource=proxy)

do we know for sure that such a connection will actually be new vs. a partially closed connection which the peers are reopening?

Is there such a thing as reopening a close-wait TCP connection? RFC793 mentions the following on reception of a SYN packet while in close-wait state (page 71):

If the SYN is in the window it is an error, send a reset, any
outstanding RECEIVEs and SEND should receive "reset" responses,
all segment queues should be flushed, the user should also
receive an unsolicited general "connection reset" signal, enter
the CLOSED state, delete the TCB, and return.

@pchaigno Hmm, I was thinking more about time-wait rather than close-wait, see RFC1122 Section 4.2.2.13:

When a connection is closed actively, it MUST linger in
TIME-WAIT state for a time 2xMSL (Maximum Segment Lifetime).
However, it MAY accept a new SYN from the remote TCP to
reopen the connection directly from TIME-WAIT state, if it:
       (1)  assigns its initial sequence number for the new
            connection to be larger than the largest sequence
            number it used on the previous connection incarnation,
            and

       (2)  returns to TIME-WAIT state if the SYN turns out to be
            an old duplicate.

Is there such a thing as reopening a close-wait TCP connection? RFC793 mentions the following on reception of a SYN packet while in close-wait state (page 71):

If the SYN is in the window it is an error, send a reset, any
outstanding RECEIVEs and SEND should receive "reset" responses,
all segment queues should be flushed, the user should also
receive an unsolicited general "connection reset" signal, enter
the CLOSED state, delete the TCB, and return.

I think we are not talking about the TCP layer here, and the re-open is just a re-use of the old entry from conntrack's view. The connection may have been considered as closed from TCP layer's view.

/test-me-please

We can ignore the net-next failure. It's a known flake.

I think we are not talking about the TCP layer here, and the re-open is just a re-use of the old entry from conntrack's view. The connection may have been considered as closed from TCP layer's view.

Before this PR, both connection reopens from time-wait and new connections reusing the same tuple would be considered as the existing connection and no policy verdict would be returned. So this is correct for the time-wait/re-open case but wrong for the tuple re-use case (which should be considered a new connection).
With the PR currently, both cases above would be considered new, which is correct for the tuple re-use case but could be considered wrong for the time-wait/reopen case since it's the same connection, just being reopened..
The only way to accurately determine when the connection is new or being reused for both cases AFAICT would be to also track  sequence numbers, which is probably more work than we really care to do.
I think the argument of this PR is that overall, Cilium is more likely to send policy verdict notifications more accurately across these cases because (particularly in local testing), reuse of the tuple for a new connection is more likely than reopen of the existing time-wait connection? Or maybe it could be argued that even following the time-wait case above, in some sense it is triggering another "opening" of a connection and therefore we should log the policy verdict. I'm fine with either of these assessments.
Regarding the timeouts, my reading on the above time-wait would be that for that case, we should resume the regular connection timeouts. But as you say, the timeout would be updated on the next connection update anyway so it's probably not that consequential?
Given the comments above and inside __ct_update_timeout(),  I would probably err on the side of not clearing the seen_non_syn bit unless we have some pretty clear guidance to describe why it's important or necessary.

Thanks Joe for the explanation. Now I got what you mean. Not sure how frequently would a tcp being re-opened with a SYN after entering the time-wait state, as most time time-wait is used to catch data packets that arrive later than the FIN. Also time-wait with 2xMSL is usually less than a couple of minutes, but the conntrack entry can stick for quite long in CiIlium due to the GC mechanism (please correct me if I am wrong), so the chance of hitting the tuple-reuse case could be larger. Agree that this is not a perfect solution, but it should work for most cases, and we probably don't need to be 100% accurate here :-)

test-me-please

CI is green except for checkpatch but we can ignore that particular warning (would require a lot more changes to fix).

authors: joestringer lzang pchaigno


text:
workflows: issue_comment triggers refactoring

Please review per commit :)

test-nbu

test-nbu

/test-nbu

test-nbu

/test-nbu

test-nbu

test-nbu

/test-nbu

/test-nbu

/test-nbu

/test-nbu

/test-nbu

/test-nbu

We also need to add docs, but that can be in a follow-up PR.

Too late, I was already doing it :D

@nbusseneau Did you validate this with a test commit already?

I looked at the PR history and was like "hmmm, no I did not, why didn't I?" 🤔 So I added a DO NOT MERGE commit and then remembered why I did not: this PR is from my fork, and cannot trigger test runs.
I am opening a separate PR for testing.

Anybody knows why https://github.com/cilium/cilium/actions/runs/1270095584 is failing? I suppose it is due to this:
{[3/5] update MLH config with new `/test` trigger}
  Running on 417c7794d8797687c82bfe31abbe3a1cba8f8258
  Warning: WARNING:COMMIT_MESSAGE: Missing commit description - Add an appropriate one

  NOTE: For some of the reported defects, checkpatch may be able to
        mechanically convert to the typical style using --fix or --fix-inplace.

  "[PATCH] update MLH config with new `/test` trigger" has style problems, please review.

  NOTE: Ignored message types: C99_COMMENT_TOLERANCE COMMIT_LOG_LONG_LINE COMPLEX_MACRO CONSTANT_CONVERSION CONST_STRUCT EMAIL_SUBJECT FILE_PATH_CHANGES FROM_SIGN_OFF_MISMATCH GIT_COMMIT_ID JIFFIES_COMPARISON LEADING_SPACE LONG_LINE_COMMENT MACRO_WITH_FLOW_CONTROL MULTISTATEMENT_MACRO_USE_DO_WHILE NOT_UNIFIED_DIFF PRINTK_WITHOUT_KERN_LEVEL TRAILING_SEMICOLON TRAILING_STATEMENTS VOLATILE

  NOTE: If any of the errors are false positives, please report
        them to the maintainer, see CHECKPATCH in MAINTAINERS.

Do we not allow empty commit descriptions anymore?

All tests in #17465 successfully triggered, however please note that the PR tests the pull_request path and not the issue_comment triggers themselves, so this test only guarantees that the PR changes are syntactically correct and won't break workflows after merge.

Do we not allow empty commit descriptions anymore?

cc @qmonnet

Reviews are in and required tests are passing. Marking ready to merge.

Do we not allow empty commit descriptions anymore?

No.
There was a Slack discussion about that some time ago, and I made checkpatch complain on empty commit logs as a result. Only my checkpatch change introduced a bug and checkpatch would not make the GitHub action fail when detecting errors :disappointed:. Fixed now, so normal checkpatch activity should resume, with complaints on empty commit logs in addition to the previous reports.

There was a Slack discussion about that some time ago, and I made checkpatch complain on empty commit logs as a result.

IIRC, the conclusion of that discussion was that empty commit are sometimes useful, as illustrated here. I think we should revert.

source: gharchive/pull-request

authors: nbusseneau pchaigno qmonnet

repo: cilium/cilium

license_type: permissive

license_source: github-api


text:
Improve Hubble memory usage and performance on decoding events

The first 7 commits are preparatory cleanup and addition/extension of tests to avoid regressions introduced by the successive two commits. These reduce Hubble's memory usage on L3/4 and L7 event decoding as follows:
name         old time/op    new time/op    delta
L34Decode-8    4.10µs ± 5%    3.63µs ± 8%  -11.51%  (p=0.000 n=10+10)

name         old alloc/op   new alloc/op   delta
L34Decode-8    1.24kB ± 0%    1.03kB ± 0%  -16.77%  (p=0.000 n=10+10)

name         old allocs/op  new allocs/op  delta
L34Decode-8      26.0 ± 0%      21.0 ± 0%  -19.23%  (p=0.000 n=10+10)

name        old time/op    new time/op    delta
L7Decode-8    6.37µs ±11%    5.79µs ± 4%   -9.02%  (p=0.000 n=10+10)

name        old alloc/op   new alloc/op   delta
L7Decode-8    1.53kB ± 0%    1.37kB ± 0%  -10.47%  (p=0.000 n=10+10)

name        old allocs/op  new allocs/op  delta
L7Decode-8      36.0 ± 0%      34.0 ± 0%   -5.56%  (p=0.000 n=10+10)

See the individual commit messages for details.

/test

CI is green and reviews were provided by all teams. Marking as ready to merge.


text:
go.mod, vendor: update cloud provider SDK Go modules

Update the cloud provider SDK Go modules using
contrib/scripts/go-mod-update-cloud-providers.sh

/ci-aks

/ci-awscni

/ci-eks

Review is in and affected CI jobs passed (Travis CI is currently failing consistently on master). Marking as ready to merge.

Rebased to resolve conflicts in go.sum. Go vendoring checks passed, no need to re-run other tests, marking as ready to merge.


text:
Fix connectivity issue upon agent restart in case of ipv6 + direct routing + KPR replacement

Automatic detection of the direct routing device is performed when tunneling is not enabled, and certain conditions are met (i.e., BPF NodePort, BPF HostRouting or Wireguard are enabled), as well as if IPv6 NDP is enabled. In such cases, the device is identified as the one having the IP address of the k8s node.
Still, when IPv6 support is enabled, the cilium_host device is also assigned the same IPv6 address as the node, hence being possibly selected as the target direct routing device (based on interface ordering) when the agent is restarted. If this happens, cilium then attaches the cil_*_netdev programs, overriding the correct ones (cil_*_host) and breaking the connectivity from the node to hosted pods.
The occurrence of the issue is highlighted by the following log lines:
level=info msg="Direct routing device detected" direct-routing-device=cilium_host subsys=linux-datapath
level=info msg="Detected devices" devices="[cilium_host eth0]" subsys=linux-datapath

level=debug msg="Attaching program to interface" device=cilium_host direction=ingress ifindex=3 objPath=1020_next/bpf_host.o progName=cil_to_host subsys=datapath-loader
level=debug msg="Attaching program to interface" device=cilium_host direction=egress ifindex=3 objPath=1020_next/bpf_host.o progName=cil_from_host subsys=datapath-loader
level=debug msg="Attaching program to interface" device=cilium_host direction=ingress ifindex=3 objPath=1020_next/bpf_netdev_cilium_host.o progName=cil_from_netdev subsys=datapath-loader
level=debug msg="Attaching program to interface" device=cilium_host direction=egress ifindex=3 objPath=1020_next/bpf_netdev_cilium_host.o progName=cil_to_netdev subsys=datapath-loader

This PR introduces an additional check to exclude cilium_host during the detection process.
I'm marking this PR for backport to all supported versions, given it matches the criteria "Major bugfix relevant to the correct operation of Cilium". Indeed, although rare, when all the conditions for the issue to occur are met, it causes complete connectivity disruption.

Fixes: #23840
Fix connectivity issue upon agent restart in case of ipv6 + direct routing + KPR replacement

/test

/ci-verifier


text:
Change routing-mode and tunnel-protocol based on .Values.tunnel and .Values.routingMode

Fixes https://github.com/cilium/cilium/issues/27756

Marking this for needs-backport since the tunnel flag will be removed in v1.15 according to the upgrade docs

The way I see it, tunnel should only be taken into consideration if routingMode isn't set, wouldn't you agree?
What if someone sets tunnel and tunnelProtocol to different things? That would unnecessarily complicate things.
Since tunnel is deprecated, it should be ignored when (the new) routingMode and tunnelProtocol are set.
The only case in which tunnel should be honored is if it were already set and none of the new values were explicitly given. (This would only happen if you upgraded Cilium without reading the release notes or ignored the deprecation notice).

Also, the commit subject is overly long, thus causing checkpatch.pl to fail in CI. Could you shorten it a bit and instead put the details in the commit message description? Thanks

Will fix it tomorrow.

Interesting, so with the new validation, some of our CI is now failing. For example:
https://github.com/cilium/cilium/actions/runs/6084377949/job/16513347947?pr=27841
Error: Unable to install Cilium: execution error at (cilium/templates/cilium-configmap.yaml:82:6): routingMode and tunnel are mutually exclusive. Please set only one of them.

We might have to change the CI workflows before we can merge this PR.

Hi @gandro,
Yes, that one was easy to fix by removing --helm-set=tunnel=disabled from the install command.
https://github.com/cilium/cilium/actions/runs/6084377962/job/16513356982 is a bit trickier since I can't find where the tunnel value is coming from (assuming there is nothing wrong with the validation).

I'd say it's a bug in cilium-cli:
❯ cilium install --dry-run-helm-values --helm-set=routingMode=native
cluster:
  name: colima-docker
operator:
  replicas: 1
routingMode: native
serviceAccounts:
  cilium:
    name: cilium
  operator:
    name: cilium-operator
tunnel: vxlan

Note I'm passing routingMode but it still generates tunnel in the output. If I force --datapath-mode=native, it works as expected.
Do you want me to add the workaround to the worflows?

Here the datapath-mode is set to tunnel because we're running on Kind.
And this is still using the old syntax. It should set tunnelProtocol instead.

Up for discussion: Should we actually force routingMode=native in the test workflows if cilium-cli data-path autodetect feature uses tunnel under similar circumstances?

Up for discussion: Should we actually force routingMode=native in the test workflows if cilium-cli data-path autodetect feature uses tunnel under similar circumstances?

Thanks for looking into it. I think we want to fix the CLI first. Especially if we backport this to v1.14, it might cause frictions to CLI users.
Aslo note that commit https://github.com/cilium/cilium/pull/27841/commits/30f3cf67808e189f25a15414e12d7abcd9d9c8b8 is likely not working because we don't run CI workflow from forks for security reasons.
Maybe a way forward would be to merge your PR without the validation, backport it to v1.14, In separate PRs, we can then fix CLI and CI for main branches, and then introduce the validation once all the tooling and CI has caught up. What do you think?

Maybe a way forward would be to merge your PR without the validation, backport it to v1.14, In separate PRs, we can then fix CLI and CI for main branches, and then introduce the validation once all the tooling and CI has caught up. What do you think?

Seems reasonable, though I have no say on most of what's going to happen outside this PR. I'd gladly revert it to a CI-passing state so that it can be merged. Everything else would depend more on Cilium committers than on me. If you're ok with it, just let me know when I can create the 2nd PR to add the validation.
Shall we proceed?

Sounds like a plan! Yeah I'm happy to drive the CI fixes forward. If you want, you could of course also attempt a PR for the CLI against cilium/cilium-cli to remove it's use of the tunnel flag on v1.14 and newer, but I can also take that over.

@gandro anything else?

@gandro anything else?

No, this looks good to me know! Thanks again, let's wait for the other CODEOWNERs to review.

/test

authors: gandro macmiranda


text:
makefile: check for $(CILIUM_CLI) dependency

Prior to this commit executing any target that invoked $(CILIUM_CLI) silently failed (as of $?==0), e.g. kind-install-cilium.
This commit adds check_deps target in the main Makefile, and adds it as a target dep for all targets using $(CILIUM_CLI).
See for instance:
~/dev/cilium$ make kind-install-cilium
kind is ready
  INSTALL cilium
# cilium-cli doesn't support idempotent installs, so we uninstall and
# reinstall here. https://github.com/cilium/cilium-cli/issues/205
# cilium-cli's --wait flag doesn't work, so we just force it to run
# in the background instead and wait for the resources to be available.
# https://github.com/cilium/cilium-cli/issues/1070
cilium install \
	--chart-directory=/home/msuneclo/dev/cilium/install/kubernetes/cilium \
	--helm-values=/home/msuneclo/dev/cilium/contrib/testing/kind-common.yaml --helm-values=/home/msuneclo/dev/cilium/contrib/testing/kind-values.yaml \
	--version= \
	>/dev/null 2>&1 &
~/dev/cilium$ echo $?
0
~/dev/cilium$ cilium --help
cilium: command not found

Issue
No issue, but I can create one if necessary.
kubectl and other deps are invoked in foreground, so they fail as expected. I could add them to check_deps though, to have cleaner messages. Please advise.
Release notes
Not sure if worth. Please advise.

/test

authors: joestringer msune


text:
Problems running gRPC server, misteriously led to failure attaching event_exit_acct_process on latest version

What happened?
This issue stated as a discussion with several participants who had mostly the same problem with Tetragon v1.0.0-v1.0.2.
Symptoms are:

Tetragon can't run due to liveness probe failure, which is based on tetra being connected to Tetragon over gRPC
When liveness probe is disabled Tetragon starts, but gRPC server not run despite logs say that it should:

time="2024-03-23T15:19:59Z" level=info msg="Starting gRPC server" address="localhost:54321" protocol=tcp

When this line is present there should be goroutine started with gRPC server instance.
However, what we observed is that for some mysterious reason it's not run, and stack trace shows no such goroutine - try search for "grpc" in the stack trace output:
# gops stack 1
goroutine 14 [running]:
runtime/pprof.writeGoroutineStacks({0x2e63600, 0xc00086a310})
        /usr/local/go/src/runtime/pprof/pprof.go:703 +0x6a
runtime/pprof.writeGoroutine({0x2e63600?, 0xc00086a310?}, 0xc0000a9400?)
        /usr/local/go/src/runtime/pprof/pprof.go:692 +0x25
runtime/pprof.(*Profile).WriteTo(0x2a6f74e?, {0x2e63600?, 0xc00086a310?}, 0x231f?)
        /usr/local/go/src/runtime/pprof/pprof.go:329 +0x146
github.com/google/gops/agent.handle({0x7c842f4de5c8?, 0xc00086a310}, {0xc0007a6000?, 0x1?, 0x1?})
        /go/src/github.com/cilium/tetragon/vendor/github.com/google/gops/agent/agent.go:200 +0xd2
github.com/google/gops/agent.listen({0x2e83de8, 0xc0002b9520})
        /go/src/github.com/cilium/tetragon/vendor/github.com/google/gops/agent/agent.go:144 +0x1a5
created by github.com/google/gops/agent.Listen in goroutine 1
        /go/src/github.com/cilium/tetragon/vendor/github.com/google/gops/agent/agent.go:122 +0x379

goroutine 1 [chan send]:
github.com/cilium/tetragon/pkg/sensors.(*Manager).RemoveAllSensors(...)
        /go/src/github.com/cilium/tetragon/pkg/sensors/manager.go:278
github.com/cilium/tetragon/pkg/observer.RemoveSensors({0x2e98248?, 0xc002d7e910})
        /go/src/github.com/cilium/tetragon/pkg/observer/observer.go:420 +0xc7
main.tetragonExecute.func5()
        /go/src/github.com/cilium/tetragon/cmd/tetragon/main.go:303 +0x1e
main.tetragonExecute()
        /go/src/github.com/cilium/tetragon/cmd/tetragon/main.go:440 +0x1c65
main.execute.func1(0xc000670700?, {0x2a63272?, 0x4?, 0x2a63276?})
        /go/src/github.com/cilium/tetragon/cmd/tetragon/main.go:733 +0xcb
github.com/spf13/cobra.(*Command).execute(0xc00056b200, {0xc000072050, 0x1, 0x1})
        /go/src/github.com/cilium/tetragon/vendor/github.com/spf13/cobra/command.go:944 +0x863
github.com/spf13/cobra.(*Command).ExecuteC(0xc00056b200)
        /go/src/github.com/cilium/tetragon/vendor/github.com/spf13/cobra/command.go:1068 +0x3a5
github.com/spf13/cobra.(*Command).Execute(...)
        /go/src/github.com/cilium/tetragon/vendor/github.com/spf13/cobra/command.go:992
main.execute()
        /go/src/github.com/cilium/tetragon/cmd/tetragon/main.go:746 +0x16f
main.main()
        /go/src/github.com/cilium/tetragon/cmd/tetragon/tetragon.go:11 +0x13

goroutine 138 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/controller.go:132 +0x25
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 134
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/controller.go:131 +0xab

goroutine 16 [syscall, 1 minutes]:
os/signal.signal_recv()
        /usr/local/go/src/runtime/sigqueue.go:152 +0x29
os/signal.loop()
        /usr/local/go/src/os/signal/signal_unix.go:23 +0x13
created by os/signal.Notify.func1.1 in goroutine 1
        /usr/local/go/src/os/signal/signal.go:151 +0x1f

goroutine 49 [chan receive, 1 minutes]:
main.tetragonExecute.func3(0x0?)
        /go/src/github.com/cilium/tetragon/cmd/tetragon/main.go:255 +0x50
created by main.tetragonExecute in goroutine 1
        /go/src/github.com/cilium/tetragon/cmd/tetragon/main.go:253 +0xed7

goroutine 50 [chan receive, 1 minutes]:
github.com/cilium/tetragon/pkg/sensors.startSensorManager.func1()
        /go/src/github.com/cilium/tetragon/pkg/sensors/manager.go:65 +0x65
created by github.com/cilium/tetragon/pkg/sensors.startSensorManager in goroutine 1
        /go/src/github.com/cilium/tetragon/pkg/sensors/manager.go:60 +0xc5

goroutine 51 [IO wait, 1 minutes]:
internal/poll.runtime_pollWait(0x7c842fb4cea8, 0x72)
        /usr/local/go/src/runtime/netpoll.go:343 +0x85
internal/poll.(*pollDesc).wait(0xc002b18000?, 0xc002b13c50?, 0x0)
        /usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
        /usr/local/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc002b18000)
        /usr/local/go/src/internal/poll/fd_unix.go:611 +0x2ac
net.(*netFD).accept(0xc002b18000)
        /usr/local/go/src/net/fd_unix.go:172 +0x29
net.(*TCPListener).accept(0xc002b16080)
        /usr/local/go/src/net/tcpsock_posix.go:152 +0x1e
net.(*TCPListener).Accept(0xc002b16080)
        /usr/local/go/src/net/tcpsock.go:315 +0x30
net/http.(*Server).Serve(0xc002d9c000, {0x2e83de8, 0xc002b16080})
        /usr/local/go/src/net/http/server.go:3056 +0x364
net/http.(*Server).ListenAndServe(0xc002d9c000)
        /usr/local/go/src/net/http/server.go:2985 +0x71
net/http.ListenAndServe(...)
        /usr/local/go/src/net/http/server.go:3239
github.com/cilium/tetragon/pkg/metrics.EnableMetrics({0xc000589144, 0x5})
        /go/src/github.com/cilium/tetragon/pkg/metrics/metrics.go:25 +0x1cf
created by main.tetragonExecute in goroutine 1
        /go/src/github.com/cilium/tetragon/cmd/tetragon/main.go:323 +0x109e

goroutine 81 [select]:
k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc002b98060)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:276 +0x305
created by k8s.io/client-go/util/workqueue.newDelayingQueue in goroutine 31
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:113 +0x21f

goroutine 31 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0xc0038ecb50, 0x0)
        /usr/local/go/src/runtime/sema.go:527 +0x159
sync.(*Cond).Wait(0xc000b808a0?)
        /usr/local/go/src/sync/cond.go:70 +0x85
k8s.io/client-go/util/workqueue.(*Type).Get(0xc000b808a0)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/util/workqueue/queue.go:200 +0x99
github.com/cilium/tetragon/pkg/metrics.StartPodDeleteHandler()
        /go/src/github.com/cilium/tetragon/pkg/metrics/metricwithpod.go:126 +0x44
created by main.tetragonExecute in goroutine 1
        /go/src/github.com/cilium/tetragon/cmd/tetragon/main.go:325 +0x10b6

goroutine 143 [select]:
github.com/cilium/tetragon/pkg/process.(*Cache).cacheGarbageCollector.func1()
        /go/src/github.com/cilium/tetragon/pkg/process/cache.go:47 +0xf1
created by github.com/cilium/tetragon/pkg/process.(*Cache).cacheGarbageCollector in goroutine 1
        /go/src/github.com/cilium/tetragon/pkg/process/cache.go:43 +0xe7

goroutine 137 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc002d7e190, 0xc001215dd0?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/shared_informer.go:803 +0x47
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:55 +0x1e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:72 +0x4f
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 134
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:70 +0x73

goroutine 96 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/shared_informer.go:969 +0x4b
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x30?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:226 +0x33
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc002b90f38?, {0x2e66c80, 0xc002bf9170}, 0x1, 0xc002ab0e40)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:227 +0xaf
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0xc0?, 0xc002b90f88?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:204 +0x7f
k8s.io/apimachinery/pkg/util/wait.Until(...)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0xc002586ab0)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/shared_informer.go:968 +0x69
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:72 +0x4f
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 111
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:70 +0x73

goroutine 86 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0xc002c2c028, 0x0)
        /usr/local/go/src/runtime/sema.go:527 +0x159
sync.(*Cond).Wait(0xc000943be0?)
        /usr/local/go/src/sync/cond.go:70 +0x85
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc002c2c000, 0xc002bcf9f0)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/delta_fifo.go:575 +0x236
k8s.io/client-go/tools/cache.(*controller).processLoop(0xc002c2a140)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/controller.go:188 +0x30
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x30?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:226 +0x33
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4466c0?, {0x2e66c80, 0xc002bf9080}, 0x1, 0xc0000d6420)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:227 +0xaf
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc002bfb6f0?, 0x3b9aca00, 0x0, 0x0?, 0xdf8475800?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:204 +0x7f
k8s.io/apimachinery/pkg/util/wait.Until(...)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0xc002c2a140, 0xc0000d6420)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/controller.go:159 +0x393
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc00370e210, 0x0?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/shared_informer.go:504 +0x2c8
github.com/cilium/tetragon/pkg/k8s/client/informers/externalversions.(*sharedInformerFactory).Start.func1()
        /go/src/github.com/cilium/tetragon/vendor/github.com/cilium/tetragon/pkg/k8s/client/informers/externalversions/factory.go:119 +0x5c
created by github.com/cilium/tetragon/pkg/k8s/client/informers/externalversions.(*sharedInformerFactory).Start in goroutine 1
        /go/src/github.com/cilium/tetragon/vendor/github.com/cilium/tetragon/pkg/k8s/client/informers/externalversions/factory.go:117 +0x205

goroutine 139 [select, 1 minutes]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0x4704d60?}, {0x2e7ae40, 0xc00250c500}, {0x7c842f8c6a20, 0xc00370e4d0}, {0x2ec3af0?, 0x2a1c760}, 0x0, ...)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:714 +0x17b
k8s.io/client-go/tools/cache.(*Reflector).watch(0xc002ba4540, {0x0?, 0x0?}, 0xc0000d6420, 0x61bf?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:433 +0x545
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc002ba4540, 0xc0000d6420)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:358 +0x36c
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:291 +0x25
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x10?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:226 +0x33
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc002514420?, {0x2e66ca0, 0xc002d7e640}, 0x1, 0xc0000d6420)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:227 +0xaf
k8s.io/client-go/tools/cache.(*Reflector).Run(0xc002ba4540, 0xc0000d6420)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:290 +0x1cd
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:55 +0x1e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:72 +0x4f
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 134
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:70 +0x73

goroutine 104 [chan receive]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/shared_informer.go:969 +0x4b
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x30?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:226 +0x33
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000948f38?, {0x2e66c80, 0xc003056090}, 0x1, 0xc00305a000)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:227 +0xaf
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x30?, 0xc0023da8a0?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:204 +0x7f
k8s.io/apimachinery/pkg/util/wait.Until(...)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0xc002507950)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/shared_informer.go:968 +0x69
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:72 +0x4f
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 47
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:70 +0x73

goroutine 105 [select]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0xc002507950)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/shared_informer.go:939 +0x10d
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:72 +0x4f
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 47
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:70 +0x73

goroutine 120 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0xc0031902e8, 0x0)
        /usr/local/go/src/runtime/sema.go:527 +0x159
sync.(*Cond).Wait(0xc002528be0?)
        /usr/local/go/src/sync/cond.go:70 +0x85
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc0031902c0, 0xc002585f30)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/delta_fifo.go:575 +0x236
k8s.io/client-go/tools/cache.(*controller).processLoop(0xc001762e60)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/controller.go:188 +0x30
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x30?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:226 +0x33
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4466c0?, {0x2e66c80, 0xc00297b8f0}, 0x1, 0xc0000d6420)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:227 +0xaf
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc002994f90?, 0x3b9aca00, 0x0, 0x0?, 0x0?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:204 +0x7f
k8s.io/apimachinery/pkg/util/wait.Until(...)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0xc001762e60, 0xc0000d6420)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/controller.go:159 +0x393
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc003190210, 0x0?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/shared_informer.go:504 +0x2c8
github.com/cilium/tetragon/pkg/k8s/client/informers/externalversions.(*sharedInformerFactory).Start.func1()
        /go/src/github.com/cilium/tetragon/vendor/github.com/cilium/tetragon/pkg/k8s/client/informers/externalversions/factory.go:119 +0x5c
created by github.com/cilium/tetragon/pkg/k8s/client/informers/externalversions.(*sharedInformerFactory).Start in goroutine 118
        /go/src/github.com/cilium/tetragon/vendor/github.com/cilium/tetragon/pkg/k8s/client/informers/externalversions/factory.go:117 +0x205

goroutine 115 [IO wait]:
internal/poll.runtime_pollWait(0x7c842fb4cdb0, 0x72)
        /usr/local/go/src/runtime/netpoll.go:343 +0x85
internal/poll.(*pollDesc).wait(0xc002cddd00?, 0xc002562000?, 0x0)
        /usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
        /usr/local/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc002cddd00, {0xc002562000, 0xa000, 0xa000})
        /usr/local/go/src/internal/poll/fd_unix.go:164 +0x27a
net.(*netFD).Read(0xc002cddd00, {0xc002562000?, 0xc00256603a?, 0x1a5?})
        /usr/local/go/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc0004d6008, {0xc002562000?, 0x6f33b7?, 0xc0031421b8?})
        /usr/local/go/src/net/net.go:179 +0x45
crypto/tls.(*atLeastReader).Read(0xc0005e9698, {0xc002562000?, 0xc0005e9698?, 0x0?})
        /usr/local/go/src/crypto/tls/conn.go:805 +0x3b
bytes.(*Buffer).ReadFrom(0xc0031422a8, {0x2e65a40, 0xc0005e9698})
        /usr/local/go/src/bytes/buffer.go:211 +0x98
crypto/tls.(*Conn).readFromUntil(0xc003142000, {0x2e63520?, 0xc0004d6008}, 0x5fcb?)
        /usr/local/go/src/crypto/tls/conn.go:827 +0xde
crypto/tls.(*Conn).readRecordOrCCS(0xc003142000, 0x0)
        /usr/local/go/src/crypto/tls/conn.go:625 +0x250
crypto/tls.(*Conn).readRecord(...)
        /usr/local/go/src/crypto/tls/conn.go:587
crypto/tls.(*Conn).Read(0xc003142000, {0xc003195000, 0x1000, 0x98cbc9?})
        /usr/local/go/src/crypto/tls/conn.go:1369 +0x158
bufio.(*Reader).Read(0xc003196000, {0xc003180200, 0x9, 0x25aecc0?})
        /usr/local/go/src/bufio/bufio.go:244 +0x197
io.ReadAtLeast({0x2e63320, 0xc003196000}, {0xc003180200, 0x9, 0x9}, 0x9)
        /usr/local/go/src/io/io.go:335 +0x90
io.ReadFull(...)
        /usr/local/go/src/io/io.go:354
golang.org/x/net/http2.readFrameHeader({0xc003180200, 0x9, 0xa8400?}, {0x2e63320?, 0xc003196000?})
        /go/src/github.com/cilium/tetragon/vendor/golang.org/x/net/http2/frame.go:237 +0x65
golang.org/x/net/http2.(*Framer).ReadFrame(0xc0031801c0)
        /go/src/github.com/cilium/tetragon/vendor/golang.org/x/net/http2/frame.go:498 +0x85
golang.org/x/net/http2.(*clientConnReadLoop).run(0xc00315ff98)
        /go/src/github.com/cilium/tetragon/vendor/golang.org/x/net/http2/transport.go:2275 +0x11f
golang.org/x/net/http2.(*ClientConn).readLoop(0xc003192000)
        /go/src/github.com/cilium/tetragon/vendor/golang.org/x/net/http2/transport.go:2170 +0x65
created by golang.org/x/net/http2.(*Transport).newClientConn in goroutine 114
        /go/src/github.com/cilium/tetragon/vendor/golang.org/x/net/http2/transport.go:821 +0xcbe

goroutine 84 [select]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0xc002ba4540, 0xc0000d6420, 0xc002ab0840, 0x209?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:370 +0x10f
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 139
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:357 +0x348

goroutine 44 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0xc00370e448, 0x19)
        /usr/local/go/src/runtime/sema.go:527 +0x159
sync.(*Cond).Wait(0xc0036f92c0?)
        /usr/local/go/src/sync/cond.go:70 +0x85
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc00370e420, 0xc0025047b0)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/delta_fifo.go:575 +0x236
k8s.io/client-go/tools/cache.(*controller).processLoop(0xc0031741e0)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/controller.go:188 +0x30
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x30?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:226 +0x33
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4466c0?, {0x2e66c80, 0xc002508ae0}, 0x1, 0xc0000d6420)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:227 +0xaf
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0025021d0?, 0x3b9aca00, 0x0, 0x0?, 0xdf8475800?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:204 +0x7f
k8s.io/apimachinery/pkg/util/wait.Until(...)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0xc0031741e0, 0xc0000d6420)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/controller.go:159 +0x393
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc00370e0b0, 0x0?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/shared_informer.go:504 +0x2c8
k8s.io/client-go/informers.(*sharedInformerFactory).Start.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/informers/factory.go:150 +0x5c
created by k8s.io/client-go/informers.(*sharedInformerFactory).Start in goroutine 1
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/informers/factory.go:148 +0x205

goroutine 85 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0xc002c01680, 0xc002aa7f00)
        /go/src/github.com/cilium/tetragon/vendor/golang.org/x/net/http2/transport.go:1464 +0xac7
golang.org/x/net/http2.(*clientStream).doRequest(0xc0025024e0?, 0xc002522fb8?)
        /go/src/github.com/cilium/tetragon/vendor/golang.org/x/net/http2/transport.go:1326 +0x18
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 139
        /go/src/github.com/cilium/tetragon/vendor/golang.org/x/net/http2/transport.go:1232 +0x308

goroutine 109 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0xc0028ac780, 0xc0027f4700)
        /go/src/github.com/cilium/tetragon/vendor/golang.org/x/net/http2/transport.go:1464 +0xac7
golang.org/x/net/http2.(*clientStream).doRequest(0xc0025021d0?, 0xc002529fb8?)
        /go/src/github.com/cilium/tetragon/vendor/golang.org/x/net/http2/transport.go:1326 +0x18
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 129
        /go/src/github.com/cilium/tetragon/vendor/golang.org/x/net/http2/transport.go:1232 +0x308

goroutine 47 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc002d7e140, 0x0?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/shared_informer.go:803 +0x47
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:55 +0x1e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:72 +0x4f
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 44
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:70 +0x73

goroutine 48 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/controller.go:132 +0x25
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 44
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/controller.go:131 +0xab

goroutine 129 [select]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0x4704d60?}, {0x2e7ae40, 0xc00250c300}, {0x7c842f8c6a20, 0xc00370e420}, {0x2ec3af0?, 0x2a1b8e0}, 0x0, ...)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:714 +0x17b
k8s.io/client-go/tools/cache.(*Reflector).watch(0xc002ba40e0, {0x0?, 0x0?}, 0xc0000d6420, 0xc003c4fd80?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:433 +0x545
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc002ba40e0, 0xc0000d6420)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:358 +0x36c
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:291 +0x25
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x10?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:226 +0x33
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc002514090?, {0x2e66ca0, 0xc002d7e2d0}, 0x1, 0xc0000d6420)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:227 +0xaf
k8s.io/client-go/tools/cache.(*Reflector).Run(0xc002ba40e0, 0xc0000d6420)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:290 +0x1cd
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:55 +0x1e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:72 +0x4f
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 44
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:70 +0x73

goroutine 108 [select]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0xc002ba40e0, 0xc0000d6420, 0xc00305a8a0, 0xf?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:370 +0x10f
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 129
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:357 +0x348

goroutine 106 [chan receive]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/shared_informer.go:969 +0x4b
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x30?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:226 +0x33
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc003c53738?, {0x2e66c80, 0xc0030560c0}, 0x1, 0xc00305a060)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:227 +0xaf
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x0?, 0xc003c53788?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:204 +0x7f
k8s.io/apimachinery/pkg/util/wait.Until(...)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0xc0025079e0)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/shared_informer.go:968 +0x69
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:72 +0x4f
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 47
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:70 +0x73

goroutine 107 [select]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0xc0025079e0)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/shared_informer.go:939 +0x10d
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:72 +0x4f
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 47
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:70 +0x73

goroutine 133 [sync.Cond.Wait]:
sync.runtime_notifyListWait(0xc0028ac7c8, 0x18)
        /usr/local/go/src/runtime/sema.go:527 +0x159
sync.(*Cond).Wait(0x2e79fe0?)
        /usr/local/go/src/sync/cond.go:70 +0x85
golang.org/x/net/http2.(*pipe).Read(0xc0028ac7b0, {0xc00216a001, 0x7dff, 0x7dff})
        /go/src/github.com/cilium/tetragon/vendor/golang.org/x/net/http2/pipe.go:76 +0xdf
golang.org/x/net/http2.transportResponseBody.Read({0x2a62177?}, {0xc00216a001?, 0x2a73ede?, 0xa?})
        /go/src/github.com/cilium/tetragon/vendor/golang.org/x/net/http2/transport.go:2558 +0x65
encoding/json.(*Decoder).refill(0xc001717e00)
        /usr/local/go/src/encoding/json/stream.go:165 +0x188
encoding/json.(*Decoder).readValue(0xc001717e00)
        /usr/local/go/src/encoding/json/stream.go:140 +0x9d
encoding/json.(*Decoder).Decode(0xc001717e00, {0x25ff1c0, 0xc0005e9dd0})
        /usr/local/go/src/encoding/json/stream.go:63 +0x75
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc002509560, {0xc002192000, 0x8000, 0xa000})
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc002d7e550, 0xc002516840?, {0x2e7a968, 0xc0020f1dc0})
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/runtime/serializer/streaming/streaming.go:77 +0xa3
k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc002b16840)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/rest/watch/decoder.go:49 +0x4b
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc00250c300)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:105 +0xdb
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 129
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:76 +0x125

goroutine 134 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0xc00370e4f8, 0x1)
        /usr/local/go/src/runtime/sema.go:527 +0x159
sync.(*Cond).Wait(0xc002a9ed40?)
        /usr/local/go/src/sync/cond.go:70 +0x85
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc00370e4d0, 0xc002504d90)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/delta_fifo.go:575 +0x236
k8s.io/client-go/tools/cache.(*controller).processLoop(0xc003174500)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/controller.go:188 +0x30
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x30?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:226 +0x33
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4466c0?, {0x2e66c80, 0xc0025096b0}, 0x1, 0xc0000d6420)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:227 +0xaf
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0025024e0?, 0x3b9aca00, 0x0, 0x0?, 0xdf8475800?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:204 +0x7f
k8s.io/apimachinery/pkg/util/wait.Until(...)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0xc003174500, 0xc0000d6420)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/controller.go:159 +0x393
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc00370e160, 0xc002524f20?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/shared_informer.go:504 +0x2c8
k8s.io/client-go/informers.(*sharedInformerFactory).Start.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/informers/factory.go:150 +0x5c
created by k8s.io/client-go/informers.(*sharedInformerFactory).Start in goroutine 1
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/informers/factory.go:148 +0x205

goroutine 142 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0xc002c016c8, 0x0)
        /usr/local/go/src/runtime/sema.go:527 +0x159
sync.(*Cond).Wait(0x58?)
        /usr/local/go/src/sync/cond.go:70 +0x85
golang.org/x/net/http2.(*pipe).Read(0xc002c016b0, {0xc003cea600, 0x200, 0x200})
        /go/src/github.com/cilium/tetragon/vendor/golang.org/x/net/http2/pipe.go:76 +0xdf
golang.org/x/net/http2.transportResponseBody.Read({0xc002b94d48?}, {0xc003cea600?, 0x2?, 0x100000009?})
        /go/src/github.com/cilium/tetragon/vendor/golang.org/x/net/http2/transport.go:2558 +0x65
encoding/json.(*Decoder).refill(0xc002548140)
        /usr/local/go/src/encoding/json/stream.go:165 +0x188
encoding/json.(*Decoder).readValue(0xc002548140)
        /usr/local/go/src/encoding/json/stream.go:140 +0x9d
encoding/json.(*Decoder).Decode(0xc002548140, {0x25ff1c0, 0xc002c84cc0})
        /usr/local/go/src/encoding/json/stream.go:63 +0x75
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc002c827e0, {0xc00253c800, 0x400, 0x400})
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc002d7e780, 0x8?, {0x2e7a968, 0xc00250c540})
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/runtime/serializer/streaming/streaming.go:77 +0xa3
k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc002b16d80)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/rest/watch/decoder.go:49 +0x4b
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc00250c500)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:105 +0xdb
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 139
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:76 +0x125

goroutine 94 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/shared_informer.go:969 +0x4b
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x30?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:226 +0x33
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000944f38?, {0x2e66c80, 0xc002bf9140}, 0x1, 0xc002ab0de0)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:227 +0xaf
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc002bf90b0?, 0x3b9aca00, 0x0, 0x20?, 0xc000944f88?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:204 +0x7f
k8s.io/apimachinery/pkg/util/wait.Until(...)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*processorListener).run(0xc002586b40)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/shared_informer.go:968 +0x69
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:72 +0x4f
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 122
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:70 +0x73

goroutine 89 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc002d7e1e0, 0xc0006847a8?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/shared_informer.go:803 +0x47
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:55 +0x1e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:72 +0x4f
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 86
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:70 +0x73

goroutine 90 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/controller.go:132 +0x25
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 86
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/controller.go:131 +0xab

goroutine 91 [select, 1 minutes]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0x4704d60?}, {0x2e7df60, 0xc002c282a0}, {0x7c842f8c6a20, 0xc002c2c000}, {0x2ec3af0?, 0x29ef460}, 0x0, ...)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:714 +0x17b
k8s.io/client-go/tools/cache.(*Reflector).watch(0xc003a1cb60, {0x0?, 0x0?}, 0xc0000d6420, 0xc000800000?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:433 +0x545
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc003a1cb60, 0xc0000d6420)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:358 +0x36c
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:291 +0x25
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x10?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:226 +0x33
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc002ab0c60?, {0x2e66ca0, 0xc002d0c320}, 0x1, 0xc0000d6420)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:227 +0xaf
k8s.io/client-go/tools/cache.(*Reflector).Run(0xc003a1cb60, 0xc0000d6420)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:290 +0x1cd
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:55 +0x1e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:72 +0x4f
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 86
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:70 +0x73

goroutine 93 [select]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0xc003a1cb60, 0xc0000d6420, 0xc002ab0d20, 0xc002540f10?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:370 +0x10f
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 91
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:357 +0x348

goroutine 144 [select]:
github.com/cilium/tetragon/pkg/eventcache.(*Cache).loop(0xc00250c5c0)
        /go/src/github.com/cilium/tetragon/pkg/eventcache/eventcache.go:169 +0x117
created by github.com/cilium/tetragon/pkg/eventcache.NewWithTimer in goroutine 1
        /go/src/github.com/cilium/tetragon/pkg/eventcache/eventcache.go:238 +0x178

goroutine 119 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0xc0028d6028, 0x0)
        /usr/local/go/src/runtime/sema.go:527 +0x159
sync.(*Cond).Wait(0xc000948be0?)
        /usr/local/go/src/sync/cond.go:70 +0x85
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc0028d6000, 0xc002879bd0)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/delta_fifo.go:575 +0x236
k8s.io/client-go/tools/cache.(*controller).processLoop(0xc00286d9a0)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/controller.go:188 +0x30
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x30?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:226 +0x33
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x4466c0?, {0x2e66c80, 0xc0028d41e0}, 0x1, 0xc0000d6420)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:227 +0xaf
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc002895b10?, 0x3b9aca00, 0x0, 0x0?, 0x0?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:204 +0x7f
k8s.io/apimachinery/pkg/util/wait.Until(...)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:161
k8s.io/client-go/tools/cache.(*controller).Run(0xc00286d9a0, 0xc0000d6420)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/controller.go:159 +0x393
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc003190160, 0x22a17f4?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/shared_informer.go:504 +0x2c8
github.com/cilium/tetragon/pkg/k8s/client/informers/externalversions.(*sharedInformerFactory).Start.func1()
        /go/src/github.com/cilium/tetragon/vendor/github.com/cilium/tetragon/pkg/k8s/client/informers/externalversions/factory.go:119 +0x5c
created by github.com/cilium/tetragon/pkg/k8s/client/informers/externalversions.(*sharedInformerFactory).Start in goroutine 118
        /go/src/github.com/cilium/tetragon/vendor/github.com/cilium/tetragon/pkg/k8s/client/informers/externalversions/factory.go:117 +0x205

goroutine 122 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc003148280, 0x2ea2f70?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/shared_informer.go:803 +0x47
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:55 +0x1e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:72 +0x4f
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 120
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:70 +0x73

goroutine 123 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/controller.go:132 +0x25
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 120
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/controller.go:131 +0xab

goroutine 124 [select, 1 minutes]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0x4704d60?}, {0x2e7ae40, 0xc002899280}, {0x7c842f8c6a20, 0xc0031902c0}, {0x2ec3af0?, 0x2a01200}, 0x0, ...)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:714 +0x17b
k8s.io/client-go/tools/cache.(*Reflector).watch(0xc002a300e0, {0x0?, 0x0?}, 0xc0000d6420, 0xc003c4ff80?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:433 +0x545
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc002a300e0, 0xc0000d6420)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:358 +0x36c
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:291 +0x25
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x10?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:226 +0x33
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc00298cf00?, {0x2e66ca0, 0xc0031482d0}, 0x1, 0xc0000d6420)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:227 +0xaf
k8s.io/client-go/tools/cache.(*Reflector).Run(0xc002a300e0, 0xc0000d6420)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:290 +0x1cd
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:55 +0x1e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:72 +0x4f
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 120
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:70 +0x73

goroutine 180 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0xc002a300e0, 0xc0000d6420, 0xc00305ae40, 0x25cbf40?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:370 +0x10f
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 124
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:357 +0x348

goroutine 111 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc003148230, 0x0?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/shared_informer.go:803 +0x47
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run.(*Group).StartWithChannel.func4()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:55 +0x1e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:72 +0x4f
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 119
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:70 +0x73

goroutine 112 [chan receive, 1 minutes]:
k8s.io/client-go/tools/cache.(*controller).Run.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/controller.go:132 +0x25
created by k8s.io/client-go/tools/cache.(*controller).Run in goroutine 119
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/controller.go:131 +0xab

goroutine 95 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0xc002586b40)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/shared_informer.go:939 +0x10d
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:72 +0x4f
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 122
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:70 +0x73

goroutine 161 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0xc002586ab0)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/shared_informer.go:939 +0x10d
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:72 +0x4f
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 111
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:70 +0x73

goroutine 177 [select, 1 minutes]:
k8s.io/client-go/tools/cache.watchHandler({0x0?, 0x0?, 0x4704d60?}, {0x2e7ae40, 0xc002a1cec0}, {0x7c842f8c6a20, 0xc0028d6000}, {0x2ec3af0?, 0x29fc4a0}, 0x0, ...)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:714 +0x17b
k8s.io/client-go/tools/cache.(*Reflector).watch(0xc0028d8000, {0x0?, 0x0?}, 0xc0000d6420, 0x0?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:433 +0x545
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc0028d8000, 0xc0000d6420)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:358 +0x36c
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:291 +0x25
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x10?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:226 +0x33
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc00305ac00?, {0x2e66ca0, 0xc0029fe0a0}, 0x1, 0xc0000d6420)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:227 +0xaf
k8s.io/client-go/tools/cache.(*Reflector).Run(0xc0028d8000, 0xc0000d6420)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:290 +0x1cd
k8s.io/client-go/tools/cache.(*controller).Run.(*Group).StartWithChannel.func2()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:55 +0x1e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:72 +0x4f
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start in goroutine 119
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:70 +0x73

goroutine 182 [select, 1 minutes]:
k8s.io/client-go/tools/cache.(*Reflector).startResync(0xc0028d8000, 0xc0000d6420, 0xc00305b140, 0xc002525fb8?)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:370 +0x10f
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch in goroutine 177
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/tools/cache/reflector.go:357 +0x348

goroutine 181 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0xc0028aca80, 0xc0027f4d00)
        /go/src/github.com/cilium/tetragon/vendor/golang.org/x/net/http2/transport.go:1464 +0xac7
golang.org/x/net/http2.(*clientStream).doRequest(0x0?, 0xc003c4ff10?)
        /go/src/github.com/cilium/tetragon/vendor/golang.org/x/net/http2/transport.go:1326 +0x18
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 124
        /go/src/github.com/cilium/tetragon/vendor/golang.org/x/net/http2/transport.go:1232 +0x308

goroutine 127 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0xc0028acc48, 0x0)
        /usr/local/go/src/runtime/sema.go:527 +0x159
sync.(*Cond).Wait(0x58?)
        /usr/local/go/src/sync/cond.go:70 +0x85
golang.org/x/net/http2.(*pipe).Read(0xc0028acc30, {0xc00319cc00, 0x200, 0x200})
        /go/src/github.com/cilium/tetragon/vendor/golang.org/x/net/http2/pipe.go:76 +0xdf
golang.org/x/net/http2.transportResponseBody.Read({0xc000947d48?}, {0xc00319cc00?, 0x2?, 0x10000000f?})
        /go/src/github.com/cilium/tetragon/vendor/golang.org/x/net/http2/transport.go:2558 +0x65
encoding/json.(*Decoder).refill(0xc002a223c0)
        /usr/local/go/src/encoding/json/stream.go:165 +0x188
encoding/json.(*Decoder).readValue(0xc002a223c0)
        /usr/local/go/src/encoding/json/stream.go:140 +0x9d
encoding/json.(*Decoder).Decode(0xc002a223c0, {0x25ff1c0, 0xc0029beaf8})
        /usr/local/go/src/encoding/json/stream.go:63 +0x75
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc00297bdd0, {0xc002a2dc00, 0x400, 0x400})
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc0031484b0, 0x8?, {0x2e7a968, 0xc002a1cf00})
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/runtime/serializer/streaming/streaming.go:77 +0xa3
k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc002597b20)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/rest/watch/decoder.go:49 +0x4b
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc002a1cec0)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:105 +0xdb
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 177
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:76 +0x125

goroutine 183 [select, 1 minutes]:
golang.org/x/net/http2.(*clientStream).writeRequest(0xc0028acc00, 0xc0027f5000)
        /go/src/github.com/cilium/tetragon/vendor/golang.org/x/net/http2/transport.go:1464 +0xac7
golang.org/x/net/http2.(*clientStream).doRequest(0x0?, 0xc003c4df10?)
        /go/src/github.com/cilium/tetragon/vendor/golang.org/x/net/http2/transport.go:1326 +0x18
created by golang.org/x/net/http2.(*ClientConn).RoundTrip in goroutine 177
        /go/src/github.com/cilium/tetragon/vendor/golang.org/x/net/http2/transport.go:1232 +0x308

goroutine 184 [sync.Cond.Wait, 1 minutes]:
sync.runtime_notifyListWait(0xc0028acac8, 0x0)
        /usr/local/go/src/runtime/sema.go:527 +0x159
sync.(*Cond).Wait(0xc0028acab8?)
        /usr/local/go/src/sync/cond.go:70 +0x85
golang.org/x/net/http2.(*pipe).Read(0xc0028acab0, {0xc0039aa800, 0x200, 0x200})
        /go/src/github.com/cilium/tetragon/vendor/golang.org/x/net/http2/pipe.go:76 +0xdf
golang.org/x/net/http2.transportResponseBody.Read({0xc003c4dd48?}, {0xc0039aa800?, 0xc003c4dd10?, 0xc003c4dcac?})
        /go/src/github.com/cilium/tetragon/vendor/golang.org/x/net/http2/transport.go:2558 +0x65
encoding/json.(*Decoder).refill(0xc002889900)
        /usr/local/go/src/encoding/json/stream.go:165 +0x188
encoding/json.(*Decoder).readValue(0xc002889900)
        /usr/local/go/src/encoding/json/stream.go:140 +0x9d
encoding/json.(*Decoder).Decode(0xc002889900, {0x25ff1c0, 0xc0028e2210})
        /usr/local/go/src/encoding/json/stream.go:63 +0x75
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc0028d5ef0, {0xc0028cf400, 0x400, 0x400})
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/util/framer/framer.go:152 +0x19c
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc0029fe5f0, 0xc003192050?, {0x2e7a968, 0xc0028992c0})
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/runtime/serializer/streaming/streaming.go:77 +0xa3
k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc0028f65c0)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/client-go/rest/watch/decoder.go:49 +0x4b
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc002899280)
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:105 +0xdb
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher in goroutine 124
        /go/src/github.com/cilium/tetragon/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:76 +0x125

Here is gops 1 output in our case, it's clear that gRPC server is not run:
# gops 1
threads:        16
memory usage:   0.540%
cpu usage:      1.152%
username:       root
cmd+args:       /usr/bin/tetragon --config-dir=/etc/tetragon/tetragon.conf.d/
elapsed time:   01:21
local/remote:   127.0.0.1:8118 <-> 0.0.0.0:0 (LISTEN)
local/remote:   0.0.0.0:2112 <-> 0.0.0.0:0 (LISTEN)
local/remote:   10.80.122.156:42272 <-> 10.43.0.1:443 (ESTABLISHED)

After upgrade to latest CI image with help of these command:
helm install --namespace kube-system \
        --set tetragonOperator.image.override=quay.io/cilium/tetragon-operator-ci:latest \
        --set tetragon.image.override=quay.io/cilium/tetragon-ci:latest  \
        tetragon cilium/tetragon

Tetragon start failing to start with this message:
time="2024-03-26T12:26:53Z" level=info msg="tetragon, map loaded." map=tg_execve_joined_info_map_stats path=/sys/fs/bpf/tetragon/tg_execve_joined_info_map_stats sensor=__base__
time="2024-03-26T12:26:53Z" level=info msg="tetragon, map loaded." map=execve_calls path=/sys/fs/bpf/tetragon/execve_calls sensor=__base__
time="2024-03-26T12:26:53Z" level=info msg="tetragon, map loaded." map=tcpmon_map path=/sys/fs/bpf/tetragon/tcpmon_map sensor=__base__
time="2024-03-26T12:26:53Z" level=info msg="tetragon, map loaded." map=tg_conf_map path=/sys/fs/bpf/tetragon/tg_conf_map sensor=__base__
time="2024-03-26T12:26:53Z" level=info msg="tetragon, map loaded." map=tg_stats_map path=/sys/fs/bpf/tetragon/tg_stats_map sensor=__base__
time="2024-03-26T12:26:53Z" level=info msg="Loading BPF program" Attach=acct_process Program=/var/lib/tetragon/bpf_exit.o Type=kprobe
time="2024-03-26T12:26:53Z" level=info msg="BPF events statistics: 0 received, 0% events loss"
time="2024-03-26T12:26:53Z" level=info msg="Observer events statistics" errors=0 filterDrop=0 filterPass=0 lost=0 received=0
time="2024-03-26T12:26:53Z" level=info msg="sensor controller starts"
time="2024-03-26T12:26:53Z" level=fatal msg="Failed to start tetragon" error="failed prog /var/lib/tetragon/bpf_exit.o kern_version 328721 loadInstance: attaching 'event_exit_acct_process' failed: creating perf_kprobe PMU (arch-specific fallback for \"acct_process\"): token acct_process: opening perf event: operation not permitted"

OS is Oracle Linux 8.5 with CONFIG_BSD_PROCESS_ACCT enabled
# grep CONFIG_BSD_PROCESS_ACCT  /boot/config-$(uname -r)
CONFIG_BSD_PROCESS_ACCT=y
CONFIG_BSD_PROCESS_ACCT_V3=y

Also:
# grep acct_process < /proc/kallsyms
ffffffffb7d5fc20 t do_acct_process
ffffffffb7d60810 T acct_process

Tetragon Version
v1.0.0, v1.0.2, latest CI
Kernel Version
5.4.17-2136.304.4.1.el8uek.x86_64
Kubernetes Version
No response
Bugtool
No response
Relevant log output
No response
Anything else?
No response

Thanks @inliquid,
Is oracle linux using lockdown by any chance? What's the output of:
 sudo cat /sys/kernel/security/lockdown

Yes it seems so:
# cat /sys/kernel/security/lockdown
none integrity [confidentiality]

This mode prohibits loading BPF programs, which means that Tetragon cannot really work. We suggest  to switch to "integrity" instead. See https://github.com/iovisor/bcc/issues/2565 for more discussion on this.
There is a PR from @tixxdz to issue an early warning about this: https://github.com/cilium/tetragon/pull/2149.

@kkourt @tixxdz thank you, makes sense!
I'll try with "integrity" mode and get back with result.

source: gharchive/issue

authors: inliquid kkourt

repo: cilium/tetragon


text:
build(deps): bump github.com/cilium/cilium from 1.9.16 to 1.10.14 in /pkg/k8s

build(deps): bump github.com/cilium/cilium from 1.9.16 to 1.10.14 in /pkg/k8s
Fixes: #764

I'm closing this since it was resolved by the renovate bot. Thanks!


text:
🛑 Collection Analysis Datasette is down

In 700afe4, Collection Analysis Datasette (https://collection-analysis.cincy.pl/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Collection Analysis Datasette is back up in b153ea1 after 4 minutes.

repo: cincinnatilibrary/uptime-reports

license: MIT


text:
⚠ Cioos Pacific CKAN Sitemap has degraded performance

In 1e752bc, Cioos Pacific CKAN Sitemap (https://catalogue.cioospacific.ca/sitemap/sitemap-1.xml) experienced degraded performance:

HTTP code: 200
Response time: 13728 ms

Resolved: Cioos Pacific CKAN Sitemap performance has improved in 0002bc2 after 1 hour, 43 minutes.

repo: cioos-siooc/cwatch-upptime


text:
⚠ St. Lawrence Global Observatory CKAN Sitemap has degraded performance

In ca26347, St. Lawrence Global Observatory CKAN Sitemap (https://catalogue.ogsl.ca/sitemap/sitemap-1.xml) experienced degraded performance:

HTTP code: 200
Response time: 20174 ms

Resolved: St. Lawrence Global Observatory CKAN Sitemap performance has improved in a7b275c after 1 hour, 24 minutes.


text:
Full Tables  Paging component is not i18N supported

this depend on nz-pagination component, so i can't, just only wait ng-zorro-antd supports.

authors: Huangdongrong cipchk

repo: cipchk/ng-alain

license: mit

license_source: bigquery


text:
Unable to convert wallet to new schema

Hi,
I'm use msigna for long time ago, now i download the latest version and try to open my wallet, but i'm facing with a problme:
First msigna say:
"File was created using schema 17. Current schema version is 22.
Schema can be upgraded. Would you like to make a backup and migrate the file to the new schema now?"
So i choose OK for this.
Than I get this error:
"operation can only be performed in transaction"
Is there any way to convert my old wallet somehow?
Thanks!
Regards
Daniel

I have the same issue. I upgraded and cannot access any accounts.
Is there any user support for this product?

Same Issue here trying to convert from schema 16.
I cant seem to remember what Program I used to create the .vault file with.

Hi everyone,
I created a new vault file and then imported all my accounts. There are several issues with this:

It takes FORVER! It literally goes back to the day you created the vault and rebuilds it by importing all the blocks. It took me 10 days because the program keep quitting and I had to keep restarting it.
I managed to send a transaction during all of this with an older version but somehow the wallet sent the unspent output to a change address (this is normal) and that change address doesn't show up in my account address list. I actually did see it there in one of the versions but it was duplicated!
When it sent the unspent output to this change address, the coins were immediately swept into another address which I believe to be a miner's address. I think I have lost those coins. It's a lot of money.

Suggestions:

When re-building the vault file, don't mess with anything
At points, stop the sync by disconnecting from the server and make a copy of the vault file. If anything goes wrong, you can restart it from that file and not have to start all over from scratch again

Does anyone here know how to obtain your private key from the BIP32 Extended Private Key?
That will solve most of the issues because you can control your coins from another wallet or blockchain.info

There are some known issues with migrating vault files. DO NOT SEND transactions with v0.10.1 through 0.10.5 as these versions have a critical security issue.
Unfortunately, recreating the vault file from accounts is the only workaround.

Yes I have the same issue as above. I tried to import the old schema, and it says
"error in vault file. Please import keychains into a new vault file and recreate account." But doing so doesn't give me access to my funds and I didn't export the account file. Trying to go backwards compatible doesn't work either. This is very frustrating as there is little to no support and the stupid thing doesn't work. As a software developer, this is very poor design. You guys should've known that upgrading would be a necessity in the future and made backwards compatibility a priority in order to prevent this feedback loop of being stuck.
Now when I try to open the vault in the old version where it used to work it says the schema is too new, I have to import. WTF?!

You can download an older version from mSigna here https://ciphrex.com/releases/win64/
I had the same issue when upgrading to a new PC, i installed newer mSigna and it was a no go. I just installed the older version so I could access my wallet. I will just send all my coins to my hardware wallet, upgrade mSigna and then load back what I want to trade with.

authors: CodeShark MSISGNAHELP MrFloip highOnBytes jnbordnrt tejeskifly

repo: ciphrex/mSIGNA


text:
Release a new version?

Hi @travisbrown ,
Is it possible for you to release a new version, please?
I hit this fixed-in-master problem: https://github.com/circe/circe-golden/pull/63
Thanks.
Jules 🙂

Same here, I just hit the problem too. Would be very nice if you can release a new version soon.

Same here, I just hit the problem too. Would be very nice if you can release a new version soon.

Ah, sure, and my apologies, I thought I had done this already.

Ah, sure, and my apologies, I thought I had done this already.

0.3.0 is out now, and will be the last release supporting ScalaCheck 1.14. I'll publish an 0.4.0 later today for ScalaCheck 1.15 (and release notes for both).

0.3.0 is out now, and will be the last release supporting ScalaCheck 1.14. I'll publish an 0.4.0 later today for ScalaCheck 1.15 (and release notes for both).

Thanks @travisbrown :)

Thanks @travisbrown :)

authors: guizmaii travisbrown yoohaemin

repo: circe/circe-golden


text:
Example folder seems to be missing...

Hello! I'm trying to intergrate this into my react native app, but there's not really any documentation or examples. I've seen in package.json there's an example folder in one of the scripts but it's not in this repository.

Hi, there is no example folder in this project, since this module was needed for a specific project that we were working on. Also the docs are obfuscated, and only the most important stuff is there. I will add examples when I have some time.


text:
Fixing frontend image vulnerabilities

Fixing frontend vulnerabilities by updating the base image, some packages and provide overrides for some dependencies.
🗣 Description
Run apk update upgrade to eliminate openssl vuln in base image.
Upgraded some node packages.
Added some overrides to use version of dependencies that don't have vulns.
💭 Motivation and context
Remove vulnerabilities from frontend image.
🧪 Testing
Access the url on the local host.
📷 Screenshots (if appropriate)

✅ Pre-approval checklist

[x] This PR has an informative and human-readable title.
[x] Changes are limited to a single goal - eschew scope creep!
[x] All future TODOs are captured in issues, which are referenced
in code comments.
[x] I have read the CONTRIBUTING document.
[x] These code changes follow cisagov code standards.
[x] All new and existing tests pass.

Working on frontend test failure.

It looks like the frontend “test” pipeline is not working — can you look into that?

looking into it presently!

Build and test failures for frontend were resolved. Please approve.

repo: cisagov/crossfeed


text:
Instructions for the COOL setup seem outdated

🐛 Summary
When stepping through the "Setting up a Mac-based development environment" there is a sub section that seems to be outdated:
"Setup for the COOL". When I attempted to follow the steps each link that was listed just took me to the same COOL repo.
Also, when investigating the COOL repo, it seems that the repo will be decommissioned in a few months. This leads me to believe that maybe the instructions on the "Setup for the COOL" might need to be removed all together.
To reproduce
Steps to reproduce the behavior:

Go to this link https://github.com/cisagov/development-guide/blob/develop/dev_envs/mac-env-setup.md
Then scroll to the section "Setup for the COOL"
Attempt to setup the COOL

Expected behavior
User stepping through the guide should be able to follow the steps successfully to setup the COOL.

The Wiki pages that were linked in that section no longer exist.  The current temporary replacement URLs are below:

Install MIT Kerberos
Configuring Kerberos for the COOL
Configuring your browser for the COOL
these instructions to access Guacamole

@michaelsaki If you could create a PR to update those links, we would very much appreciate that!

repo: cisagov/development-guide


text:
Update cisagov_C.yml

Providing the latest changes for Citrix products and services in context to the Log4j vulnerabilities

🗣 Description

💭 Motivation and context

🧪 Testing

✅ Pre-approval checklist

[ ] This PR has an informative and human-readable title.
[ ] Changes are limited to a single goal - eschew scope creep!
[ ] All future TODOs are captured in issues, which are referenced
in code comments.
[ ] All relevant type-of-change labels have been added.
[ ] I have read the CONTRIBUTING document.
[ ] These code changes follow cisagov code standards.
[ ] All relevant repo and/or project documentation has been updated
to reflect the changes in this PR.
[ ] Tests have been added and/or modified to cover the changes in this PR.
[ ] All new and existing tests pass.

✅ Pre-merge checklist

[ ] Revert dependencies to default branches.
[ ] Finalize version.

✅ Post-merge checklist

[ ] Add a tag or create a release.

Good to go :)

authors: Sidgawri justmurphy


text:
Support strict mode for schemas

Should it be possible to set strict mode for a schema and that superValidate throws an exception (or rather, passes on the Zod exception)?
The same if strict is set for a field within the schema?

This could be a breaking change, since adding strict to a schema currently does nothing, so it has to wait.

Hi @ciscoheat  - trying to migrate some GraphQl mutations to Sveltekit superforms and this issue came up when integration testing.
GraphQl does not allow "extra" fields, but with Superforms/Zod, the schema is valid --> even if I provide .strict.
Is there a workaround until this feature is upgraded :) ?

Hi, maybe you can use Object.keys(schema.shape) to get the keys, and filter based on that. If there are effects on the schema, you have to unwrap it first, which you can do like this.

authors: alexbjorlig ciscoheat

repo: ciscoheat/sveltekit-superforms


text:
AAD account ?

If you sign up for an AAD account (enter your email and password), do you get a welcome email? Right now that would be the same email you would get if you sign up for a drain....or do you only get a welcome email after you adopt your first drain? Trying to sort out which emails need to be updated/created.

Off the top of my head, there is a "thanks" email for the first and second adoption. I don't believe there is a welcome email.

but there would be an email (maybe not a 'welcome' email) if we set up some sort of password verification/check for a legitimate email address...

Correct, there will be a "Please verify you own this email account" email - issue #164. I feel like it'd be appropriate to also say "Welcome" in that email. I can supply rough draft verbiage for #164 if you'd like to work on the Welcome part.

Sounds  good!

No welcome email
1st adoption sends email
2nd adoption sends email
3rd email NO

authors: Wilfongjt beyondtheteal cara-lgrow

repo: citizenlabsgr/adopt-a-drain


text:
updated postal address

and some rewording

PR has conflicts. @makuhama could you please rebase and solve the conflicts?

Done.
I think Nico has removed a little bit too much (and also forgot to remove the link to www.consol.de)

authors: christophd makuhama

repo: citrusframework/citrus-website


text:
Master_add_node also accepts IP addresses

Fixes #214

Some other potential sections to changes:
https://docs.citusdata.com/en/v6.0/faq/faq.html?highlight=master_add_node#how-do-i-add-nodes-to-an-existing-citus-cluster
https://docs.citusdata.com/en/v6.0/installation/production_deb.html?highlight=master_add_node#steps-to-be-executed-on-the-master-node (we note this line: "Add the workers’ DNS names and server ports to the table.")
https://docs.citusdata.com/en/v6.0/installation/production_rhel.html?highlight=master_add_node

authors: begriffs sumedhpathak


text:
A bug in converter

in tools/converter/converter.py line 399 ,this sentence
for phase,duration in tls_dict[nodeid]._programs['0']._phases:
will not work since there is no iter(self) and next(self) in  sumo(Version 1.7.0).
Besides, there is more than two elements to unpack and this can lead to error too.
Use the fllowing sentence
for current_phase in tls_dict[nodeid]._programs['0']._phases :
,modify the relative variable in line 399 to line 420  and add iter,next in Sumo/tools/sumolib/net/init.py can fix it.

Can you explain a little more detailed how to fix that issue? Couldn't fix it

Can you explain a little more detailed how to fix that issue? Couldn't fix it

You can find the working verision code in my  respositories.
Once again, remember to add two function __iter(self)__ and  __next(self)__ in Sumo/tools/sumoliv/net/__init.py which are essential for python to finish the for in loop.

Can you explain a little more detailed how to fix that issue? Couldn't fix it

You can find the working verision code in my respositories.
Once again, remember to add two function __iter(self)__ and __next(self)__ in Sumo/tools/sumoliv/net/__init.py which are essential for python to finish the for in loop.

Can you explain a little more detailed how to fix that issue? Couldn't fix it

You can find the working verision code in my respositories.
Once again, remember to add two function __iter(self)__ and __next(self)__ in Sumo/tools/sumoliv/net/__init.py which are essential for python to finish the for in loop.

I'm going through the same problem. Where should I add these functions in init.py?

I'm going through the same problem. Where should I add these functions in __init__.py?
Well... exactly in Sumo/tools/sumolib/net/__init.py class Phase.
You will most likely to see this class in line 93.

I think that the discussion above can clearly solve this problem now, so I decided to close it. If anyone watching this still have trouble fixing it, you can just check the working version in my respositories.(I also forked sumo, so you can check how I fixed it there, it's quiet simple)

authors: Salchipao X3nOph0N guiga-mertens

repo: cityflow-project/CityFlow


text:
User does not have a home folder

In case you experience issues with docker image provided by linuxserver.io/papermerge, please open bug report in their repository.
Description
After creating a new user, logging out the admin user, and trying to log in as the newly created user, get a screen with only this message: User does not have home folder
Using the docker-compose file in the 3.0 documentation to run papermerge
Expected
Expected a return to the log in screen so that I could log in as the newly created user
Actual
No login screen. Just the above message
Info:

OS: Ubuntu 22.04 LTS with docker
Browser Chrome running on Linuxmint
Database SQLite
Papermerge Version 3.0 stable
pmbizDockerLog.txt

Hello!
I've also encountered the same issue. As a workaround, I've tried to update the home_folder_id by performing a PATCH request on the specified endpoint (api/users/user_id), but without success. I've tried to change any other field (e.g. username, email) and it has worked, but for home_folder_id it still assigns null.

@thndrbck, @cezarasurdoiu  thank you for reporting this issue. This is definitely a bug.
The bug is there because this line of code was not invoked upon user creation
Did you create new user via web UI ?
Until fix is available, here is the workaround:
While Papermerge instance is up and running , you need to enter into web app's docker container.
For that:
$ docker ps

CONTAINER ID   IMAGE                       COMMAND                  CREATED        STATUS         PORTS                                     NAMES
8b74e4fac42f   pcore-web                   "/run.bash server"       14 hours ago   Up 6 minutes   0.0.0.0:11000->80/tcp, :::11000->80/tcp   pcore-web-1
4e59703425f8   pcore-worker                "/run.bash worker"       14 hours ago   Up 6 minutes   80/tcp                                    pcore-worker-1
d2d745d1428c   redis:6                     "docker-entrypoint.s…"   3 days ago     Up 6 minutes   6379/tcp                                  pcore-redis-1
e9bfa7258ac2   bitnami/postgresql:16.1.0   "/opt/bitnami/script…"   3 days ago     Up 6 minutes   5432/tcp                                  pcore-db-1

In example above, web app container is 8b74e4fac42f.
Then:
$ docker exec -it 8b74e4fac42f /bin/bash

While in container, activate app's virtual environment (without changing current folder, which by default is /core_app):
$ source ./venv/bin/activate

Then enter into Django's shell:
$ ./manage.py shell

In django shell run following commands (let's say user without home folder has username john):
1. from papermerge.core.models import User
2. user = User.objects.get(username='john')
3. user.create_special_folders()
4. user.save()

At this point your user should have both home folder and inbox folder; you can double check that with (while in Django's shell):
1. user.home_folder
2. user.inbox_folder

Both statements should return valid home/inbox folder with UUIDs

Hello, @ciur ! Yes, in my case, the new user was created via web UI. Thank you for the detailed workaround, it worked for me. Now, the login with a new user works as expected!

I cannot reproduce the problem locally, but intuitively I think where the problem may be.
This PR should fix the problem. The change is about creating users/inbox/home  in one DB transaction.
The fix will be available in 3.0.1 release.

I'll test it again with version 3.01
On Sat, Jan 13, 2024, 2:17 AM Eugen Ciur @.***> wrote:

I cannot reproduce the problem locally, but intuitively I think where the
problem may be.
This PR https://github.com/papermerge/papermerge-core/pull/301 should
fix the problem. The change is about creating users/inbox/home in one DB
transaction.
The fix will be available in 3.0.1 release.
—
Reply to this email directly, view it on GitHub
https://github.com/ciur/papermerge/issues/572#issuecomment-1890355198,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AEADQQR3THWGP35JLN3XUGDYOIYKFAVCNFSM6AAAAABBNMT74KVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOJQGM2TKMJZHA
.
You are receiving this because you were mentioned.Message ID:
@.***>

authors: cezarasurdoiu ciur thndrbck

repo: ciur/papermerge