kubernetes/test
Patrick Ohly 97a8d72a67 test/integration/logs: update benchmark support
When trying again with recent log files from the CI job, it was found that some
JSON messages get split across multiple lines, both in container logs and in
the systemd journal:

   2022-12-21T07:09:47.914739996Z stderr F {"ts":1671606587914.691,"caller":"rest/request.go:1169","msg":"Response ...
   2022-12-21T07:09:47.914984628Z stderr F 70 72  6f 78 79 10 01 1a 13 53 ... \".|\n","v":8}

Note the different time stamp on the second line. That first line is
long (17384 bytes). This seems to happen because the data must pass through a
stream-oriented pipe and thus may get split up by the Linux kernel.

The implication is that lines must get merged whenever the JSON decoder
encounters an incomplete line. The benchmark loader now supports that. To
simplifies this, stripping the non-JSON line prefixes must be done before using
a log as test data.

The updated README explains how to do that when downloading a CI job
result. The amount of manual work gets reduced by committing symlinks under
data to the expected location under ci-kubernetes-kind-e2e-json-logging and
ignoring them when the data is not there.

Support for symlinks gets removed and path/filepath is used instead of path
because it has better Windows support.
2023-03-07 16:03:48 +01:00
..
cmd Re-enable label selector 2023-02-20 09:10:51 +03:00
conformance turn field validation e2e tests into conformance tests 2023-02-27 14:39:21 -08:00
e2e Merge pull request #116040 from pbeschetnov/master 2023-03-07 04:20:16 -08:00
e2e_kubeadm e2e: use Ginkgo context 2022-12-16 20:14:04 +01:00
e2e_node test: Fix node e2e shutdown test flake 2023-03-06 15:38:45 -08:00
fixtures Updating pause image refernces to 3.9 2022-11-14 10:24:54 -08:00
fuzz
images node: device-mgr: sample device plugin: control registration process 2023-03-01 10:00:52 +00:00
instrumentation include beta metrics in documentation and update docs for metrics 2023-03-01 11:32:19 -08:00
integration test/integration/logs: update benchmark support 2023-03-07 16:03:48 +01:00
kubemark Drop unsupported iks configuration for kubemark 2022-09-25 17:33:22 -04:00
list
soak/serve_hostnames fix typos 2022-06-15 13:38:48 +09:00
typecheck Avoid typechecking stdlib 2023-01-28 23:32:50 -05:00
utils Add integration tests 2023-03-06 21:51:33 -05:00
OWNERS test/OWNERS: add pohly as approver 2023-01-09 09:54:10 +01:00