kubernetes/test/conformance
John Schnake 2683b1065c Update the conformance list and doc generation logic
The existing walk.go and conformance.txt have a few shortcomings
which we'd like to resolve:
 - difficult to get the full test name due to test context nesting
 - complicated AST logic and understanding necessary due to the
different ways a test can be invoked and written

This changes the AST parsing logic to be much more simple and simply
looks for the comments at/around a specific line. This file/line
information (and the full test name) is gathered by a custom ginkgo
reporter which dumps the SpecSummary data to a file.

Also, the SpecSummary dump can, itself, be potentially useful for
other post-processing and debugging tasks.

Signed-off-by: John Schnake <jschnake@vmware.com>
2020-02-24 14:00:44 -08:00
..
behaviors Merge pull request #88126 from johnbelamaric/behaviors-readme 2020-02-18 14:04:41 -08:00
kubetestgen Validation for behaviors 2020-02-04 10:45:53 -08:00
testdata Update the conformance list and doc generation logic 2020-02-24 14:00:44 -08:00
BUILD Update the conformance list and doc generation logic 2020-02-24 14:00:44 -08:00
cf_header.md Update the conformance list and doc generation logic 2020-02-24 14:00:44 -08:00
conformance_test.sh Update the conformance list and doc generation logic 2020-02-24 14:00:44 -08:00
doc.go Update the conformance list and doc generation logic 2020-02-24 14:00:44 -08:00
OWNERS Add johnbelamaric as conformance code reviewer/approver 2019-11-12 13:51:16 -08:00
README.md Update the conformance list and doc generation logic 2020-02-24 14:00:44 -08:00
walk_test.go Update the conformance list and doc generation logic 2020-02-24 14:00:44 -08:00
walk.go Update the conformance list and doc generation logic 2020-02-24 14:00:44 -08:00

This directory contains the regression test for controlling the list of all conformance tests.

If you add or remove a conformance test, this test will fail and you will need to update the golden list of tests stored in testdata/. Changes to that file require review by sig-architecture.

To update the list, run

bazel build //test/conformance:list_conformance_tests
cp bazel-genfiles/test/conformance/conformance.yaml test/conformance/testdata

Add the changed file to your PR, then send for review.