Commit Graph

6 Commits

Author SHA1 Message Date
John Schnake
d0ab1f06fb Allow disruptive conformance tests and marks 2
- Adjusts tooling to allow disrutpive tests to be marked conformance
 - Updates the corresponding tests
 - Marks 2 tests as disruptive
2019-09-24 14:17:37 -05:00
Aaron Crickenberger
ffe70f1a6e Conformance walker should handle nested/adjacent Describes
This also revealed that the regex for Context was too generous and would
catch things like SecurityContext or ContextWithFoo(...) calls

This ensures that test suites with a ineligible tag in their top-level
Describe will be rejected from promotion to conformance
2019-06-25 21:41:38 -07:00
Aaron Crickenberger
67be4f5d06 Error on tests ineligible for promotion to conformance
If there are tags in the test name that describe qualities of the
test that make it ineligible for conformance, raise an error. This
is basically the "skip list" that heptio's e2e image used to use.

Thankfully all of our existing Conformance tests lack these tags. I
considered added [Slow] to the list, but let's save that for another
day.
2019-06-05 10:36:59 -07:00
Srini Brahmaroutu
1cb5872cd3 Comment association to ConformanceIt block should be validated properly. 2019-05-07 09:16:44 -07:00
Yu-Ju Hong
1816d4eca4 conformance: normalize the test names
To detect whether conformance tests have been changed, the test
argument with the `ConformanceIt` is recorded to conformance.txt.
This change remove additional tags (e.g., [Feature:]) and trim spaces,
so that the detection is less-prone to noise.

This change also updates conformance.txt with normalized names.
2018-05-23 12:49:31 -07:00
Srini Brahmaroutu
fa51acbda3 Create Conformance document to display all tests that belong to Conformance suite 2018-01-15 14:17:48 -08:00