Monday, November 6 • 11:15am - 11:45am
Conformance Profiles: Building a generic conformance test reporting framework

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
API conformance is a hot topic for all the Kubernetes APIs at a certain level of maturity, and that maturity came for the Gateway API as well. Since the first APIs got into beta version, gateway conformance tests have been added to help the downstream projects build a conformant and reliable implementation. After that, the amount of conformance tests increased over time with the API maturity level and adoption. The Network Policy API project had a very similar journey with their APIs as well.
Alongside the conformance suite improvement, the community needed a mechanism to keep track of the implementations that were actually conformant, and on the other hand, the implementations could benefit from having an official conformance acknowledgment upstream.
To address the growing needs for conformance tests in upstream Kubernetes projects in SIG network, the “conformance profiles” project was created to provide a generic test suite and testing framework, as well as a reporting mechanism to certify implementations. A conformance profile is a set of features which can be subscribed to during a test run. The test suite runs tests relevant to the selected profiles, and when all tests complete the test suite submits a conformance report which shows the results, and can be submitted back upstream to certify the implementation. Some features may be considered “optional” in that not all implementations must support them: these “extended” features can be opted into in the conformance test suite, and the results of those extra tests will be reported in the conformance report as well.
This mechanism is generic enough to be adopted by other APIs, and the Network Policy API project is the first example of such an adoption. In the future, the conformance report API and machinery could be moved to a separate repository and used by other APIs as a shared conformance package.

avatar for Surya Seetharaman

Surya Seetharaman

Senior Software Engineer, Red Hat
Surya is an Open Source advocate and contributor, active in the Kubernetes SIG-Network working group. She is working as a Senior Software Engineer at Red Hat in the OpenShift Networking team. Her areas of interest include Cloud Infrastructure and Networked Services and Systems. She... Read More →
avatar for Shane Utt

Shane Utt

Staff Software Engineer, Kong
avatar for Mattia Lavacca

Mattia Lavacca

Software Engineer, Kong
Mattia is a Software Engineer at Kong, working on Kubernetes networking. He is an active contributor to the Gateway API and is working on many Kong projects related to networking in Kubernetes, among which are the Ingress controller and the Gateway Operator.

Monday November 6, 2023 11:15am - 11:45am CST
Jackson Park A