Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Testing Environments for Assessing Conformance and Interoperability



Robert D. Snelick, Leonard E. Gebase


We present a classification framework of testing environments that support conformance and interoperability testing of distributed systems. We describe each testing environment and state the applicability and requirements placed on a realization of a testing tool. The broad categories identified include data instance validation, isolated systems testing, and peer-to-peer systems testing. Our targeted systems include those that support data exchange standards. We list and define the types of conformance and interoperability testing that can be conducted and associate the types that can be performed in a given testing environment. We describe and illustrate a conceptual test tool design for each testing environment. The delineation of environments and their testing capacity is intended to facilitate a more structured approach to testing in which the relationship between testing and test requirements is more clearly defined and the capabilities and limitations of testing tools are better understood. In broader terms this approach should help industry and testing bodies identify and describe the depth and scope of their testing endeavors.
Proceedings Title
Software Engineering Research and Practice (SERP10), WORLDCOMP’10
Conference Dates
July 12-15, 2010
Conference Location
Las Vegas, NV


Conformance, Data Exchange Standards, Evaluation Criteria, Interoperability, Messaging Systems, Testing Environments.


Snelick, R. and Gebase, L. (2012), Testing Environments for Assessing Conformance and Interoperability, Software Engineering Research and Practice (SERP10), WORLDCOMP’10, Las Vegas, NV (Accessed July 16, 2024)


If you have any questions about this publication or are having problems accessing it, please contact

Created July 12, 2012, Updated February 19, 2017