Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Appendix B: References and End Notes

Appendix B: References and End Notes

ANSI01:

American National Standard for Methods of Measurement of Compatibility between Wireless Communication Devices and Hearing Aids, ANSI C63.19-2001.

ANSI02:

ANSI/TIA-968-A: 2002, Technical Requirements for Connection of Terminal Equipment to the Telephone Network.

ANSI06:

ANSI C84.1:2006, Electric Power Systems and Equipment—Voltage Ratings (60 Hertz).

ANSI06a:

CISPR 22 Ed. 5.2 b: 2006, Information technology equipment - Radio disturbance characteristics - Limits and methods of measurement. 

ANSI93:

ANSI C63.16:1993, American National Standard Guide for Electrostatic Discharge Test – Methodology and Criteria for Electronic Equipment.

ANSI97:

CISPR 24 Ed. 1.0 b: 1999, Information technology equipment - Immunity characteristics - Limits and methods of measurement. 

Beizer84:

Boris Beizer, Software System Testing and Quality Assurance, Van Nostrand Reinhold Company, 1984.

CA06:

California Volume Reliability Testing Protocol rev. January 31, 2006-01-31. Available from http://www.ss.ca.gov/elections/voting_systems/volume_test_protocol_final.pdf.

CERT06:

CERT® Coordination Center, Secure Coding homepage, http://www.cert.org/secure-coding/, July 2006.

CMU06:

Capability Maturity Model Integration, http://www.sei.cmu.edu/cmmi/, July 2006.

DHS06:

Department of Homeland Security, Build Security In, https://buildsecurityin.us-cert.gov/, July 2006.

EAC06:

U.S. Election Assistance Commission, Quick Start Management Guide for Ballot Preparation/Printing and Pre-Election Testing, October 2006. Available from http://www.eac.gov/eac_qs_guides.htm.

EAC06a:

U.S. Election Assistance Commission, Quick Start Management Guide for Voting System Security, October 2006. Available from http://www.eac.gov/eac_qs_guides.htm.

EAC06b:

U.S. Election Assistance Commission, Testing and Certification Program Manual, Version 1.0, December 5, 2006. Available from http://www.eac.gov/docs/Voting%20System%20Testing%20and%20Certification%20Program%20Manual--Final%20--120506.pdf.

Epstein55:

Benjamin Epstein and Milton Sobel, "Sequential Life Tests in the Exponential Case," Annals of Mathematical Statistics, v. 26, n. 1, March 1955, pp. 82-93.

FCC07:

Title 47, Part 15, Rules and Regulations of the Federal Communications Commission, Radio Frequency Devices: 2000.

FCC07a:

Title 47, Part 68, Rules and Regulations of the Federal Communications Commission, Connection of Terminal Equipment to the Telephone Network: 2000.

GPO90:

Performance and Test Standards for Punchcard, Marksense, and Direct Recording Electronic Voting Systems, January 1990 edition with April 1990 revisions, in Voting System Standards, U.S. Government Printing Office, 1990.14 Available from http://josephhall.org/fec_vss_1990_pdf/1990_VSS.pdf.

Grebe96:

T.E. Grebe, "Application of Distribution Systems Capacitor Banks and their Impact on Power Quality," IEEE Transactions IA-32, May-June 1996. Available from IEEE. http://www.ieee.org/.

HAVA02:

The Help America Vote Act of 2002, Public Law 107-252. Available from http://www.fec.gov/hava/hava.htm.

Hoare69:

C. A. R. Hoare, "An Axiomatic Basis for Computer Programming," Communications of the ACM, v. 12, n. 10, October 1969, pp. 576-580, 583.

IEEE00:

IEEE 100:2000 The Authoritative Dictionary of IEEE Standard Terms, Seventh Edition. 

IEEE02:

IEEE Std. C62.41.1™:2002 IEEE Guide on the Surge Environment in Low-Voltage (1000 V and less) AC Power Circuits.

IEEE02a:

IEEE Std. C62.41.2™:2002 IEEE Recommended Practice on Characterization of Surges in Low-Voltage (1000V and Less) AC Power Circuits.  

IEEE02b:

IEEE Std. C62.45™:2002 IEEE Recommended Practice on Surge Testing for Equipment Connected to Low-Voltage (1000V and Less) AC Power Circuits

IEEE05:

IEEE Std. 1100™:2005 IEEE Recommended Practice for Powering and Grounding Electronic Equipment. 

IEEE80:

IEEE Std. 587™:1980 IEEE Guide for Surge Voltages in Low-Voltage AC Power Circuits. 

IEEE91:

IEEE Std. C62.41™:1991 Recommended Practice for Surge Voltages in Low-Voltage AC Power Circuits. 

IEEE92:

IEEE Std. 519™:1992 519-1992 IEEE Recommended Practices and Requirements for Harmonic Control in Electrical Power Systems.

IEEE97:

IEEE/EIA 12207.1-1997, Industry implementation of International Standard ISO/IEC 12207:1995—(ISO/IEC 12207) standard for information technology—software life cycle processes—life cycle data. 

IEEE98:

IEEE Std 829-1998, IEEE standard for software test documentation.

ISO00:

ISO 9001:2000, Quality management systems – Requirements. 

ISO00a:

ISO/IEC TR 15942:2000, Information technology—Programming languages—Guide for the use of the Ada programming language in high integrity systems. 

ISO01:

ISO/IEC 61000-4-2:2001, Electromagnetic compatibility (EMC) - Part 4-2: Testing and measurement techniques - Electrostatic discharge immunity test. 

ISO02:

ISO 18921:2002, Imaging materials—Compact discs (CD-ROM)—Method for estimating the life expectancy based on the effects of temperature and relative humidity.

ISO03:

ISO 10007:2003, Quality management systems – Guidelines for configuration management. 

ISO03a:

ISO/IEC 14882:2003, Programming languages—C

ISO03b:

ISO/IEC 23270:2003, Information technology—C# language specification. Superseded by [ISO06].

ISO04:

ISO 8601:2004, Data elements and interchange formats—Information interchange—Representation of dates and times. 

ISO04a:

ISO 17000:2004, Conformity assessment—Vocabulary and general principles.

ISO04b:

ISO/IEC 61000-4-4:2004 Electromagnetic compatibility (EMC) - Part 4-3. Testing and measurement techniques – Electrical fast transient/burst immunity test.

ISO05:

ISO 9000:2005, Quality management systems – Fundamentals and vocabulary. 

ISO06:

ISO/IEC 23270:2006, Information technology—Programming languages—C#. 

ISO06a:

ISO/IEC 61000-4-3:2006, Electromagnetic compatibility (EMC) - Part 4-3. Testing and measurement techniques - Radiated, radio-frequency, electromagnetic field immunity test. 

ISO06b:

ISO/IEC 61000-4-6:2006 Electromagnetic compatibility (EMC) - Part 4-6: Testing and measurement techniques - Immunity to conducted disturbances, induced by radio-frequency fields. 

ISO06c:

ISO/IEC 61000-4-12:2006 Electromagnetic compatibility (EMC) - Part 4-12: Testing and measurement techniques – Ring wave immunity test.

ISO06d:

ISO/IEC 61000-4-21:2003 Electromagnetic compatibility (EMC) - Part 4-21. Testing and measurement techniques - Reverberation chamber test methods. 

ISO06e:

ISO/IEC 25062:2006 Common Industry Format (CIF) for Usability Test Reports. 

ISO87:

ISO/IEC 8652:1987, Programming languages—Ada. Superseded by [ISO95].

ISO90:

ISO/IEC 9899:1990, Programming languages—C. Superseded by [ISO99].

ISO94:

ISO 9706:1994, Information and documentation—Paper for documents—Requirements for permanence. 

ISO95:

ISO/IEC 8652:1995, Information technology—Programming languages—Ada. 

ISO95a:

ISO/IEC 61000-2-5:1995, Electromagnetic compatibility (EMC) - Part 2-5: Environment – Classification of electromagnetic environments.

ISO98:

ISO/IEC 14882:1998, Programming languages—C. Superseded by [ISO03a].

ISO98a:

ISO 9241-11:1998, Ergonomic requirements for office work with visual display terminals (VDTs) -- Part 11: Guidance on usability.

ISO99:

ISO/IEC 9899:1999, Programming languages—C. 

ITIC00:

ITI (CBEMA) Curve, Information Technology Industry Council (ITI):2000. Available from ITI, http://www.itic.org/.

java05:

The Java Language Specification, Third Edition, 2005. Available from http://java.sun.com/docs/books/jls/index.html.

Key94:

T.S. Key and F.D. Martzloff, "Surging the Upside-Down House: Looking into Upsetting Reference Voltages," PQA'94 Conference, Amsterdam, Netherlands, 1994. Accessible on-line at the NIST-hosted SPD Anthology – Part 5,
http://pml.nist.gov/spd-anthology/methods.html

KS05:

Request For Proposal #08455, Kansas, 2005-05-16. Available from http://www.kssos.org/elections/05elec/Voting_Equipment_RFP.pdf, July 2006.

Martin07:

Philippe A. Martin, Petri Net Linear Form (PNLF), in "Using PIPE and Woflan (and the Petri Net Linear Form)," May 9, 2007, http://www.cit.gu.edu.au/~phmartin/wf/PIPE/.

MIL83:

MIL-STD-810-D, Environmental Test Methods and Engineering Guidelines, 1983-7-19.

MIL85:

MIL-STD-1521B (USAF) Technical Reviews and Audits for Systems, Equipments [sic], and Computer Software, rev. December 19, 1985.

MIL96:

MIL-HDBK-781A, Handbook for Reliability Test Methods, Plans, and Environments for Engineering, Development, Qualification, and Production, April 1, 1996.

MIRA04:

MISRA-C:2004: Guidelines for the use of the C language in critical systems, MIRA Limited, U.K., November 2004.

Morris84:

F. L. Morris and C. B. Jones, "An Early Program Proof by Alan Turing," IEEE Annals of the History of Computing, v. 6, n. 2, April 1984, pp. 139-143.

Moulding89:

M. R. Moulding, "Designing for high integrity: the software fault tolerance approach," Section 3.4. In C. T. Sennett, ed., High-Integrity Software, Plenum Press, New York and London, 1989.

MS05:

Request For Proposal #3443, Mississippi, Apreil 28, 2005. Available from http://www.its.state.ms.us/rfps/3443.htm, 2006-07. (THIS DOCUMENT IS NO LONGER AVAILABLE)

MS05:

Paul Vick, The Microsoft® Visual Basic® Language Specification, Version 8.0, 2005. Available from Microsoft Download Center, http://go.microsoft.com/fwlink/?linkid=62990.

ND06:

Request for Proposals #108.6-03-001, North Dakota, October 31, 2003. Available from http://www.state.nd.us/hava/documents/docs/vsp-rfp-official.pdf, 2006-01-26.

NFPA05:

National Electrical Code (NFPA 70):2005. Available from NFPA, http://www.nfpa.org/.

NGC06:

Nevada Gaming Commission and State Gaming Control Board, Technical Standards for Gaming Devices and On-Line Slot Systems, March 2006. Available from http://gaming.nv.gov/modules/showdocument.aspx?documentid=3310

NIST02:

National Institute of Standards and Technology Special Publication 800-41: Guidelines on Firewalls and Firewall Policy, Revised Sept 2009. Available from http://csrc.nist.gov/publications/nistpubs/800-41-Rev1/sp800-41-rev1.pdf

NIST03:

Fred R. Byers, Care and Handling of CDs and DVDs—A Guide for Librarians and Archivists, National Institute of Standards and Technology Special Publication 500-252, 2003-10. Available from http://www.itl.nist.gov/div895/carefordisc/index.html.

NIST05:

Recommended Security Controls for Federal Information Systems, National Institute of Standards and Technology Special Publication 800-53, 2005-02. Available from http://csrc.nist.gov/publications/nistpubs/.

NIST05a:

National Institute of Standards and Technology Special Publication 800-70: Security Configuration Checklist Program for IT Products – Guidance for Checklists Users and Developers, Revised Feb. 2011. Available from http://csrc.nist.gov/publications/nistpubs/800-70-rev2/SP800-70-rev2.pdf

NIST05b:

Peter Mell, Karen Kent, Joseph Nusbaum, National Institute of Standards and Technology Special Publication 800-83: Guide to Malware Incident Prevention and Handling, November 2005. Available from http://csrc.nist.gov/publications/nistpubs/800-83/SP800-83.pdf.

NIST06:

William Burr, Donna Dodson, W. Timothy Polk, National Institute of Standards and Technology Special Publication 800-63: Electronic Authentication Guideline, April 2006. Available from http://csrc.nist.gov/publications/nistpubs/800-63/SP800-63V1_0_2.pdf.

NIST06a:

Karen Kent, Murugiah Souppaya, National Institute of Standards and Technology Special Publication 800-92: Guide to Computer Security Log Management, September 2006. Available from http://csrc.nist.gov/publications/nistpubs/800-92/SP800-92.pdf.

NIST07:

Karen Scarfone, Peter Mell, National Institute of Standards and Technology Special Publication 800-94: Guide to Intrusion Detection and Prevention Systems, February 2007. Available from http://csrc.nist.gov/publications/nistpubs/800-94/SP800-94.pdf.

OASIS07:

OASIS EML v5.0 Committee Draft, Organization for the Advancement of Structured Information Standards (OASIS), March 2007. Available from http://www.oasis-open.org/committees/download.php/22788/EML%20v5.0%20Committee%20Draft.zip.

OMG04:

UML 2.0 Superstructure Specification, October 8, 2004, http://www.omg.org/cgi-bin/doc.cgi?ptc/2004-10-02.

Oxford93:

New Shorter Oxford English Dictionary, Clarendon Press, Oxford, 1993.

P1583:

IEEE Draft Standard for the Evaluation of Voting Equipment, draft P1583/D5.3.2b, April 1, 2004. Unpublished.

P1622:

IEEE Draft Standard for Voting Systems Electronic Data Interchange version 01.003. Information Available from http://grouper.ieee.org/groups/1622/.

Pietrek97:

Matt Pietrek, "A Crash Course on the Depths of Win32™ Structured Exception Handling," Microsoft Systems Journal, January 1997. Available from http://www.microsoft.com/msj/0197/exception/exception.aspx.

Redmill88:

F. J. Redmill, Ed., Dependability of Critical Computer Systems 1, Elsevier Applied Science, London and New York, 1988.

Rivest06:

Ronald R. Rivest and John P. Wack, "On the notion of "software independence" in voting systems," July 28, 2006. 

SCAM01:

Joel Scambray, Stuart McClure, George Kurtz, Hacking Exposed: Network Security Secrets and Solutions, Second Edition, 2001.

Sourceforge00:

CEXCEPT (exception handling in C), software package, 2000. Available from http://cexcept.sourceforge.net/.

Telcordia06:

Telcordia GR-1089:2006, Electromagnetic Compatibility and Electrical Safety - Generic Criteria for Network Telecommunications Equipment. Available from Telcordia, http://telecom-info.telcordia.com/.

truevotemd04:

2004 Presidential General Election Review Lessons Learned. Available from http://www.truevotemd.org/Resources/Lessons_Learned.pdf.

UL03:

UL 437:2003, Standard for Key Locks. (2003).

UL05:

UL 60950-1:2005, Information Technology Equipment – Safety – Part 1: General Requirements.

UL06:

UL 943:2006, Standard for Safety for Ground-Fault Circuit-Interrupters. 

UT04:

Solicitation #DG5502, Utah, 2004-07-09. Available from http://purchasing.utah.gov/BidHeaders/8750.pdf, January 27, 2006. (THIS DOCUMENT IS NO LONGER AVAILABLE FROM THE UTAH.GOV SITE)

Valgrind06:

Valgrind home page, http://valgrind.org/, July 2006.

VSS2002:

2002 Voting Systems Standards. Available from http://www.eac.gov/election_resources/vss.html.

VVSG1:

Voluntary Voting System Guidelines Version I Initial Report, May 9, 2005

VVSG2005:

2005 Voluntary Voting System Guidelines, Version 1.0, March 6, 2006. Available from http://www.eac.gov/vvsg_intro.htm.

Wald47:

Abraham Wald, Sequential Analysis, John Wiley & Sons, 1947.

 

 

End Notes

 

 

[1] Visual Basic 8 does not support named block exit, but it does support specifying the kind of block (do loop, for loop, while loop, select, subroutine, function, etc.) from which to exit, which need not be the innermost block.

[2] Specific equipment and materials are identified in order to describe certain procedures. In no case does such identification imply recommendation or endorsement, nor does it imply that the materials or equipment identified are necessarily the best available for the purpose.

[3] A prerequisite for device-level certification would be prescribing a system architecture so that the responsibilities of each device and the interfaces between those devices could be well-specified. Such prescription is undesirable. More importantly, even with a prescribed architecture, a device-level certification would provide no assurance that any particular system that included that component would function as specified. That assurance can only be obtained by evaluating the complete system in the configuration in which it is to be deployed.

[4] Portions of this section are derived from Section 5.6.2.2 of [P1583].

[5] This material is from an unapproved draft of a proposed IEEE Standard, P1583. As such, the material is subject to change in the final standard. Because this material is from an unapproved draft, the IEEE recommends that it not be utilized for any conformance/compliance purposes. It is used at your own risk.

[6] Portions of this section are derived from Sections 5.6.2.2 and 6.6.4.2 of [P1583].

[7] In mathematical jargon, the word domain would be more appropriate than range for input variables; however, "range checking" is the common programming jargon.

[8] These values are derived from category 3K3 of IEC 60721-3-3, which is described as, the product operating in a temperature-controlled enclosed location where the humidity is not controlled. Further, the product is not subject to condensed water or water from other sources.

[9] A compromised device could be programmed to give the correct answers during logic and accuracy testing but behave differently after polls are opened. This kind of fraud is detected and prevented through other means, beginning with the design review specified in Part 3 Section 4.3 and Requirement part1:6.1-A and continuing with setup validation and routine audits.

[10] The reasons that ranked order voting is not handled are discussed in Part 1 Section 7.7.2.5.

[11] A system conforming to the Write-ins class is required to be capable of counting and reporting totals for all candidates that are written in by voters. In some states, write-in votes are not counted unless they exactly match one of a list of registered, accepted write-in candidates. Voting systems may support reporting options that meet the requirements of such states without disruption to the counting logic.

[12] The test lab may rely on media manufacturers' specifications for data retention or life expectancy if accelerated testing results are not available. See also [NIST03], [ISO94] and [ISO02].

[13] Requirement part1:6.6-A.3 and Requirement part1:6.6-A.4 indicate acceptable designs.

[14] The 1990 Voting System Standards package also included "A Plan for Implementing the FEC Voting System Standards," "System Escrow Plan for the Voting System Standards Program," and "A Process for Evaluating Independent Test Authorities."

Created September 28, 2010, Updated May 24, 2017