These are files to allow you to reproduce the results in "SATE VI Ockham Sound Analysis Criteria" NIST-IR XXXX, available at http://dx.doi.org/10.6028/NIST.IR.XXXX These files are available on-line at https://nist-sate-ockham-sound-analysis-criteria-evaluation-material.s3.amazonaws.com/ockham-sate-VI-2020/ockhamCriteriaSATEVIdata2020.tar.xz This is an experimental system. NIST assumes no responsibility whatsoever for its use by other parties and makes no guaranties, expressed or implied, about its quality, reliability, or any other characteristic. Certain commercial equipment or materials are identified in this article to specify the experimental procedure adequately. Such identification is not intended to imply recommendation or endorsement by NIST, nor is it intended to imply that the materials or equipment identified are necessarily the best available for the purpose. Pursuant to title 17 Section 105 of the United States Code, software, data, and files developed at the National Institute of Standards and Technology by employees of the Federal Government in the course of their official duties are not subject to copyright protection and are in the public domain. CONTENTS OF MAIN DIRECTORY *Astree Scripts and files to evaluate Astrée. *Frama-C Scripts and files to evaluate Frama-C. flawManifestXML2csv Convert flaws in a SARD flaw manifest XML format file to CSV format. Translate from CWE classes to our classes. *flawManifestXML2csvTest Material to automatically run regression tests on flawManifestXML2csv. manifest.xml The most recent list of weaknesses in Juliet 1.3 for C as of September 2019. SOFTWARE This evaluation was run on Ubuntu 18.04 LTS. The major software packages used for this evaluation are: Python Perl make We also used the following Unix utilities: grep comm sort echo mv test wc rm Caution: these make extensive use of sorting and comparing, which depends on the LC_COLLATE shell environment variable. A later run may have an error about a file out of order if runs are done with different settings. NOTE: Each Ockham bug class has many "names". For example, Arithmetic or Conversion Fault--Truncate (or ARC/Truncate) analysis is in a subdirectory named Class_ARC_Trunc, the prefix of file names is arcTrunc, and the encoding in .csv files is ARC-T. end of README