Refs #70

Add experimental "new" failure reporter script: new-result-reporter.pl.
The script creates a static HTML page containing links to MTT results
that have changed (see below link for a sample).

 http://www.open-mpi.org/~emallove/new-result-reporter-preview.html

It bombards the database with queries, so - for testing purposes - the
above output HTML page was creating after running mtt-result-reporter.pl
for only 15 seconds, but on only a six hour period of MTT results
- it can crank away for a looong time.  (Fixing #362 would greatly
shrink the new-result-reporter.pl's output HTML pages.)

The script looks through a batch of test results (always delimited by
date range, and optionally delimited by other fields such as MPI
version).  Out of these results, it looks for pairs of test cases that
are similar, but had differing outcomes.  There is a range of
"similarness" that is illustrated in shades of red table cells.  The
"redder" the cell, the more similar the pair of test cases.
Specifically, "more similar" means more database columns match between
the pairs of tests.  It is assumed that if two test cases are nearly
identical, but have different outcomes, this would be more relevant to
the MPI source - and hence - these results are redder and at the top of
the page.  Right now, the script is generalized such that no columns are
weighted as more important than others, but we will need to hone in on
which matching columns (and groupings of columns) are most critical.
All the links displayed are unique.  new-result-reporter.pl needs
improvement in the following areas:

 1. Report fewer, and more meaningful links to results
 2. Optimize the algorithm used for finding result pairs, which might
    lessen the number of queries it needs to run (it is basically brute
    force right now)
 3. Optimize the SELECTs (using SQL magic like indexes, caching,
    temporary tables, etc.)

This commit was SVN r1359.

Author: Ethan Mallove

server/php/reporter.inc

@@ -277,18 +277,26 @@ function setup_advanced($params) {
 
     $menu = array(
         'compute_cluster' => array(
+            'compute_cluster_id'  => null,
             'os_version'          => array('', $control),
             'platform_type'       => array('', $control),
             'platform_hardware'   => array('', $control),
             'platform_name'       => array('', $control),
             'os_name'             => array('', $control),
         ),
         'submit' => array(
+            'submit_id'           => null,
             'hostname'            => array('', $control),
             'local_username'      => array('', $control),
             'http_username'       => array('', $control),
         ),
         'mpi_install' => array(
+
+            'mpi_get_id'               => null,
+            'mpi_install_compiler_id'  => null,
+            'mpi_install_configure_id' => null,
+            'mpi_install_id'           => null,
+
             'compiler_name'       => array('', $control),
             'compiler_version'    => array('', $control),
             'vpath_mode'          => array('', $control),
@@ -320,6 +328,8 @@ function setup_advanced($params) {
                     $menu,
                     array('test_build' =>
                         array(
+                            'test_build_id' => null,
+                            'test_build_compiler_id' => null,
                             'suite_name' => array('', $control),
                         ))
                 );
@@ -330,13 +340,19 @@ function setup_advanced($params) {
                     $menu,
                     array('test_run' =>
                         array(
-                            'launcher'   => array('', $control),
+                            'test_run_id'         => null,
+                            'test_name_id'        => null,
+                            'test_run_command_id' => null,
+                            'test_suite_id'       => null,
+                            'performance_id'      => null,
+
+                            'launcher'     => array('', $control),
                             'resource_mgr' => array('', $control),
-                            'network'    => array('', $control),
-                            'parameters' => array('', $control),
-                            'test_name'  => array('', $control),
-                            'np'         => array('', $control),
-                            'full_command'   => array('', $control),
+                            'network'      => array('', $control),
+                            'parameters'   => array('', $control),
+                            'test_name'    => array('', $control),
+                            'np'           => array('', $control),
+                            'full_command' => array('', $control),
                         ))
                 );
         }

server/php/screen.inc

@@ -1002,6 +1002,12 @@ function form_popup($elements, $params, $specs) {
         foreach (array_keys($elements[$category]) as $field) {
             $array = $elements[$category][$field];
 
+            # Skip over some fields compeltely (e.g., most
+            # users will have *no* need to see *_id fields)
+            if (is_null($array)) {
+                continue;
+            }
+
             $menu .= $tr . $td . label(label($field));
 
             # Set the colspan based on the number of
@@ -1180,13 +1186,26 @@ function hidden_carryover($params) {
         $col_types = array('text_', 'show_');
 
         $setup_advanced = setup_advanced($_GET);
+
         foreach (array_keys($setup_advanced) as $table) {
             foreach (array_keys($setup_advanced[$table]) as $field) {
+
                 $arr = $setup_advanced[$table][$field];
 
-                foreach (array_keys($arr) as $i) {
-                    $type = $col_types[$i];
+                # If the column is set to null in setup_advanced, it only means
+                # that we didn't want to display it in the web front-end.  Make
+                # it a text_* field so that we can filter it via a WHERE
+                # clause, but it's not something we want to display to the
+                # user.  E.g, it's okay for us to slip it in a query string or
+                # <hidden> form field using find-new-mtt-failures.pl script.
+                if (is_null($arr)) {
+                    $type = $col_types[0];
                     $advanced_fields[] = "$type$field";
+                } else {
+                    foreach (array_keys($arr) as $i) {
+                        $type = $col_types[$i];
+                        $advanced_fields[] = "$type$field";
+                    }
                 }
             }
         }