-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathindex.html.erb
152 lines (145 loc) · 7.27 KB
/
index.html.erb
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<meta name="viewport" content="width=device-width, initial-scale=1">
<title>Coq bench</title>
<link rel="shortcut icon" type="image/png" href="favicon.png" />
<link href="bootstrap.min.css" rel="stylesheet">
<link href="bootstrap-custom.css" rel="stylesheet">
<link href="//maxcdn.bootstrapcdn.com/font-awesome/4.2.0/css/font-awesome.min.css" rel="stylesheet">
<script src="moment.min.js"></script>
<!-- HTML5 Shim and Respond.js IE8 support of HTML5 elements and media queries -->
<!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
<!--[if lt IE 9]>
<script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script>
<script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script>
<![endif]-->
</head>
<body>
<div class="container">
<div class="navbar navbar-default" role="navigation">
<div class="container-fluid">
<div class="navbar-header">
<a class="navbar-brand" href=""><i class="fa fa-lg fa-flag-checkered"></i> Coq bench</a>
</div>
</div>
</div>
<div class="article">
<div class="row">
<div class="col-md-12">
<h1>Coq bench</h1>
<p>We bench the <a href="https://github.com/coq/opam-coq-archive">Coq opam packages</a>, not <a href="https://coq.inria.fr/">Coq</a> itself. The compilation times are only informative. To discuss, there is a live thread on <a href="https://coq.zulipchat.com/#narrow/stream/237656-Coq-devs.20.26.20plugin.20devs/topic/coq-bench.20for.20opam">Zulip</a>.</p>
<h2>Results</h2>
<table class="table table-striped text-center">
<thead>
<tr>
<td>OS</td>
<td>Machine</td>
<td>OCaml</td>
<td>Opam</td>
<td>Released</td>
<td>Development</td>
</tr>
</thead>
<tbody>
<% for architecture in databases[:clean].architectures %>
<% os, machine, ocaml, opam = architecture.split("-") %>
<tr>
<td><%= h(os) %></td>
<td><%= h(machine) %></td>
<td><%= h(ocaml) %></td>
<td><%= h(opam) %></td>
<% for repository in Database.repositories %>
<% if last_bench = databases[:clean].get_last_bench_by_architecture(architecture, repository) %>
<td><a href="<%= "#{:clean}/#{u(architecture)}/#{repository}/" %>"><script>document.write(moment("<%= h(last_bench.strftime("%F %T")) %> +0000", "YYYY-MM-DD HH:mm:ss Z").fromNow());</script></a></td>
<% end %>
<% end %>
</tr>
<% end %>
</tbody>
</table>
<h2>About</h2>
<p>The main aim of <strong>Coq bench</strong> is to check that all stable Coq packages are working. We check all packages in all versions. We target the current Coq projects and the reproducibility of older ones. We install each package from a fresh Coq install. This is more a checker than a bench. For precise timings, look at <a href="https://github.com/coq/coq-bench">github.com/coq/coq-bench</a>. If you find a bug in an opam package, please report it on <a href="https://github.com/coq/opam-coq-archive/issues">github.com/coq/opam-coq-archive/issues</a>.</p>
<p>This website has been running continuously almost since the beginning of the use of <a href="https://opam.ocaml.org/">opam</a> as a package mananger for Coq. The <a href="https://github.com/coq-bench/coq-bench.github.io/commit/8fb68344263cd944621bb020aa1eb9faa8d41fae">first commit</a> dates back to February 2015. We host everything on <a href="https://github.com/coq-bench">GitHub</a>, both the source code and the website. We run the tests on separated servers, and commit results in GitHub. One needs to be part of the <a href="https://github.com/orgs/coq-bench/people">coq-bench organization</a> to have control of everything. A similar project in the <a href="https://ocaml.org/">OCaml</a> community is <a href="http://check.ocamllabs.io/">check.ocamllabs.io</a>.</p>
<h2>Changelog</h2>
<h4>October 5, 2019</h4>
<ul>
<li>truncating the logs (maximum 100.000 characters)</li>
</ul>
<h4>August 24, 2019</h4>
<ul>
<li>testing <code>coq-intuitionistic-nuprl</code>, again</li>
</ul>
<h4>August 10, 2019</h4>
<ul>
<li>add a black-list system for recurring and hard to solve errors (see <a href="https://github.com/coq-bench/make-html/blob/master/black_list.rb">black_list.rb</a>)</li>
</ul>
<h4>July 23, 2019</h4>
<ul>
<li>publish results on Gitter in the room <a href="https://gitter.im/coq/opam-bench-reports">coq/opam-bench-reports</a></li>
</ul>
<h4>June 25, 2019</h4>
<ul>
<li>stop testing <code>coq-intuitionistic-nuprl</code> (too slow)</li>
</ul>
<h4>June 20, 2019</h4>
<ul>
<li>use the OCaml setup from the opam switch</li>
</ul>
<h4>April 30, 2019</h4>
<ul>
<li>test incompatibility with the current OCaml version</li>
<li>give the worst test case instead of the best for the summary column</li>
</ul>
<h4>April 7, 2019</h4>
<ul>
<li>add Coq <code>8.9</code></li>
</ul>
<h4>June 5, 2018</h4>
<ul>
<li>add Coq <code>8.8</code></li>
</ul>
<h4>November 1, 2017</h4>
<ul>
<li>add Coq <code>8.7</code></li>
</ul>
<h4>December 29, 2016</h4>
<ul>
<li>add Coq <code>8.6</code></li>
</ul>
<h4>October 28, 2016</h4>
<ul>
<li>add Coq <code>8.5.3</code></li>
</ul>
<h4>July 17, 2016</h4>
<ul>
<li>add Coq <code>8.6.dev</code></li>
</ul>
<h4>July 13, 2016</h4>
<ul>
<li>upgrade to Coq <code>8.5.2</code></li>
</ul>
<h4>May 28, 2016</h4>
<ul>
<li>run the <code>opam lint</code> check</li>
<li>single-threaded compilation for better reproducibility of builds</li>
<li>shorter installation timeout (30 minutes) to anticipate the release of the contribs</li>
<li>a timeout is not an error anymore</li>
</ul>
<h2>Contact</h2>
<p>Send an email to <code>coqbench [at] clarus [dot] me</code>.</p>
</div>
</div>
</div>
<hr/>
<div class="footer">
<p class="text-center">
Sources are on <a href="https://github.com/coq-bench">GitHub</a> © Guillaume Claret 🐣
</p>
</div>
</div>
<script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.1/jquery.min.js"></script>
<script src="bootstrap.min.js"></script>
</body>
</html>