Skip to content

Commit 3c312ee

Browse files
committed
Update spec compatibility
1 parent 1110e8f commit 3c312ee

File tree

1 file changed

+19
-12
lines changed

1 file changed

+19
-12
lines changed

doc/user/compatibility.md

Lines changed: 19 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -279,15 +279,22 @@ runtime reflection.
279279

280280
## Spec Completeness
281281

282-
'How many specs are there' is not a question with an easy precise answer. The
283-
three numbers listed below for each part of the specs are the number of
284-
expectations that the version of MRI we are compatible with passes, then the
285-
number TruffleRuby passes, and then the TruffleRuby number as a percentage of
286-
the MRI number. This is run on macOS. The numbers probably vary a little based
287-
on platform and configuration. The library and C extension specs are quite
288-
limited so may be misleading.
289-
290-
* Language: 3913, 3903, 99%
291-
* Core: 176111, 169117, 96%
292-
* Library (`:library` and `:openssl` on TruffleRuby): 20820, 16934, 81%
293-
* C extensions: 1679, 1627, 97%
282+
'How many specs are there?' is not a question with an easy precise answer. The
283+
number of specs varies for different versions of the Ruby language, different
284+
platforms, different versions of the specs, and different configurations of
285+
the specs. The specs for the standard library and C extension API are also
286+
very uneven and they so can give misleading results.
287+
288+
For the command line interface, the language, and the core library specs,
289+
which covers the bulk of what TruffleRuby reimplements, this is how many spec
290+
examples TruffleRuby runs successfully compared to our compatible version of
291+
MRI running the version of specs from TruffleRuby:
292+
293+
<!--
294+
For example `jt test :language` in TruffleRuby and `make test-spec MSPECOPT=:language`
295+
in MRI, having copied our specs over theirs.
296+
-->
297+
298+
* Command line 112 / 136, **82%**
299+
* Language 2270 / 2332, **97%**
300+
* Core library 19453 / 20644, **94%**

0 commit comments

Comments
 (0)