This report gives the result of running the computer algebra independent integration problems (Lite version) obtained from from Albert Rich Rubi web site.
The following versions of Maple were tested at this time. All on windows 7.
The PC used is an Intel i73930k running at 3.20 GHz with 16 GB memory.
A time limit of 3 minutes is used for all integrals in each CAS. If the integration does not complete within this time limit then the integral is considered to have failed.
The table below gives additional break down of the grading of quality of the antiderivatives generated by each CAS. The grading is given using the letters A,B,C and F with A being the best quality. The grading is accomplished by comparing the antiderivative generated with the optimal antiderivatives included in the test suite. The following table describes the meaning of these grades.
grade 
description 
A 
Integral was solved and antiderivative is optimal in quality and leaf size. 
B 
Integral was solved and antiderivative is optimal in quality but leaf size is larger than twice the optimal antiderivatives leaf size. 
C 
Integral was solved and antiderivative is nonoptimal in quality. This can be due to one or more of the following reasons

F 
Integral was not solved. Either the integral was returned unevaluated within the time limit, or it timed out, or CAS hanged or crashed or an exception was raised. 
Based on the above, the following tables summarizes the grading for each test suite for each version
This table shows the percentage and count of solved and non solved integrals for each version. There are a total of [ 14944 ] integrals in the test suite.
Version  percentage solved  number solved  number failed 
2017.3  80.815  12077  2867 
2016.2  80.828  12079  2865 
2015.2  80.755  12068  2876 
18.02  78.707  11762  3182 
17.02  77.817  11629  3315 
16.02  77.79  11625  3319 
14.0  77.657  11605  3339 
12.0  77.376  11563  3381 
This figure shows the percentage of passed integrals in each version.
This Plot shows the number of A graded result for each version.
This table shows the grading performance for each version.
Version  %A  %B  %C  %F 
2017.3  52.382 (7828)  20.844 (3115)  7.588 (1134)  19.185 (2867) 
2016.2  51.747 (7733)  21.36 (3192)  7.722 (1154)  19.172 (2865) 
2015.2  51.459 (7690)  21.547 (3220)  7.749 (1158)  19.245 (2876) 
18.02  50.241 (7508)  21.313 (3185)  7.153 (1069)  21.293 (3182) 
17.02  49.926 (7461)  21.32 (3186)  6.571 (982)  22.183 (3315) 
16.02  49.953 (7465)  21.266 (3178)  6.571 (982)  22.21 (3319) 
14.0  49.886 (7455)  21.159 (3162)  6.611 (988)  22.343 (3339) 
12.0  49.672 (7423)  21.166 (3163)  6.538 (977)  22.624 (3381) 
This figure show the mean of the normalized leaf size for each version. This was normalized to the size of the optimal result.
This figure show the mean leaf size for each version.
This figure show the median leaf size for each version.
This figure show the mean CPU time (sec) for each version.