[yocto] QA Test Report for Yocto Project 2.3 M2 rc3

[Perez Carranza, Jose]

Hi

Here is the report for Partial QA Cycle on 2.3 M2 rc3

Full Report :  https://wiki.yoctoproject.org/wiki/WW06_-_2017-02-03_-_Full_Test_Cycle_2.3_M2_rc3

Summary
The QA cycle for 2.3 M2 rc3 is complete, this was a partial test cycle focused on testimage, selftest and performance. Bug that was blocking testimage on rc1 was resolved correctly and hence this unblocked the component to be validated on this release candidate. There were 3 new issues found the most important one is for Build Appliance images not available to test on AB, the other 2 are related to parselogs and a failure in specific workers for selftest; none of this 3 seem to be a release blocker; there were also another 4 bugs that are still open from previous releases. Performance measurements  were improved compared to M2 rc1 but are still above compared to M1, bug 10844[1] was reopened to keep the investigation on degradations.

Bugs

      * New

-        11022 - Fail to build BA for 2.3 M2 rc3 [2]

-        11013 - parselogs: Is failing on Xorg with error " FBDEV(0): mode "640x480" test failed " [3]

-        11025 - selftest/devtool: Build mdadm failing on Centos7 and Ubuntu 1404 [4]

      * High / M+ Not New

-        10456 - X cannot launch on qemumips64 [5]

-        10473 - Fail to launch custom qemu image with runqemu [6]

Full bugs Report : https://wiki.yoctoproject.org/wiki/WW06_-_2017-02-03_-_Full_Test_Cycle_2.3_M2_rc3#Bugs_Found_during_QA_Test

Performance
As bug 10844[1] was reopened Fedora machine is being used for debugging activities hence only results for Ubuntu machine are being analyzed for this Milestone. There were improvements on the measurements against M2 rc1, but the numbers are still above of the normal trend from the past releases/milestones.

                     rc1         rc3            %
sato       1:14:59    1:11:47    -4.27
rootfs    4:14          4:02          -4.72
rmwork 1:08:02    1:05:56    -3.09
kernel      5:01         5:00          -0.33
eSDK        3:47         3:28          -8.37

Performance Charts : https://wiki.yoctoproject.org/charts/perf_milestone_GDC/performance_test.html

Links


1-     https://bugzilla.yoctoproject.org/show_bug.cgi?id=10844

2-     https://bugzilla.yoctoproject.org/show_bug.cgi?id=11022

3-     https://bugzilla.yoctoproject.org/show_bug.cgi?id=11013

4-     https://bugzilla.yoctoproject.org/show_bug.cgi?id=11025

5-     https://bugzilla.yoctoproject.org/show_bug.cgi?id=10456

6-     https://bugzilla.yoctoproject.org/show_bug.cgi?id=10473


Regards,
José

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20170209/b7c48925/attachment.html>