[yocto] QA Test Report for YP - 2.0.2 rc1 build

Mon May 30 14:27:14 PDT 2016

Hello,
Here is the QA test report for "Yocto Project – 2.0.2 rc1 build."

Issues summary:

-        2 Bugs filed on 1.8.2 were also reproduced on 2.0.2

o   Install on USB or SD card failed giving “"(sdc): Volume was not properly unmounted” :  9652 [1]

o   Ogg media file audio is not working, note that this only was reproduced on NUC:  9654 [2]

-        Parse logs bug found on 2.1 was also reproduced: 9250 [3]

-        Abat script failed in module [intel_agp] and module [i915] : 9681 [4]

-        Toaster -  "Edit Columns" Button on the Compatible layers view is missing: 9684 [5]

-        Toaster - Toaster is not building for Yocto Project 1.8 Fido : 9687 [6]

[1]-  https://bugzilla.yoctoproject.org/show_bug.cgi?id=9652
[2]- https://bugzilla.yoctoproject.org/show_bug.cgi?id=9654
[3]- https://bugzilla.yoctoproject.org/show_bug.cgi?id=9520
[4]- https://bugzilla.yoctoproject.org/show_bug.cgi?id=9681
[5]- https://bugzilla.yoctoproject.org/show_bug.cgi?id=9684
[6]- https://bugzilla.yoctoproject.org/show_bug.cgi?id=9687

The full report is available here for review: https://wiki.yoctoproject.org/wiki/WW23_-_2016-05-24_-_Full_Pass_2.0.2.rc1

Testing data

 Test type:  Full Pass Release Test

 Branch: master

 Build name: 2.0.2.rc1

 poky commit: dade0e68c645473d94e1b05020b064df40677e81

 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-2.0.2.rc1

 Distributions tested: Ubuntu 15.04 64 bit, Fedora 23 64 bit, OpenSuse 13.2 64bit, CentOS 7 64 bit

Test Run Summary Report
Testing Summary Report

Test Run

Test Plan

Environment

Passed

Other issues

Failed

Failing bugs

Blocked

Blocking bugs

Complete

5949<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5949> 5950<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5950>

ADT: jethro branch

Fedora 23 i686

100.0%

none

0.0%

none

0.0%

none

100.0%

5947<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5947> 5948<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5948>

ADT: jethro branch

Ubuntu 14.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

5951<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5951> 5952<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5952>

BSP/QEMU: jethro branch

Beaglebone Black

100.0%

none

0.0%

none

0.0%

none

100.0%

5957<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5957> 5959<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5959>

BSP/QEMU: jethro branch

EdgeRouter

100.0%

none

0.0%

none

0.0%

none

100.0%

5926<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5926> 5927<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5927>

BSP/QEMU: jethro branch

genericx86 - on MMAX32bit

96.6%

none

3.4%

9652<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9652> 9520<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9520>

0.0%

none

100.0%

5922<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5922>

BSP/QEMU: jethro branch

genericx86-64 on MMAX64

98.1%

none

1.9%

9520<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9520>

0.0%

none

100.0%

5920<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5920> 5921<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5921>

BSP/QEMU: jethro branch

genericx86-64 on NUC

87.5%

none

2.1%

9654<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9654> 9681<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9681>

10.4%

9654<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9654>

100.0%

5924<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5924>

BSP/QEMU: jethro branch

genericx86-64-lsb on NUC

100.0%

none

0.0%

none

0.0%

none

100.0%

5967<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5967>

BSP/QEMU: jethro branch

genericx86-64-WIC on MMAX64

97.7%

none

2.3%

9520<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9520>

0.0%

none

100.0%

5968<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5968>

BSP/QEMU: jethro branch

genericx86-64-WIC on NUC

100.0%

none

0.0%

none

0.0%

none

100.0%

5925<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5925>

BSP/QEMU: jethro branch

genericx86-lsb on MMAX32bit

98.1%

none

1.9%

9520<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9520>

0.0%

none

100.0%

5966<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5966>

BSP/QEMU: jethro branch

genericx86-WIC on MMAX32

97.7%

none

2.3%

9520<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9520>

0.0%

none

100.0%

5958<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5958> 5960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5960>

BSP/QEMU: jethro branch

MPC8315e-rdb

98.4%

none

1.6%

8484<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8484>

0.0%

none

100.0%

5928<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5928> 5929<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5929>

BSP/QEMU: jethro branch

qemu-x86

100.0%

none

0.0%

none

0.0%

none

100.0%

5932<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5932> 5933<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5933>

BSP/QEMU: jethro branch

qemuarm

100.0%

none

0.0%

none

0.0%

none

100.0%

5953<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5953> 5954<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5954>

BSP/QEMU: jethro branch

qemuarm64

100.0%

none

0.0%

none

0.0%

none

100.0%

5934<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5934> 5935<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5935>

BSP/QEMU: jethro branch

qemumips

100.0%

none

0.0%

none

0.0%

none

100.0%

5955<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5955> 5956<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5956>

BSP/QEMU: jethro branch

qemumips64

100.0%

none

0.0%

none

0.0%

none

100.0%

5936<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5936> 5937<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5937>

BSP/QEMU: jethro branch

qemuppc

100.0%

none

0.0%

none

0.0%

none

100.0%

5930<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5930> 5931<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5931>

BSP/QEMU: jethro branch

qemux86-64

100.0%

none

0.0%

none

0.0%

none

100.0%

5964<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5964>

BSP/QEMU: jethro branch

qemux86-lsb

100.0%

none

0.0%

none

0.0%

none

100.0%

5965<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5965>

BSP/QEMU: jethro branch

qemux86_64-lsb

100.0%

none

0.0%

none

0.0%

none

100.0%

5916<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5916>

Eclipse Plugin: jethro branch

Kepler - Fedora 22 x86_64

96.4%

none

3.6%

7054<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7054>

0.0%

none

100.0%

5917<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5917>

Eclipse Plugin: jethro branch

Luna on Fedora 22 X86_64

96.4%

none

3.6%

7054<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7054>

0.0%

none

100.0%

5918<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5918>

Eclipse Plugin: jethro branch

Mars on Fedora 22 x86_64

96.4%

none

3.6%

7054<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7054>

0.0%

none

100.0%

5962<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5962> 5963<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5963>

Meta-yocto: jethro branch

Ubuntu 14.04 x86_64

96.7%

6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>

3.3%

9120<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9120>

0.0%

none

100.0%

5912<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5912> 5913<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5913> 5914<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5914> 5915<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5915>

Toaster: Jethro branch

Debian 4.3.0-0.bpo.1-amd64

94.8%

none

5.2%

9687<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9687> 9684<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9684>

0.0%

none

100.0%

5944<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5944>

OE-Core:jethro branch

CentOS 7.1 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

5943<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5943>

OE-Core:jethro branch

Fedora 23 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

5945<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5945>

OE-Core:jethro branch

OpenSuse 13.2 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

5919<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5919>

OE-Core:jethro branch

Ubuntu 15.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

5942<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5942>

Automated Build Testing: jethro branch

CentOS 7 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

5941<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5941>

Automated Build Testing: jethro branch

Fedora 23 x86-64

100.0%

none

0.0%

none

0.0%

none

100.0%

5940<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5940>

Automated Build Testing: jethro branch

OpenSuse 13.2 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

5939<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5939>

Automated Build Testing: jethro branch

Ubuntu 15.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

5938<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5938>

Runtime: jethro branch

Multiple Environments

100.0%

none

0.0%

none

0.0%

none

100.0%

5961<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5961>

Build Appliance: jethro branch

VMWare Player on Ubuntu

100.0%

none

0.0%

none

0.0%

none

100.0%

Total: 37

[Bug Status]

Test Case Status Report

Status

Count

BLOCKED

10

FAILED

19

PASSED

2482

Total: 2511

[http://chart.apis.google.com/chart?cht=bvg&chs=372x120&chbh=a&chds=0,2482&chxt=y&chxr=0,0,2482,414&chd=t:&chd=t:10,19,2482&chco=FFFF66|FF9933|00FF00&chdl=BLOCKED(10)+0%25|FAILED(19)+1%25|PASSED(2482)+99%25]

Bugs Found during QA Test
[edit<https://wiki.yoctoproject.org/wiki/index.php?title=WW23_-_2016-05-24_-_Full_Pass_2.0.2.rc1&action=edit&section=4>]New and notable issues Found during QA Test & Community
ID

Summary (6 tasks) ⇒<https://bugzilla.yoctoproject.org/buglist.cgi?&field0-0-0=bug_id&type0-0-0=equals&value0-0-0=9520&field0-0-1=bug_id&type0-0-1=equals&value0-0-1=%20%209652&field0-0-2=bug_id&type0-0-2=equals&value0-0-2=%20%209654&field0-0-3=bug_id&type0-0-3=equals&value0-0-3=%20%209681&field0-0-4=bug_id&type0-0-4=equals&value0-0-4=%209684&field0-0-5=bug_id&type0-0-5=equals&value0-0-5=%209687&field0-1-0=bug_status&type0-1-0=notequals&value0-1-0=CLOSED>

P

Assignee

QA

Milestone

Status

Resolution

cf_regression_type

Created

BSPs

9520<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9520>

test_parselogs failed on udevd[342] inotify_add_watch /dev/loop when running test image

Medium+

Saul Wold

Francisco Pedraza

2.1.1

NEW

Regression (Found by QA test)

2016-04-25

9652<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9652>

boot and install from USB failed getting [sdc] error message

Medium+

Jianxun Zhang

Francisco Pedraza

1.8.3

NEW

Regression (Found by QA test)

2016-05-17

9654<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9654>

Ogg media file audio is not working on NUC and MMax

Medium+

Saul Wold

Francisco Pedraza

1.8.3

NEW

Regression (Found by QA test)

2016-05-17

9681<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9681>

Running abat script failed in module [intel_agp] and module [i915]

Undecided

Saul Wold

Francisco Pedraza

---

NEW

Regression (Found by QA test)

2016-05-27

Toaster

9684<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9684>

"Edit Columns" Button on the Compatible layers view is missing

Undecided

Toaster default assignee

Libertad

---

NEW

---

2016-05-30

9687<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9687>

[Test Case 1099] Check if build succeeded when project release is changed

Undecided

Toaster default assignee

Libertad

---

NEW

---

2016-05-30

Other Bugs found during QA Test
ID

Summary (2 tasks) ⇒<https://bugzilla.yoctoproject.org/buglist.cgi?&field0-0-0=bug_id&type0-0-0=equals&value0-0-0=6156&field0-0-1=bug_id&type0-0-1=equals&value0-0-1=%207054&field0-1-0=bug_status&type0-1-0=notequals&value0-1-0=CLOSED>

P

Assignee

QA

Milestone

Status

Resolution

cf_regression_type

Created

Regression (Used to work)

7054<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7054>

OprofileUI needs to be updated to reflect new oprofile functionality

Medium

Ross Burton

Valentin Hangan

2.2

ACCEPTED

Regression (Used to work)

2014-12-09

OE-Core

6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>

[crosstap] no trace message output on qemuarm

Medium

Tom Zanussi

2.2

ACCEPTED

Regression (Used to work)

2014-04-14

Current community Open Bugs - Medium+/High

Overview of the open bugs opened against current milestone or release which are Medium+ or High and are not targeted for the next milestones
ID

P

Summary (6 tasks) ⇒<https://bugzilla.yoctoproject.org/buglist.cgi?&field0-0-0=target_milestone&type0-0-0=equals&value0-0-0=1.9&field0-0-1=target_milestone&type0-0-1=equals&value0-0-1=1.9%20M1&field0-0-2=target_milestone&type0-0-2=equals&value0-0-2=1.9%20M2&field0-0-3=target_milestone&type0-0-3=equals&value0-0-3=1.9%20M3&field0-0-4=target_milestone&type0-0-4=equals&value0-0-4=2.0&field0-0-5=target_milestone&type0-0-5=equals&value0-0-5=2.0.1&field0-0-6=target_milestone&type0-0-6=equals&value0-0-6=2.0.2&field0-1-0=priority&type0-1-0=equals&value0-1-0=high&field0-1-1=priority&type0-1-1=equals&value0-1-1=Medium%2B&field0-2-0=bug_severity&type0-2-0=notequals&value0-2-0=enhancement&field0-3-0=bug_status&type0-3-0=notequals&value0-3-0=RESOLVED&field0-4-0=bug_status&type0-4-0=notequals&value0-4-0=VERIFIED>

Assignee

QA

Milestone

Status

cf_regression_type

Created

0

Automated Runtime Testing

8307<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8307>

Medium+

AttributeError: 'TestContext' object has no attribute 'sigterm'

Mariano Lopez

Alexandru Georgescu

2.0

CLOSED

---

2015-09-16

1

BSPs

8092<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8092>

Medium+

Implementation of the function glXChooseFBConfig in the libGL.so does not match OpenGL documentation

Otavio Salvador

2.0.2

WaitForUpstream

New (Never tested)

2015-08-03

1

Cross-prelink

7991<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7991>

Medium+

qemuppc bootup failure with oe-core toolchain (with systemd)

Mark Hatle

2.0.2

IN PROGRESS IMPLEMENTATION

---

2015-07-13

1

OE-Core

8877<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8877>

Medium+

WebKitGTK+ Security Advisories

ytao

2.0.2

NEW

---

2016-01-06

8028<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8028>

Medium+

Garbage in SDK manifest file

Mariano Lopez

Bogdan Alexandru Voiculescu

2.0.2

IN PROGRESS REVIEW

---

2015-07-17

9353<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9353>

Medium+

yocto-bsp: script using different kernel than the one given when creating bsp

Humberto Ibarra

2.0.2

IN PROGRESS REVIEW

---

2016-03-29

3

Regards,
José

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20160530/1c0cf2d3/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 177 bytes
Desc: image001.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20160530/1c0cf2d3/attachment.png>