[yocto] QA Test Report for YP - 1.8.2.rc3 build

Perez Carranza, Jose jose.perez.carranza at intel.com
Fri May 20 11:05:10 PDT 2016 

Hello,

Here is the QA test report for "Yocto Project - 1.8.2.rc3 build"


Issues Summary:


-        Install on USB or SD card failed giving “"(sdc): Volume was not properly unmounted” :  Bug 9652 [1]

-        Black screen is displayed when trying to Boot or Install on NUC:  Bug 9653 [2]

-        Media files are not being reproduced on NUC and MMax : Bug 9654 [3]

-        Kernel panic is generated trying to do a NFS boot on qemu : Bug 9656 [4]

-        “Eject icon” is displayed as “file icon” on SATO image when plug the USB; Bug 9650 [5]

-        Parse logs bug found on 2.1 was also reproduced on this 1.8.2 bug when running test image : Bug 9250 [6]


[1] - https://bugzilla.yoctoproject.org/show_bug.cgi?id=9652
[2] - https://bugzilla.yoctoproject.org/show_bug.cgi?id=9653
[3] - https://bugzilla.yoctoproject.org/show_bug.cgi?id=9654
[4] - https://bugzilla.yoctoproject.org/show_bug.cgi?id=9656
[5] - https://bugzilla.yoctoproject.org/show_bug.cgi?id=9650
[6] - https://bugzilla.yoctoproject.org/show_bug.cgi?id=9250

The full report is available here for review:  https://wiki.yoctoproject.org/wiki/WW21_-_2016-05-13_-_Full_Pass_1.8.2


Testing data

 Test type:  Full Pass Release Test

 Branch: fido

 Build name: 1.8.2

 poky commit: c9f0a99050ec0050f0dbcd55d0cd2ab18848113f

 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-1.8.2.rc3

 Distributions tested: CentOS 7 x86 64 bits, Fedora 23 x86 64 bits, OpenSuse 13.2 x86 64 bits, Ubuntu 15.04 x86 64 bits


Test Run Summary Report
Testing Summary Report

Test Run

Test Plan

Environment

Passed

Other issues

Failed

Failing bugs

Blocked

Blocking bugs

Complete

5862<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5862> 5863<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5863>

ADT: fido branch

Fedora 23 i686

100.0%

none

0.0%

none

0.0%

none

100.0%

5859<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5859> 5860<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5860>

ADT: fido branch

Ubuntu 14.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

5864<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5864> 5865<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5865>

BSP/QEMU: fido branch

Beaglebone Black

100.0%

none

0.0%

none

0.0%

none

100.0%

5902<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5902> 5903<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5903>

BSP/QEMU: fido branch

EdgeRouter

100.0%

none

0.0%

none

0.0%

none

100.0%

5831<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5831> 5832<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5832>

BSP/QEMU: fido branch

genericx86 - on MMAX32bit

95.5%

none

4.5%

9652<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9652> 9653<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9653> 9654<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9654> 9520<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9520>

0.0%

none

100.0%

5829<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5829>

BSP/QEMU: fido branch

genericx86-64 on MMAX64

98.1%

none

1.9%

9520<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9520>

0.0%

none

100.0%

5828<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5828> 5895<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5895>

BSP/QEMU: fido branch

genericx86-64 on NUC

96.6%

none

3.4%

9520<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9520> 9650<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9650> 9654<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9654>

0.0%

none

100.0%

5909<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5909>

BSP/QEMU: fido branch

genericx86-64-lsb on NUC

96.2%

none

3.8%

9520<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9520>

0.0%

none

100.0%

5910<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5910>

BSP/QEMU: fido branch

genericx86-lsb on MMAX32bit

96.2%

none

3.8%

9520<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9520>

0.0%

none

100.0%

5904<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5904> 5905<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5905>

BSP/QEMU: fido branch

MPC8315e-rdb

100.0%

none

0.0%

none

0.0%

none

100.0%

5866<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5866> 5867<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5867>

BSP/QEMU: fido branch

P1022ds

100.0%

none

0.0%

none

0.0%

none

100.0%

5834<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5834> 5897<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5897>

BSP/QEMU: fido branch

qemu-x86

98.5%

none

1.5%

9656<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9656>

0.0%

none

100.0%

5837<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5837> 5838<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5838>

BSP/QEMU: fido branch

qemuarm

100.0%

none

0.0%

none

0.0%

none

100.0%

5900<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5900> 5901<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5901>

BSP/QEMU: fido branch

qemuarm64

100.0%

none

0.0%

none

0.0%

none

100.0%

5839<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5839> 5840<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5840>

BSP/QEMU: fido branch

qemumips

100.0%

none

0.0%

none

0.0%

none

100.0%

5898<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5898> 5899<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5899>

BSP/QEMU: fido branch

qemumips64

100.0%

none

0.0%

none

0.0%

none

100.0%

5841<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5841> 5842<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5842>

BSP/QEMU: fido branch

qemuppc

100.0%

none

0.0%

none

0.0%

none

100.0%

5836<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5836> 5896<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5896>

BSP/QEMU: fido branch

qemux86-64

98.5%

none

1.5%

9656<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9656>

0.0%

none

100.0%

5856<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5856>

Eclipse Plugin: fido branch

Kepler - Fedora 22 x86_64

96.4%

none

3.6%

7054<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7054>

0.0%

none

100.0%

5857<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5857>

Eclipse Plugin: fido branch

Luna on Fedora 22 X86_64

96.4%

none

3.6%

7054<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7054>

0.0%

none

100.0%

5906<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5906> 5907<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5907>

Meta-yocto: fido branch

Ubuntu 14.04 x86_64

100.0%

6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>

0.0%

none

0.0%

none

100.0%

5874<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5874>

OE-Core: fido branch

CentOS 7.1 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

5872<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5872>

OE-Core: fido branch

Fedora 23 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

5873<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5873>

OE-Core: fido branch

OpenSuse 13.2 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

5871<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5871>

OE-Core: fido branch

Ubuntu 15.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

5845<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5845>

BitBake: fido branch

Debian 4.3.5-1~bpo8+1

100.0%

none

0.0%

none

0.0%

none

100.0%

5850<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5850>

Automated Build Testing: fido branch

CentOS 7 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

5849<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5849>

Automated Build Testing: fido branch

Fedora 23 x86-64

100.0%

none

0.0%

none

0.0%

none

100.0%

5848<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5848>

Automated Build Testing: fido branch

OpenSuse 13.2 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

5847<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5847>

Automated Build Testing: fido branch

Ubuntu 15.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

5908<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=5908>

Build Appliance: fido branch

VMWare Player on Ubuntu

100.0%

none

0.0%

none

0.0%

none

100.0%

Total: 31



[Bug Status]


Test Case Status Report

Status

Count

FAILED

16

PASSED

1840

Total: 1856


[http://chart.apis.google.com/chart?cht=bvg&chs=372x120&chbh=a&chds=0,1840&chxt=y&chxr=0,0,1840,307&chd=t:&chd=t:16,1840&chco=FF9933|00FF00&chdl=FAILED(16)+1%25|PASSED(1840)+99%25]





Bugs Found during QA Test
New and notable issues Found during QA Test & Community
ID

Summary (4 tasks) ⇒<https://bugzilla.yoctoproject.org/buglist.cgi?&field0-0-0=bug_id&type0-0-0=equals&value0-0-0=9520&field0-0-1=bug_id&type0-0-1=equals&value0-0-1=%20%209652&field0-0-2=bug_id&type0-0-2=equals&value0-0-2=%20%209653&field0-0-3=bug_id&type0-0-3=equals&value0-0-3=%20%209654&field0-1-0=bug_status&type0-1-0=notequals&value0-1-0=CLOSED>

P

Assignee

QA

Milestone

Status

Resolution

cf_regression_type

Created

BSPs

9520<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9520>

test_parselogs failed on udevd[342] inotify_add_watch /dev/loop when running test image

Medium+

Saul Wold

Francisco Pedraza

2.1.1

NEW

Regression (Found by QA test)

2016-04-25

9652<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9652>

boot and install from USB failed getting [sdc] error message

Medium+

Jianxun Zhang

Francisco Pedraza

1.8.2

NEW

Regression (Found by QA test)

2016-05-17

9653<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9653>

Boot and install from USB failed after GRUB black screen is displayed

Medium+

Jianxun Zhang

Francisco Pedraza

1.8.2

NEW

Regression (Found by QA test)

2016-05-17

9654<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9654>

Ogg media file audio is not working on NUC and MMax

Medium+

Saul Wold

Francisco Pedraza

1.8.2

NEW

Regression (Found by QA test)

2016-05-17




Other Bugs found during QA Test (including regressions)
ID

Summary (4 tasks) ⇒<https://bugzilla.yoctoproject.org/buglist.cgi?&field0-0-0=bug_id&type0-0-0=equals&value0-0-0=6156&field0-0-1=bug_id&type0-0-1=equals&value0-0-1=%20%207054&field0-0-2=bug_id&type0-0-2=equals&value0-0-2=%20%209650&field0-0-3=bug_id&type0-0-3=equals&value0-0-3=%20%209656&field0-1-0=bug_status&type0-1-0=notequals&value0-1-0=CLOSED>

P

Assignee

QA

Milestone

Status

Resolution

cf_regression_type

Created

Regression (Found by QA test)

9656<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9656>

NFS boot failed due No working init found kernel panic on qemu

Medium

Alexandru Georgescu

Francisco Pedraza

1.8.2

NEEDINFO

Regression (Found by QA test)

2016-05-18

Manual Testing

9650<https://bugzilla.yoctoproject.org/show_bug.cgi?id=9650>

Eject icon is displayed as "file" on SATO sdk NUC when plugging USB

Medium

Jussi Kukkonen

Francisco Pedraza

1.8.3

NEW

Regression (Found by QA test)

2016-05-17

Regression (Used to work)

6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>

[crosstap] no trace message output on qemuarm

Medium

Tom Zanussi



2.2

ACCEPTED

Regression (Used to work)

2014-04-14

OE-Core

7054<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7054>

OprofileUI needs to be updated to reflect new oprofile functionality

Medium

Ross Burton

Valentin Hangan

2.2

ACCEPTED

Regression (Used to work)

2014-12-09




Regards,
José

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20160520/85b23591/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.jpg
Type: image/jpeg
Size: 6771 bytes
Desc: image002.jpg
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20160520/85b23591/attachment.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image004.jpg
Type: image/jpeg
Size: 5513 bytes
Desc: image004.jpg
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20160520/85b23591/attachment-0001.jpg>

More information about the yocto mailing list