[poky] Fullpass Test Report for Yocto M4 RC1 20110226 Build

Sun Mar 6 01:32:55 PST 2011

Hi all,

       This is the fullpass test report for RC1 build 20110226. The critical bug blocks out testing is most BSP targets build failed on autobuilder. Together with sanity test result against the same build, there are 17 new bugs reported with RC1 build. And there are 31 bugs met in this testing, which cause 73 cases failed. For QEMU targets, most functionality work well, except for partial zypper function. Most failed test cases on beagleboard are excepted and will not be fixed in v1.0. For poky feature, sstate and non-GPLv3 build do not work correctly. SDK testing is partly blocked with i586 toolchain tarball build failed. For compliance with LTP/POSIX/LSB, these testing results are still in analysis and will be published later.

      NOTE: Yi Zhao, Liangliang Wang and Liang Li helped to do a sanity test against the latest BSP builds(20110301), including beagleboard, mpc8315e-rdb and routerstationpro. They did not find any show-stoper or critical bugs with this build. Only one new issue is found with RTC set on routerstationpro. You could find the detailed test report in attachment.

Test Summary
---------------------------------------
Test Result Summary

Component

Target

Status

Comments

BSP

SugarBay

BLOCK

BSP build failed

CrownBay

BLOCK

BSP build failed

JasperForest

BLOCK

BSP build failed

Blacksand

BUGGY

BSP build failed, atom-pc build pass for core; With atom-pc image, partial zypper function not work well;  connman-applet and audio/video not work;

Beagleboard

BUGGY

USB, RTC, X window, NAND do not work; sato-sdk image not copied to sharing folder; Most failed cases will be fixed in v1.1. So will skip them in next RC2 testing;

Routerstationpro

BLOCK

sato-sdk image not copied to sharing folder

Mpc8315e-rdb

BLOCK

sato-sdk image not copied to sharing folder

QEMU

qemux86

GOOD

Partial zypper function not work well

qemux86-64

GOOD

Partial zypper function not work well

qemuarm

GOOD

Partial zypper function not work well

qemuppc

BUGGY

gcc segfault and zypper function not work well

qemumips

BUGGY

x11vnc and partial zypper function not work well

Poky

BUGGY

sstate and non-gplv3 build do not work correctly

Documentation

GOOD

SDK

BLOCK

unfs not work for qemuppc; i586 toolchain not build out

Complience Test

In analysis

LTP and POSIX testing is finished and being analysis now; LSB testing is partly finished, you could check the attachment for LSP test result.

Critical bugs, more than 50% test cases are blocked

Only Normal, Minor or Enhancement bugs, less than 10% test cases failed

Normal, Major and Critical bugs, more than 10% test cases failed

Detailed Test Result for each component

Target

Total TCs

Not Run

Passed

Failed

Not testable (Blocked)

Blacksand Sato

52

0

33

14 (bug 607, 803, 804, 613, 798, 799)

5 (bug 779, 613)

BeagleBoard Sato

21

0

8

10 (bug 764, 765, 767, 772)

3 (bug 764)

Qemux86-64 Sato

21

0

20

1 (bug 721)

0

Qemux86-64 SDK

26

0

22

4 (bug 721)

0

Qemux86 Sato

21

0

18

3 (bug 803, 804)

0

Qemux86 SDK

26

0

23

3 (bug 803, 804)

0

Qemumips Sato

21

0

15

6 (bug 721, 782, 787)

0

Qemumips SDK

26

0

20

6 (bug 721, 782, 787)

0

Qemuppc Sato

18

0

12

6 (bug 722, 787)

0

Qemuppc SDK

23

0

16

7 (bug 722, 780, 778)

0

Qemuarm Sato

21

0

16

5 (bug 491, 489, 490, 749, 787)

0

Qemuarm SDK

26

0

22

4 (bug 491, 489, 490, 787)

0

SDK

3

0

0

1 (bug 414)

2 (Toolchain tarballs not built out for i586)

Poky

8

0

5

3 (bug 598, 712, 788, 789)

0

Documentation

1

0

1

0

0

Total

314

0

231

73

10

* You can check the detailed test result in attachment for each target.

** The failed/blocked case number is listed with failed cases’ bug number.

Images
---------------------------------------

http://autobuilder.pokylinux.org/nightly/20110226-1/

Issue Summary
---------------------------------------

Zypper/RPM:

1.     New! [zypper] zypper install does not work on qemux86/atom-pc

http://bugzilla.pokylinux.org/show_bug.cgi?id=803

2.     New! [zypper] package installed by rpm could not be recognized by zypper

http://bugzilla.pokylinux.org/show_bug.cgi?id=804

3.     New! rpm remove package error

http://bugzilla.pokylinux.org/show_bug.cgi?id=787

4.     [zypper] zypper segfault in qemux86-64 sdk image

http://bugzilla.pokylinux.org/show_bug.cgi?id=721

5.     [qemuarm]zypper search package warning in sato image: no '/usr/bin/uuidgen'

http://bugzilla.pokylinux.org/show_bug.cgi?id=749

6.     [zypper] package removal failure

http://bugzilla.pokylinux.org/show_bug.cgi?id=491

7.     [zypper] uname -m and repo arch difference

http://bugzilla.pokylinux.org/show_bug.cgi?id=489

8.     [zypper] installation failure on arm

http://bugzilla.pokylinux.org/show_bug.cgi?id=490

9.     [zypper]  search failure on qemuppc (nightly build 20110212-1)

http://bugzilla.pokylinux.org/show_bug.cgi?id=722

Poky:

1.     New! [sstate] random error message shown when sstate is used

http://bugzilla.pokylinux.org/show_bug.cgi?id=788

2.     New! [sstate] only few setscene tasks run even with same build environment

http://bugzilla.pokylinux.org/show_bug.cgi?id=789

3.     Fail to build non-GPLv3 image

http://bugzilla.pokylinux.org/show_bug.cgi?id=712

4.     [poky] kernel interactive build does not work via ssh

http://bugzilla.pokylinux.org/show_bug.cgi?id=598

SDK:

1.     [PPC] kernel panic when booting poky-image-sdk-qemuppc through UNFS

http://bugzilla.pokylinux.org/show_bug.cgi?id=414

BSP:

1.     New! [blacksand] no sound even all options in amixer enabled

http://bugzilla.pokylinux.org/show_bug.cgi?id=798

2.     New! [blacksand] configured audiosink is not working for video player

http://bugzilla.pokylinux.org/show_bug.cgi?id=799

3.     New! [RouterStationPro] Missing file when setting RTC on routerstationpro

http://bugzilla.pokylinux.org/show_bug.cgi?id=801

4.     [Connman] xuser must be granted privilege to start connman-applet

http://bugzilla.pokylinux.org/show_bug.cgi?id=779

5.     [Blacksand] Some error information prompted when run dmesg command

http://bugzilla.pokylinux.org/show_bug.cgi?id=607

6.     [Blacksand]system cannot enter S3 standby mode

http://bugzilla.pokylinux.org/show_bug.cgi?id=613

7.     [beagleboard] X server can not startup on beagleboard

http://bugzilla.pokylinux.org/show_bug.cgi?id=764

8.     [beagleboard] USB does not work on beagleboard

http://bugzilla.pokylinux.org/show_bug.cgi?id=765

9.     [beagleboard] Can not set RTC correctly

http://bugzilla.pokylinux.org/show_bug.cgi?id=767

10.  [beagleboard] Can not recognize NAND flash on board

http://bugzilla.pokylinux.org/show_bug.cgi?id=772

Complience:

1.     New! The process of installing LSB test suit and running LSB test on qemu-ppc is very slow

http://bugzilla.pokylinux.org/show_bug.cgi?id=793

2.     New! LSB: A test case (lib/Config.t) failed during running perl test of LSB

http://bugzilla.pokylinux.org/show_bug.cgi?id=794

3.     New! LSB: Some cases (libstdc++.so.6) failed on library check of LSB test

http://bugzilla.pokylinux.org/show_bug.cgi?id=795

4.     New! LSB: Some cases related to locale failed on libstdcpp and cpp-t2c test of LSB

http://bugzilla.pokylinux.org/show_bug.cgi?id=796

Others:

1.     [X11VNC Server ] No response when I click 'X11VNC Server' icon

http://bugzilla.pokylinux.org/show_bug.cgi?id=781

2.     gcc segfault on qemuppc (nightly build 20110226-1)

http://bugzilla.pokylinux.org/show_bug.cgi?id=780

3.     The vnc client does not pop-up on qemumips-sato-sdk

http://bugzilla.pokylinux.org/show_bug.cgi?id=782

Best Regards,

Jiajun
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/poky/attachments/20110306/d2d2ba74/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: M4-RC1_20110226_detail_testreport_fullpass.ods
Type: application/oleobject
Size: 22095 bytes
Desc: M4-RC1_20110226_detail_testreport_fullpass.ods
URL: <http://lists.yoctoproject.org/pipermail/poky/attachments/20110306/d2d2ba74/attachment.bin>
-------------- next part --------------
An embedded message was scrubbed...
From: Zhao Yi <yi.zhao at windriver.com>
Subject: Sanity Test Report for Yocto 1.0 RC1 20110301 build on non-x86 hardware
Date: Fri, 4 Mar 2011 17:22:53 +0800
Size: 32697
URL: <http://lists.yoctoproject.org/pipermail/poky/attachments/20110306/d2d2ba74/attachment.mht>
-------------- next part --------------
An embedded message was scrubbed...
From: Xiaofeng Yan <xiaofeng.yan at windriver.com>
Subject: The status for lsb test
Date: Fri, 4 Mar 2011 18:35:12 +0800
Size: 16076
URL: <http://lists.yoctoproject.org/pipermail/poky/attachments/20110306/d2d2ba74/attachment-0001.mht>