[poky] Fullpass test report for Yocto1.1 M2 RC3 20110717

[Xu, Jiajun]

Hi all,
Currently the only one testing not finished is the LTP stress testing on beagleboard, which is supposed to be finished next Monday.
QA does not find other new issues, compared with RC3 weekly test result ¨C Crownbay has 2 issues on grub and Xorg separately. Gettext-native build issue on opensuse11.4 still exists but Saul already has a patch to fix the issue. For performance testing, sugarbay and crownbay have no regression compared with M1 result. Core build testing shows 109 minutes for a qemux86 core-image-sato build on a Core i7 860 machine.


Best Regards,
Jiajun

From: yocto-bounces at yoctoproject.org [mailto:yocto-bounces at yoctoproject.org] On Behalf Of Fan, WenhuaX
Sent: Friday, July 22, 2011 5:23 PM
To: poky at pokylinux.org; yocto at yoctoproject.org
Subject: [yocto] Fullpass test report for Yocto1.1 M2 RC3 20110717

Hi all,
       This is the Fullpass test report for Yocto1.1 M2 RC3 build. There is no new bug found in this testing. We add two stress testing for Beagleboard. Xorg eats lots of CPU¡¯s resource after standby on Crownbay, expect for this issue, broken grub issue appear on this machine.
       Helltest and Crashme could pass 24 hours testing on Jasperforest. Idle power consumption of sugarbay and crownbay are 37.50W and 23.96W respectively. LTP and POSIX testing are pass. Crashme on Jasperforest and Beagleboard could pass 24 hours stress testing. And Helltest on Jasperforest could pass also, but Helltest on Beagleboard is on running.



Test Summary
---------------------------------------

Test Result Summary

Component

Target

Status

Comments

BSP

SugarBay

GOOD

3D testing blocked due to libsdl.so

CrownBay-emgd

GOOD

Xorg eats lots of CPU time after standby; broken grub due to wrong root path

JasperForest

GOOD

I/OAT DMA engine init failed;

Blacksand

GOOD

Psplash failed when boot up Yocto

eMenlow

GOOD

i2c_transfer error; Standby failed;

Beagleboard

GOOD

Everything runs well

Routerstationpro

GOOD

Everything runs well

Mpc8315e-rdb

GOOD

Everything runs well

QEMU

qemux86

GOOD

Perl not exist

qemux86-64

GOOD

Perl not exist

qemuarm

GOOD

Perl not exist

qemuppc

BUGGY

Perl not exist; unfs does not work with qemuppc.

qemumips

GOOD

Perl not exist

Core Build System

¡¡

BUGGY

/usr/lib64/libxml2.so: undefined reference to `gzdirect at ZLIB_1.2.2.3';
Skeleton initscript can not start with minimal image.

Power/Performance

¡¡

GOOD

Power consumption of sugarbay and crownbay are 37.50W and 23.96W respectively

Compliance

¡¡

GOOD

LTP result: https://wiki.yoctoproject.org/wiki/LTP_result
POSIX result: https://wiki.pokylinux.org/wiki/Posix_result

Stress

¡¡

GOOD

Except for Helltest on Beagleboard is on running, Helltest and crashme could pass 24 hours testing

ADT

¡¡

BUGGY

Unfs does not work with qemuppc;


¡¡

Critical bugs, more than 50% test cases are blocked

¡¡

Only Normal, Minor or Enhancement bugs, or less than 10% test cases failed

¡¡

Normal, Major and Critical bugs, and more than 10% test cases failed


Detailed Test Result for each component

Target

Total TCs

Not Run

Passed

Failed

Not testable (Blocked)

Sugarbay Sato-SDK

59

0

57

0

2 (bug 883)

Jasperforest Sato-SDK

32

0

31

1 (bug 1188)

0

n450 Sato-SDK

56

0

56

0

0

eMenlow Sato-SDK

56

0

54

2(bug 310, 503)

0

Crownbay-Sato-SDK

56

0

56

0

0

Beagleboard

36

0

36

0

0

Routerstationpro

31

0

31

0

0

Mpc8315e-rdb

34

0

34

0

0

Qemux86-64 Sato

28

0

27

1 (bug 1172)

0

Qemux86-64 Sato-SDK

31

0

31

0

0

Qemux86 Sato

28

0

27

1 (bug 1172)

0

Qemux86 Sato-SDK

31

0

31

0

0

Qemumips Sato

28

0

27

1 (bug 1172)

0

Qemumips Sato-SDK

31

0

31

0

0

Qemuppc Sato

21

0

19

2 (bug 414, 1172)

0

Qemuppc Sato-SDK

24

0

23

1 (bug 414)

0

Qemuarm Sato

28

0

27

1 (bug 1172)

0

Qemuarm Sato-SDK

31

0

31

0

0

Core Build System

9

0

7

2 (bug 1242, 1165)

0

Power/Performance

5

0

5

0

0

Compliance

2

0

2

0

0

Stress

2

0

2

0

0

ADT

6

0

5

1 (bug 414)

0

Total

665

0

650

13

2




Commit Information
---------------------------------------

For Emenlow/Blacksand/Crownbay/Sugarbay/Jasperforest:

Tree/Branch: Poky/1.1_M2
Poky Commit id: fa4bcfdb73167f8159b88e5a4d711c0d37627a70
Meta Branch: 1.1_M2
Meta Commit id: 738d2bc6d1a0d7ff6589000893c1c8b4f983d76f

For Toolchain/Qemux86/Qemux86-64£º

Tree/Branch: Poky/1.1_M2
Poky Commit id: 93a2ca70482f09e93469481936302e7b6847156e
Meta Branch: 1.1_M2
Meta commit id£º1a6bcb62666b0fc67a66bd38a1c3f2a3399a249f

For qemuarm/mips/ppc/beagleboard/mpc8315e-rdb/routerstationpro:

Tree/Branch: Poky/1.1_M2
Poky Commit: 93a2ca70482f09e93469481936302e7b6847156e



Issue Summary
---------------------------------------

Component

Bug Number

Target Milestone

System & Core OS

Installation & Boot

Bug 1211 - [Blacksand] Psplash failed when boot up Yocto

1.1 M2

System Usage

Bug 1172: Perl not exist in sato image

1.1 M2

Bug 1174: [zypper/rpm] package install/removal costs lots of disk space

1.1 M3

Bug 1234: No response when I click the 'Install/Remove Software' icon

1.1 M4

Other

Bug 1236 - Broken ldd due to wrong path for ld.so

1.1 M3

New! Bug 1257 - [crownbay] broken grub due to wrong root path

1.1 M3

New! Bug 1258 -[crownbay] Xorg eats lots of CPU time after standby

1.1 M4

Core Build System

Bug 1165 - Skeleton initscript can not start with minimal image

1.1 M3

Bug 1242 - [opensuse11.4] /usr/lib64/libxml2.so: undefined reference to `gzdirect at ZLIB_1.2.2.3'

1.1 M3

Power/Performance

Power consumption of sugarbay and crownbay are 37.50W and 23.96W respectively

¡¡

Compliance

Compliance testing is finished, but result is still under analysis. LTP test result is on https://wiki.pokylinux.org/wiki/LTP_result
POSIX test result is on https://wiki.pokylinux.org/wiki/Posix_result

¡¡

Stress

Crashme on Jasperforest and Beagleboard could pass 24 hours stress testing. And Helltest on Jasperforest could pass also, but Helltest on Beagleboard is on running.

¡¡

ADT

Bug 414: [PPC] kernel panic when booting poky-image-sdk-qemuppc through UNFS

1.1 M3


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/poky/attachments/20110723/a16d059b/attachment.html>