[yocto] Resend QA cycle report for 2.4.2 RC2

[Yeoh, Ee Peng]

Hi Stephen,

Those idle test cases are actually belongs to the outdated testcases inside Testopia, GDC had opened a Bugzilla ticket to remove and replace outdated and duplicated test cases. We are in progress of removing ducplicated test cases, next step is to remove outdated test cases using automated script that utilize testopia python api. 

https://bugzilla.yoctoproject.org/show_bug.cgi?id=12435

For testrun# 9206-9212, testopia testcases not 100% completed as there are some outdated testcases that were no longer available in oeqa/selftest testsuite, pending testopia data cleanup.

Please let me know if any more question.

Thanks,
Ee Peng 

-----Original Message-----
From: Jolley, Stephen K 
Sent: Friday, March 9, 2018 12:48 AM
To: Yeoh, Ee Peng <ee.peng.yeoh at intel.com>; 'yocto at yoctoproject.org' <yocto at yoctoproject.org>; Purdie, Richard <richard.purdie at intel.com>; Jordan, Robin L <robin.l.jordan at intel.com>; Zhang, Jessica <jessica.zhang at intel.com>; Lock, Joshua G <joshua.g.lock at intel.com>; Eggleton, Paul <paul.eggleton at intel.com>
Cc: Sangal, Apoorv <apoorv.sangal at intel.com>
Subject: RE: Resend QA cycle report for 2.4.2 RC2

Why are we showing 62 (2%) of the test cases as Idle.  (Not Run).  Were they blocked? What happened to them?

Thanks,

Stephen

-----Original Message-----
From: Yeoh, Ee Peng 
Sent: Thursday, March 08, 2018 1:41 AM
To: 'yocto at yoctoproject.org' <yocto at yoctoproject.org>; Purdie, Richard <richard.purdie at intel.com>; Jolley, Stephen K <stephen.k.jolley at intel.com>; Jordan, Robin L <robin.l.jordan at intel.com>; Zhang, Jessica <jessica.zhang at intel.com>; Lock, Joshua G <joshua.g.lock at intel.com>; Eggleton, Paul <paul.eggleton at intel.com>
Cc: Sangal, Apoorv <apoorv.sangal at intel.com>
Subject: Resend QA cycle report for 2.4.2 RC2

Hello All,
Resend the full report for 2.4.2 RC2 with updated information:  
https://wiki.yoctoproject.org/wiki/WW10_-_2018-03-05-_Full_Test_Cycle_-_2.4.2_rc2

======= Summary ========

The QA cycle for release 2.4.2 RC2 was completed including the performance test.  Team had discovered 3 new bugs (oeselftest.sstatetests.test_sstate_sametune_samesigs failed, x11perf failed on minnowmax and nuc, toaster run again button does not behaved as expected).

For testrun# 9206-9212, testopia testcases not 100% completed as there are some outdated testcases that were no longer available in oeqa/selftest testsuite, pending testopia data cleanup. 

Performance tests were executed for both 2.4.2 RC2 and 2.4.1 RC1 (as regression and benchmark) on these new machines in linux foundation. 

======= QA-Hints========

QA shows no major bug.

======= Bugs ========

New Bugs
[1] 12587 - [2.4.2 rc2] test_sstate_sametune_samesigs (sstatetests.SStateTests) [2] 12590 - [2.4.2 rc2] No. of Chars/sec For Yocto Image is very Low To that of Ubuntu [3] 12591 - [2.4.2 rc2] Run again button from all builds page must run the specified task

======== Links =========
1. https://bugzilla.yoctoproject.org/show_bug.cgi?id=12587
2. https://bugzilla.yoctoproject.org/show_bug.cgi?id=12590
3. https://bugzilla.yoctoproject.org/show_bug.cgi?id=12591

Regards
Ee Peng