[poky] [LTP] Yocto 1.0 M2 assessment -- DONE

[Tian, Kevin]

> From: Saul Wold
> Sent: Monday, January 31, 2011 4:41 AM
> 
> On 01/30/2011 01:12 AM, Tian, Kevin wrote:
> > Hi, all,
> >
> > I'd like to share the current LTP status, that I've basically done the
> > assessment for
> >
> > all the failures except routerstation (2.6.34 kernel has some IPC issues
> > which causes
> >
> > lots of unexpected failures).
> >
> Kevin,
> 
> Thanks for the excellent assesment, as we move forward, I will consult
> with you about the contents of the images.  Is there a reason you chose
> the SDK image over the LSB image?

I talked with Jiajun before. The major reason using SDK is to reduce the QA effort,
because LSB image doesn't run on real hardware, and doesn't contain enough
development tools for openposix test.

But regarding to the fact that I still need manually run LSB images to verify most
failures, it's perhaps a good idea to ask QA to use LSB for Qemu LTP test, and
then use SDK for real-hw LTP and all posix tests. This does add some extra effort
but that's what we have to do in current stage.

> 
> As you may have heard, we are working on creating sets of images that
> will meet various developers.  Soon, there will be an LSB-dev and
> LSD-sdk set of images that will contain headers/libraries and then
> headers/libraries and developer tools in LSB.  We might want to consider
> testing with the lsb-sdk image in the future since it will have some of
> the missing things that you have tested.
> 
> Thoughts?

That's great. If this can be ready in M3, we can move to it to save more time.
Also it's better to have LSB running on real-hw which further unifies the effort.  :-)

> > - The majority (36) failures are categorized as Not-A-Bug, which mostly
> > comes from
> >
> > the fact that SDK profile doesn't include necessary packages for test,
> > and then are
> >
> > verified PASS by adding them back with necessary tweaking. There're also
> > a few
> >
> > coming from lacking of memory/disk resources, which will be avoided in
> > the next test.
> >
> Do you have the list os packages that you had to add?  I do not see a
> summary of that list.

All the packages I have to add are contained in LSB profile already. The only
missing bits, as you said earlier, is the development part and graphics part.

Of course even with LSB profile there're some errors such as cron/at, which
have been fixed in earlier bug lists.

> 
> Again thanks for this great effort, and I look forward to the POSIX
> evaluation at somepoint in the near future.
> 

POSIX is a bit lagging behind, because I want to focus on LTP first. So this work
will extend into M4 a bit. But I hope to have a major break before CNY, if there
may be one reason for the majority of the failures. :-)

Thanks
Kevin