[poky] Broken dependency behavior in master?

[Scott Garman]

On 04/01/2011 04:31 AM, Richard Purdie wrote:
> On Thu, 2011-03-31 at 17:23 -0700, Scott Garman wrote:
>> Beth pointed me to a failure occurring on the autobuilder when building
>> docbook-sgml-dtd-3.1-native using the latest master:
>>
>> http://autobuilder.pokylinux.org:8010/builders/nightly-external/builds/88/steps/shell_3/logs/stdio
>>
>> I am able to reproduce it on my development system. The problem occurs
>> because sgml-common-native is not being fully built before
>> docbook-sgml-dtd-3.1-native, even though it is listed in DEPENDS. I see
>> log files only up to the do_configure step for sgml-common-native.
>
> Looking at the log above and keeping the order but removing some lines:
>
>
> NOTE: package sgml-common-native-0.6.3-r0: task do_configure: Succeeded
> NOTE: Running task 1263 of 7259 (ID: 7236, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/sgml-common/sgml-common-native_0.6.3.bb, do_compile)
> NOTE: package sgml-common-native-0.6.3-r0: task do_compile: Started
> NOTE: package sgml-common-native-0.6.3-r0: task do_compile: Succeeded
> NOTE: Running task 1269 of 7259 (ID: 7231, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/sgml-common/sgml-common-native_0.6.3.bb, do_install)
> NOTE: package sgml-common-native-0.6.3-r0: task do_install: Started
> NOTE: package sgml-common-native-0.6.3-r0: task do_install: Succeeded
> NOTE: Running task 1271 of 7259 (ID: 7232, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/sgml-common/sgml-common-native_0.6.3.bb, do_populate_sysroot)
> NOTE: Running noexec task 1272 of 7259 (ID: 7238, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/sgml-common/sgml-common-native_0.6.3.bb, do_package)
> NOTE: Running noexec task 1273 of 7259 (ID: 7237, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/sgml-common/sgml-common-native_0.6.3.bb, do_package_write)
> NOTE: package sgml-common-native-0.6.3-r0: task do_populate_sysroot: Started
> NOTE: package sgml-common-native-0.6.3-r0: task do_populate_sysroot: Succeeded
> NOTE: Running noexec task 1287 of 7259 (ID: 7234, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/sgml-common/sgml-common-native_0.6.3.bb, do_build)
> NOTE: Running task 1288 of 7259 (ID: 7239, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/sgml-common/sgml-common-native_0.6.3.bb, do_rm_work)
> NOTE: package libxft-1_2.2.0-r0: task do_populate_lic: Succeeded
> NOTE: package sgml-common-native-0.6.3-r0: task do_rm_work: Started
> NOTE: package sgml-common-native-0.6.3-r0: task do_rm_work: Succeeded
>
> Then later we see:
>
> NOTE: Running task 1370 of 7259 (ID: 6965, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/docbook-sgml-dtd/docbook-sgml-dtd-3.1-native.bb, do_configure)
> NOTE: package opensp-native-1.5-r0: task do_populate_lic: Started
> NOTE: package docbook-sgml-dtd-3.1-native-1.0-r1.0: task do_configure: Started
>
> [...]
>
> NOTE: Running task 1375 of 7259 (ID: 5055, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/perl/libxml-parser-perl-native_2.36.bb, do_populate_sysroot)
> NOTE: package docbook-sgml-dtd-3.1-native-1.0-r1.0: task do_populate_lic: Started
> WARNING: docbook-sgml-dtd-3.1-native: Something went wrong with copying: OASIS to /srv/home/pokybuild/poky-slave/nightly-external/build/meta/files/common-licenses
> WARNING: This could be either because we do not have a generic for this license or the LICENSE field is incorrect
> NOTE: package docbook-dsssl-stylesheets-native-1.79-r2: task do_configure: Started
> NOTE: package docbook-sgml-dtd-3.1-native-1.0-r1.0: task do_compile: Started
> ERROR: Function 'docbook_sgml_dtd_sstate_postinst' failed (see /srv/home/pokybuild/poky-slave/nightly-external/build/build/tmp/work/x86_64-linux/docbook-sgml-dtd-3.1-native-1.0-r1.0/temp/log.do_populate_lic.14913 for further information)
> NOTE: package docbook-dsssl-stylesheets-native-1.79-r2: task do_configure: Succeeded
> NOTE: Running noexec task 1376 of 7259 (ID: 5061, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/perl/libxml-parser-perl-native_2.36.bb, do_package)
> NOTE: Running noexec task 1377 of 7259 (ID: 5060, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/perl/libxml-parser-perl-native_2.36.bb, do_package_write)
> NOTE: Running task 1378 of 7259 (ID: 6951, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/docbook-dsssl-stylesheets/docbook-dsssl-stylesheets-native_1.79.bb, do_compile)
> ERROR: Logfile of failure stored in: /srv/home/pokybuild/poky-slave/nightly-external/build/build/tmp/work/x86_64-linux/docbook-sgml-dtd-3.1-native-1.0-r1.0/temp/log.do_populate_lic.14913
> Log data follows:
> | WARNING: docbook-sgml-dtd-3.1-native: Something went wrong with copying: OASIS to /srv/home/pokybuild/poky-slave/nightly-external/build/meta/files/common-licenses
> | WARNING: This could be either because we do not have a generic for this license or the LICENSE field is incorrect
> | ERROR: Function 'docbook_sgml_dtd_sstate_postinst' failed (see /srv/home/pokybuild/poky-slave/nightly-external/build/build/tmp/work/x86_64-linux/docbook-sgml-dtd-3.1-native-1.0-r1.0/temp/log.do_populate_lic.14913 for further information)
> | install-catalog: "/srv/home/pokybuild/poky-slave/nightly-external/build/build/tmp/sysroots/x86_64-linux/etc/sgml/sgml-docbook-dtd-3.1.cat" does not exist or is empty.
> NOTE: package docbook-sgml-dtd-3.1-native-1.0-r1.0: task do_populate_lic: Failed
> ERROR: Task 6970 (/srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/docbook-sgml-dtd/docbook-sgml-dtd-3.1-native.bb, do_populate_lic) failed with exit code '1'
> NOTE: Running task 1379 of 7259 (ID: 6935, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/sgmlspl/sgmlspl-native_1.03ii.bb, do_configure)
> NOTE: package docbook-sgml-dtd-3.1-native-1.0-r1.0: task do_compile: Succeeded
> NOTE: Running task 1380 of 7259 (ID: 6961, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/docbook-sgml-dtd/docbook-sgml-dtd-3.1-native.bb, do_install)
> NOTE: package docbook-dsssl-stylesheets-native-1.79-r2: task do_populate_lic: Started
> WARNING: docbook-dsssl-stylesheets-native: Something went wrong with copying: DSSSL to /srv/home/pokybuild/poky-slave/nightly-external/build/meta/files/common-licenses
> WARNING: This could be either because we do not have a generic for this license or the LICENSE field is incorrect
> NOTE: package libxml-parser-perl-native-2.36-r1: task do_populate_sysroot: Started
> ERROR: Function 'docbook_dsssl_stylesheets_sstate_postinst' failed (see /srv/home/pokybuild/poky-slave/nightly-external/build/build/tmp/work/x86_64-linux/docbook-dsssl-stylesheets-native-1.79-r2/temp/log.do_populate_lic.15063 for further information)
> ERROR: Logfile of failure stored in: /srv/home/pokybuild/poky-slave/nightly-external/build/build/tmp/work/x86_64-linux/docbook-dsssl-stylesheets-native-1.79-r2/temp/log.do_populate_lic.15063
> Log data follows:
> | WARNING: docbook-dsssl-stylesheets-native: Something went wrong with copying: DSSSL to /srv/home/pokybuild/poky-slave/nightly-external/build/meta/files/common-licenses
> | WARNING: This could be either because we do not have a generic for this license or the LICENSE field is incorrect
> | ERROR: Function 'docbook_dsssl_stylesheets_sstate_postinst' failed (see /srv/home/pokybuild/poky-slave/nightly-external/build/build/tmp/work/x86_64-linux/docbook-dsssl-stylesheets-native-1.79-r2/temp/log.do_populate_lic.15063 for further information)
> | install-catalog: "/srv/home/pokybuild/poky-slave/nightly-external/build/build/tmp/sysroots/x86_64-linux/etc/sgml/dsssl-docbook-stylesheets.cat" does not exist or is empty.
> NOTE: package docbook-dsssl-stylesheets-native-1.79-r2: task do_populate_lic: Failed
> ERROR: Task 6955 (/srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/docbook-dsssl-stylesheets/docbook-dsssl-stylesheets-native_1.79.bb, do_populate_lic) failed with exit code '1'
> NOTE: Running task 1381 of 7259 (ID: 6940, /srv/home/pokybuild/poky-slave/nightly-ext
>
>> This makes me think something could be seriously broken in master when
>> it comes to handling build dependencies.
>>
>> I've verified that sgml-common-native is showing up as a build
>> dependency properly in the dependency explorer.
>
> I'm not convinced as its clear above that sgml-common-native is being
> built before docbook-dsssl-stylesheets-native do_configure runs.

That was the case on the autobuilder. On my local development system, I 
proved to myself without a doubt that sgml-common-native only got as far 
as do_configure before the docbook-sgml-dtd-3.1-native error was 
encountered.

I also then ran bitbake sgml-common-native afterward and verified that 
the remaining build steps were run to make sure it wasn't a case of 
missing log files.

> Did both your builds have rm_work enabled?

My local build did not have rm_work enabled, but I believe it is enabled 
on the autobuilder.

Scott

-- 
Scott Garman
Embedded Linux Engineer - Yocto Project
Intel Open Source Technology Center