[poky] SRC checksum checking broken

Gary Thomas gary at mlbassoc.com
Tue Apr 10 13:10:35 PDT 2012


I'm not sure how, but this revision broke the checking of checksums:

commit 3d69d9462d550ce4e00e14768cc616bc9ad7e8a5
Author: Richard Purdie <richard.purdie at linuxfoundation.org>
Date:   Fri Mar 23 14:52:23 2012 +0000

     bitbake/fetch2: Ensure mirror tarballs have .done stamps so we don't redownload and corrupt them

     [YOCTO #2154]

     (Bitbake rev: 521d6b14151d3bf934b9597557f7ae46e50a3d7a)

     Signed-off-by: Richard Purdie <richard.purdie at linuxfoundation.org>

The attached log shows this failure - I've modified the busybox_1.19.4.bb
recipe to have incorrect checksums.  With revision 67c83a8, the failure
is correctly identified.  With revision 3d69d94, it is not.

The error happens with direct downloads (using DL_DIR) and also
with a mirror setup (using own-mirrors).

I've reviewed the change and I don't see how/why this happens.

-- 
------------------------------------------------------------
Gary Thomas                 |  Consulting for the
MLB Associates              |    Embedded world
------------------------------------------------------------
-------------- next part --------------
[gthomas at titan poky_test]$ bitbake busybox -c patch
Loading cache: 100% |####################################################################################| ETA:  00:00:00
Loaded 1108 entries from dependency cache.

OE Build Configuration:
BB_VERSION        = "1.15.1"
TARGET_ARCH       = "arm"
TARGET_OS         = "linux-gnueabi"
MACHINE           = "beagleboard"
DISTRO            = "poky"
DISTRO_VERSION    = "1.1+snapshot-20120410"
TUNE_FEATURES     = "armv7a vfp neon cortexa8"
TARGET_FPU        = "vfp-neon"
meta              
meta-yocto        = "(nobranch):67c83a8c0838c28cfbbb792daa83aa1f3c331302"

NOTE: Resolving any missing task queue dependencies
NOTE: Preparing runqueue
NOTE: Executing SetScene Tasks
NOTE: Executing RunQueue Tasks
NOTE: Running task 8 of 10 (ID: 2, /home/local/poky-master/meta/recipes-core/busybox/busybox_1.19.4.bb, do_fetch)
NOTE: package busybox-1.19.4-r0: task do_fetch: Started
WARNING: Failed to fetch URL http://www.busybox.net/downloads/busybox-1.19.4.tar.bz2;name=tarball
ERROR: Function failed: Fetcher failure for URL: 'http://www.busybox.net/downloads/busybox-1.19.4.tar.bz2;name=tarball'. Checksum mismatch!
File: '/home/local/poky_test/downloads/busybox-1.19.4.tar.bz2' has md5 checksum 9c0cae5a0379228e7b55e5b29528df8e when 9c0cae5a0379228e7b55e5b29528df8f was expected
File: '/home/local/poky_test/downloads/busybox-1.19.4.tar.bz2' has sha256 checksum 9b853406da61ffb59eb488495fe99cbb7fb3dd29a31307fcfa9cf070543710ee when 9b853406da61ffb59eb488495fe99cbb7fb3dd29a31307fcfa9cf070543710ef was expected
ERROR: Logfile of failure stored in: /home/local/poky_test/tmp/work/armv7a-vfp-neon-poky-linux-gnueabi/busybox-1.19.4-r0/temp/log.do_fetch.3868
Log data follows:
| DEBUG: Trying PREMIRRORS
| DEBUG: For url ['http', 'www.busybox.net', '/downloads/busybox-1.19.4.tar.bz2', '', '', {'name': 'tarball'}] comparing ['bzr', '.*', '/.*', '', '', {}] to ['http', 'downloads.yoctoproject.org', '/mirror/sources/', '', '', {}]
| DEBUG: For url ['http', 'www.busybox.net', '/downloads/busybox-1.19.4.tar.bz2', '', '', {'name': 'tarball'}] comparing ['cvs', '.*', '/.*', '', '', {}] to ['http', 'downloads.yoctoproject.org', '/mirror/sources/', '', '', {}]
| DEBUG: For url ['http', 'www.busybox.net', '/downloads/busybox-1.19.4.tar.bz2', '', '', {'name': 'tarball'}] comparing ['git', '.*', '/.*', '', '', {}] to ['http', 'downloads.yoctoproject.org', '/mirror/sources/', '', '', {}]
| DEBUG: For url ['http', 'www.busybox.net', '/downloads/busybox-1.19.4.tar.bz2', '', '', {'name': 'tarball'}] comparing ['hg', '.*', '/.*', '', '', {}] to ['http', 'downloads.yoctoproject.org', '/mirror/sources/', '', '', {}]
| DEBUG: For url ['http', 'www.busybox.net', '/downloads/busybox-1.19.4.tar.bz2', '', '', {'name': 'tarball'}] comparing ['osc', '.*', '/.*', '', '', {}] to ['http', 'downloads.yoctoproject.org', '/mirror/sources/', '', '', {}]
| DEBUG: For url ['http', 'www.busybox.net', '/downloads/busybox-1.19.4.tar.bz2', '', '', {'name': 'tarball'}] comparing ['p4', '.*', '/.*', '', '', {}] to ['http', 'downloads.yoctoproject.org', '/mirror/sources/', '', '', {}]
| DEBUG: For url ['http', 'www.busybox.net', '/downloads/busybox-1.19.4.tar.bz2', '', '', {'name': 'tarball'}] comparing ['svk', '.*', '/.*', '', '', {}] to ['http', 'downloads.yoctoproject.org', '/mirror/sources/', '', '', {}]
| DEBUG: For url ['http', 'www.busybox.net', '/downloads/busybox-1.19.4.tar.bz2', '', '', {'name': 'tarball'}] comparing ['svn', '.*', '/.*', '', '', {}] to ['http', 'downloads.yoctoproject.org', '/mirror/sources/', '', '', {}]
| DEBUG: Trying Upstream
| NOTE: fetch http://www.busybox.net/downloads/busybox-1.19.4.tar.bz2
| DEBUG: executing /usr/bin/env wget -t 5 -nv --passive-ftp --no-check-certificate -P /home/local/poky_test/downloads 'http://www.busybox.net/downloads/busybox-1.19.4.tar.bz2'
| DEBUG: Fetcher accessed the network with the command /usr/bin/env wget -t 5 -nv --passive-ftp --no-check-certificate -P /home/local/poky_test/downloads 'http://www.busybox.net/downloads/busybox-1.19.4.tar.bz2'
| DEBUG: Running export HOME="/home/gthomas"; export GIT_CONFIG="/home/local/poky_test/tmp/sysroots/i686-linux/etc/gitconfig"; export PATH="/home/local/poky_test/tmp/sysroots/i686-linux/usr/bin/armv7a-vfp-neon-poky-linux-gnueabi:/home/local/poky_test/tmp/sysroots/beagleboard/usr/bin/crossscripts:/home/local/poky_test/tmp/sysroots/i686-linux/usr/sbin:/home/local/poky_test/tmp/sysroots/i686-linux/usr/bin:/home/local/poky_test/tmp/sysroots/i686-linux/sbin:/home/local/poky_test/tmp/sysroots/i686-linux//bin:/home/local/poky-master/scripts:/home/local/poky-master/bitbake/bin/:/opt/amltd/bin:/usr/java/jdk1.6.0_10/bin:/home/gthomas/Android/android-sdk-linux_x86-1.1_r1/tools:/home/gthomas/bin:/usr/lib/qt-3.3/bin:/usr/kerberos/sbin:/usr/kerberos/bin:/usr/lib/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/local/poky-master/scripts"; /usr/bin/env wget -t 5 -nv --passive-ftp --no-check-certificate -P /home/local/poky_test/downloads 'http://www.busybox.net/downloads/busybox-1.19.4.tar.bz2'
| WARNING: Failed to fetch URL http://www.busybox.net/downloads/busybox-1.19.4.tar.bz2;name=tarball
| DEBUG: Fetcher failure for URL: 'http://www.busybox.net/downloads/busybox-1.19.4.tar.bz2;name=tarball'. Checksum mismatch!
| File: '/home/local/poky_test/downloads/busybox-1.19.4.tar.bz2' has md5 checksum 9c0cae5a0379228e7b55e5b29528df8e when 9c0cae5a0379228e7b55e5b29528df8f was expected
| File: '/home/local/poky_test/downloads/busybox-1.19.4.tar.bz2' has sha256 checksum 9b853406da61ffb59eb488495fe99cbb7fb3dd29a31307fcfa9cf070543710ee when 9b853406da61ffb59eb488495fe99cbb7fb3dd29a31307fcfa9cf070543710ef was expected
| DEBUG: Trying MIRRORS
| DEBUG: For url ['http', 'www.busybox.net', '/downloads/busybox-1.19.4.tar.bz2', '', '', {'name': 'tarball'}] comparing ['ftp', '.*', '/.*', '', '', {}] to ['http', 'downloads.yoctoproject.org', '/mirror/sources/', '', '', {}]
| DEBUG: For url ['http', 'www.busybox.net', '/downloads/busybox-1.19.4.tar.bz2', '', '', {'name': 'tarball'}] comparing ['http', '.*', '/.*', '', '', {}] to ['http', 'downloads.yoctoproject.org', '/mirror/sources/', '', '', {}]
| DEBUG: For url http://www.busybox.net/downloads/busybox-1.19.4.tar.bz2;name=tarball returning http://downloads.yoctoproject.org/mirror/sources/busybox-1.19.4.tar.bz2;name=tarball
| NOTE: fetch http://downloads.yoctoproject.org/mirror/sources/busybox-1.19.4.tar.bz2
| DEBUG: executing /usr/bin/env wget -t 5 -nv --passive-ftp --no-check-certificate -P /home/local/poky_test/downloads 'http://downloads.yoctoproject.org/mirror/sources/busybox-1.19.4.tar.bz2'
| DEBUG: Fetcher accessed the network with the command /usr/bin/env wget -t 5 -nv --passive-ftp --no-check-certificate -P /home/local/poky_test/downloads 'http://downloads.yoctoproject.org/mirror/sources/busybox-1.19.4.tar.bz2'
| DEBUG: Running export HOME="/home/gthomas"; export GIT_CONFIG="/home/local/poky_test/tmp/sysroots/i686-linux/etc/gitconfig"; export PATH="/home/local/poky_test/tmp/sysroots/i686-linux/usr/bin/armv7a-vfp-neon-poky-linux-gnueabi:/home/local/poky_test/tmp/sysroots/beagleboard/usr/bin/crossscripts:/home/local/poky_test/tmp/sysroots/i686-linux/usr/sbin:/home/local/poky_test/tmp/sysroots/i686-linux/usr/bin:/home/local/poky_test/tmp/sysroots/i686-linux/sbin:/home/local/poky_test/tmp/sysroots/i686-linux//bin:/home/local/poky-master/scripts:/home/local/poky-master/bitbake/bin/:/opt/amltd/bin:/usr/java/jdk1.6.0_10/bin:/home/gthomas/Android/android-sdk-linux_x86-1.1_r1/tools:/home/gthomas/bin:/usr/lib/qt-3.3/bin:/usr/kerberos/sbin:/usr/kerberos/bin:/usr/lib/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/local/poky-master/scripts"; /usr/bin/env wget -t 5 -nv --passive-ftp --no-check-certificate -P /home/local/poky_test/downloads 'http://downloads.yoctoproject.org/mirror/sources/busybox-1.19.4.tar.bz2'
| ERROR: Function failed: Fetcher failure for URL: 'http://www.busybox.net/downloads/busybox-1.19.4.tar.bz2;name=tarball'. Checksum mismatch!
| File: '/home/local/poky_test/downloads/busybox-1.19.4.tar.bz2' has md5 checksum 9c0cae5a0379228e7b55e5b29528df8e when 9c0cae5a0379228e7b55e5b29528df8f was expected
| File: '/home/local/poky_test/downloads/busybox-1.19.4.tar.bz2' has sha256 checksum 9b853406da61ffb59eb488495fe99cbb7fb3dd29a31307fcfa9cf070543710ee when 9b853406da61ffb59eb488495fe99cbb7fb3dd29a31307fcfa9cf070543710ef was expected
NOTE: package busybox-1.19.4-r0: task do_fetch: Failed
ERROR: Task 2 (/home/local/poky-master/meta/recipes-core/busybox/busybox_1.19.4.bb, do_fetch) failed with exit code '1'
NOTE: Tasks Summary: Attempted 8 tasks of which 7 didn't need to be rerun and 1 failed.

Summary: 1 task failed:
  /home/local/poky-master/meta/recipes-core/busybox/busybox_1.19.4.bb, do_fetch
Summary: There was 1 WARNING message shown.
Summary: There was 1 ERROR message shown, returning a non-zero exit code.


[gthomas at titan poky_test]$ bitbake busybox -c patch
Loading cache: 100% |####################################################################################| ETA:  00:00:00
Loaded 1108 entries from dependency cache.

OE Build Configuration:
BB_VERSION        = "1.15.1"
TARGET_ARCH       = "arm"
TARGET_OS         = "linux-gnueabi"
MACHINE           = "beagleboard"
DISTRO            = "poky"
DISTRO_VERSION    = "1.1+snapshot-20120410"
TUNE_FEATURES     = "armv7a vfp neon cortexa8"
TARGET_FPU        = "vfp-neon"
meta              
meta-yocto        = "(nobranch):3d69d9462d550ce4e00e14768cc616bc9ad7e8a5"

NOTE: Resolving any missing task queue dependencies
NOTE: Preparing runqueue
NOTE: Executing SetScene Tasks
NOTE: Executing RunQueue Tasks
NOTE: Running task 8 of 10 (ID: 2, /home/local/poky-master/meta/recipes-core/busybox/busybox_1.19.4.bb, do_fetch)
NOTE: package busybox-1.19.4-r0: task do_fetch: Started
WARNING: Failed to fetch URL http://www.busybox.net/downloads/busybox-1.19.4.tar.bz2;name=tarball
NOTE: package busybox-1.19.4-r0: task do_fetch: Succeeded
NOTE: Running task 9 of 10 (ID: 0, /home/local/poky-master/meta/recipes-core/busybox/busybox_1.19.4.bb, do_unpack)
NOTE: package busybox-1.19.4-r0: task do_unpack: Started
NOTE: package busybox-1.19.4-r0: task do_unpack: Succeeded
NOTE: Running task 10 of 10 (ID: 1, /home/local/poky-master/meta/recipes-core/busybox/busybox_1.19.4.bb, do_patch)
NOTE: package busybox-1.19.4-r0: task do_patch: Started
NOTE: package busybox-1.19.4-r0: task do_patch: Succeeded
NOTE: Tasks Summary: Attempted 10 tasks of which 7 didn't need to be rerun and all succeeded.

Summary: There was 1 WARNING message shown.



More information about the poky mailing list