[Toaster] [review-request][PATCH] toaster: Fix import of custom layers from toasterjson.conf
sujith h
sujith.h at gmail.com
Wed Sep 2 01:56:06 PDT 2015
Hi Brian,
Was there an instance of bitbake running in your build folder before you
triggered the build from toaster?
Thanks,
Sujith H
On Wed, Sep 2, 2015 at 2:12 PM, sujith h <sujith.h at gmail.com> wrote:
>
>
> On Tue, Sep 1, 2015 at 10:39 PM, Brian Avery <avery.brian at gmail.com>
> wrote:
>
>> Hi,
>>
>> I'm on the correct patch afaik. I put the toasterconf.json into the
>> directory above poky and loaded it with:
>> poky/bitbake/lib/toaster/manage.py loadconf
>> /home/bavery/src/intel/myBugs2/sujith/toasterconf.json
>>
>
> This is not my latest patch which I worked on :) It was with subject: [PATCH]
> toaster: Import external layers outside poky from toasterconf.json
>
>
>> I also used option 0 so that toaster did not attempt to load the
>> layers from openembedded.
>>
>> My branch for this test is:
>>
>> http://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/?h=bavery%2Fsubmit%2Fsujith%2F20150827_custom_layer_import
>>
>> I ran a build of core-image-sato with qtbase and iw set in
>> IMAGE_INSTALL_append for the project.
>>
>> The results:
>> The good-
>> I got a core-image-sato as well as the qt5 and iw packages; so the build
>> worked.
>>
>> The not so good -
>> 1) My build progress bar did not update.
>> 2) my recipe list after the build looks like:
>>
>> https://www.dropbox.com/s/qs7hulsbmcgg4ik/Screenshot%202015-09-01%2010.02.29.png?dl=0
>> 3) in the build directory I set when starting up toaster (where the
>> tmp/deploy ends up among other things) the toaster_ui.log file was
>> filled with errors (it ended up being 17G by the end of the build).
>> I'm attaching the first 120 lines of it so you can see what it looked
>> like.
>>
>> I would like to share my poky and cloned_layers directory and the ui log
> file attached:
>
> ------------
> sujith at kdekidd0:~/MEL/test_poky$ pwd
> /home/sujith/MEL/test_poky
> sujith at kdekidd0:~/MEL/test_poky$ ls -lt
> total 16488
> -rw-r--r-- 1 sujith sujith 16855040 Sep 2 13:46 toaster.sqlite
> drwxrwxr-x 3 sujith sujith 4096 Sep 2 13:45 toaster_build_artifacts
> drwxr-xr-x 8 sujith sujith 4096 Sep 2 13:43 build
> drwxrwxr-x 11 sujith sujith 4096 Sep 2 10:01 poky
> -rw-rw-r-- 1 sujith sujith 4632 Aug 28 12:21 toasterconf.json
> drwxrwxr-x 6 sujith sujith 4096 Aug 28 11:53 venv
> sujith at kdekidd0:~/MEL/test_poky$ ls ../cloned_layers/ -l
> total 8
> drwxrwxr-x 19 sujith sujith 4096 Aug 28 11:51 meta-oe
> drwxrwxr-x 8 sujith sujith 4096 Aug 28 12:10 meta-qt5
> sujith at kdekidd0:~/MEL/test_poky$
> ------------
>
> Now the step done to load configuration:
>
> ------------
> sujith at kdekidd0:~/MEL/test_poky$ source venv/bin/activate
> (venv)sujith at kdekidd0:~/MEL/test_poky$ ./poky/bitbake/bin/toaster
> Syncing...
> Creating tables ...
> Creating table auth_permission
> Creating table auth_group_permissions
> Creating table auth_group
> Creating table auth_user_groups
> Creating table auth_user_user_permissions
> Creating table auth_user
> Creating table django_content_type
> Creating table django_session
> Creating table django_admin_log
> Creating table south_migrationhistory
>
> You just installed Django's auth system, which means you don't have any
> superusers defined.
> Would you like to create one now? (yes/no): yes
> Username (leave blank to use 'sujith'):
> Email address:
> Password:
> Password (again):
> Superuser created successfully.
> Installing custom SQL ...
> Installing indexes ...
> Installed 0 object(s) from 0 fixture(s)
>
> Synced:
> > django.contrib.auth
> > django.contrib.contenttypes
> > django.contrib.messages
> > django.contrib.sessions
> > django.contrib.admin
> > django.contrib.staticfiles
> > django.contrib.humanize
> > south
>
> Not synced (use migrations):
> - bldcontrol
> - orm
> (use ./manage.py migrate to migrate these)
> Running migrations for orm:
> - Migrating forwards to 0024_auto__add_field_recipe_is_image.
> > orm:0001_initial
> > orm:0002_auto__add_field_build_timespent
> > orm:0003_timespent
> - Migration 'orm:0003_timespent' is marked for no-dry-run.
> > orm:0004_auto__add_field_package_installed_name
> >
> orm:0005_auto__add_target_image_file__add_target_file__add_field_variablehistor
> >
> orm:0006_auto__add_field_target_image_size__add_field_target_license_manifest_p
> > orm:0007_auto__add_helptext
> >
> orm:0008_auto__chg_field_variablehistory_operation__chg_field_recipe_descriptio
> >
> orm:0009_auto__add_projectvariable__add_projectlayer__add_projecttarget__add_pr
> >
> orm:0010_auto__add_field_project_branch__add_field_project_short_description__a
> > orm:0011_auto__add_field_projectlayer_dirpath
> >
> orm:0012_auto__add_field_projectlayer_optional__add_field_projecttarget_task
> >
> orm:0013_auto__add_release__add_layerversiondependency__add_unique_layerversion
> >
> orm:0014_auto__chg_field_package_summary__chg_field_layer_summary__chg_field_re
> >
> orm:0015_auto__add_field_layer_vcs_web_url__add_field_layer_vcs_web_tree_base_u
> >
> orm:0016_auto__add_field_release_helptext__chg_field_release_branch__add_index_
> >
> orm:0017_auto__del_toastersettingdefaultlayer__add_releaselayersourcepriority__
> > orm:0018_auto__add_field_layer_version_project
> > orm:0019_auto__add_buildartifact
> >
> orm:0020_auto__add_field_layer_version_local_path__add_field_recipe_pathflags__
> >
> orm:0021_auto__chg_field_build_project__chg_field_project_bitbake_version__chg_
> >
> orm:0022_auto__add_field_target_task__add_field_layer_version_local_path__del_f
> >
> orm:0023_auto__del_field_build_warnings_no__del_field_build_errors_no__del_fiel
> > orm:0024_auto__add_field_recipe_is_image
> - Loading initial data for orm.
> Installed 0 object(s) from 0 fixture(s)
> Running migrations for bldcontrol:
> - Migrating forwards to 0008_brarchive.
> > bldcontrol:0001_initial
> >
> bldcontrol:0002_auto__add_field_buildenvironment_sourcedir__add_field_buildenvironment
> > bldcontrol:0003_auto__add_field_brlayer_dirpath
> > bldcontrol:0004_loadinitialdata
> - Migration 'bldcontrol:0004_loadinitialdata' is marked for no-dry-run.
> > bldcontrol:0005_auto__add_brerror
> > bldcontrol:0006_auto__add_brbitbake
> >
> bldcontrol:0007_auto__add_field_buildrequest_environment__chg_field_buildrequest_build
> > bldcontrol:0008_brarchive
> - Migration 'bldcontrol:0008_brarchive' is marked for no-dry-run.
> - Loading initial data for bldcontrol.
> Installed 0 object(s) from 0 fixture(s)
> Toaster needs to know in which directory it can download build log files
> and other artifacts.
> Toaster suggests "/home/sujith/MEL/test_poky/toaster_build_artifacts/".
> Press Enter to select
> "/home/sujith/MEL/test_poky/toaster_build_artifacts/" or type the full path
> to a different directory:
> Verifying the Build Environment. If the local Build Environment is not
> properly configured, you will be asked to configure it.
>
> -- Validation: The checkout directory must be set.
> Toaster needs to know in which directory it should check out the layers
> that will be needed for your builds.
> Toaster suggests "/home/sujith". If you select this directory, a layer
> like "meta-intel" will end up in "/home/sujith/meta-intel".
> Press Enter to select "/home/sujith" or type the full path to a different
> directory (must be a parent of current checkout directory):
> Verifying the Build Environment. If the local Build Environment is not
> properly configured, you will be asked to configure it.
>
> -- Validation: The build directory must be set.
> Toaster needs to know where is your build directory.
> The build directory is where all the artifacts created by your builds
> will be stored. Type the full path to the directory (for example: "
> /home/sujith/build")/home/sujith/MEL/test_poky/build
> Build configuration saved
> Verifying the Build Environment. If the local Build Environment is not
> properly configured, you will be asked to configure it.
>
> Toaster can use a SINGLE predefined configuration file to set up default
> project settings and layer information sources.
>
> Toaster will list now the configuration files that it found. Select the
> number to use the desired configuration file.
> [1] - /home/sujith/MEL/toaster_work/poky/meta-yocto/conf/toasterconf.json
> [2] - /home/sujith/MEL/cedar/poky/meta-yocto/conf/toasterconf.json
> [3] -
> /home/sujith/MEL/toaster_MEL_final/poky/meta-yocto/conf/toasterconf.json
> [4] - /home/sujith/MEL/test_poky/poky/meta-yocto/conf/toasterconf.json
> [5] -
> /home/sujith/MEL/upstream_poky_work/poky-contrib/meta-yocto/conf/toasterconf.json
> [6] - /home/sujith/gitroot/poky/meta-yocto/conf/toasterconf.json
>
> [0] - Exit without importing any file
>
> Enter your option: 0
> Starting webserver...
> Webserver address: http://0.0.0.0:8000/
> Starting browser...
> Toaster is now running. You can stop it with Ctrl-C
> ^Z
> [1]+ Stopped ./poky/bitbake/bin/toaster
> (venv)sujith at kdekidd0:~/MEL/test_poky$
> ./poky/bitbake/lib/toaster/manage.py loadconf toasterconf.json
> (venv)sujith at kdekidd0:~/MEL/test_poky$ fg
> ./poky/bitbake/bin/toaster
> 2015-09-02 10:11:54,415 DEBUG localhostbecontroller, our git repos are
> {(u'', u'HEAD'): [('bitbake', u'bitbake')],
> (u'git://git.yoctoproject.org/poky', u'HEAD'): [(u'openembedded-core',
> u'meta'),
> (u'meta-yocto',
> u'meta-yocto'),
> (u'meta-yocto-bsp',
> u'meta-yocto-bsp')],
> (u'git://github.com/meta-qt5/meta-qt5.git', u'HEAD'): [(u'meta-qt5',
> u'meta-qt5')],
> (u'git://github.com/openembedded/meta-oe.git', u'HEAD'):
> [(u'meta-python',
>
> u'meta-python'),
>
> (u'meta-multimedia',
>
> u'meta-multimedia'),
>
> (u'meta-filesystems',
>
> u'meta-filesystems'),
>
> (u'meta-networking',
>
> u'meta-networking'),
> (u'meta-oe',
> u'meta-oe')]}
> 2015-09-02 10:11:54,416 DEBUG lbc_shellcmmd: (/home/sujith/Documents) git
> remote -v
> 2015-09-02 10:11:54,419 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,419 DEBUG lbc_shellcmmd: (/home/sujith/.thumbnails)
> git remote -v
> 2015-09-02 10:11:54,422 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,422 DEBUG lbc_shellcmmd: (/home/sujith/.emacs.d) git
> remote -v
> 2015-09-02 10:11:54,425 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,425 DEBUG lbc_shellcmmd: (/home/sujith/Templates) git
> remote -v
> 2015-09-02 10:11:54,429 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,429 DEBUG lbc_shellcmmd: (/home/sujith/.pylint.d) git
> remote -v
> 2015-09-02 10:11:54,432 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,432 DEBUG lbc_shellcmmd: (/home/sujith/.cscache) git
> remote -v
> 2015-09-02 10:11:54,439 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,439 DEBUG lbc_shellcmmd: (/home/sujith/.config) git
> remote -v
> 2015-09-02 10:11:54,443 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,443 DEBUG lbc_shellcmmd: (/home/sujith/bin) git remote
> -v
> 2015-09-02 10:11:54,448 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,448 DEBUG lbc_shellcmmd: (/home/sujith/MEL) git remote
> -v
> 2015-09-02 10:11:54,452 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,452 DEBUG lbc_shellcmmd: (/home/sujith/Pictures) git
> remote -v
> 2015-09-02 10:11:54,455 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,455 DEBUG lbc_shellcmmd: (/home/sujith/.pip) git
> remote -v
> 2015-09-02 10:11:54,459 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,459 DEBUG lbc_shellcmmd: (/home/sujith/Music) git
> remote -v
> 2015-09-02 10:11:54,463 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,463 DEBUG lbc_shellcmmd: (/home/sujith/debian) git
> remote -v
> 2015-09-02 10:11:54,466 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,466 DEBUG lbc_shellcmmd: (/home/sujith/.distlib) git
> remote -v
> 2015-09-02 10:11:54,470 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,470 DEBUG lbc_shellcmmd: (/home/sujith/.mozilla) git
> remote -v
> 2015-09-02 10:11:54,473 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,474 DEBUG lbc_shellcmmd: (/home/sujith/Django_study)
> git remote -v
> 2015-09-02 10:11:54,478 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,478 DEBUG lbc_shellcmmd: (/home/sujith/.java) git
> remote -v
> 2015-09-02 10:11:54,481 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,482 DEBUG lbc_shellcmmd:
> (/home/sujith/patches_to_push) git remote -v
> 2015-09-02 10:11:54,485 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,485 DEBUG lbc_shellcmmd: (/home/sujith/.ssh) git
> remote -v
> 2015-09-02 10:11:54,488 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,488 DEBUG lbc_shellcmmd: (/home/sujith/Downloads) git
> remote -v
> 2015-09-02 10:11:54,492 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,492 DEBUG lbc_shellcmmd: (/home/sujith/.pki) git
> remote -v
> 2015-09-02 10:11:54,495 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,496 DEBUG lbc_shellcmmd: (/home/sujith/Public) git
> remote -v
> 2015-09-02 10:11:54,499 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,499 DEBUG lbc_shellcmmd: (/home/sujith/.repoconfig)
> git remote -v
> 2015-09-02 10:11:54,502 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,502 DEBUG lbc_shellcmmd: (/home/sujith/.pc) git remote
> -v
> 2015-09-02 10:11:54,505 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,505 DEBUG lbc_shellcmmd: (/home/sujith/wsgiref) git
> remote -v
> 2015-09-02 10:11:54,510 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,510 DEBUG lbc_shellcmmd: (/home/sujith/.mentor) git
> remote -v
> 2015-09-02 10:11:54,513 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,515 DEBUG lbc_shellcmmd:
> (/home/sujith/MENTOR_TOOLCHAIN) git remote -v
> 2015-09-02 10:11:54,517 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,518 DEBUG lbc_shellcmmd: (/home/sujith/Desktop) git
> remote -v
> 2015-09-02 10:11:54,521 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,521 DEBUG lbc_shellcmmd: (/home/sujith/.local) git
> remote -v
> 2015-09-02 10:11:54,525 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,525 DEBUG lbc_shellcmmd: (/home/sujith/.dbus) git
> remote -v
> 2015-09-02 10:11:54,529 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,529 DEBUG lbc_shellcmmd: (/home/sujith/workspace) git
> remote -v
> 2015-09-02 10:11:54,532 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,533 DEBUG lbc_shellcmmd:
> (/home/sujith/.gstreamer-0.10) git remote -v
> 2015-09-02 10:11:54,536 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,536 DEBUG lbc_shellcmmd: (/home/sujith/.gnome) git
> remote -v
> 2015-09-02 10:11:54,540 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,540 DEBUG lbc_shellcmmd: (/home/sujith/.cache) git
> remote -v
> 2015-09-02 10:11:54,544 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,544 DEBUG lbc_shellcmmd:
> (/home/sujith/codebench-linux-install-2014.11-96-arm) git remote -v
> 2015-09-02 10:11:54,547 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,547 DEBUG lbc_shellcmmd: (/home/sujith/Videos) git
> remote -v
> 2015-09-02 10:11:54,550 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,550 DEBUG lbc_shellcmmd: (/home/sujith/.gconf) git
> remote -v
> 2015-09-02 10:11:54,554 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,555 DEBUG lbc_shellcmmd: (/home/sujith/.subversion)
> git remote -v
> 2015-09-02 10:11:54,558 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,558 DEBUG lbc_shellcmmd: (/home/sujith/.thunderbird)
> git remote -v
> 2015-09-02 10:11:54,561 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,561 DEBUG lbc_shellcmmd: (/home/sujith/gitroot) git
> remote -v
> 2015-09-02 10:11:54,564 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,564 DEBUG lbc_shellcmmd: (/home/sujith/.oe) git remote
> -v
> 2015-09-02 10:11:54,568 WARNING localhostbecontroller: shellcmd error
> command: git remote -v
> fatal: Not a git repository (or any of the parent directories): .git
>
> 2015-09-02 10:11:54,570 DEBUG localhostbecontroller: current layer list
> [u'/home/sujith/MEL/test_poky/poky/meta',
> u'/home/sujith/MEL/test_poky/poky/meta-yocto',
> u'/home/sujith/MEL/test_poky/poky/meta-yocto-bsp',
> u'/home/sujith/MEL/cloned_layers/meta-oe/meta-python',
> u'/home/sujith/MEL/cloned_layers/meta-oe/meta-multimedia',
> u'/home/sujith/MEL/cloned_layers/meta-oe/meta-filesystems',
> u'/home/sujith/MEL/cloned_layers/meta-oe/meta-networking',
> u'/home/sujith/MEL/cloned_layers/meta-oe/meta-oe',
> u'/home/sujith/MEL/cloned_layers/meta-qt5']
> 2015-09-02 10:11:54,571 DEBUG lbc_shellcmmd: (/home/sujith) bash -c
> "source /home/sujith/MEL/test_poky/poky/oe-init-build-env
> /home/sujith/MEL/test_poky/build"
> 2015-09-02 10:11:54,684 DEBUG localhostbecontroller: shellcmd success
> 2015-09-02 10:11:54,691 DEBUG localhostbecontroller: running the listener
> at /home/sujith/MEL/test_poky/poky/bitbake/bin/bitbake
> 2015-09-02 10:11:54,691 DEBUG localhostbecontroller: starting builder
> bash -c "source /home/sujith/MEL/test_poky/poky/oe-init-build-env
> /home/sujith/MEL/test_poky/build 2>&1 >toaster_server.log && bitbake --read
> /home/sujith/MEL/test_poky/build/conf/toaster-pre.conf --postread
> /home/sujith/MEL/test_poky/build/conf/toaster.conf --server-only -t xmlrpc
> -B 0.0.0.0:0 2>&1 >>toaster_server.log "
>
> 2015-09-02 10:11:54,691 DEBUG lbc_shellcmmd: (/home/sujith) bash -c
> "source /home/sujith/MEL/test_poky/poky/oe-init-build-env
> /home/sujith/MEL/test_poky/build 2>&1 >toaster_server.log && bitbake --read
> /home/sujith/MEL/test_poky/build/conf/toaster-pre.conf --postread
> /home/sujith/MEL/test_poky/build/conf/toaster.conf --server-only -t xmlrpc
> -B 0.0.0.0:0 2>&1 >>toaster_server.log "
> 2015-09-02 10:11:56,198 DEBUG localhostbecontroller: shellcmd success
> 2015-09-02 10:11:56,199 DEBUG localhostbecontroller: Found bitbake server
> port 33000
>
> 2015-09-02 10:11:56,200 DEBUG localhostbecontroller: Waiting bitbake
> server to start
> 2015-09-02 10:11:56,701 DEBUG localhostbecontroller: Waiting bitbake
> server to start
> 2015-09-02 10:11:57,202 DEBUG localhostbecontroller: Waiting bitbake
> server to start
> 2015-09-02 10:11:57,704 DEBUG localhostbecontroller: Waiting bitbake
> server to start
> 2015-09-02 10:11:58,205 DEBUG localhostbecontroller: Started bitbake server
> 2015-09-02 10:11:58,236 DEBUG localhostbecontroller: Build launched,
> exiting. Follow build logs at
> /home/sujith/MEL/test_poky/build/toaster_ui.log
> ------------
>
> The path to tmp/deploy/image and the content inside the directory:
>
> ------------
> sujith at kdekidd0:~/MEL/test_poky/build$ ls tmp/deploy/images/qemux86/ -lt
> total 1244112
> lrwxrwxrwx 1 sujith sujith 53 Sep 2 13:43
> core-image-sato-qemux86.tar.bz2 ->
> core-image-sato-qemux86-20150902044346.rootfs.tar.bz2
> lrwxrwxrwx 1 sujith sujith 50 Sep 2 13:43
> core-image-sato-qemux86.ext3 ->
> core-image-sato-qemux86-20150902044346.rootfs.ext3
> lrwxrwxrwx 1 sujith sujith 50 Sep 2 13:43
> core-image-sato-qemux86.ext4 ->
> core-image-sato-qemux86-20150902044346.rootfs.ext4
> lrwxrwxrwx 1 sujith sujith 54 Sep 2 13:43
> core-image-sato-qemux86.manifest ->
> core-image-sato-qemux86-20150902044346.rootfs.manifest
> lrwxrwxrwx 1 sujith sujith 51 Sep 2 13:43
> core-image-sato-qemux86.jffs2 ->
> core-image-sato-qemux86-20150902044346.rootfs.jffs2
> -rw-r--r-- 1 sujith sujith 196083712 Sep 2 13:43
> core-image-sato-qemux86-20150902044346.rootfs.jffs2
> -rw-r--r-- 1 sujith sujith 535930880 Sep 2 13:42
> core-image-sato-qemux86-20150902044346.rootfs.ext4
> -rw-r--r-- 1 sujith sujith 535930880 Sep 2 13:42
> core-image-sato-qemux86-20150902044346.rootfs.ext3
> -rw-r--r-- 1 sujith sujith 154285168 Sep 2 13:42
> core-image-sato-qemux86-20150902044346.rootfs.tar.bz2
> -rw-r--r-- 1 sujith sujith 21112 Sep 2 13:41
> core-image-sato-qemux86-20150902044346.rootfs.manifest
> -rw-r--r-- 2 sujith sujith 294 Sep 2 13:40
> README_-_DO_NOT_DELETE_FILES_IN_THIS_DIRECTORY.txt
> lrwxrwxrwx 1 sujith sujith 71 Sep 2 12:53 bzImage ->
> bzImage--4.1.6+git0+429f9e2ff0_59b8c4f5e8-r0-qemux86-20150902044346.bin
> lrwxrwxrwx 1 sujith sujith 71 Sep 2 12:53 bzImage-qemux86.bin ->
> bzImage--4.1.6+git0+429f9e2ff0_59b8c4f5e8-r0-qemux86-20150902044346.bin
> lrwxrwxrwx 1 sujith sujith 71 Sep 2 12:53 modules-qemux86.tgz ->
> modules--4.1.6+git0+429f9e2ff0_59b8c4f5e8-r0-qemux86-20150902044346.tgz
> -rw-rw-r-- 2 sujith sujith 83308568 Sep 2 12:53
> modules--4.1.6+git0+429f9e2ff0_59b8c4f5e8-r0-qemux86-20150902044346.tgz
> -rw-r--r-- 2 sujith sujith 6957488 Sep 2 12:53
> bzImage--4.1.6+git0+429f9e2ff0_59b8c4f5e8-r0-qemux86-20150902044346.bin
> sujith at kdekidd0:~/MEL/test_poky/build$
> ------------
>
> The screenshot of image built successfully: http://i.imgur.com/V3qtXFh.png
>
>> ---
>> So, you may want to look at/try my poky-contrib branch and look
>> closely at my toasterconf.json file to see if you can tell why you do
>> not see these issues.
>>
>
> The toaster-pre.conf of mine looks as:
> sujith at kdekidd0:~/MEL/test_poky/build/conf$ cat toaster-pre.conf
> IMAGE_INSTALL_append=" qtbase iw"
> PACKAGE_CLASSES="package_ipk"
> MACHINE="qemux86"
> SDKMACHINE="x86_64"
> DISTRO="poky"
> IMAGE_FSTYPES="ext3 jffs2 tar.bz2"
> TOASTER_BRBE="1:1"
> sujith at kdekidd0:~/MEL/test_poky/build/conf$
>
> Somehow I am not able to figure out what is going on wrong at your end :(
>
>>
>> -brian
>>
>> On Sun, Aug 30, 2015 at 11:47 PM, sujith h <sujith.h at gmail.com> wrote:
>> > Hi Brian,
>> >
>> > On Sat, Aug 29, 2015 at 1:13 AM, Brian Avery <avery.brian at gmail.com>
>> wrote:
>> >>
>> >> Hi Sujith,
>> >>
>> >> The new toasterconf does make it easier to test, thanks! I've
>> >> attached mine so you can see what I did in case that caused any of the
>> >> issues below.
>> >> I changed:
>> >> 1) directory paths
>> >> 2) you had "branches": ["mel", "yocto", "HEAD"], which i
>> >> changed to "branches": ["HEAD", "master", "fido",
>> >> "dizzy"],
>> >>
>> >>
>> >>
>> >> So here is my directory layout
>> >>
>> >> /big/src/intel/myBugs2
>> >> cloned_layers/
>> >> meta-oe/
>> >> meta-qt5/
>> >> sujith/
>> >> poky
>> >
>> >
>> > Here is my directory layout:
>> > /home/sujith/MEL/test_poky
>> > poky
>> > /home/sujith/MEL/cloned_layers
>> > meta-oe
>> > meta-qt5
>> >
>> >>
>> >>
>> >> I put the attached toasterconf.json into the sujith/meta-yocto/conf/
>> >> directory (overwriting the default one) and toaster found it on
>> >> startup.
>> >
>> >
>> > I have added my configuration into:
>> > /home/sujith/MEL/test_poky/toasterconf.json
>> >
>> > I never tried over writing toasterconf.json file in meta-yocto/conf
>> >
>> > I use option [0] while running poky/bitbake/bin/toaster i.e, exit
>> without
>> > importing any layers. Then I manually try to import it using command:
>> > poky/bitbake/lib/toaster/manage.py loadconf toasterconf.json
>> >
>> >> Question:
>> >> Where are you putting your toasterconf.json file? I haven't gone
>> >> through the search logic yet but toaster seemed to have trouble
>> >> finding it in other directories.
>> >>
>> >> My directory settings for starting toaster are:
>> >> build log -> /home/bavery/toaster_build_artifacts
>> >> layer checkout -> /big/src/intel/myBugs2/sujith/
>> >> build -> /home/bavery/toaster_build_artifacts
>> >>
>> >>
>> >> I found the following issues:
>> >> 1)On startup toaster complained about not being able to load from
>> >> openembedded.layers.org and once toaster was up, there were no layers
>> >> available except the local ones.
>> >>
>> >> (
>> https://www.dropbox.com/s/jdkayha71l8i9fe/Screenshot%202015-08-28%2012.29.06.png?dl=0
>> )
>> >> 2) I started a build of core-image-sato with MAGE_INSTALL_append =
>> >> "qt5 iws"
>> >> (
>> https://www.dropbox.com/s/m3l6uyxq6ptr5vv/Screenshot%202015-08-28%2012.32.16.png?dl=0
>> )
>> >> and the build no longer shows progress on the progress bar. top
>> >> running shows that I am well into the build but that is not reflected
>> >> in the UI
>> >> (
>> https://www.dropbox.com/s/x3cl2whp2twt8xm/Screenshot%202015-08-28%2012.32.44.png?dl=0
>> )
>> >> 3) the toaster_ui.log in the build directory is huge and is filled
>> >> with things like :Cannot determine the vcs_reference for layer version
>> >> {'build_id': 1, '_layer_cache': <Layer: __FIXME__unidentified_layer /
>> >> None >, 'layer_id': 204, '_state': <django.db.models.base.ModelSt...."
>> >>
>> >>
>> >>
>> >> Do you see any of these?
>> >
>> >
>> > Since I haven't tried overwriting toasters default configuration file, I
>> > couldn't hit with any of these errors. Would you mind to try with my
>> way, if
>> > you don't mind?
>> > Let me know if you face any issue with the procedure I followed.
>> >
>> >
>> > Thanks,
>> > Sujith H
>> >>
>> >>
>> >> -b
>> >>
>> >> On Fri, Aug 28, 2015 at 12:06 AM, sujith h <sujith.h at gmail.com> wrote:
>> >> >
>> >> >
>> >> > On Thu, Aug 27, 2015 at 9:56 PM, sujith h <sujith.h at gmail.com>
>> wrote:
>> >> >>
>> >> >>
>> >> >>
>> >> >> On Thu, Aug 27, 2015 at 9:36 PM, Brian Avery <avery.brian at gmail.com
>> >
>> >> >> wrote:
>> >> >>>
>> >> >>> Hi Sujith,
>> >> >>>
>> >> >>> I'd like to test this out. Is it possible to get a config file
>> that
>> >> >>> exercises the new features?
>> >> >>
>> >> >>
>> >> >> I have attached the toaster configuration file which I used for
>> >> >> testing.
>> >> >> What you can also do is remove meta-mentor,meta-sourcery and
>> meta-mx6q
>> >> >> layers from the
>> >> >> configuration file. And try with the layers we have. That might help
>> >> >> you
>> >> >> in testing. Also you
>> >> >> may have to remove some additional settings I have used in the
>> >> >> configuration, like Distro as "mel",
>> >> >> toolchain path etc
>> >> >>
>> >> >> Or the simplest testing would be by adding poky and meta-oe layer.
>> Then
>> >> >> try to build
>> >> >> some recipe from meta-oe. That would be the simplest test.
>> >> >>
>> >> >> Let me know if you need more information or face any issues. I would
>> >> >> help
>> >> >> you with that.
>> >> >
>> >> >
>> >> > Hi Brian,
>> >> >
>> >> > I have attached a new configuration file which I am testing right
>> away.
>> >> > The
>> >> > build is in progress.
>> >> > In the IMAGE_INSTALL_append ( from UI ), I have added qtbase and iw
>> >> > packages. The 2 repos I have
>> >> > cloned is:
>> >> > git clone git://github.com/meta-qt5/meta-qt5.git
>> >> > and
>> >> > git clone git://github.com/openembedded/meta-oe.git
>> >> >
>> >> > Accordingly adjust your paths mentioned in the configuration file.
>> >> >
>> >> > I hope this configuration file should help you proceed with your
>> test.
>> >> > Let
>> >> > me know if you face any issues.
>> >> >
>> >> > Thanks,
>> >> > Sujith H
>> >> >>
>> >> >>
>> >> >> Thanks,
>> >> >> Sujith H
>> >> >>>
>> >> >>>
>> >> >>> -b
>> >> >>>
>> >> >>>
>> >> >>> On Mon, Aug 24, 2015 at 7:16 PM, sujith h <sujith.h at gmail.com>
>> wrote:
>> >> >>> > On 24 Aug 2015 6:49 pm, "sujith h" <sujith.h at gmail.com> wrote:
>> >> >>> >>
>> >> >>> >>
>> >> >>> >>
>> >> >>> >> On Fri, Aug 21, 2015 at 8:07 PM, Damian, Alexandru
>> >> >>> >> <alexandru.damian at intel.com> wrote:
>> >> >>> >>>
>> >> >>> >>>
>> >> >>> >>>
>> >> >>> >>> On Fri, Aug 21, 2015 at 1:52 PM, sujith h <sujith.h at gmail.com>
>> >> >>> >>> wrote:
>> >> >>> >>>>
>> >> >>> >>>>
>> >> >>> >>>>
>> >> >>> >>>> On Fri, Aug 21, 2015 at 4:45 PM, Damian, Alexandru
>> >> >>> >>>> <alexandru.damian at intel.com> wrote:
>> >> >>> >>>>>
>> >> >>> >>>>> Hi,
>> >> >>> >>>>>
>> >> >>> >>>>> I think we need a better patch description. If I understand
>> >> >>> >>>>> correctly,
>> >> >>> >>>>> the issue you were facing is:
>> >> >>> >>>>> - even if we have layers at HEAD that are not under the poky/
>> >> >>> >>>>> tree,
>> >> >>> >>>>> the
>> >> >>> >>>>> code would always return the
>> >> >>> >>>>> checkout path in the poky/ tree; I recognize that this is a
>> >> >>> >>>>> valid
>> >> >>> >>>>> issue.
>> >> >>> >>>>>
>> >> >>> >>>>> I feel that this issue can be handled a bit differently if we
>> >> >>> >>>>> frame
>> >> >>> >>>>> it
>> >> >>> >>>>> as such:
>> >> >>> >>>>> - if we have a HEAD branch specified for a layer, we need to
>> >> >>> >>>>> find
>> >> >>> >>>>> out
>> >> >>> >>>>> the current checkout directory for that layer, since no
>> checkout
>> >> >>> >>>>> would be
>> >> >>> >>>>> performed.
>> >> >>> >>>>>
>> >> >>> >>>>> As such, when we import a toasterconf.json file (they only
>> way
>> >> >>> >>>>> to
>> >> >>> >>>>> get
>> >> >>> >>>>> HEAD branches for a layer) we need to store the actual layer
>> >> >>> >>>>> checkout path
>> >> >>> >>>>> in the database (in the localpath, perhaps?), and reuse that
>> >> >>> >>>>> value,
>> >> >>> >>>>> instead
>> >> >>> >>>>> of employing special logic to search for it. What I mean, the
>> >> >>> >>>>> core
>> >> >>> >>>>> of the
>> >> >>> >>>>> problem is solved by replacing the whole gitrepos checkout
>> logic
>> >> >>> >>>>> with a
>> >> >>> >>>>> database value for all "HEAD" layers, and eliminate the
>> magic in
>> >> >>> >>>>> getGitCloneDirectory().
>> >> >>> >>>>>
>> >> >>> >>>>> I have a couple more comments on the patch below.
>> >> >>> >>>>>
>> >> >>> >>>>> Cheers,
>> >> >>> >>>>> Alex
>> >> >>> >>>>>
>> >> >>> >>>>> On Fri, Aug 21, 2015 at 9:41 AM, Sujith H <
>> sujith.h at gmail.com>
>> >> >>> >>>>> wrote:
>> >> >>> >>>>>>
>> >> >>> >>>>>> This patch fixes import of custom layers from
>> toasterjson.conf
>> >> >>> >>>>>> file. For example it was verified using layers like
>> >> >>> >>>>>> meta-mentor,
>> >> >>> >>>>>> meta-fsl-arm, meta-sourcery etc.
>> >> >>> >>>>>>
>> >> >>> >>>>>> Signed-off-by: Sujith Haridasan <
>> Sujith_Haridasan at mentor.com>
>> >> >>> >>>>>> ---
>> >> >>> >>>>>> .../toaster/bldcontrol/localhostbecontroller.py | 49
>> >> >>> >>>>>> ++++++++++++++++++++--
>> >> >>> >>>>>> .../bldcontrol/management/commands/loadconf.py | 12
>> ++++--
>> >> >>> >>>>>> 2 files changed, 54 insertions(+), 7 deletions(-)
>> >> >>> >>>>>>
>> >> >>> >>>>>> diff --git
>> >> >>> >>>>>> a/bitbake/lib/toaster/bldcontrol/localhostbecontroller.py
>> >> >>> >>>>>> b/bitbake/lib/toaster/bldcontrol/localhostbecontroller.py
>> >> >>> >>>>>> index 231a7d3..c43f33f 100644
>> >> >>> >>>>>> ---
>> a/bitbake/lib/toaster/bldcontrol/localhostbecontroller.py
>> >> >>> >>>>>> +++
>> b/bitbake/lib/toaster/bldcontrol/localhostbecontroller.py
>> >> >>> >>>>>> @@ -178,7 +178,7 @@ class
>> >> >>> >>>>>> LocalhostBEController(BuildEnvironmentController):
>> >> >>> >>>>>> self.be.save()
>> >> >>> >>>>>> logger.debug("localhostbecontroller: Stopped
>> bitbake
>> >> >>> >>>>>> server")
>> >> >>> >>>>>>
>> >> >>> >>>>>> - def getGitCloneDirectory(self, url, branch):
>> >> >>> >>>>>> + def
>> >> >>> >>>>>>
>> >> >>> >>>>>> getGitCloneDirectory(self, url, branch, cached_layers=None):
>> >> >>> >>>>>> """ Utility that returns the last component of a
>> git
>> >> >>> >>>>>> path
>> >> >>> >>>>>> as
>> >> >>> >>>>>> directory
>> >> >>> >>>>>> """
>> >> >>> >>>>>> import re
>> >> >>> >>>>>> @@ -191,6 +191,17 @@ class
>> >> >>> >>>>>> LocalhostBEController(BuildEnvironmentController):
>> >> >>> >>>>>>
>> >> >>> >>>>>> # word of attention; this is a localhost-specific
>> >> >>> >>>>>> issue;
>> >> >>> >>>>>> only
>> >> >>> >>>>>> on the localhost we expect to have "HEAD" releases
>> >> >>> >>>>>> # which _ALWAYS_ means the current poky checkout
>> >> >>> >>>>>> + if cached_layers:
>> >> >>> >>>>>
>> >> >>> >>>>>
>> >> >>> >>>>> Using cached_layers here works only by coincidence - if the
>> >> >>> >>>>> desired
>> >> >>> >>>>> layer is not manually checked out under be.sourcedir, it will
>> >> >>> >>>>> not
>> >> >>> >>>>> be found
>> >> >>> >>>>> by cached_layers code, and will not appear here.
>> >> >>> >>>>
>> >> >>> >>>>
>> >> >>> >>>> Ah, so would it be good to read from the database? Because I
>> was
>> >> >>> >>>> giving
>> >> >>> >>>> full path of layers in the toasterconf.json file. I assume
>> that
>> >> >>> >>>> layer
>> >> >>> >>>> information from the toasterconf.json file would be updated in
>> >> >>> >>>> the
>> >> >>> >>>> database?
>> >> >>> >>>
>> >> >>> >>>
>> >> >>> >>> Would be inserted into the database as the file is read.
>> >> >>> >>>
>> >> >>> >>>>>
>> >> >>> >>>>>
>> >> >>> >>>>> I think a completely new piece of code is needed, which will
>> >> >>> >>>>> track
>> >> >>> >>>>> where any layer that has a HEAD branch is actually checked
>> out.
>> >> >>> >>>>> This path
>> >> >>> >>>>> would be discovered and stored by importing a
>> toasterconf.json
>> >> >>> >>>>> file
>> >> >>> >>>>> (the
>> >> >>> >>>>> only place that can generate a HEAD branch), and verified to
>> >> >>> >>>>> actually exist
>> >> >>> >>>>> at build time in this function, getGitCloneDirectory(). This
>> >> >>> >>>>> patch
>> >> >>> >>>>> touches
>> >> >>> >>>>> loadconf, but I think we might be able to get a better
>> handling
>> >> >>> >>>>> of
>> >> >>> >>>>> that.
>> >> >>> >>>>>
>> >> >>> >>>>>
>> >> >>> >>>>>> + if not url.endswith('.git'):
>> >> >>> >>>>>
>> >> >>> >>>>>
>> >> >>> >>>>> I am not sure why the actual GIT url format is relevant for
>> >> >>> >>>>> "HEAD"
>> >> >>> >>>>> branches; we don't need to figure out where the layer would
>> get
>> >> >>> >>>>> checked out,
>> >> >>> >>>>> but where it actually exists.
>> >> >>> >>>>>
>> >> >>> >>>>>
>> >> >>> >>>>>> + from os.path import dirname
>> >> >>> >>>>>> + extractDir = dirname(url)
>> >> >>> >>>>>> + for key, val in cached_layers.iteritems():
>> >> >>> >>>>>> + if val == extractDir:
>> >> >>> >>>>>> + local_checkout_path = key
>> >> >>> >>>>>> + return cached_layers[local_checkout_path]
>> >> >>> >>>>>> + else:
>> >> >>> >>>>>> + local_checkout_path = cached_layers[url]
>> >> >>> >>>>>> + return local_checkout_path
>> >> >>> >>>>>> from os.path import dirname as DN
>> >> >>> >>>>>> local_checkout_path =
>> >> >>> >>>>>> DN(DN(DN(DN(DN(os.path.abspath(__file__))))))
>> >> >>> >>>>>> #logger.debug("localhostbecontroller: using HEAD
>> >> >>> >>>>>> checkout
>> >> >>> >>>>>> in
>> >> >>> >>>>>> %s" % local_checkout_path)
>> >> >>> >>>>>> @@ -245,7 +256,14 @@ class
>> >> >>> >>>>>> LocalhostBEController(BuildEnvironmentController):
>> >> >>> >>>>>>
>> >> >>> >>>>>> # 3. checkout the repositories
>> >> >>> >>>>>> for giturl, commit in gitrepos.keys():
>> >> >>> >>>>>> - localdirname = os.path.join(self.be.sourcedir,
>> >> >>> >>>>>> self.getGitCloneDirectory(giturl, commit))
>> >> >>> >>>>>> + if not giturl.endswith('.git'):
>> >> >>> >>>>>> + for key, val in cached_layers.iteritems():
>> >> >>> >>>>>> + if os.path.dirname(giturl) == val:
>> >> >>> >>>>>> + tmpKey = key
>> >> >>> >>>>>> + tmpVal = gitrepos[(giturl, commit)]
>> >> >>> >>>>>> + gitrepos[(tmpKey, commit)] += tmpVal
>> >> >>> >>>>>> + giturl = tmpKey
>> >> >>> >>>>>> + localdirname = os.path.join(self.be.sourcedir,
>> >> >>> >>>>>> self.getGitCloneDirectory(giturl, commit, cached_layers))
>> >> >>> >>>>>> logger.debug("localhostbecontroller: giturl
>> %s:%s
>> >> >>> >>>>>> checking out in current directory %s" % (giturl, commit,
>> >> >>> >>>>>> localdirname))
>> >> >>> >>>>>>
>> >> >>> >>>>>> # make sure our directory is a git repository
>> >> >>> >>>>>> @@ -280,13 +298,36 @@ class
>> >> >>> >>>>>> LocalhostBEController(BuildEnvironmentController):
>> >> >>> >>>>>>
>> >> >>> >>>>>> # verify our repositories
>> >> >>> >>>>>> for name, dirpath in gitrepos[(giturl,
>> commit)]:
>> >> >>> >>>>>> - localdirpath = os.path.join(localdirname,
>> >> >>> >>>>>> dirpath)
>> >> >>> >>>>>
>> >> >>> >>>>>
>> >> >>> >>>>> I am not sure what this change tries to do; dirpath is
>> actually
>> >> >>> >>>>> a
>> >> >>> >>>>> path
>> >> >>> >>>>> in the git repo where the layer lives; it is not immediate
>> that
>> >> >>> >>>>> the
>> >> >>> >>>>> all the
>> >> >>> >>>>> layers live in the top directory of a git repo. This change
>> >> >>> >>>>> invalidates the
>> >> >>> >>>>> check below, where we verify that the layer path actually
>> exists
>> >> >>> >>>>> after
>> >> >>> >>>>> checkout.
>> >> >>> >>>>>
>> >> >>> >>>>>>
>> >> >>> >>>>>> + localdirpath = localdirname
>> >> >>> >>>>>>
>> >> >>> >>>>>> logger.debug("localhostbecontroller:
>> >> >>> >>>>>> localdirpath
>> >> >>> >>>>>> expected '%s'" % localdirpath)
>> >> >>> >>>>>> if not os.path.exists(localdirpath):
>> >> >>> >>>>>> raise BuildSetupException("Cannot find
>> >> >>> >>>>>> layer
>> >> >>> >>>>>> git
>> >> >>> >>>>>> path '%s' in checked out repository '%s:%s'. Aborting." %
>> >> >>> >>>>>> (localdirpath,
>> >> >>> >>>>>> giturl, commit))
>> >> >>> >>>>>>
>> >> >>> >>>>>> + layerlisturl, layerlistdir = "", ""
>> >> >>> >>>>>> + layerlisturl = [localurl for localurl,
>> >> >>> >>>>>> localpath
>> >> >>> >>>>>> in
>> >> >>> >>>>>> cached_layers.iteritems() if localpath == localdirpath]
>> >> >>> >>>>>
>> >> >>> >>>>>
>> >> >>> >>>>> I suspect this logic will go away if we're not going to use
>> >> >>> >>>>> cached_layers to discover the local checkout directories for
>> >> >>> >>>>> HEAD
>> >> >>> >>>>> urls.
>> >> >>> >>>>>
>> >> >>> >>>>>
>> >> >>> >>>>>>
>> >> >>> >>>>>> + if len(layerlisturl) != 0:
>> >> >>> >>>>>> + layerlisturl = layerlisturl[0]
>> >> >>> >>>>>> + if len(layerlisturl) == 0:
>> >> >>> >>>>>> + if
>> >> >>> >>>>>> os.path.basename(localdirpath).startswith("_"):
>> >> >>> >>>>>> + layerlisturl = localdirpath
>> >> >>> >>>>>> if name != "bitbake":
>> >> >>> >>>>>> -
>> layerlist.append(localdirpath.rstrip("/"))
>> >> >>> >>>>>> + for gitlocal, localpath in
>> >> >>> >>>>>> gitrepos.iteritems():
>> >> >>> >>>>>> + if layerlisturl in gitlocal:
>> >> >>> >>>>>> + if len(localpath) > 2:
>> >> >>> >>>>>> + for paths in localpath:
>> >> >>> >>>>>> + if "bitbake" not in
>> >> >>> >>>>>> paths[1]:
>> >> >>> >>>>>> + layerlistdir =
>> >> >>> >>>>>> localdirpath
>> >> >>> >>>>>> +"/" + str(paths[1])
>> >> >>> >>>>>> + if layerlistdir not in
>> >> >>> >>>>>> layerlist:
>> >> >>> >>>>>> +
>> >> >>> >>>>>> layerlist.append(layerlistdir.rstrip("/"))
>> >> >>> >>>>>> + else:
>> >> >>> >>>>>> +
>> >> >>> >>>>>> layerlist.append(localdirpath.rstrip("/"))
>> >> >>> >>>>>> + break
>> >> >>> >>>>>> + if len(layerlist) == 0:
>> >> >>> >>>>>> + for gitlocal, localpath in
>> >> >>> >>>>>> gitrepos.iteritems():
>> >> >>> >>>>>> + for paths in localpath:
>> >> >>> >>>>>> + if "bitbake" not in paths:
>> >> >>> >>>>>> +
>> >> >>> >>>>>> layerlist.append(layerlisturl +
>> >> >>> >>>>>> "/"
>> >> >>> >>>>>> + str(paths[1]))
>> >> >>> >>>>>> +
>> >> >>> >>>>>>
>> >> >>> >>>>>> logger.debug("localhostbecontroller: current layer
>> >> >>> >>>>>> list
>> >> >>> >>>>>> %s "
>> >> >>> >>>>>> % pformat(layerlist))
>> >> >>> >>>>>>
>> >> >>> >>>>>> diff --git a/
>> >> >>> >>>>>>
>> >> >>> >>>>>>
>> bitbake/lib/toaster/bldcontrol/management/commands/loadconf.py
>> >> >>> >>>>>>
>> >> >>> >>>>>>
>> b/bitbake/lib/toaster/bldcontrol/management/commands/loadconf.py
>> >> >>> >>>>>> index 5022b59..a22f744 100644
>> >> >>> >>>>>> ---
>> >> >>> >>>>>>
>> >> >>> >>>>>>
>> a/bitbake/lib/toaster/bldcontrol/management/commands/loadconf.py
>> >> >>> >>>>>> +++
>> >> >>> >>>>>>
>> >> >>> >>>>>>
>> b/bitbake/lib/toaster/bldcontrol/management/commands/loadconf.py
>> >> >>> >>>>>> @@ -45,12 +45,14 @@ class Command(BaseCommand):
>> >> >>> >>>>>> for i in ['bitbake', 'releases', 'defaultrelease',
>> >> >>> >>>>>> 'config',
>> >> >>> >>>>>> 'layersources']:
>> >> >>> >>>>>> assert i in data
>> >> >>> >>>>>>
>> >> >>> >>>>>> - def _read_git_url_from_local_repository(address):
>> >> >>> >>>>>> + def _read_git_url_from_local_repository(address,
>> path
>> >> >>> >>>>>> =
>> >> >>> >>>>>> None):
>> >> >>> >>>>>
>> >> >>> >>>>>
>> >> >>> >>>>> If you want to pass in the path, please move the whole
>> function
>> >> >>> >>>>> outside
>> >> >>> >>>>> _import_layer_config, as it's no longer a closure.
>> >> >>> >>>>>
>> >> >>> >>>>>
>> >> >>> >>>>>>
>> >> >>> >>>>>> url = None
>> >> >>> >>>>>> + if not path:
>> >> >>> >>>>>> + path = os.path.dirname(filepath)
>> >> >>> >>>>>> # we detect the remote name at runtime
>> >> >>> >>>>>> import subprocess
>> >> >>> >>>>>> (remote, remote_name) = address.split(":", 1)
>> >> >>> >>>>>> - cmd = subprocess.Popen("git remote -v",
>> >> >>> >>>>>> shell=True,
>> >> >>> >>>>>> cwd =
>> >> >>> >>>>>> os.path.dirname(filepath), stdout=subprocess.PIPE, stderr =
>> >> >>> >>>>>> subprocess.PIPE)
>> >> >>> >>>>>> + cmd = subprocess.Popen("git remote -v",
>> >> >>> >>>>>> shell=True,
>> >> >>> >>>>>> cwd =
>> >> >>> >>>>>> path, stdout=subprocess.PIPE, stderr = subprocess.PIPE)
>> >> >>> >>>>>> (out,err) = cmd.communicate()
>> >> >>> >>>>>> if cmd.returncode != 0:
>> >> >>> >>>>>> logging.warning("Error while importing
>> layer
>> >> >>> >>>>>> vcs_url:
>> >> >>> >>>>>> git error: %s" % err)
>> >> >>> >>>>>> @@ -121,7 +123,11 @@ class Command(BaseCommand):
>> >> >>> >>>>>> logger.error("Local layer path %s
>> must
>> >> >>> >>>>>> exists. Are you trying to import a layer that does not
>> exist ?
>> >> >>> >>>>>> Check your
>> >> >>> >>>>>> local toasterconf.json" % lo.local_path)
>> >> >>> >>>>>>
>> >> >>> >>>>>> if
>> >> >>> >>>>>> layerinfo['vcs_url'].startswith("remote:"):
>> >> >>> >>>>>> - lo.vcs_url =
>> >> >>> >>>>>> _read_git_url_from_local_repository(layerinfo['vcs_url'])
>> >> >>> >>>>>> + if layerinfo['local_path'] not in
>> >> >>> >>>>>> ["meta",
>> >> >>> >>>>>> "meta-yocto", "meta-yocto-bsp"]:
>> >> >>> >>>>>
>> >> >>> >>>>>
>> >> >>> >>>>> Please don't use hardcoded layer names anywhere in the code.
>> >> >>> >>>>>
>> >> >>> >>>>> We do not want special handling for some layers, all layers
>> need
>> >> >>> >>>>> to
>> >> >>> >>>>> be
>> >> >>> >>>>> treated in the same, uniform, way.
>> >> >>> >>>>>
>> >> >>> >>>>>
>> >> >>> >>>>>> + repo_path =
>> >> >>> >>>>>> layerinfo['local_path']
>> >> >>> >>>>>> + else:
>> >> >>> >>>>>> + repo_path = None
>> >> >>> >>>>>> + lo.vcs_url =
>> >> >>> >>>>>> _read_git_url_from_local_repository(layerinfo['vcs_url'],
>> >> >>> >>>>>> repo_path)
>> >> >>> >>>>>
>> >> >>> >>>>>
>> >> >>> >>>>> I think this code needs
>> >> >>> >>>>>
>> >> >>> >>>>>
>> >> >>> >>>>>>
>> >> >>> >>>>>> if lo.vcs_url is None:
>> >> >>> >>>>>> logger.error("The toaster
>> config
>> >> >>> >>>>>> file
>> >> >>> >>>>>> references the local git repo, but Toaster cannot detect
>> >> >>> >>>>>> it.\nYour
>> >> >>> >>>>>> local
>> >> >>> >>>>>> configuration for layer %s is invalid. Make sure that the
>> >> >>> >>>>>> toasterconf.json
>> >> >>> >>>>>> file is correct." % layerinfo['name'])
>> >> >>> >>>>
>> >> >>> >>>>
>> >> >>> >>>> A bit more explanation would help me move further to improvise
>> >> >>> >>>> the
>> >> >>> >>>> patch. If you don't mind please? So if I understand correctly
>> a
>> >> >>> >>>> separate
>> >> >>> >>>> function should be there to handle HEAD branches provided by
>> >> >>> >>>> toasterconf.json file, right?
>> >> >>> >>>
>> >> >>> >>>
>> >> >>> >>>
>> >> >>> >>> Yep, exactly my point.
>> >> >>> >>>
>> >> >>> >>> When inserting the Layer_Version objects for the "HEAD" branch,
>> >> >>> >>> the
>> >> >>> >>> Layer_Version.local_path should
>> >> >>> >>>
>> >> >>> >>> be set to the layer path.
>> >> >>> >>>
>> >> >>> >>> When checking out the layers in localhost bbcontroller, the
>> >> >>> >>> checkout
>> >> >>> >>> should be skipped at all times for "HEAD" branches; instead,
>> the
>> >> >>> >>> value in
>> >> >>> >>> Layer_Version.local_path should be used.
>> >> >>> >>
>> >> >>> >>
>> >> >>> >>
>> >> >>> >> Is there a way to access local_path of toasterconf.json file
>> from
>> >> >>> >> localhostbecontroller.py file?
>> >> >>> >
>> >> >>> > I got the solution. I have modified local_path from "/" to the
>> value
>> >> >>> > in
>> >> >>> > the
>> >> >>> > configuration file in the database.
>> >> >>> >
>> >> >>> >
>> >> >>> >>
>> >> >>> >>
>> >> >>> >>>
>> >> >>> >>>
>> >> >>> >>>
>> >> >>> >>>>>>
>> >> >>> >>>>>>
>> >> >>> >>>>>> --
>> >> >>> >>>>>> 1.9.1
>> >> >>> >>>>>>
>> >> >>> >>>>>> --
>> >> >>> >>>>>> _______________________________________________
>> >> >>> >>>>>> toaster mailing list
>> >> >>> >>>>>> toaster at yoctoproject.org
>> >> >>> >>>>>> https://lists.yoctoproject.org/listinfo/toaster
>> >> >>> >>>>>
>> >> >>> >>>>>
>> >> >>> >>>>>
>> >> >>> >>>>>
>> >> >>> >>>>> --
>> >> >>> >>>>> Alex Damian
>> >> >>> >>>>> Yocto Project
>> >> >>> >>>>> SSG / OTC
>> >> >>> >>>>
>> >> >>> >>>>
>> >> >>> >>>>
>> >> >>> >>>>
>> >> >>> >>>> --
>> >> >>> >>>> സുജിത് ഹരിദാസന്
>> >> >>> >>>> Bangalore
>> >> >>> >>>> <Project>Contributor to KDE project
>> >> >>> >>>> http://fci.wikia.com/wiki/Anti-DRM-Campaign
>> >> >>> >>>> <Blog> http://sujithh.info
>> >> >>> >>>
>> >> >>> >>>
>> >> >>> >>>
>> >> >>> >>>
>> >> >>> >>> --
>> >> >>> >>> Alex Damian
>> >> >>> >>> Yocto Project
>> >> >>> >>> SSG / OTC
>> >> >>> >>
>> >> >>> >>
>> >> >>> >>
>> >> >>> >>
>> >> >>> >> --
>> >> >>> >> സുജിത് ഹരിദാസന്
>> >> >>> >> Bangalore
>> >> >>> >> <Project>Contributor to KDE project
>> >> >>> >> http://fci.wikia.com/wiki/Anti-DRM-Campaign
>> >> >>> >> <Blog> http://sujithh.info
>> >> >>> >
>> >> >>> >
>> >> >>> > --
>> >> >>> > _______________________________________________
>> >> >>> > toaster mailing list
>> >> >>> > toaster at yoctoproject.org
>> >> >>> > https://lists.yoctoproject.org/listinfo/toaster
>> >> >>> >
>> >> >>
>> >> >>
>> >> >>
>> >> >>
>> >> >> --
>> >> >> സുജിത് ഹരിദാസന്
>> >> >> Bangalore
>> >> >> <Project>Contributor to KDE project
>> >> >> http://fci.wikia.com/wiki/Anti-DRM-Campaign
>> >> >> <Blog> http://sujithh.info
>> >> >
>> >> >
>> >> >
>> >> >
>> >> > --
>> >> > സുജിത് ഹരിദാസന്
>> >> > Bangalore
>> >> > <Project>Contributor to KDE project
>> >> > http://fci.wikia.com/wiki/Anti-DRM-Campaign
>> >> > <Blog> http://sujithh.info
>> >
>> >
>> >
>> >
>> > --
>> > സുജിത് ഹരിദാസന്
>> > Bangalore
>> > <Project>Contributor to KDE project
>> > http://fci.wikia.com/wiki/Anti-DRM-Campaign
>> > <Blog> http://sujithh.info
>>
>
>
>
> --
> സുജിത് ഹരിദാസന്
> Bangalore
> <Project>Contributor to KDE project
> http://fci.wikia.com/wiki/Anti-DRM-Campaign
> <Blog> http://sujithh.info
>
--
സുജിത് ഹരിദാസന്
Bangalore
<Project>Contributor to KDE project
http://fci.wikia.com/wiki/Anti-DRM-Campaign
<Blog> http://sujithh.info
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/toaster/attachments/20150902/3c9b76f5/attachment-0001.html>
More information about the toaster
mailing list