[Toaster] [review-request][PATCH] toaster: Fix import of custom layers from toasterjson.conf
sujith h
sujith.h at gmail.com
Wed Sep 9 08:46:11 PDT 2015
Hi Brian,
I am attaching the tar file which contains the conf folder from the build
directory and the toasterconf.json file just outside poky folder.
Thanks,
Sujith H
On Wed, Sep 2, 2015 at 2:26 PM, sujith h <sujith.h at gmail.com> wrote:
> Hi Brian,
>
> Was there an instance of bitbake running in your build folder before you
> triggered the build from toaster?
>
> Thanks,
> Sujith H
>
> On Wed, Sep 2, 2015 at 2:12 PM, sujith h <sujith.h at gmail.com> wrote:
>
>>
>>
>> On Tue, Sep 1, 2015 at 10:39 PM, Brian Avery <avery.brian at gmail.com>
>> wrote:
>>
>>> Hi,
>>>
>>> I'm on the correct patch afaik. I put the toasterconf.json into the
>>> directory above poky and loaded it with:
>>> poky/bitbake/lib/toaster/manage.py loadconf
>>> /home/bavery/src/intel/myBugs2/sujith/toasterconf.json
>>>
>>
>> This is not my latest patch which I worked on :) It was with subject:
>> [PATCH] toaster: Import external layers outside poky from
>> toasterconf.json
>>
>>
>>> I also used option 0 so that toaster did not attempt to load the
>>> layers from openembedded.
>>>
>>> My branch for this test is:
>>>
>>> http://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/?h=bavery%2Fsubmit%2Fsujith%2F20150827_custom_layer_import
>>>
>>> I ran a build of core-image-sato with qtbase and iw set in
>>> IMAGE_INSTALL_append for the project.
>>>
>>> The results:
>>> The good-
>>> I got a core-image-sato as well as the qt5 and iw packages; so the build
>>> worked.
>>>
>>> The not so good -
>>> 1) My build progress bar did not update.
>>> 2) my recipe list after the build looks like:
>>>
>>> https://www.dropbox.com/s/qs7hulsbmcgg4ik/Screenshot%202015-09-01%2010.02.29.png?dl=0
>>> 3) in the build directory I set when starting up toaster (where the
>>> tmp/deploy ends up among other things) the toaster_ui.log file was
>>> filled with errors (it ended up being 17G by the end of the build).
>>> I'm attaching the first 120 lines of it so you can see what it looked
>>> like.
>>>
>>> I would like to share my poky and cloned_layers directory and the ui log
>> file attached:
>>
>> ------------
>> sujith at kdekidd0:~/MEL/test_poky$ pwd
>> /home/sujith/MEL/test_poky
>> sujith at kdekidd0:~/MEL/test_poky$ ls -lt
>> total 16488
>> -rw-r--r-- 1 sujith sujith 16855040 Sep 2 13:46 toaster.sqlite
>> drwxrwxr-x 3 sujith sujith 4096 Sep 2 13:45 toaster_build_artifacts
>> drwxr-xr-x 8 sujith sujith 4096 Sep 2 13:43 build
>> drwxrwxr-x 11 sujith sujith 4096 Sep 2 10:01 poky
>> -rw-rw-r-- 1 sujith sujith 4632 Aug 28 12:21 toasterconf.json
>> drwxrwxr-x 6 sujith sujith 4096 Aug 28 11:53 venv
>> sujith at kdekidd0:~/MEL/test_poky$ ls ../cloned_layers/ -l
>> total 8
>> drwxrwxr-x 19 sujith sujith 4096 Aug 28 11:51 meta-oe
>> drwxrwxr-x 8 sujith sujith 4096 Aug 28 12:10 meta-qt5
>> sujith at kdekidd0:~/MEL/test_poky$
>> ------------
>>
>> Now the step done to load configuration:
>>
>> ------------
>> sujith at kdekidd0:~/MEL/test_poky$ source venv/bin/activate
>> (venv)sujith at kdekidd0:~/MEL/test_poky$ ./poky/bitbake/bin/toaster
>> Syncing...
>> Creating tables ...
>> Creating table auth_permission
>> Creating table auth_group_permissions
>> Creating table auth_group
>> Creating table auth_user_groups
>> Creating table auth_user_user_permissions
>> Creating table auth_user
>> Creating table django_content_type
>> Creating table django_session
>> Creating table django_admin_log
>> Creating table south_migrationhistory
>>
>> You just installed Django's auth system, which means you don't have any
>> superusers defined.
>> Would you like to create one now? (yes/no): yes
>> Username (leave blank to use 'sujith'):
>> Email address:
>> Password:
>> Password (again):
>> Superuser created successfully.
>> Installing custom SQL ...
>> Installing indexes ...
>> Installed 0 object(s) from 0 fixture(s)
>>
>> Synced:
>> > django.contrib.auth
>> > django.contrib.contenttypes
>> > django.contrib.messages
>> > django.contrib.sessions
>> > django.contrib.admin
>> > django.contrib.staticfiles
>> > django.contrib.humanize
>> > south
>>
>> Not synced (use migrations):
>> - bldcontrol
>> - orm
>> (use ./manage.py migrate to migrate these)
>> Running migrations for orm:
>> - Migrating forwards to 0024_auto__add_field_recipe_is_image.
>> > orm:0001_initial
>> > orm:0002_auto__add_field_build_timespent
>> > orm:0003_timespent
>> - Migration 'orm:0003_timespent' is marked for no-dry-run.
>> > orm:0004_auto__add_field_package_installed_name
>> >
>> orm:0005_auto__add_target_image_file__add_target_file__add_field_variablehistor
>> >
>> orm:0006_auto__add_field_target_image_size__add_field_target_license_manifest_p
>> > orm:0007_auto__add_helptext
>> >
>> orm:0008_auto__chg_field_variablehistory_operation__chg_field_recipe_descriptio
>> >
>> orm:0009_auto__add_projectvariable__add_projectlayer__add_projecttarget__add_pr
>> >
>> orm:0010_auto__add_field_project_branch__add_field_project_short_description__a
>> > orm:0011_auto__add_field_projectlayer_dirpath
>> >
>> orm:0012_auto__add_field_projectlayer_optional__add_field_projecttarget_task
>> >
>> orm:0013_auto__add_release__add_layerversiondependency__add_unique_layerversion
>> >
>> orm:0014_auto__chg_field_package_summary__chg_field_layer_summary__chg_field_re
>> >
>> orm:0015_auto__add_field_layer_vcs_web_url__add_field_layer_vcs_web_tree_base_u
>> >
>> orm:0016_auto__add_field_release_helptext__chg_field_release_branch__add_index_
>> >
>> orm:0017_auto__del_toastersettingdefaultlayer__add_releaselayersourcepriority__
>> > orm:0018_auto__add_field_layer_version_project
>> > orm:0019_auto__add_buildartifact
>> >
>> orm:0020_auto__add_field_layer_version_local_path__add_field_recipe_pathflags__
>> >
>> orm:0021_auto__chg_field_build_project__chg_field_project_bitbake_version__chg_
>> >
>> orm:0022_auto__add_field_target_task__add_field_layer_version_local_path__del_f
>> >
>> orm:0023_auto__del_field_build_warnings_no__del_field_build_errors_no__del_fiel
>> > orm:0024_auto__add_field_recipe_is_image
>> - Loading initial data for orm.
>> Installed 0 object(s) from 0 fixture(s)
>> Running migrations for bldcontrol:
>> - Migrating forwards to 0008_brarchive.
>> > bldcontrol:0001_initial
>> >
>> bldcontrol:0002_auto__add_field_buildenvironment_sourcedir__add_field_buildenvironment
>> > bldcontrol:0003_auto__add_field_brlayer_dirpath
>> > bldcontrol:0004_loadinitialdata
>> - Migration 'bldcontrol:0004_loadinitialdata' is marked for no-dry-run.
>> > bldcontrol:0005_auto__add_brerror
>> > bldcontrol:0006_auto__add_brbitbake
>> >
>> bldcontrol:0007_auto__add_field_buildrequest_environment__chg_field_buildrequest_build
>> > bldcontrol:0008_brarchive
>> - Migration 'bldcontrol:0008_brarchive' is marked for no-dry-run.
>> - Loading initial data for bldcontrol.
>> Installed 0 object(s) from 0 fixture(s)
>> Toaster needs to know in which directory it can download build log files
>> and other artifacts.
>> Toaster suggests "/home/sujith/MEL/test_poky/toaster_build_artifacts/".
>> Press Enter to select
>> "/home/sujith/MEL/test_poky/toaster_build_artifacts/" or type the full path
>> to a different directory:
>> Verifying the Build Environment. If the local Build Environment is not
>> properly configured, you will be asked to configure it.
>>
>> -- Validation: The checkout directory must be set.
>> Toaster needs to know in which directory it should check out the layers
>> that will be needed for your builds.
>> Toaster suggests "/home/sujith". If you select this directory, a layer
>> like "meta-intel" will end up in "/home/sujith/meta-intel".
>> Press Enter to select "/home/sujith" or type the full path to a
>> different directory (must be a parent of current checkout directory):
>> Verifying the Build Environment. If the local Build Environment is not
>> properly configured, you will be asked to configure it.
>>
>> -- Validation: The build directory must be set.
>> Toaster needs to know where is your build directory.
>> The build directory is where all the artifacts created by your builds
>> will be stored. Type the full path to the directory (for example: "
>> /home/sujith/build")/home/sujith/MEL/test_poky/build
>> Build configuration saved
>> Verifying the Build Environment. If the local Build Environment is not
>> properly configured, you will be asked to configure it.
>>
>> Toaster can use a SINGLE predefined configuration file to set up default
>> project settings and layer information sources.
>>
>> Toaster will list now the configuration files that it found. Select the
>> number to use the desired configuration file.
>> [1] -
>> /home/sujith/MEL/toaster_work/poky/meta-yocto/conf/toasterconf.json
>> [2] - /home/sujith/MEL/cedar/poky/meta-yocto/conf/toasterconf.json
>> [3] -
>> /home/sujith/MEL/toaster_MEL_final/poky/meta-yocto/conf/toasterconf.json
>> [4] - /home/sujith/MEL/test_poky/poky/meta-yocto/conf/toasterconf.json
>> [5] -
>> /home/sujith/MEL/upstream_poky_work/poky-contrib/meta-yocto/conf/toasterconf.json
>> [6] - /home/sujith/gitroot/poky/meta-yocto/conf/toasterconf.json
>>
>> [0] - Exit without importing any file
>>
>> Enter your option: 0
>> Starting webserver...
>> Webserver address: http://0.0.0.0:8000/
>> Starting browser...
>> Toaster is now running. You can stop it with Ctrl-C
>> ^Z
>> [1]+ Stopped ./poky/bitbake/bin/toaster
>> (venv)sujith at kdekidd0:~/MEL/test_poky$
>> ./poky/bitbake/lib/toaster/manage.py loadconf toasterconf.json
>> (venv)sujith at kdekidd0:~/MEL/test_poky$ fg
>> ./poky/bitbake/bin/toaster
>> 2015-09-02 10:11:54,415 DEBUG localhostbecontroller, our git repos are
>> {(u'', u'HEAD'): [('bitbake', u'bitbake')],
>> (u'git://git.yoctoproject.org/poky', u'HEAD'): [(u'openembedded-core',
>> u'meta'),
>> (u'meta-yocto',
>> u'meta-yocto'),
>> (u'meta-yocto-bsp',
>> u'meta-yocto-bsp')],
>> (u'git://github.com/meta-qt5/meta-qt5.git', u'HEAD'): [(u'meta-qt5',
>> u'meta-qt5')],
>> (u'git://github.com/openembedded/meta-oe.git', u'HEAD'):
>> [(u'meta-python',
>>
>> u'meta-python'),
>>
>> (u'meta-multimedia',
>>
>> u'meta-multimedia'),
>>
>> (u'meta-filesystems',
>>
>> u'meta-filesystems'),
>>
>> (u'meta-networking',
>>
>> u'meta-networking'),
>> (u'meta-oe',
>> u'meta-oe')]}
>> 2015-09-02 10:11:54,416 DEBUG lbc_shellcmmd: (/home/sujith/Documents) git
>> remote -v
>> 2015-09-02 10:11:54,419 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,419 DEBUG lbc_shellcmmd: (/home/sujith/.thumbnails)
>> git remote -v
>> 2015-09-02 10:11:54,422 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,422 DEBUG lbc_shellcmmd: (/home/sujith/.emacs.d) git
>> remote -v
>> 2015-09-02 10:11:54,425 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,425 DEBUG lbc_shellcmmd: (/home/sujith/Templates) git
>> remote -v
>> 2015-09-02 10:11:54,429 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,429 DEBUG lbc_shellcmmd: (/home/sujith/.pylint.d) git
>> remote -v
>> 2015-09-02 10:11:54,432 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,432 DEBUG lbc_shellcmmd: (/home/sujith/.cscache) git
>> remote -v
>> 2015-09-02 10:11:54,439 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,439 DEBUG lbc_shellcmmd: (/home/sujith/.config) git
>> remote -v
>> 2015-09-02 10:11:54,443 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,443 DEBUG lbc_shellcmmd: (/home/sujith/bin) git
>> remote -v
>> 2015-09-02 10:11:54,448 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,448 DEBUG lbc_shellcmmd: (/home/sujith/MEL) git
>> remote -v
>> 2015-09-02 10:11:54,452 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,452 DEBUG lbc_shellcmmd: (/home/sujith/Pictures) git
>> remote -v
>> 2015-09-02 10:11:54,455 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,455 DEBUG lbc_shellcmmd: (/home/sujith/.pip) git
>> remote -v
>> 2015-09-02 10:11:54,459 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,459 DEBUG lbc_shellcmmd: (/home/sujith/Music) git
>> remote -v
>> 2015-09-02 10:11:54,463 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,463 DEBUG lbc_shellcmmd: (/home/sujith/debian) git
>> remote -v
>> 2015-09-02 10:11:54,466 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,466 DEBUG lbc_shellcmmd: (/home/sujith/.distlib) git
>> remote -v
>> 2015-09-02 10:11:54,470 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,470 DEBUG lbc_shellcmmd: (/home/sujith/.mozilla) git
>> remote -v
>> 2015-09-02 10:11:54,473 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,474 DEBUG lbc_shellcmmd: (/home/sujith/Django_study)
>> git remote -v
>> 2015-09-02 10:11:54,478 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,478 DEBUG lbc_shellcmmd: (/home/sujith/.java) git
>> remote -v
>> 2015-09-02 10:11:54,481 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,482 DEBUG lbc_shellcmmd:
>> (/home/sujith/patches_to_push) git remote -v
>> 2015-09-02 10:11:54,485 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,485 DEBUG lbc_shellcmmd: (/home/sujith/.ssh) git
>> remote -v
>> 2015-09-02 10:11:54,488 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,488 DEBUG lbc_shellcmmd: (/home/sujith/Downloads) git
>> remote -v
>> 2015-09-02 10:11:54,492 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,492 DEBUG lbc_shellcmmd: (/home/sujith/.pki) git
>> remote -v
>> 2015-09-02 10:11:54,495 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,496 DEBUG lbc_shellcmmd: (/home/sujith/Public) git
>> remote -v
>> 2015-09-02 10:11:54,499 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,499 DEBUG lbc_shellcmmd: (/home/sujith/.repoconfig)
>> git remote -v
>> 2015-09-02 10:11:54,502 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,502 DEBUG lbc_shellcmmd: (/home/sujith/.pc) git
>> remote -v
>> 2015-09-02 10:11:54,505 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,505 DEBUG lbc_shellcmmd: (/home/sujith/wsgiref) git
>> remote -v
>> 2015-09-02 10:11:54,510 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,510 DEBUG lbc_shellcmmd: (/home/sujith/.mentor) git
>> remote -v
>> 2015-09-02 10:11:54,513 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,515 DEBUG lbc_shellcmmd:
>> (/home/sujith/MENTOR_TOOLCHAIN) git remote -v
>> 2015-09-02 10:11:54,517 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,518 DEBUG lbc_shellcmmd: (/home/sujith/Desktop) git
>> remote -v
>> 2015-09-02 10:11:54,521 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,521 DEBUG lbc_shellcmmd: (/home/sujith/.local) git
>> remote -v
>> 2015-09-02 10:11:54,525 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,525 DEBUG lbc_shellcmmd: (/home/sujith/.dbus) git
>> remote -v
>> 2015-09-02 10:11:54,529 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,529 DEBUG lbc_shellcmmd: (/home/sujith/workspace) git
>> remote -v
>> 2015-09-02 10:11:54,532 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,533 DEBUG lbc_shellcmmd:
>> (/home/sujith/.gstreamer-0.10) git remote -v
>> 2015-09-02 10:11:54,536 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,536 DEBUG lbc_shellcmmd: (/home/sujith/.gnome) git
>> remote -v
>> 2015-09-02 10:11:54,540 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,540 DEBUG lbc_shellcmmd: (/home/sujith/.cache) git
>> remote -v
>> 2015-09-02 10:11:54,544 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,544 DEBUG lbc_shellcmmd:
>> (/home/sujith/codebench-linux-install-2014.11-96-arm) git remote -v
>> 2015-09-02 10:11:54,547 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,547 DEBUG lbc_shellcmmd: (/home/sujith/Videos) git
>> remote -v
>> 2015-09-02 10:11:54,550 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,550 DEBUG lbc_shellcmmd: (/home/sujith/.gconf) git
>> remote -v
>> 2015-09-02 10:11:54,554 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,555 DEBUG lbc_shellcmmd: (/home/sujith/.subversion)
>> git remote -v
>> 2015-09-02 10:11:54,558 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,558 DEBUG lbc_shellcmmd: (/home/sujith/.thunderbird)
>> git remote -v
>> 2015-09-02 10:11:54,561 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,561 DEBUG lbc_shellcmmd: (/home/sujith/gitroot) git
>> remote -v
>> 2015-09-02 10:11:54,564 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,564 DEBUG lbc_shellcmmd: (/home/sujith/.oe) git
>> remote -v
>> 2015-09-02 10:11:54,568 WARNING localhostbecontroller: shellcmd error
>> command: git remote -v
>> fatal: Not a git repository (or any of the parent directories): .git
>>
>> 2015-09-02 10:11:54,570 DEBUG localhostbecontroller: current layer list
>> [u'/home/sujith/MEL/test_poky/poky/meta',
>> u'/home/sujith/MEL/test_poky/poky/meta-yocto',
>> u'/home/sujith/MEL/test_poky/poky/meta-yocto-bsp',
>> u'/home/sujith/MEL/cloned_layers/meta-oe/meta-python',
>> u'/home/sujith/MEL/cloned_layers/meta-oe/meta-multimedia',
>> u'/home/sujith/MEL/cloned_layers/meta-oe/meta-filesystems',
>> u'/home/sujith/MEL/cloned_layers/meta-oe/meta-networking',
>> u'/home/sujith/MEL/cloned_layers/meta-oe/meta-oe',
>> u'/home/sujith/MEL/cloned_layers/meta-qt5']
>> 2015-09-02 10:11:54,571 DEBUG lbc_shellcmmd: (/home/sujith) bash -c
>> "source /home/sujith/MEL/test_poky/poky/oe-init-build-env
>> /home/sujith/MEL/test_poky/build"
>> 2015-09-02 10:11:54,684 DEBUG localhostbecontroller: shellcmd success
>> 2015-09-02 10:11:54,691 DEBUG localhostbecontroller: running the listener
>> at /home/sujith/MEL/test_poky/poky/bitbake/bin/bitbake
>> 2015-09-02 10:11:54,691 DEBUG localhostbecontroller: starting builder
>> bash -c "source /home/sujith/MEL/test_poky/poky/oe-init-build-env
>> /home/sujith/MEL/test_poky/build 2>&1 >toaster_server.log && bitbake --read
>> /home/sujith/MEL/test_poky/build/conf/toaster-pre.conf --postread
>> /home/sujith/MEL/test_poky/build/conf/toaster.conf --server-only -t xmlrpc
>> -B 0.0.0.0:0 2>&1 >>toaster_server.log "
>>
>> 2015-09-02 10:11:54,691 DEBUG lbc_shellcmmd: (/home/sujith) bash -c
>> "source /home/sujith/MEL/test_poky/poky/oe-init-build-env
>> /home/sujith/MEL/test_poky/build 2>&1 >toaster_server.log && bitbake --read
>> /home/sujith/MEL/test_poky/build/conf/toaster-pre.conf --postread
>> /home/sujith/MEL/test_poky/build/conf/toaster.conf --server-only -t xmlrpc
>> -B 0.0.0.0:0 2>&1 >>toaster_server.log "
>> 2015-09-02 10:11:56,198 DEBUG localhostbecontroller: shellcmd success
>> 2015-09-02 10:11:56,199 DEBUG localhostbecontroller: Found bitbake server
>> port 33000
>>
>> 2015-09-02 10:11:56,200 DEBUG localhostbecontroller: Waiting bitbake
>> server to start
>> 2015-09-02 10:11:56,701 DEBUG localhostbecontroller: Waiting bitbake
>> server to start
>> 2015-09-02 10:11:57,202 DEBUG localhostbecontroller: Waiting bitbake
>> server to start
>> 2015-09-02 10:11:57,704 DEBUG localhostbecontroller: Waiting bitbake
>> server to start
>> 2015-09-02 10:11:58,205 DEBUG localhostbecontroller: Started bitbake
>> server
>> 2015-09-02 10:11:58,236 DEBUG localhostbecontroller: Build launched,
>> exiting. Follow build logs at
>> /home/sujith/MEL/test_poky/build/toaster_ui.log
>> ------------
>>
>> The path to tmp/deploy/image and the content inside the directory:
>>
>> ------------
>> sujith at kdekidd0:~/MEL/test_poky/build$ ls tmp/deploy/images/qemux86/ -lt
>> total 1244112
>> lrwxrwxrwx 1 sujith sujith 53 Sep 2 13:43
>> core-image-sato-qemux86.tar.bz2 ->
>> core-image-sato-qemux86-20150902044346.rootfs.tar.bz2
>> lrwxrwxrwx 1 sujith sujith 50 Sep 2 13:43
>> core-image-sato-qemux86.ext3 ->
>> core-image-sato-qemux86-20150902044346.rootfs.ext3
>> lrwxrwxrwx 1 sujith sujith 50 Sep 2 13:43
>> core-image-sato-qemux86.ext4 ->
>> core-image-sato-qemux86-20150902044346.rootfs.ext4
>> lrwxrwxrwx 1 sujith sujith 54 Sep 2 13:43
>> core-image-sato-qemux86.manifest ->
>> core-image-sato-qemux86-20150902044346.rootfs.manifest
>> lrwxrwxrwx 1 sujith sujith 51 Sep 2 13:43
>> core-image-sato-qemux86.jffs2 ->
>> core-image-sato-qemux86-20150902044346.rootfs.jffs2
>> -rw-r--r-- 1 sujith sujith 196083712 Sep 2 13:43
>> core-image-sato-qemux86-20150902044346.rootfs.jffs2
>> -rw-r--r-- 1 sujith sujith 535930880 Sep 2 13:42
>> core-image-sato-qemux86-20150902044346.rootfs.ext4
>> -rw-r--r-- 1 sujith sujith 535930880 Sep 2 13:42
>> core-image-sato-qemux86-20150902044346.rootfs.ext3
>> -rw-r--r-- 1 sujith sujith 154285168 Sep 2 13:42
>> core-image-sato-qemux86-20150902044346.rootfs.tar.bz2
>> -rw-r--r-- 1 sujith sujith 21112 Sep 2 13:41
>> core-image-sato-qemux86-20150902044346.rootfs.manifest
>> -rw-r--r-- 2 sujith sujith 294 Sep 2 13:40
>> README_-_DO_NOT_DELETE_FILES_IN_THIS_DIRECTORY.txt
>> lrwxrwxrwx 1 sujith sujith 71 Sep 2 12:53 bzImage ->
>> bzImage--4.1.6+git0+429f9e2ff0_59b8c4f5e8-r0-qemux86-20150902044346.bin
>> lrwxrwxrwx 1 sujith sujith 71 Sep 2 12:53 bzImage-qemux86.bin ->
>> bzImage--4.1.6+git0+429f9e2ff0_59b8c4f5e8-r0-qemux86-20150902044346.bin
>> lrwxrwxrwx 1 sujith sujith 71 Sep 2 12:53 modules-qemux86.tgz ->
>> modules--4.1.6+git0+429f9e2ff0_59b8c4f5e8-r0-qemux86-20150902044346.tgz
>> -rw-rw-r-- 2 sujith sujith 83308568 Sep 2 12:53
>> modules--4.1.6+git0+429f9e2ff0_59b8c4f5e8-r0-qemux86-20150902044346.tgz
>> -rw-r--r-- 2 sujith sujith 6957488 Sep 2 12:53
>> bzImage--4.1.6+git0+429f9e2ff0_59b8c4f5e8-r0-qemux86-20150902044346.bin
>> sujith at kdekidd0:~/MEL/test_poky/build$
>> ------------
>>
>> The screenshot of image built successfully:
>> http://i.imgur.com/V3qtXFh.png
>>
>>> ---
>>> So, you may want to look at/try my poky-contrib branch and look
>>> closely at my toasterconf.json file to see if you can tell why you do
>>> not see these issues.
>>>
>>
>> The toaster-pre.conf of mine looks as:
>> sujith at kdekidd0:~/MEL/test_poky/build/conf$ cat toaster-pre.conf
>> IMAGE_INSTALL_append=" qtbase iw"
>> PACKAGE_CLASSES="package_ipk"
>> MACHINE="qemux86"
>> SDKMACHINE="x86_64"
>> DISTRO="poky"
>> IMAGE_FSTYPES="ext3 jffs2 tar.bz2"
>> TOASTER_BRBE="1:1"
>> sujith at kdekidd0:~/MEL/test_poky/build/conf$
>>
>> Somehow I am not able to figure out what is going on wrong at your end :(
>>
>>>
>>> -brian
>>>
>>> On Sun, Aug 30, 2015 at 11:47 PM, sujith h <sujith.h at gmail.com> wrote:
>>> > Hi Brian,
>>> >
>>> > On Sat, Aug 29, 2015 at 1:13 AM, Brian Avery <avery.brian at gmail.com>
>>> wrote:
>>> >>
>>> >> Hi Sujith,
>>> >>
>>> >> The new toasterconf does make it easier to test, thanks! I've
>>> >> attached mine so you can see what I did in case that caused any of the
>>> >> issues below.
>>> >> I changed:
>>> >> 1) directory paths
>>> >> 2) you had "branches": ["mel", "yocto", "HEAD"], which i
>>> >> changed to "branches": ["HEAD", "master", "fido",
>>> >> "dizzy"],
>>> >>
>>> >>
>>> >>
>>> >> So here is my directory layout
>>> >>
>>> >> /big/src/intel/myBugs2
>>> >> cloned_layers/
>>> >> meta-oe/
>>> >> meta-qt5/
>>> >> sujith/
>>> >> poky
>>> >
>>> >
>>> > Here is my directory layout:
>>> > /home/sujith/MEL/test_poky
>>> > poky
>>> > /home/sujith/MEL/cloned_layers
>>> > meta-oe
>>> > meta-qt5
>>> >
>>> >>
>>> >>
>>> >> I put the attached toasterconf.json into the sujith/meta-yocto/conf/
>>> >> directory (overwriting the default one) and toaster found it on
>>> >> startup.
>>> >
>>> >
>>> > I have added my configuration into:
>>> > /home/sujith/MEL/test_poky/toasterconf.json
>>> >
>>> > I never tried over writing toasterconf.json file in meta-yocto/conf
>>> >
>>> > I use option [0] while running poky/bitbake/bin/toaster i.e, exit
>>> without
>>> > importing any layers. Then I manually try to import it using command:
>>> > poky/bitbake/lib/toaster/manage.py loadconf toasterconf.json
>>> >
>>> >> Question:
>>> >> Where are you putting your toasterconf.json file? I haven't gone
>>> >> through the search logic yet but toaster seemed to have trouble
>>> >> finding it in other directories.
>>> >>
>>> >> My directory settings for starting toaster are:
>>> >> build log -> /home/bavery/toaster_build_artifacts
>>> >> layer checkout -> /big/src/intel/myBugs2/sujith/
>>> >> build -> /home/bavery/toaster_build_artifacts
>>> >>
>>> >>
>>> >> I found the following issues:
>>> >> 1)On startup toaster complained about not being able to load from
>>> >> openembedded.layers.org and once toaster was up, there were no layers
>>> >> available except the local ones.
>>> >>
>>> >> (
>>> https://www.dropbox.com/s/jdkayha71l8i9fe/Screenshot%202015-08-28%2012.29.06.png?dl=0
>>> )
>>> >> 2) I started a build of core-image-sato with MAGE_INSTALL_append =
>>> >> "qt5 iws"
>>> >> (
>>> https://www.dropbox.com/s/m3l6uyxq6ptr5vv/Screenshot%202015-08-28%2012.32.16.png?dl=0
>>> )
>>> >> and the build no longer shows progress on the progress bar. top
>>> >> running shows that I am well into the build but that is not reflected
>>> >> in the UI
>>> >> (
>>> https://www.dropbox.com/s/x3cl2whp2twt8xm/Screenshot%202015-08-28%2012.32.44.png?dl=0
>>> )
>>> >> 3) the toaster_ui.log in the build directory is huge and is filled
>>> >> with things like :Cannot determine the vcs_reference for layer version
>>> >> {'build_id': 1, '_layer_cache': <Layer: __FIXME__unidentified_layer /
>>> >> None >, 'layer_id': 204, '_state': <django.db.models.base.ModelSt...."
>>> >>
>>> >>
>>> >>
>>> >> Do you see any of these?
>>> >
>>> >
>>> > Since I haven't tried overwriting toasters default configuration file,
>>> I
>>> > couldn't hit with any of these errors. Would you mind to try with my
>>> way, if
>>> > you don't mind?
>>> > Let me know if you face any issue with the procedure I followed.
>>> >
>>> >
>>> > Thanks,
>>> > Sujith H
>>> >>
>>> >>
>>> >> -b
>>> >>
>>> >> On Fri, Aug 28, 2015 at 12:06 AM, sujith h <sujith.h at gmail.com>
>>> wrote:
>>> >> >
>>> >> >
>>> >> > On Thu, Aug 27, 2015 at 9:56 PM, sujith h <sujith.h at gmail.com>
>>> wrote:
>>> >> >>
>>> >> >>
>>> >> >>
>>> >> >> On Thu, Aug 27, 2015 at 9:36 PM, Brian Avery <
>>> avery.brian at gmail.com>
>>> >> >> wrote:
>>> >> >>>
>>> >> >>> Hi Sujith,
>>> >> >>>
>>> >> >>> I'd like to test this out. Is it possible to get a config file
>>> that
>>> >> >>> exercises the new features?
>>> >> >>
>>> >> >>
>>> >> >> I have attached the toaster configuration file which I used for
>>> >> >> testing.
>>> >> >> What you can also do is remove meta-mentor,meta-sourcery and
>>> meta-mx6q
>>> >> >> layers from the
>>> >> >> configuration file. And try with the layers we have. That might
>>> help
>>> >> >> you
>>> >> >> in testing. Also you
>>> >> >> may have to remove some additional settings I have used in the
>>> >> >> configuration, like Distro as "mel",
>>> >> >> toolchain path etc
>>> >> >>
>>> >> >> Or the simplest testing would be by adding poky and meta-oe layer.
>>> Then
>>> >> >> try to build
>>> >> >> some recipe from meta-oe. That would be the simplest test.
>>> >> >>
>>> >> >> Let me know if you need more information or face any issues. I
>>> would
>>> >> >> help
>>> >> >> you with that.
>>> >> >
>>> >> >
>>> >> > Hi Brian,
>>> >> >
>>> >> > I have attached a new configuration file which I am testing right
>>> away.
>>> >> > The
>>> >> > build is in progress.
>>> >> > In the IMAGE_INSTALL_append ( from UI ), I have added qtbase and iw
>>> >> > packages. The 2 repos I have
>>> >> > cloned is:
>>> >> > git clone git://github.com/meta-qt5/meta-qt5.git
>>> >> > and
>>> >> > git clone git://github.com/openembedded/meta-oe.git
>>> >> >
>>> >> > Accordingly adjust your paths mentioned in the configuration file.
>>> >> >
>>> >> > I hope this configuration file should help you proceed with your
>>> test.
>>> >> > Let
>>> >> > me know if you face any issues.
>>> >> >
>>> >> > Thanks,
>>> >> > Sujith H
>>> >> >>
>>> >> >>
>>> >> >> Thanks,
>>> >> >> Sujith H
>>> >> >>>
>>> >> >>>
>>> >> >>> -b
>>> >> >>>
>>> >> >>>
>>> >> >>> On Mon, Aug 24, 2015 at 7:16 PM, sujith h <sujith.h at gmail.com>
>>> wrote:
>>> >> >>> > On 24 Aug 2015 6:49 pm, "sujith h" <sujith.h at gmail.com> wrote:
>>> >> >>> >>
>>> >> >>> >>
>>> >> >>> >>
>>> >> >>> >> On Fri, Aug 21, 2015 at 8:07 PM, Damian, Alexandru
>>> >> >>> >> <alexandru.damian at intel.com> wrote:
>>> >> >>> >>>
>>> >> >>> >>>
>>> >> >>> >>>
>>> >> >>> >>> On Fri, Aug 21, 2015 at 1:52 PM, sujith h <sujith.h at gmail.com
>>> >
>>> >> >>> >>> wrote:
>>> >> >>> >>>>
>>> >> >>> >>>>
>>> >> >>> >>>>
>>> >> >>> >>>> On Fri, Aug 21, 2015 at 4:45 PM, Damian, Alexandru
>>> >> >>> >>>> <alexandru.damian at intel.com> wrote:
>>> >> >>> >>>>>
>>> >> >>> >>>>> Hi,
>>> >> >>> >>>>>
>>> >> >>> >>>>> I think we need a better patch description. If I understand
>>> >> >>> >>>>> correctly,
>>> >> >>> >>>>> the issue you were facing is:
>>> >> >>> >>>>> - even if we have layers at HEAD that are not under the
>>> poky/
>>> >> >>> >>>>> tree,
>>> >> >>> >>>>> the
>>> >> >>> >>>>> code would always return the
>>> >> >>> >>>>> checkout path in the poky/ tree; I recognize that this is a
>>> >> >>> >>>>> valid
>>> >> >>> >>>>> issue.
>>> >> >>> >>>>>
>>> >> >>> >>>>> I feel that this issue can be handled a bit differently if
>>> we
>>> >> >>> >>>>> frame
>>> >> >>> >>>>> it
>>> >> >>> >>>>> as such:
>>> >> >>> >>>>> - if we have a HEAD branch specified for a layer, we need to
>>> >> >>> >>>>> find
>>> >> >>> >>>>> out
>>> >> >>> >>>>> the current checkout directory for that layer, since no
>>> checkout
>>> >> >>> >>>>> would be
>>> >> >>> >>>>> performed.
>>> >> >>> >>>>>
>>> >> >>> >>>>> As such, when we import a toasterconf.json file (they only
>>> way
>>> >> >>> >>>>> to
>>> >> >>> >>>>> get
>>> >> >>> >>>>> HEAD branches for a layer) we need to store the actual layer
>>> >> >>> >>>>> checkout path
>>> >> >>> >>>>> in the database (in the localpath, perhaps?), and reuse that
>>> >> >>> >>>>> value,
>>> >> >>> >>>>> instead
>>> >> >>> >>>>> of employing special logic to search for it. What I mean,
>>> the
>>> >> >>> >>>>> core
>>> >> >>> >>>>> of the
>>> >> >>> >>>>> problem is solved by replacing the whole gitrepos checkout
>>> logic
>>> >> >>> >>>>> with a
>>> >> >>> >>>>> database value for all "HEAD" layers, and eliminate the
>>> magic in
>>> >> >>> >>>>> getGitCloneDirectory().
>>> >> >>> >>>>>
>>> >> >>> >>>>> I have a couple more comments on the patch below.
>>> >> >>> >>>>>
>>> >> >>> >>>>> Cheers,
>>> >> >>> >>>>> Alex
>>> >> >>> >>>>>
>>> >> >>> >>>>> On Fri, Aug 21, 2015 at 9:41 AM, Sujith H <
>>> sujith.h at gmail.com>
>>> >> >>> >>>>> wrote:
>>> >> >>> >>>>>>
>>> >> >>> >>>>>> This patch fixes import of custom layers from
>>> toasterjson.conf
>>> >> >>> >>>>>> file. For example it was verified using layers like
>>> >> >>> >>>>>> meta-mentor,
>>> >> >>> >>>>>> meta-fsl-arm, meta-sourcery etc.
>>> >> >>> >>>>>>
>>> >> >>> >>>>>> Signed-off-by: Sujith Haridasan <
>>> Sujith_Haridasan at mentor.com>
>>> >> >>> >>>>>> ---
>>> >> >>> >>>>>> .../toaster/bldcontrol/localhostbecontroller.py | 49
>>> >> >>> >>>>>> ++++++++++++++++++++--
>>> >> >>> >>>>>> .../bldcontrol/management/commands/loadconf.py | 12
>>> ++++--
>>> >> >>> >>>>>> 2 files changed, 54 insertions(+), 7 deletions(-)
>>> >> >>> >>>>>>
>>> >> >>> >>>>>> diff --git
>>> >> >>> >>>>>> a/bitbake/lib/toaster/bldcontrol/localhostbecontroller.py
>>> >> >>> >>>>>> b/bitbake/lib/toaster/bldcontrol/localhostbecontroller.py
>>> >> >>> >>>>>> index 231a7d3..c43f33f 100644
>>> >> >>> >>>>>> ---
>>> a/bitbake/lib/toaster/bldcontrol/localhostbecontroller.py
>>> >> >>> >>>>>> +++
>>> b/bitbake/lib/toaster/bldcontrol/localhostbecontroller.py
>>> >> >>> >>>>>> @@ -178,7 +178,7 @@ class
>>> >> >>> >>>>>> LocalhostBEController(BuildEnvironmentController):
>>> >> >>> >>>>>> self.be.save()
>>> >> >>> >>>>>> logger.debug("localhostbecontroller: Stopped
>>> bitbake
>>> >> >>> >>>>>> server")
>>> >> >>> >>>>>>
>>> >> >>> >>>>>> - def getGitCloneDirectory(self, url, branch):
>>> >> >>> >>>>>> + def
>>> >> >>> >>>>>>
>>> >> >>> >>>>>> getGitCloneDirectory(self, url, branch,
>>> cached_layers=None):
>>> >> >>> >>>>>> """ Utility that returns the last component of a
>>> git
>>> >> >>> >>>>>> path
>>> >> >>> >>>>>> as
>>> >> >>> >>>>>> directory
>>> >> >>> >>>>>> """
>>> >> >>> >>>>>> import re
>>> >> >>> >>>>>> @@ -191,6 +191,17 @@ class
>>> >> >>> >>>>>> LocalhostBEController(BuildEnvironmentController):
>>> >> >>> >>>>>>
>>> >> >>> >>>>>> # word of attention; this is a localhost-specific
>>> >> >>> >>>>>> issue;
>>> >> >>> >>>>>> only
>>> >> >>> >>>>>> on the localhost we expect to have "HEAD" releases
>>> >> >>> >>>>>> # which _ALWAYS_ means the current poky checkout
>>> >> >>> >>>>>> + if cached_layers:
>>> >> >>> >>>>>
>>> >> >>> >>>>>
>>> >> >>> >>>>> Using cached_layers here works only by coincidence - if the
>>> >> >>> >>>>> desired
>>> >> >>> >>>>> layer is not manually checked out under be.sourcedir, it
>>> will
>>> >> >>> >>>>> not
>>> >> >>> >>>>> be found
>>> >> >>> >>>>> by cached_layers code, and will not appear here.
>>> >> >>> >>>>
>>> >> >>> >>>>
>>> >> >>> >>>> Ah, so would it be good to read from the database? Because I
>>> was
>>> >> >>> >>>> giving
>>> >> >>> >>>> full path of layers in the toasterconf.json file. I assume
>>> that
>>> >> >>> >>>> layer
>>> >> >>> >>>> information from the toasterconf.json file would be updated
>>> in
>>> >> >>> >>>> the
>>> >> >>> >>>> database?
>>> >> >>> >>>
>>> >> >>> >>>
>>> >> >>> >>> Would be inserted into the database as the file is read.
>>> >> >>> >>>
>>> >> >>> >>>>>
>>> >> >>> >>>>>
>>> >> >>> >>>>> I think a completely new piece of code is needed, which will
>>> >> >>> >>>>> track
>>> >> >>> >>>>> where any layer that has a HEAD branch is actually checked
>>> out.
>>> >> >>> >>>>> This path
>>> >> >>> >>>>> would be discovered and stored by importing a
>>> toasterconf.json
>>> >> >>> >>>>> file
>>> >> >>> >>>>> (the
>>> >> >>> >>>>> only place that can generate a HEAD branch), and verified to
>>> >> >>> >>>>> actually exist
>>> >> >>> >>>>> at build time in this function, getGitCloneDirectory(). This
>>> >> >>> >>>>> patch
>>> >> >>> >>>>> touches
>>> >> >>> >>>>> loadconf, but I think we might be able to get a better
>>> handling
>>> >> >>> >>>>> of
>>> >> >>> >>>>> that.
>>> >> >>> >>>>>
>>> >> >>> >>>>>
>>> >> >>> >>>>>> + if not url.endswith('.git'):
>>> >> >>> >>>>>
>>> >> >>> >>>>>
>>> >> >>> >>>>> I am not sure why the actual GIT url format is relevant for
>>> >> >>> >>>>> "HEAD"
>>> >> >>> >>>>> branches; we don't need to figure out where the layer would
>>> get
>>> >> >>> >>>>> checked out,
>>> >> >>> >>>>> but where it actually exists.
>>> >> >>> >>>>>
>>> >> >>> >>>>>
>>> >> >>> >>>>>> + from os.path import dirname
>>> >> >>> >>>>>> + extractDir = dirname(url)
>>> >> >>> >>>>>> + for key, val in cached_layers.iteritems():
>>> >> >>> >>>>>> + if val == extractDir:
>>> >> >>> >>>>>> + local_checkout_path = key
>>> >> >>> >>>>>> + return cached_layers[local_checkout_path]
>>> >> >>> >>>>>> + else:
>>> >> >>> >>>>>> + local_checkout_path = cached_layers[url]
>>> >> >>> >>>>>> + return local_checkout_path
>>> >> >>> >>>>>> from os.path import dirname as DN
>>> >> >>> >>>>>> local_checkout_path =
>>> >> >>> >>>>>> DN(DN(DN(DN(DN(os.path.abspath(__file__))))))
>>> >> >>> >>>>>> #logger.debug("localhostbecontroller: using HEAD
>>> >> >>> >>>>>> checkout
>>> >> >>> >>>>>> in
>>> >> >>> >>>>>> %s" % local_checkout_path)
>>> >> >>> >>>>>> @@ -245,7 +256,14 @@ class
>>> >> >>> >>>>>> LocalhostBEController(BuildEnvironmentController):
>>> >> >>> >>>>>>
>>> >> >>> >>>>>> # 3. checkout the repositories
>>> >> >>> >>>>>> for giturl, commit in gitrepos.keys():
>>> >> >>> >>>>>> - localdirname = os.path.join(self.be.sourcedir,
>>> >> >>> >>>>>> self.getGitCloneDirectory(giturl, commit))
>>> >> >>> >>>>>> + if not giturl.endswith('.git'):
>>> >> >>> >>>>>> + for key, val in cached_layers.iteritems():
>>> >> >>> >>>>>> + if os.path.dirname(giturl) == val:
>>> >> >>> >>>>>> + tmpKey = key
>>> >> >>> >>>>>> + tmpVal = gitrepos[(giturl, commit)]
>>> >> >>> >>>>>> + gitrepos[(tmpKey, commit)] += tmpVal
>>> >> >>> >>>>>> + giturl = tmpKey
>>> >> >>> >>>>>> + localdirname = os.path.join(self.be.sourcedir,
>>> >> >>> >>>>>> self.getGitCloneDirectory(giturl, commit, cached_layers))
>>> >> >>> >>>>>> logger.debug("localhostbecontroller: giturl
>>> %s:%s
>>> >> >>> >>>>>> checking out in current directory %s" % (giturl, commit,
>>> >> >>> >>>>>> localdirname))
>>> >> >>> >>>>>>
>>> >> >>> >>>>>> # make sure our directory is a git repository
>>> >> >>> >>>>>> @@ -280,13 +298,36 @@ class
>>> >> >>> >>>>>> LocalhostBEController(BuildEnvironmentController):
>>> >> >>> >>>>>>
>>> >> >>> >>>>>> # verify our repositories
>>> >> >>> >>>>>> for name, dirpath in gitrepos[(giturl,
>>> commit)]:
>>> >> >>> >>>>>> - localdirpath = os.path.join(localdirname,
>>> >> >>> >>>>>> dirpath)
>>> >> >>> >>>>>
>>> >> >>> >>>>>
>>> >> >>> >>>>> I am not sure what this change tries to do; dirpath is
>>> actually
>>> >> >>> >>>>> a
>>> >> >>> >>>>> path
>>> >> >>> >>>>> in the git repo where the layer lives; it is not immediate
>>> that
>>> >> >>> >>>>> the
>>> >> >>> >>>>> all the
>>> >> >>> >>>>> layers live in the top directory of a git repo. This change
>>> >> >>> >>>>> invalidates the
>>> >> >>> >>>>> check below, where we verify that the layer path actually
>>> exists
>>> >> >>> >>>>> after
>>> >> >>> >>>>> checkout.
>>> >> >>> >>>>>
>>> >> >>> >>>>>>
>>> >> >>> >>>>>> + localdirpath = localdirname
>>> >> >>> >>>>>>
>>> >> >>> >>>>>> logger.debug("localhostbecontroller:
>>> >> >>> >>>>>> localdirpath
>>> >> >>> >>>>>> expected '%s'" % localdirpath)
>>> >> >>> >>>>>> if not os.path.exists(localdirpath):
>>> >> >>> >>>>>> raise BuildSetupException("Cannot find
>>> >> >>> >>>>>> layer
>>> >> >>> >>>>>> git
>>> >> >>> >>>>>> path '%s' in checked out repository '%s:%s'. Aborting." %
>>> >> >>> >>>>>> (localdirpath,
>>> >> >>> >>>>>> giturl, commit))
>>> >> >>> >>>>>>
>>> >> >>> >>>>>> + layerlisturl, layerlistdir = "", ""
>>> >> >>> >>>>>> + layerlisturl = [localurl for localurl,
>>> >> >>> >>>>>> localpath
>>> >> >>> >>>>>> in
>>> >> >>> >>>>>> cached_layers.iteritems() if localpath == localdirpath]
>>> >> >>> >>>>>
>>> >> >>> >>>>>
>>> >> >>> >>>>> I suspect this logic will go away if we're not going to use
>>> >> >>> >>>>> cached_layers to discover the local checkout directories for
>>> >> >>> >>>>> HEAD
>>> >> >>> >>>>> urls.
>>> >> >>> >>>>>
>>> >> >>> >>>>>
>>> >> >>> >>>>>>
>>> >> >>> >>>>>> + if len(layerlisturl) != 0:
>>> >> >>> >>>>>> + layerlisturl = layerlisturl[0]
>>> >> >>> >>>>>> + if len(layerlisturl) == 0:
>>> >> >>> >>>>>> + if
>>> >> >>> >>>>>> os.path.basename(localdirpath).startswith("_"):
>>> >> >>> >>>>>> + layerlisturl = localdirpath
>>> >> >>> >>>>>> if name != "bitbake":
>>> >> >>> >>>>>> -
>>> layerlist.append(localdirpath.rstrip("/"))
>>> >> >>> >>>>>> + for gitlocal, localpath in
>>> >> >>> >>>>>> gitrepos.iteritems():
>>> >> >>> >>>>>> + if layerlisturl in gitlocal:
>>> >> >>> >>>>>> + if len(localpath) > 2:
>>> >> >>> >>>>>> + for paths in localpath:
>>> >> >>> >>>>>> + if "bitbake" not in
>>> >> >>> >>>>>> paths[1]:
>>> >> >>> >>>>>> + layerlistdir =
>>> >> >>> >>>>>> localdirpath
>>> >> >>> >>>>>> +"/" + str(paths[1])
>>> >> >>> >>>>>> + if layerlistdir not in
>>> >> >>> >>>>>> layerlist:
>>> >> >>> >>>>>> +
>>> >> >>> >>>>>> layerlist.append(layerlistdir.rstrip("/"))
>>> >> >>> >>>>>> + else:
>>> >> >>> >>>>>> +
>>> >> >>> >>>>>> layerlist.append(localdirpath.rstrip("/"))
>>> >> >>> >>>>>> + break
>>> >> >>> >>>>>> + if len(layerlist) == 0:
>>> >> >>> >>>>>> + for gitlocal, localpath in
>>> >> >>> >>>>>> gitrepos.iteritems():
>>> >> >>> >>>>>> + for paths in localpath:
>>> >> >>> >>>>>> + if "bitbake" not in paths:
>>> >> >>> >>>>>> +
>>> >> >>> >>>>>> layerlist.append(layerlisturl +
>>> >> >>> >>>>>> "/"
>>> >> >>> >>>>>> + str(paths[1]))
>>> >> >>> >>>>>> +
>>> >> >>> >>>>>>
>>> >> >>> >>>>>> logger.debug("localhostbecontroller: current layer
>>> >> >>> >>>>>> list
>>> >> >>> >>>>>> %s "
>>> >> >>> >>>>>> % pformat(layerlist))
>>> >> >>> >>>>>>
>>> >> >>> >>>>>> diff --git a/
>>> >> >>> >>>>>>
>>> >> >>> >>>>>>
>>> bitbake/lib/toaster/bldcontrol/management/commands/loadconf.py
>>> >> >>> >>>>>>
>>> >> >>> >>>>>>
>>> b/bitbake/lib/toaster/bldcontrol/management/commands/loadconf.py
>>> >> >>> >>>>>> index 5022b59..a22f744 100644
>>> >> >>> >>>>>> ---
>>> >> >>> >>>>>>
>>> >> >>> >>>>>>
>>> a/bitbake/lib/toaster/bldcontrol/management/commands/loadconf.py
>>> >> >>> >>>>>> +++
>>> >> >>> >>>>>>
>>> >> >>> >>>>>>
>>> b/bitbake/lib/toaster/bldcontrol/management/commands/loadconf.py
>>> >> >>> >>>>>> @@ -45,12 +45,14 @@ class Command(BaseCommand):
>>> >> >>> >>>>>> for i in ['bitbake', 'releases', 'defaultrelease',
>>> >> >>> >>>>>> 'config',
>>> >> >>> >>>>>> 'layersources']:
>>> >> >>> >>>>>> assert i in data
>>> >> >>> >>>>>>
>>> >> >>> >>>>>> - def _read_git_url_from_local_repository(address):
>>> >> >>> >>>>>> + def _read_git_url_from_local_repository(address,
>>> path
>>> >> >>> >>>>>> =
>>> >> >>> >>>>>> None):
>>> >> >>> >>>>>
>>> >> >>> >>>>>
>>> >> >>> >>>>> If you want to pass in the path, please move the whole
>>> function
>>> >> >>> >>>>> outside
>>> >> >>> >>>>> _import_layer_config, as it's no longer a closure.
>>> >> >>> >>>>>
>>> >> >>> >>>>>
>>> >> >>> >>>>>>
>>> >> >>> >>>>>> url = None
>>> >> >>> >>>>>> + if not path:
>>> >> >>> >>>>>> + path = os.path.dirname(filepath)
>>> >> >>> >>>>>> # we detect the remote name at runtime
>>> >> >>> >>>>>> import subprocess
>>> >> >>> >>>>>> (remote, remote_name) = address.split(":", 1)
>>> >> >>> >>>>>> - cmd = subprocess.Popen("git remote -v",
>>> >> >>> >>>>>> shell=True,
>>> >> >>> >>>>>> cwd =
>>> >> >>> >>>>>> os.path.dirname(filepath), stdout=subprocess.PIPE, stderr =
>>> >> >>> >>>>>> subprocess.PIPE)
>>> >> >>> >>>>>> + cmd = subprocess.Popen("git remote -v",
>>> >> >>> >>>>>> shell=True,
>>> >> >>> >>>>>> cwd =
>>> >> >>> >>>>>> path, stdout=subprocess.PIPE, stderr = subprocess.PIPE)
>>> >> >>> >>>>>> (out,err) = cmd.communicate()
>>> >> >>> >>>>>> if cmd.returncode != 0:
>>> >> >>> >>>>>> logging.warning("Error while importing
>>> layer
>>> >> >>> >>>>>> vcs_url:
>>> >> >>> >>>>>> git error: %s" % err)
>>> >> >>> >>>>>> @@ -121,7 +123,11 @@ class Command(BaseCommand):
>>> >> >>> >>>>>> logger.error("Local layer path %s
>>> must
>>> >> >>> >>>>>> exists. Are you trying to import a layer that does not
>>> exist ?
>>> >> >>> >>>>>> Check your
>>> >> >>> >>>>>> local toasterconf.json" % lo.local_path)
>>> >> >>> >>>>>>
>>> >> >>> >>>>>> if
>>> >> >>> >>>>>> layerinfo['vcs_url'].startswith("remote:"):
>>> >> >>> >>>>>> - lo.vcs_url =
>>> >> >>> >>>>>> _read_git_url_from_local_repository(layerinfo['vcs_url'])
>>> >> >>> >>>>>> + if layerinfo['local_path'] not in
>>> >> >>> >>>>>> ["meta",
>>> >> >>> >>>>>> "meta-yocto", "meta-yocto-bsp"]:
>>> >> >>> >>>>>
>>> >> >>> >>>>>
>>> >> >>> >>>>> Please don't use hardcoded layer names anywhere in the code.
>>> >> >>> >>>>>
>>> >> >>> >>>>> We do not want special handling for some layers, all layers
>>> need
>>> >> >>> >>>>> to
>>> >> >>> >>>>> be
>>> >> >>> >>>>> treated in the same, uniform, way.
>>> >> >>> >>>>>
>>> >> >>> >>>>>
>>> >> >>> >>>>>> + repo_path =
>>> >> >>> >>>>>> layerinfo['local_path']
>>> >> >>> >>>>>> + else:
>>> >> >>> >>>>>> + repo_path = None
>>> >> >>> >>>>>> + lo.vcs_url =
>>> >> >>> >>>>>> _read_git_url_from_local_repository(layerinfo['vcs_url'],
>>> >> >>> >>>>>> repo_path)
>>> >> >>> >>>>>
>>> >> >>> >>>>>
>>> >> >>> >>>>> I think this code needs
>>> >> >>> >>>>>
>>> >> >>> >>>>>
>>> >> >>> >>>>>>
>>> >> >>> >>>>>> if lo.vcs_url is None:
>>> >> >>> >>>>>> logger.error("The toaster
>>> config
>>> >> >>> >>>>>> file
>>> >> >>> >>>>>> references the local git repo, but Toaster cannot detect
>>> >> >>> >>>>>> it.\nYour
>>> >> >>> >>>>>> local
>>> >> >>> >>>>>> configuration for layer %s is invalid. Make sure that the
>>> >> >>> >>>>>> toasterconf.json
>>> >> >>> >>>>>> file is correct." % layerinfo['name'])
>>> >> >>> >>>>
>>> >> >>> >>>>
>>> >> >>> >>>> A bit more explanation would help me move further to
>>> improvise
>>> >> >>> >>>> the
>>> >> >>> >>>> patch. If you don't mind please? So if I understand
>>> correctly a
>>> >> >>> >>>> separate
>>> >> >>> >>>> function should be there to handle HEAD branches provided by
>>> >> >>> >>>> toasterconf.json file, right?
>>> >> >>> >>>
>>> >> >>> >>>
>>> >> >>> >>>
>>> >> >>> >>> Yep, exactly my point.
>>> >> >>> >>>
>>> >> >>> >>> When inserting the Layer_Version objects for the "HEAD"
>>> branch,
>>> >> >>> >>> the
>>> >> >>> >>> Layer_Version.local_path should
>>> >> >>> >>>
>>> >> >>> >>> be set to the layer path.
>>> >> >>> >>>
>>> >> >>> >>> When checking out the layers in localhost bbcontroller, the
>>> >> >>> >>> checkout
>>> >> >>> >>> should be skipped at all times for "HEAD" branches; instead,
>>> the
>>> >> >>> >>> value in
>>> >> >>> >>> Layer_Version.local_path should be used.
>>> >> >>> >>
>>> >> >>> >>
>>> >> >>> >>
>>> >> >>> >> Is there a way to access local_path of toasterconf.json file
>>> from
>>> >> >>> >> localhostbecontroller.py file?
>>> >> >>> >
>>> >> >>> > I got the solution. I have modified local_path from "/" to the
>>> value
>>> >> >>> > in
>>> >> >>> > the
>>> >> >>> > configuration file in the database.
>>> >> >>> >
>>> >> >>> >
>>> >> >>> >>
>>> >> >>> >>
>>> >> >>> >>>
>>> >> >>> >>>
>>> >> >>> >>>
>>> >> >>> >>>>>>
>>> >> >>> >>>>>>
>>> >> >>> >>>>>> --
>>> >> >>> >>>>>> 1.9.1
>>> >> >>> >>>>>>
>>> >> >>> >>>>>> --
>>> >> >>> >>>>>> _______________________________________________
>>> >> >>> >>>>>> toaster mailing list
>>> >> >>> >>>>>> toaster at yoctoproject.org
>>> >> >>> >>>>>> https://lists.yoctoproject.org/listinfo/toaster
>>> >> >>> >>>>>
>>> >> >>> >>>>>
>>> >> >>> >>>>>
>>> >> >>> >>>>>
>>> >> >>> >>>>> --
>>> >> >>> >>>>> Alex Damian
>>> >> >>> >>>>> Yocto Project
>>> >> >>> >>>>> SSG / OTC
>>> >> >>> >>>>
>>> >> >>> >>>>
>>> >> >>> >>>>
>>> >> >>> >>>>
>>> >> >>> >>>> --
>>> >> >>> >>>> സുജിത് ഹരിദാസന്
>>> >> >>> >>>> Bangalore
>>> >> >>> >>>> <Project>Contributor to KDE project
>>> >> >>> >>>> http://fci.wikia.com/wiki/Anti-DRM-Campaign
>>> >> >>> >>>> <Blog> http://sujithh.info
>>> >> >>> >>>
>>> >> >>> >>>
>>> >> >>> >>>
>>> >> >>> >>>
>>> >> >>> >>> --
>>> >> >>> >>> Alex Damian
>>> >> >>> >>> Yocto Project
>>> >> >>> >>> SSG / OTC
>>> >> >>> >>
>>> >> >>> >>
>>> >> >>> >>
>>> >> >>> >>
>>> >> >>> >> --
>>> >> >>> >> സുജിത് ഹരിദാസന്
>>> >> >>> >> Bangalore
>>> >> >>> >> <Project>Contributor to KDE project
>>> >> >>> >> http://fci.wikia.com/wiki/Anti-DRM-Campaign
>>> >> >>> >> <Blog> http://sujithh.info
>>> >> >>> >
>>> >> >>> >
>>> >> >>> > --
>>> >> >>> > _______________________________________________
>>> >> >>> > toaster mailing list
>>> >> >>> > toaster at yoctoproject.org
>>> >> >>> > https://lists.yoctoproject.org/listinfo/toaster
>>> >> >>> >
>>> >> >>
>>> >> >>
>>> >> >>
>>> >> >>
>>> >> >> --
>>> >> >> സുജിത് ഹരിദാസന്
>>> >> >> Bangalore
>>> >> >> <Project>Contributor to KDE project
>>> >> >> http://fci.wikia.com/wiki/Anti-DRM-Campaign
>>> >> >> <Blog> http://sujithh.info
>>> >> >
>>> >> >
>>> >> >
>>> >> >
>>> >> > --
>>> >> > സുജിത് ഹരിദാസന്
>>> >> > Bangalore
>>> >> > <Project>Contributor to KDE project
>>> >> > http://fci.wikia.com/wiki/Anti-DRM-Campaign
>>> >> > <Blog> http://sujithh.info
>>> >
>>> >
>>> >
>>> >
>>> > --
>>> > സുജിത് ഹരിദാസന്
>>> > Bangalore
>>> > <Project>Contributor to KDE project
>>> > http://fci.wikia.com/wiki/Anti-DRM-Campaign
>>> > <Blog> http://sujithh.info
>>>
>>
>>
>>
>> --
>> സുജിത് ഹരിദാസന്
>> Bangalore
>> <Project>Contributor to KDE project
>> http://fci.wikia.com/wiki/Anti-DRM-Campaign
>> <Blog> http://sujithh.info
>>
>
>
>
> --
> സുജിത് ഹരിദാസന്
> Bangalore
> <Project>Contributor to KDE project
> http://fci.wikia.com/wiki/Anti-DRM-Campaign
> <Blog> http://sujithh.info
>
--
സുജിത് ഹരിദാസന്
Bangalore
<Project>Contributor to KDE project
http://fci.wikia.com/wiki/Anti-DRM-Campaign
<Blog> http://sujithh.info
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/toaster/attachments/20150909/0abb8766/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: config.tgz
Type: application/x-gzip
Size: 5621 bytes
Desc: not available
URL: <http://lists.yoctoproject.org/pipermail/toaster/attachments/20150909/0abb8766/attachment-0001.bin>
More information about the toaster
mailing list