[yocto] setting up autobuilder on local machine

[Mirza Krak]

2016-12-19 16:48 GMT+01:00 Bryan Evenson <bevenson at melinkcorp.com>:
> Mirza,
>
>> -----Original Message-----
>> From: yocto-bounces at yoctoproject.org [mailto:yocto-
>> bounces at yoctoproject.org] On Behalf Of Mirza Krak
>> Sent: Monday, December 19, 2016 8:28 AM
>> To: Bill Randle <bill.randle at gmail.com>
>> Cc: yocto at yoctoproject.org
>> Subject: Re: [yocto] setting up autobuilder on local machine
>>
>> 2016-12-19 7:46 GMT+01:00 Mirza Krak <mirza.krak at gmail.com>:
>> > 2016-12-19 4:33 GMT+01:00 Bill Randle <bill.randle at gmail.com>:
>> >> On Sun, Dec 18, 2016 at 8:25 AM, Paul Barker <paul at paulbarker.me.uk>
>> wrote:
>> >>> On Sun, 18 Dec 2016 15:46:19 +0100
>> >>> Mirza Krak <mirza.krak at gmail.com> wrote:
>> >>>
>> >>>> Hi.
>> >>>>
>> >>>> I have been looking in to the possibility to utilize yocto autobuilder
>> >>>> for one of my own projects.
>> >>>>
>> >>>> But I am having some problems setting this up and hopefully someone
>> >>>> here can provide some pointers.
>> >>>>
>> >>>> I did the "quickstart part":
>> >>>>
>> >>>> git clone git://git.yoctoproject.org/yocto-autobuilder
>> >>>> cd yocto-autobuilder
>> >>>> . ./yocto-autobuilder-setup
>> >>>> yocto-start-autobuilder both
>> >>>>
>> >>>> Above succeeds without any issues. But now what? :)
>> >>>>
>> >>>> I went to https://localhost:8010. I tried to login using the
>> >>>> information that is in the .htpasswd file but that did not work. Where
>> >>>> are the credentials to login setup?
>> >>>
>> >>> You'll need to create the .htpasswd file yourself. I think the
>> >>> "htpasswd" tool can do this for you, I can't remember the exact
>> >>> commands I used to make mine though sorry.
>> >>>
>> >>>>
>> >>>> I also made an attempt to remove all un-wanted buildsets and now
>> >>>> buildset-config contains (all other directories are removed)
>> >>>>
>> >>>> nightly-mender-rpi.conf  yoctoAB.conf
>> >>>>
>> >>>> Above is parsed correctly on start-up but build is never triggered. I
>> >>>> probably removed to much :). Looking in to nigthly.conf it seem that
>> >>>> is the one that trigger all other nightly builds?
>> >>>>
>> >>>> My fork can be found at [1].
>> >>>>
>> >>>> [1]. https://github.com/mirzak/yocto-autobuilder-mender-rpi
>> >>>
>> >>> This looks good, you just need to setup the scheduler with something
>> >>> like this in nightly-mender-rpi.conf:
>> >>>
>> >>>     scheduler:
>> >>>     [{'nightly-build':{'type':'Nightly','hour':23,'minute':0}}]
>> >>>
>> >>> You should only need a separate nightly.conf when you want that to
>> >>> trigger multiple builds.
>> >>>
>> >>> I've recently setup an autobuilder for meta-raspberrypi which I'll be
>> >>> publishing once I've got the last bits of setup done. If you're still
>> >>> struggling to get the nightly triggering working let me know and I'll
>> >>> put up the configurations I've used as a git repository.
>> >>
>> >> There is also additional helpful information on the Yocto Autobuilder
>> >> wiki page here:
>> >> https://wiki.yoctoproject.org/wiki/The_Yocto_Autobuilder. Some of the
>> >> information applies to the Yocto Project build cluster, but is still
>> >> applicable to local autobuilders. I followed the same instructions to
>> >> setup a local AB. Be sure to use the htpasswd command that's in the
>> >> autobuilder git tree (in one of the bin directories, as I recall),
>> >> rather than a native system one. The AB version defaults to the
>> >> shorter crypto scheme that buildbot requires.
>> >
>> > Thank you for your fast responses. Generating the htpasswd file my
>> > self did the trick. Now I can login. The full command was (as you
>> > suggested I used the one in autobuilder git repo under ./bin):
>> >
>> >     ./htpasswd -b -c <path to htpasswd file> <user name> <secret
>> password>
>> >
>> > Forced a build of my configuration now and hoping for the best :).
>>
>> And it was not green all the way.
>>
>> I get an error that I do not get how to get around. The error message is:
>>
>> ERROR: Unable to parse
>> /home/mirzak/project/yocto-autobuilder/yocto-autobuilder-mender-
>> rpi/yocto-worker/nightly-mender-rpi/build/meta-mender/conf/layer.conf:
>> [Errno 2] file /home/mirzak/project/yocto-autobuilder/yocto-autobuilder-
>> mender-rpi/yocto-worker/nightly-mender-rpi/build/meta-
>> mender/conf/layer.conf
>> not found
>>
>> The error message I understand. But I do not understand why it adds
>> meta-mender to bblayers files. I did not tell it to do that, because
>> meta-mender contains layers that I want to include. Similar to
>> meta-openembedded (which is also added to bblayers).
>>
>> Here is the bblayers.conf also for reference:
>> mirzak at debian:~/project/yocto-autobuilder/yocto-autobuilder-mender-
>> rpi/yocto-worker/nightly-mender-rpi/build/build/conf$
>> cat bblayers.conf
>> POKY_BBLAYERS_CONF_VERSION =  "2"
>> BBPATH = "${TOPDIR}"
>> BBFILES ?=""
>> BBLAYERS += " \
>> /home/mirzak/project/yocto-autobuilder/yocto-autobuilder-mender-
>> rpi/yocto-worker/nightly-mender-rpi/build/meta
>> \
>> /home/mirzak/project/yocto-autobuilder/yocto-autobuilder-mender-
>> rpi/yocto-worker/nightly-mender-rpi/build/meta-poky
>> \
>> /home/mirzak/project/yocto-autobuilder/yocto-autobuilder-mender-
>> rpi/yocto-worker/nightly-mender-rpi/build/meta-yocto-bsp
>> \
>> /home/mirzak/project/yocto-autobuilder/yocto-autobuilder-mender-
>> rpi/yocto-worker/nightly-mender-rpi/build/meta-mender
>> \
>> /home/mirzak/project/yocto-autobuilder/yocto-autobuilder-mender-
>> rpi/yocto-worker/nightly-mender-rpi/build/oe-meta-go
>> \
>> /home/mirzak/project/yocto-autobuilder/yocto-autobuilder-mender-
>> rpi/yocto-worker/nightly-mender-rpi/build/meta-raspberrypi
>> \
>> /home/mirzak/project/yocto-autobuilder/yocto-autobuilder-mender-
>> rpi/yocto-worker/nightly-mender-rpi/build/meta-openembedded
>> \
>> /home/mirzak/project/yocto-autobuilder/yocto-autobuilder-mender-
>> rpi/yocto-worker/nightly-mender-rpi/build/meta-yocto
>> \
>> /home/mirzak/project/yocto-autobuilder/yocto-autobuilder-mender-
>> rpi/yocto-worker/nightly-mender-rpi/build/meta-mender/meta-mender-
>> core
>> \
>> /home/mirzak/project/yocto-autobuilder/yocto-autobuilder-mender-
>> rpi/yocto-worker/nightly-mender-rpi/build/meta-mender/meta-mender-
>> raspberrypi
>> \
>> /home/mirzak/project/yocto-autobuilder/yocto-autobuilder-mender-
>> rpi/yocto-worker/nightly-mender-rpi/build/meta-openembedded/meta-oe
>> \
>> "
>>
>> Can I disable the "magic" that added meta-mender and meta-
>> openembedded?
>
> Yes, you can.  I just ran into this problem the other week when I updated my autobuilder.  Add 'autoinclude':False to your layer definition in the "repos" section in your build configuration file.  For example, in one of my build configurations I have:
>
>         {'meta-openembedded':
>             {'autoinclude':False, 'repourl':'git://git.openembedded.org/meta-openembedded',
>              'branch':'fido'}},
>
> Here's the patch description further describing what the autoinclude option does: http://git.yoctoproject.org/cgit/cgit.cgi/yocto-autobuilder/commit/?id=1599d458ec078378438aeb011ed706a4474b10a6.

Thanks a lot Bryan. This is exactly what I was looking for.

Best Regards
Mirza