[yocto] setting up autobuilder on local machine

[Bryan Evenson]

Mirza,

> -----Original Message-----
> From: yocto-bounces at yoctoproject.org [mailto:yocto-
> bounces at yoctoproject.org] On Behalf Of Mirza Krak
> Sent: Monday, December 19, 2016 8:28 AM
> To: Bill Randle <bill.randle at gmail.com>
> Cc: yocto at yoctoproject.org
> Subject: Re: [yocto] setting up autobuilder on local machine
> 
> 2016-12-19 7:46 GMT+01:00 Mirza Krak <mirza.krak at gmail.com>:
> > 2016-12-19 4:33 GMT+01:00 Bill Randle <bill.randle at gmail.com>:
> >> On Sun, Dec 18, 2016 at 8:25 AM, Paul Barker <paul at paulbarker.me.uk>
> wrote:
> >>> On Sun, 18 Dec 2016 15:46:19 +0100
> >>> Mirza Krak <mirza.krak at gmail.com> wrote:
> >>>
> >>>> Hi.
> >>>>
> >>>> I have been looking in to the possibility to utilize yocto autobuilder
> >>>> for one of my own projects.
> >>>>
> >>>> But I am having some problems setting this up and hopefully someone
> >>>> here can provide some pointers.
> >>>>
> >>>> I did the "quickstart part":
> >>>>
> >>>> git clone git://git.yoctoproject.org/yocto-autobuilder
> >>>> cd yocto-autobuilder
> >>>> . ./yocto-autobuilder-setup
> >>>> yocto-start-autobuilder both
> >>>>
> >>>> Above succeeds without any issues. But now what? :)
> >>>>
> >>>> I went to https://localhost:8010. I tried to login using the
> >>>> information that is in the .htpasswd file but that did not work. Where
> >>>> are the credentials to login setup?
> >>>
> >>> You'll need to create the .htpasswd file yourself. I think the
> >>> "htpasswd" tool can do this for you, I can't remember the exact
> >>> commands I used to make mine though sorry.
> >>>
> >>>>
> >>>> I also made an attempt to remove all un-wanted buildsets and now
> >>>> buildset-config contains (all other directories are removed)
> >>>>
> >>>> nightly-mender-rpi.conf  yoctoAB.conf
> >>>>
> >>>> Above is parsed correctly on start-up but build is never triggered. I
> >>>> probably removed to much :). Looking in to nigthly.conf it seem that
> >>>> is the one that trigger all other nightly builds?
> >>>>
> >>>> My fork can be found at [1].
> >>>>
> >>>> [1]. https://github.com/mirzak/yocto-autobuilder-mender-rpi
> >>>
> >>> This looks good, you just need to setup the scheduler with something
> >>> like this in nightly-mender-rpi.conf:
> >>>
> >>>     scheduler:
> >>>     [{'nightly-build':{'type':'Nightly','hour':23,'minute':0}}]
> >>>
> >>> You should only need a separate nightly.conf when you want that to
> >>> trigger multiple builds.
> >>>
> >>> I've recently setup an autobuilder for meta-raspberrypi which I'll be
> >>> publishing once I've got the last bits of setup done. If you're still
> >>> struggling to get the nightly triggering working let me know and I'll
> >>> put up the configurations I've used as a git repository.
> >>
> >> There is also additional helpful information on the Yocto Autobuilder
> >> wiki page here:
> >> https://wiki.yoctoproject.org/wiki/The_Yocto_Autobuilder. Some of the
> >> information applies to the Yocto Project build cluster, but is still
> >> applicable to local autobuilders. I followed the same instructions to
> >> setup a local AB. Be sure to use the htpasswd command that's in the
> >> autobuilder git tree (in one of the bin directories, as I recall),
> >> rather than a native system one. The AB version defaults to the
> >> shorter crypto scheme that buildbot requires.
> >
> > Thank you for your fast responses. Generating the htpasswd file my
> > self did the trick. Now I can login. The full command was (as you
> > suggested I used the one in autobuilder git repo under ./bin):
> >
> >     ./htpasswd -b -c <path to htpasswd file> <user name> <secret
> password>
> >
> > Forced a build of my configuration now and hoping for the best :).
> 
> And it was not green all the way.
> 
> I get an error that I do not get how to get around. The error message is:
> 
> ERROR: Unable to parse
> /home/mirzak/project/yocto-autobuilder/yocto-autobuilder-mender-
> rpi/yocto-worker/nightly-mender-rpi/build/meta-mender/conf/layer.conf:
> [Errno 2] file /home/mirzak/project/yocto-autobuilder/yocto-autobuilder-
> mender-rpi/yocto-worker/nightly-mender-rpi/build/meta-
> mender/conf/layer.conf
> not found
> 
> The error message I understand. But I do not understand why it adds
> meta-mender to bblayers files. I did not tell it to do that, because
> meta-mender contains layers that I want to include. Similar to
> meta-openembedded (which is also added to bblayers).
> 
> Here is the bblayers.conf also for reference:
> mirzak at debian:~/project/yocto-autobuilder/yocto-autobuilder-mender-
> rpi/yocto-worker/nightly-mender-rpi/build/build/conf$
> cat bblayers.conf
> POKY_BBLAYERS_CONF_VERSION =  "2"
> BBPATH = "${TOPDIR}"
> BBFILES ?=""
> BBLAYERS += " \
> /home/mirzak/project/yocto-autobuilder/yocto-autobuilder-mender-
> rpi/yocto-worker/nightly-mender-rpi/build/meta
> \
> /home/mirzak/project/yocto-autobuilder/yocto-autobuilder-mender-
> rpi/yocto-worker/nightly-mender-rpi/build/meta-poky
> \
> /home/mirzak/project/yocto-autobuilder/yocto-autobuilder-mender-
> rpi/yocto-worker/nightly-mender-rpi/build/meta-yocto-bsp
> \
> /home/mirzak/project/yocto-autobuilder/yocto-autobuilder-mender-
> rpi/yocto-worker/nightly-mender-rpi/build/meta-mender
> \
> /home/mirzak/project/yocto-autobuilder/yocto-autobuilder-mender-
> rpi/yocto-worker/nightly-mender-rpi/build/oe-meta-go
> \
> /home/mirzak/project/yocto-autobuilder/yocto-autobuilder-mender-
> rpi/yocto-worker/nightly-mender-rpi/build/meta-raspberrypi
> \
> /home/mirzak/project/yocto-autobuilder/yocto-autobuilder-mender-
> rpi/yocto-worker/nightly-mender-rpi/build/meta-openembedded
> \
> /home/mirzak/project/yocto-autobuilder/yocto-autobuilder-mender-
> rpi/yocto-worker/nightly-mender-rpi/build/meta-yocto
> \
> /home/mirzak/project/yocto-autobuilder/yocto-autobuilder-mender-
> rpi/yocto-worker/nightly-mender-rpi/build/meta-mender/meta-mender-
> core
> \
> /home/mirzak/project/yocto-autobuilder/yocto-autobuilder-mender-
> rpi/yocto-worker/nightly-mender-rpi/build/meta-mender/meta-mender-
> raspberrypi
> \
> /home/mirzak/project/yocto-autobuilder/yocto-autobuilder-mender-
> rpi/yocto-worker/nightly-mender-rpi/build/meta-openembedded/meta-oe
> \
> "
> 
> Can I disable the "magic" that added meta-mender and meta-
> openembedded?

Yes, you can.  I just ran into this problem the other week when I updated my autobuilder.  Add 'autoinclude':False to your layer definition in the "repos" section in your build configuration file.  For example, in one of my build configurations I have:

        {'meta-openembedded':
            {'autoinclude':False, 'repourl':'git://git.openembedded.org/meta-openembedded',
             'branch':'fido'}},

Here's the patch description further describing what the autoinclude option does: http://git.yoctoproject.org/cgit/cgit.cgi/yocto-autobuilder/commit/?id=1599d458ec078378438aeb011ed706a4474b10a6.

Regards,
Bryan


> 
> Best Regards
> Mirza
> --
> _______________________________________________
> yocto mailing list
> yocto at yoctoproject.org
> https://lists.yoctoproject.org/listinfo/yocto