[Toaster] Testcases for 9808

Thu Aug 11 06:14:44 PDT 2016

Hi Libertad,

Thanks for writing these test cases. Some comments inline.

Cheers

Belén

On 05/08/2016 15:12, "toaster-bounces at yoctoproject.org on behalf of Cruz,
Libertad" <toaster-bounces at yoctoproject.org on behalf of
libertad.cruz at intel.com> wrote:

>Hello,
>
>I propose the following testcases for bug
>Bug 9808 - Create selenium tests for project dashboard page.
><https://bugzilla.yoctoproject.org/show_bug.cgi?id=9808http://>Any
>comments and feedback will be highly appreciated.
>
>
>
>https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=1514

I am not sure what you mean by "Check that the page has the project name
given in a upper right hand label in bold font." What I guess we should
check is that the page h1 is set to the name the user typed in the new
project form. 

>
>https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=1515

Just a small clarification about the expected results. For "Expected
Result step 4: All elements are clickable and show information." please
keep in mind that when creating a project using the "Local Yocto Project"
release, the only compatible metadata page that will contain information
is the "layers" one. The image recipes, software recipes, and machines
pages will be empty. The image recipes and software recipes tables will be
populated as you run builds, but the machines table will remain empty,
since we don't have a way to "discover" machines through the build
process. 

The "custom images" page will of course be empty until you create a custom
image. 

>
>https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=1516

We might want to add the following to the expected results:

* A machine must always be set

* The default layers specified in the Toaster configuration must always be
listed in the layers section (in our case, for the poky configuration we
should have openembedded-core, meta-poky and meta-yocto-bsp. For the OE
configuration, just openembedded-core).

* If more than one release is specified in the Toaster configuration, the
selected release information should appear in the project configuration
page. If only one release is specified in the Toaster configuration, the
release information should not appear in the project configuration page.

>
>https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=1517

As I mentioned above, a machine must always be set.

We should also create a test case for changing the project machine, if we
don't currently have one.

>
>https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=1518

Just an explanation of how that list is generated. It should include a
maximum of 5 recipes, the 5 that have been built most often in the
project, sorted in descending order (the most built recipe at the top).
When 2 recipes have been built the same number of times, we show them in
alphabetical order (a to z).

If no checkbox is selected, the build button must be disabled. If one ore
more checkboxes are selected, the build button must be enabled.

>
>https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=1519

As mentioned before, if more than one release is specified in the Toaster
configuration, the selected release information should appear in the
project configuration page. If only one release is specified in the
Toaster configuration, the release information should not appear in the
project configuration page.

>
>https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=1520

A few comments about the layers section:

* The list of layers shown depends on the loaded configuration. If you
load the poky configuration, the layers will be as specified in the test
case. If you load the openembedded configuration, the only layer listed
will be openembedded-core

* When you remove a layer from the project by clicking on the trash icon,
the layer should disappear from the list and a notification should appear
at the top of the page saying: "You have removed 1 layer from your
project: layer_name". The layer_name should be a link to the corresponding
layer details page. The layers counter next to the "layers" heading should
decrease by one. 

* If you remove all the layers from a project, a custom message should be
displayed saying:

"This project has no layers.
In order to build this project you need to add some layers first. For that
you can: 

* Choose from the layers compatible with this project
* Import a layer
* Read about layers in the documentation
* Or type a layer name below"

The "Choose from the layers compatible with this project" link should go
to the compatible layers page
The "Import a layer" link should go to the import layer page
The "Read about layers in the documentation" link should open in a new
window and bring you to
http://www.yoctoproject.org/docs/current/dev-manual/dev-manual.html#underst
anding-and-creating-layers

Also, when you delete all the layers from a project:

1. The input field in the top right hand corner should be disabled
2. The build button in the top right hand corner should be disabled
3. All checkboxes in the "most built recipes" section should be disabled.
4. All labels in the "most built recipes" section should have the class
text-muted applied and the cursor set to "not-allowed"
5. The "build selected recipes" button should be disabled

When you add a layer back, the custom message should go away, and also:

1. The input field in the top right hand corner should be enabled
2. All checkboxes in the "most build recipes" section should be enabled
3. We should remove the class text-muted and the not-allowed cursor from
the labels in the "most built recipes" section

* The "View compatible layers" link should go to the layers page
* The "Import layer" link should go to the import layer page

We might need a separate test case to cover the behaviour of the "add
layers" functionality, if we don't have one already. We might also
consider splitting the remove layer functionality into a separate test
case. 

>
>https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=1521
>
>https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=1522

It might be worth detailing the behaviour of the build form.

* The build button should be disabled whenever the text input field is
empty, so that you cannot start a build with a blank target

* Whenever there is information in the image recipes and software recipes
tables, the text input field should present suggestions from the list of
recipes provided by the layers in the "layers" list. The suggestions
contain the string typed in the input field, and update as you type. They
appear on typing the second character. A maximum of 8 suggestions can be
shown. They are sorted as follows: first recipes starting with the string,
in alphabetical order; then recipes containing the string, also in
alphabetical order.

* When you click the build button you are brought to the "Builds" tab, and
a new build in progress appears at the top of the "Latest project builds"
section

>
>https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=1523
>
>https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=1524
>
>https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=1525

>From talking to Michael, these pages (builds, import layer and new custom
image) were not included in the scope of 9808. So we might not need these
3 test cases.

>
>
>
>
>Best Regards
>Libertad G.
>
>