[Toaster] python3 issues

[Barros Pena, Belen]

I was asked to look at the branch that makes sure Toaster works with
python 3

http://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/log/?h=ed/oe/python3

I've found a few issues. I am not a 100% sure if they are this branch only
or if they also happen in master (python3 changes apparently have been
merged), but I thought I'd share early. Here comes the list:

* We need to remove old releases from toasterconf.json, since the change
to Python 3 means we can no longer support those. Ed is already on the
case, I believe

* Image artifact downloads don't seem to be working (all other artifacts
are fine)

Environment:


Request Method: GET
Request URL: 
http://icarus.isw.intel.com:8000/toastergui/build/4/artifact/imagefile/id/1

Django Version: 1.8.13
Python Version: 3.4.3
Installed Applications:
('django.contrib.auth',
 'django.contrib.contenttypes',
 'django.contrib.messages',
 'django.contrib.sessions',
 'django.contrib.admin',
 'django.contrib.staticfiles',
 'django.contrib.humanize',
 'bldcollector',
 'toastermain',
 'bldcontrol',
 'orm',
 'toastergui')
Installed Middleware:
('django.middleware.common.CommonMiddleware',
 'django.contrib.sessions.middleware.SessionMiddleware',
 'django.middleware.csrf.CsrfViewMiddleware',
 'django.contrib.auth.middleware.AuthenticationMiddleware',
 'django.contrib.messages.middleware.MessageMiddleware')


Traceback:
File 
"/home/belen/.local/lib/python3.4/site-packages/django/core/handlers/base.p
y" in get_response
  132.                     response = wrapped_callback(request,
*callback_args, **callback_kwargs)
File "/home/belen/toaster-python3/bitbake/lib/toaster/toastergui/views.py"
in build_artifact
  2991.                 response = HttpResponse(fsock, content_type =
content_type)
File 
"/home/belen/.local/lib/python3.4/site-packages/django/http/response.py"
in __init__
  342.         self.content = content
File 
"/home/belen/.local/lib/python3.4/site-packages/django/http/response.py"
in content
  363.             value = b''.join(self.make_bytes(chunk) for chunk in
value)
File 
"/home/belen/.local/lib/python3.4/site-packages/django/http/response.py"
in <genexpr>
  363.             value = b''.join(self.make_bytes(chunk) for chunk in
value)
File "/usr/lib/python3.4/codecs.py" in decode
  319.         (result, consumed) = self._buffer_decode(data, self.errors,
final)

Exception Type: UnicodeDecodeError at
/toastergui/build/4/artifact/imagefile/id/1
Exception Value: 'utf-8' codec can't decode byte 0xdb in position 1032:
invalid continuation byte

==============================================================

* Filters in the tasks page (build information) don't seem to be working.
All of them return an error

Environment:


Request Method: GET
Request URL: 
http://icarus.isw.intel.com:8000/toastergui/build/4/tasks/?orderby=order%3A
%2B&count=25&filter=task_executed%3A1&page=1&search=

Django Version: 1.8.13
Python Version: 3.4.3
Installed Applications:
('django.contrib.auth',
 'django.contrib.contenttypes',
 'django.contrib.messages',
 'django.contrib.sessions',
 'django.contrib.admin',
 'django.contrib.staticfiles',
 'django.contrib.humanize',
 'bldcollector',
 'toastermain',
 'bldcontrol',
 'orm',
 'toastergui')
Installed Middleware:
('django.middleware.common.CommonMiddleware',
 'django.contrib.sessions.middleware.SessionMiddleware',
 'django.middleware.csrf.CsrfViewMiddleware',
 'django.contrib.auth.middleware.AuthenticationMiddleware',
 'django.contrib.messages.middleware.MessageMiddleware')


Traceback:
File 
"/home/belen/.local/lib/python3.4/site-packages/django/core/handlers/base.p
y" in get_response
  132.                     response = wrapped_callback(request,
*callback_args, **callback_kwargs)
File "/home/belen/toaster-python3/bitbake/lib/toaster/toastergui/views.py"
in tasks
  1263.     return tasks_common(request, build_id, 'tasks', '')
File "/home/belen/toaster-python3/bitbake/lib/toaster/toastergui/views.py"
in tasks_common
  1066.         queryset = _get_queryset(Task, queryset_all,
filter_string, search_term, ordering_string, 'order')
File "/home/belen/toaster-python3/bitbake/lib/toaster/toastergui/views.py"
in _get_queryset
  354.         filter_query = _get_filtering_query(filter_string)
File "/home/belen/toaster-python3/bitbake/lib/toaster/toastergui/views.py"
in _get_filtering_query
  271.             x = __get_q_for_val(k, val)

Exception Type: NameError at /toastergui/build/4/tasks/
Exception Value: name 'k' is not defined

========================================================


* The variables table returns an error

Environment:


Request Method: GET
Request URL: 
http://icarus.isw.intel.com:8000/toastergui/build/4/configvars?orderby=vari
able_name%3A%2B&page=1&filter=description__regex%3A.%2B&count=100

Django Version: 1.8.13
Python Version: 3.4.3
Installed Applications:
('django.contrib.auth',
 'django.contrib.contenttypes',
 'django.contrib.messages',
 'django.contrib.sessions',
 'django.contrib.admin',
 'django.contrib.staticfiles',
 'django.contrib.humanize',
 'bldcollector',
 'toastermain',
 'bldcontrol',
 'orm',
 'toastergui')
Installed Middleware:
('django.middleware.common.CommonMiddleware',
 'django.contrib.sessions.middleware.SessionMiddleware',
 'django.middleware.csrf.CsrfViewMiddleware',
 'django.contrib.auth.middleware.AuthenticationMiddleware',
 'django.contrib.messages.middleware.MessageMiddleware')


Traceback:
File 
"/home/belen/.local/lib/python3.4/site-packages/django/core/handlers/base.p
y" in get_response
  132.                     response = wrapped_callback(request,
*callback_args, **callback_kwargs)
File "/home/belen/toaster-python3/bitbake/lib/toaster/toastergui/views.py"
in configvars
  1419.     queryset = _get_queryset(Variable, queryset, filter_string,
search_term, ordering_string, 'variable_name')
File "/home/belen/toaster-python3/bitbake/lib/toaster/toastergui/views.py"
in _get_queryset
  354.         filter_query = _get_filtering_query(filter_string)
File "/home/belen/toaster-python3/bitbake/lib/toaster/toastergui/views.py"
in _get_filtering_query
  271.             x = __get_q_for_val(k, val)

Exception Type: NameError at /toastergui/build/4/configvars
Exception Value: name 'k' is not defined

===========================================

* In the custom image details page, the add | remove filter is not
working: the filtering does not happen

* The all projects table is showing builds in progress information (builds
in progress information should not appear in any tables)

* My builds for custom images don't seem to be working. I start them, but
I never see any progress in the UI. The toaster_ui.log doesn't show them
at all, so I am kind of confused.

I think that's it so far.

Cheers

Belén