Co-authored-by: Nick Jüttner <nick@juni.io>

This is based off the work found in #1307 that was never merged. It
moves around the install and copy of certain conponents to take better
advantage of the Docker cache ad well as drops running tests during the
build of the image.

The reason for dropping tests is to improve build time and as running
tests within the build while they're already being run in CI seems like
an unnecessary added tax.
Signed-off-by: Danny Grove <danny@drgrovellc.com>

* Move into kubernetes-sigs organization

* Disable labeler action for forks

Signed-off-by: njuettner <nick@zalando.de>