Fix entirely broken config mechanism

This patch fixes various problems of the image. Starting by the config
location, the removal of unneeded source code files and creating the
configuration files in the actual system locations instead of randomly
on the filesystem.

This should make sure that the container image can successfully built
and published again. While I'm still a bit puzzled on why it worked in
first place.