How can I access the colours that the user has set for the start screen like how the settings app changes the background of the left panel accordingly.
Or is this only possible with the built in apps?
This is not possible. Apps (including built in apps) use their own branded colours.
Settings isn't an app but is part of the OS itself.
--Rob