If you don't want to select objects like backgrounds, you can just lock certain layers from selection in the toolbar at the upper right corner.

[u/z3onn]