The core problem here is that large-scale PV farms will always compete for sunlight with equally or more needed environmental uses. Land in densely populated places that is not used for housing is used for farming, and what is not used for farming is used for recreation and nature reserves.
This was precisely the point of recent protests against a PV farm in Kent where they essentially wanted to cover 7 ha of meadows and forest with PV panels.