The clause let's not talk about the view could by itself be neutral or even positive given the right context (e.g., I've never seen such a fancy hotel room, my living room doesn't look that cool... and let's not talk about the view).
the contrast relation signaled by the connective but makes it clear that the second clause has a negative polarity.