I'm sure I read somewhere that Neil said ages ago that he's like to remove success (and I'm assuming he meant commercial success) as a motivator or a requirement for what he did.
If you look at everything he's done since 1994, you could reason that everything is a different turn on the previous work. I think there have been some super things. The thing I am least interested in is Intriguer - for me it was probably too pop. I like that I don't know what he will do next and he keeps us all guessing - what bets for a musical with Tim next?
If you don't like Light sleeper, I'd say your either not giving it a fair listen or to be harder, you just don't want to. Its one of those records that flows smoothly from start to end - usually the hallmark of a very decent record.