Moved out of Sydney 4 years ago, opted for early retirement. When I do have to drive back down ( as little as possible) its a great road trip until you get to Pennant Hills Rd or Pacific Highway then the stress goes up.
It feels great when you do leave. Sad thing is all the Govt money is being spent on roads etc with very little hitting the regional areas, never really gave that too much thought until we moved to a regional town. Makes you look at things a tad differently now.
I'm at Lake Cathie just south of you Muffstar - i left Sydney 30 years ago - my family all stayed and every time i visited i could see that it had become a litle bit dirtier, more overcrowded and just not the place i remembered. I only get down there once or twice a year now and thats plenty for me. And you're right about the drive - quite relaxing until you hit Pennant Hills rd - what a goat track that is.