Hey -- I was there on Monday. If you stay on the berm all the way to the road the fence is often open when they are paving. So instead of dropping down onto the access road, just stay on the berm until you get to the fence. If it's open, go out onto the main road and turn left. I don't think the pavers care about bikes as long as you stay off the access road. (In other words, stay on the berm)
There is also a way off the berm and out toward the Interstate near the dam/bridge above the Trout Creek parking lot. It's a little trickier to find, but it's there. If you find it, turn left at the end of the trail (it's not much of a trail) and then ride until you hit Morris Bridge Road.
The easiest thing to do, I guess, is to park in the Morris Bridge parking lot or the Flatwoods parking lot and avoid the Hole in the Fence and Trout Creek parking lot altogether.