You have to remove the lower passenger side cover and then the glove box (watch out for the tabs breaking) You will also want to remove the center radio/ ECC to open up the area in order to get to the one screw on the back of the narrow part that runs under the vents. There are four screws total that hold the longer wood strip. Small nuts (8mm or so) are screwed onto screws that are mounted into the wood and are easy to get off, generally you can spin them off if you can get your hand up in there.
You will also want to remove the small piece on the drivers side so you can resurface it in the same way. I suspect that one is also faded if the other is.
Let us know how it goes.