I'll put things into perspective for you.
I once lost a World Cup TT (over 12.5 miles), by 0.4 of a second.
Now tell go back and tell me that even .1 of a watt won't make a difference. Or a few grams on a hilly course.
It's all about adding up those few grams here and few grams there, and reducing friction, etc wherever possible to ensure best possible performance. I obviously will concentrate on developing my power over the next three months, but don't want to give any time back because I didn't look at every aspect of the bike to make sure it was operating optimally.
I really DO need to get into a wind tunnel at some point. But it's a massive cost and there may only be a limited number of things I can check for aerodynamics.
I also ride the track (and won the World title in the Pursuit). I also have to prepare for that event - but that's all about power and aerodynamics and not weight.
Vittoria Crono tubs are fastest. You can't get anything faster that can be used on road.
I doubt removing seals from ceramic bearing would make any difference other than placebo.
I don't think you should put any efforts on decreasing weight, as you already have top notch bike. Many pro's are using bigger pulleys on rd, but then again, on paper the advantage gained from decreased drivetrain resistance would be 0.01w at the best.
You already have best wheelset for tt available. I don't think rebuilding to lighter hub/spokes would matter. Remember, than a proper finger placement can save 1-3w. Loosing 3w from drivetrain friction unless you have a completely dry chain with rusty sprockets is impossible. I'd say better try to find aero gains than loose weight on bike. Maybe a camelbak fairing on your back could do something, then again you shoud test that in windtunnel or if you have SRM, you can try to find gains on calm day on good roads.
Good luck in the Olympics