So to replicate your position on a 54 Aspero you would need a 100mm, 7°angle stem (stock Easton ones come with this angle) with 32mm of spacers (10mm headset cap + 22mm) and a 20mm offseatpost. That sounds good.
However, with your saddle height you would only have about 7cm of exposed seatpost (+/- 1-2cm depending on the stack of your saddle), which is not ideal to flex enough to absorb vibrations.
On a 51 Aspero, you would need a 120mm, 7°angle stem with 50mm of spacers (that's the maximum you can do: 10mm headset cap + 40mm) with a 20mm offset seatpost. That's a lot of spacers, but on this one you'd have 10cm of exposed seatpost (+/- 1-2 cm) which is still not amazing but better.
As you can see, choosing a size is not straightforward at all, there's a 20mm difference in stem length while the reach of the frame is only dropping by 9mm from size 54 to size 51!
So, if you don't mind the spacers, I would go for a 51 Aspero without any hesitation. And you could gradually experience a racier position by lowering the stem.
Just take into account that every 10mm spacer that you remove will add 3mm of reach. So if you end up removing 30mm of spacers you'd have to switch to a 110mm stem.
I hope it was clear enough and not needlessly complicated