Yep, martin's comments are pretty spot on.
Your recovery rides from the earlier hard rides in the a.m. will definitely suffice for increasing adaption and aiding recovery.
Your friday ride is described as 'hilly ride or ...'
But a hilly ride can be short sharp 300m hill climbs completed in under 1min even at 8-10% without too much stress. Or a hilly ride could be 1-2k climbs every 5k. The description isn't conclusive to understand the training stress. But, the statement after does give a good indication of the level of intensity your aiming at (i.e. vo2max intervals)
So, odds are your 'hilly' friday ride might need more training stress, or your v02max intervals may not be hard enough? But it is very hard to say without hr, watts, and rpe info...
If it is indeed a 120min ride, and your only getting in 15mins total of full on proper vo2max intervals, then it probably needs a little more time at or just below v02.
If you can add in 2 intervals, at lactate threshold, or just slightly above, of 6-8 mins each (as in, lead in intervals, before the sets of 3 and 2 min intervals), then it will both aid you in more efficient training time, and also help you complete the harder 3 and 2 min intervals more effectively.
The first interval would be at the same intensity as your monday am lactate threshold interval. i.e. your pushing but not hurting. Make it 6-8mins.
The second interval is the same as the first, but you should feel like it is easier, even though your going faster relative to the first interval.
Follow these 2 with a 10min break (with about 5 mins between the 2 intervals).
As Martin asked, is your sunday ride 5-6 hours?
If so, your monday am workout will be subpar, and won't elicit any great adaption due to fatigue.
If you make the monday am workout a 60min or less recovery ride, and the monday pm ride a 90min or so, 2x20min lactate threshold workout, then you would be better off.
My suggestion for your wednesday ride is different from Martin's though. I'd suggest a workout of lots of jumps, or multiple surge sprints, or a few full sprints, or a combination of all 3.
It builds neuromuscular power, but it also helps elicits a very good change in regards to vo2max level power (due to increased lactate capacity, as well as increased adaption and hypertrophy within the recruited fast twitch muscle fibres used in both sprints and sub 5min intervals).
As indicated though, although you may not need a power meter to judge the level of effort needed for your intervals, a power meter does make it easy to quantify your training results, and see improvement.
There are very few who can judge intervals by pure RPE without several years of understanding of how their body reacts. And a power meter is a quick way of making someone understand the physiology of how to train above lactate threshold.
You don't need a $2000+ srm. A pro level powertap with a decent ant+ computer will definately help you (powertap pro built up training wheel is around $1000, with the computer 200-300 depending on chosen model).
I would say that give your current estimated power, and training load, your a prime candidate for a power meter.
It really does help alot with training quantitatively