If the caulk is just for appearances and not part of waterproofing, I’d do my first coat of primer/paint and then re-evaluate. You may not need as much caulking as you think.