For whirlpool hops, you don't have to worry about increasing the IBUs since the alpha acids are barely soluble in their natural state, and contribute bitterness only by being continually boiled.

For late additions, since these are boiled, then the usual IBU formulae can be used. John Palmer gives Tinseth's formula and computed values for a variety of times and SGs. There's also a discussion of the formula from 'Designing Great Beers' by Ray Daniels here on HB stackexchange. For additions less than 10 minutes, 0.06 utilization is assumed. (The link gives the formula so you can compensate also for gravity if above 1.050.)

But as the OP mentions, none of the formulae are accurate. They are best used as a rough guide, which you then refine by inspection of the final result, and adjusting the amount of late additions accordingly. One thing to bear in mind is that it's believed that utilization decreases as more hop mass is added, but the current formulae don't take this into account.

Links:

• Hop Bittering Calculations, ch. 5, "How to Brew", John Palmer
• Beer calculators and batch/boil size with late fermentable additions, Homebrew Stackexchange

For whirlpool hops, you don't have to worry about increasing the IBUs since the alpha acids are barely soluble in their natural state, and contribute bitterness only by being continually boiled.

For late additions, since these are boiled, then the usual IBU formulae can be used. John Palmer gives Tinseth's formula and computed values for a variety of times and SGs. There's also a discussion of the formula from 'Designing Great Beers' by Ray Daniels here on HB stackexchange. For additions less than 10 minutes, 0.06 utilization is assumed. (The link gives the formula so you can compensate also for gravity if above 1.050.)

But as the OP mentions, none of the formulae are accurate. They are best used as a rough guide, which you then refine by inspection of the final result, and adjusting the amount of late additions accordingly. One thing to bear in mind is that it's believed that utilization decreases as more hop mass is added, but the current formulae don't take this into account.

Links:

• Hop Bittering Calculations, ch. 5, "How to Brew", John Palmer
• Beer calculators and batch/boil size with late fermentable additions, Homebrew Stackexchange