At that point I would reverse the whole shot. Getting it to land in an ordered fashion is possible, but would require adding new particles to the target emitter and that seems overkill.
In the setup below, we’re still using the xpInherit but it’s in reverse. Since the Particles on the plane have zero velocity, the xpInherit won’t actually start blending the two until they are moving, so I just nudge them in to life using the xpSpeed mod and the Linear Field. I addeed some Turbulence that has it’s Strength Mapped to the distance travelled so it eases in.
I cached it so I could easily reverse it using a negative playback Scale but you could also just reverse it in Post.