Insertion loss does not care about whether a good power match is present at the other end. It is general.

Insertion loss assumes that you already have a circuit and you insert something into it. Typically a two port component. The ratio of the powers at the desired point in the system is the insertion loss.