I’ve found the ‘solution’, I think.
When I cut up my on-camera sound en throw away some pieces it can’t merge anymore in some strange way. Even when I only cut it with the razor tool and don’t delete it. But when I delete the whole original track, or use only one part (the whole or a chunk) it can merge with different audio tracks…
I find it a little weird, but thanks for the help!