how do i make vanilla mobs forced to be passive to the player in some cases (like holding a item)

so, this is extremely specific, but how do you do this? the set attack targeting to none in procedures+ wouldnt do it, as they would completely stop attacking anything, also is it possible to do this with other mobs if they have something? i would assume