How to make all vanilla mob scared of player for a limited time if an advancement is made

You can add an 'avoid entity of type player' to the creature's AI. Then for the start/continue condition, make it check if a player exists in a certain range, and if the player has that advancement. (If you want it to be exclusively after gaining that advancement, you could add a custom status effect that does the same thing.)