Disabling Audio Unit plugin detection

Hello! I use a ton AU plugins for Ableton, but I don’t need them in djay. I’m worried they’re causing performance hiccups. Is there a way to disable them completely?