So, autoplay only removes played songs in Queue. If you choose autoplay in a playlist, you are risking the same song being played more than once.
Does this make any sense? Autoplay should NEVER repeat songs, no matter if you are autoplaying from a playlist or from the queue.
This is a bug and needs fixed asap.