To be fair, it's not like the Unknown Duelist is a person in a costume. It's a digital avatar. The person it belongs to is much shorter and... Less chesty than that. So it could realistically belong to anyone. (We only know who it belongs to because it references the DSoD movie.)