Sometimes it is an error message even though no duel invite sent to you, i keep getting it all the time from my friend and i asked him if it's true, to which he confirmed saying he didn't send anything.
If they did send a challenge though, go to PvP Arena and go to friend duels, select whoever friend that sent you a challenge and choose send challenge back.