At the moment, Silent Magician can perform slightly better than Silent Swordsman in the game. Silent Magician has Spellbooks for a reliable draw engine as well as field control. Silent Swordsman has no favourable archetype just yet. Amazoness might help, but not much with its banlist limitations. Basically it’s a bit harder to draw Silent Swordsman in early game compared to Silent Magician as for now. Also, Silent Swordsman has to rely on that only two copies of SSS to perform well. Silent Swordsman attack buff is tempting but it can be easily removed with Canadia if SSS is not available at hand. LV7 Swordsman literally kills all your spell cards, rendering backrow removals like CC, GC and Night Beam useless. Nonetheless, Silent Swordsman would definitely make a fun and competitive deck but think carefully before investing in that card.
If you're that worried about backrow while using Silent Swordsman, you could always just use cards like Xing Zhen Hu or Dust Tornado... (Even something like Seven Tools or Trap Jammer would probably work, lol.) Granted, they're slower, but you're not going to be Summoning Silent Swordsman LV7 very quickly either.
Transcendant Crystal Silent Swordsman definitely improves the draw engine. But the idea of throwing away your SSS to search for Silent Swordsman is not ideal because SSS plays an important role to protect Silent Swordsman, especially when you have only two copies. Unlike Silent Magician, Silent Burning is not much of a use except being a searcher.
So in conclusion,silent magician is way better as you can summon laila,breaker,etc and clear backrows and then summon silent magician and when shes destroyed you can summon a 3500 attack beater on the other hand,there is no warrior card that can clear a backrow and also the silent swordsman boss monster is Only a 2700 attack monster and also he stops you from activating your own spells so you cant
Sss can't be negated by anything like eiz fur for example and lv7 swordsmen can gain sss effect.. and it stops all spell effects means no spell play by opponent it only needs a good draw engine sss makes him better than magician. Now spellbook also got hit