I'm just telling you things you can do. Dual wielding doesn't mean exactly "one sword in each hand", It's a weapon in your pirmary hand, and something in your off hand. It's why parrying daggers were a thing, a well as hand axes. So, Tecnically, you could have one mythril sword, and a mythril hunting knife or axe and flavor that as dual wielding. Also, if you don't invest in magic, and intelligence, your spells will be terrible too. And wits also boosts magic damage, so if your goblin truly is dumb, but knows magic, it could work.
Though the more you do certain things, the more your stats will naturally increase. (If you have a thief only unlock chests, they will gsin wits eventually for example)