Please complete a few more dungeons first, and then tell us it's not ridiculous.
(no real, those missing stat bonuses will add up, and it won't be too long before you're finding yourself regularly dying in a single unlucky turn)
SPOILER BELOW:
At two points in the game, you will HAVE to fight one of the other characters (though supposedly the second is avoidable if you're lucky). When I played as the dwarf, I had to fight the priest. That is very bad. He has a high Magic stat, and the dwarf has a low magic stat (made even crappier by the broken stat generation). The only way I survived was by luck, and by knowing that if you defend one turn, you'll do double damage on the next. The priest will use Heal 2 if you do more than 90 damage to him, in addition to barraging you with his Ice magic. The only way you're going to survive is to hit him once, and then do a double-damage hit and hope you get a critical hit (2 attakcks) to do enough damage for the win.
Though if you have the priest as an ally, it will be a HUGE boost to finishing the game. At level 42, he learns the Elixir spell, that, as long as you keep his MP above 120, he can cast it to restore full HP and MP at any time (so with 240, you get infinite healing for both characters).