According to
this U.S. government website (which seems pretty accurate), the most difficult Latin-scripted flourishing languages for English speakers to learn are Finnish, Estonian, and Hungarian (all Uralic languages). Vietnamese is at least as difficult as (and probably more so than) these, but its Latinization is only a relatively recent, artificial addition.