Howdy,
I think it's fine playing for stacks there given his loose and aggro image because of the reasons you mentioned - SD/FD is possible, he may shove 8x and pocket pairs, not mentioning crazy moves with overcards, so against that range you are favourite.
Good luck!