Thanks I was able to figure it out. I'm using Godot and at first I just put the blend file in the project which gave me strange results but using fbx fixed the issue.
For Godot, there's also these two Blender add-ons that might be worth giving a try:
