No overlapping notes, no tempo changes, though surprisingly it WAS the note colors, I changed them all to be the same (while changing nothing else) and it worked lmao. I do remember having to import a midi once and the colors were saved, I guess it makes some extra data that gets read by the game in a weird way?
before and after for reference in case that matters:
