Hi ultracolathompson,
Sometimes the model gets confused if there are other sounds as well. Some things you could try are basically choosing a different model (select one that is more accurate or one that is faster), and also you could split the input into smaller sections, specially at the times that it is getting these issues.
Hope that helps!