I’d say wait a bit longer after your meal to hit the gym. I had the same issue and waiting like 30 to 45 mins later helped a lot. Oats are very slow digesting and def when combined with nut butter. Another option would be to keep timing the same and skip the extra fats in your meal.