I know a couple guys with the same problem. One of them tied a drift sock on his bow, corrected his problem but, he had to purchase a really good one. He tore up a cheap one the first time out.
Other guy installed one of them trolling plates that mount behind your prop. Worked but not cheap.
Other guy installed one of them trolling plates that mount behind your prop. Worked but not cheap.