You're Correct!

There is nothing more frustrating that your golf ball curving off in different directions and you dont know why. The driver elaborates any curvature of the golf ball due to the extra ball speed generated by the longer length driver shaft teamed with the lower loft on the club face.

If you hit an iron shot with a small slice this normally will be exaggerated with the driver to a bigger slice.

There are a few things you need to check to help you hit your driver with less curve, and these are:

Centeredness of strike
If you look at the face of your driver you will see that it is not perfectly straight, there is a slight curve which is known as the driver bulge. Off centre contact affects the direction the ball travels. For example, if the ball is struck on the toe of the club face the ball will more likely hook and visa versa if the ball is struck out of the heel of the club face this tends to slice the ball. Minimizing off centre strikes will result in a more consistent ball flight, as the ball will not curve as much.

Club face alignment
The initial launch direction of a golf ball when hit with a driver is 85% to where the club face is pointing at impact. You need to watch the initial starting direction of the balls flight. If the ball is starting left with contact being made out of the centre of the club face then the club face will be aiming left. Likewise if the golf ball is starting right with a centre strike then the club face will be aiming right. To hit the ball with a straight starting direction to the intended target then the club face will have to be aimed at the target.

Club path
Club path is the way that the club is being delivered to the ball. Swing path can be out to in (left), in to out (right) or neural (straight). To hit the ball on a straight flight at the target the clubs path and face will need to be neutral and matched up.

With a shot struck out of the centre of the club face, the bigger the difference between where the club face is pointing and the clubs path will lead to greater curvature on the ball.

Swinging faster will not stop the ball from curving, it will actually make the ball curve more. The faster the swing, the more chance you will curve off line with a poor swing. This is because the ball will stay in the air longer and have more time to veer off line.

By reducing your club head speed you can stop the ball curving off line but you do not want to do this as you will be losing a lot of distance. If you hit a ball with a slower swing with an off centred strike you will lose even more distance.

By aiming in the opposite direction to where the ball is going can make matters worse. For example, if you are slicing the ball your club path will be out to in (left) and by aiming further left is shifting your swing even more to the left and across the ball resulting in even bigger slices.