I agree with everyone who said to check with your doctor first (of course).
My input would be it is too soon. I had my surgery about 10 days before you did, and have had an excellent recovery.
I used to play golf, so I dusted off the clubs and swung the driver and a long iron in the backyard this weekend. Even with the shoulder work I have been doing, I can't imagine it would be very fun to play at less than 100% of what I could do if the arm was healed and fully rehabed. You will not only be risking the repair, but you could injure your shoulder if you are overcompensating for the arm. I doubt you will be ready to take a full powered swing by next month.
The other thing I was thinking about while swinging is, what if you don't take a divot, and the club abruptly digs into the turf? Will the arm be able to take that kind of shock. Even if you hit the ball clean, I think you are going to feel the vibration at the site of the injury every time you hit the ball.
Let us know what the doctor says.