Definitely, everyone is different. When I broke mine and had it pinned, I also broke my wrist on the other side. With one arm in a plaster cast and another in a sling I did nothing for 10 weeks apart from brisk walking.
The main thing for me was that when my cast was off and I could train again, due to the plate in my collarbone I couldn’t rotate my right arm swimming, nor could I use aero bars as I couldn’t tuck my arms in properly. I had to wait until 6 months after the accident for the plate to be taken out be able to swim normally and use aero bars. The day the plate came out I was fine immediately - no pain or uncomfortable feeling at all.
I did manage to complete an ironman (my first) and a half during the time between cast coming off and plate removed with a one armed swim and on a road bike but obviously they were not quick.