I also used to worry about it alot as well Norm, more so when it was a larger (older) fish on the bank.
I now get everything ready (Slings, Scales, Camera etc) so everything is to hand & it can be done quickly & smoothly when the fish is banked.
I have watched others take what i thought was a very long time handling fish out of water while they get all the bits together.
& Cakey mate I could not sack a fish either as i would be so worried about it all time.