The Zinc Carbon uses a Zinc case as the negative. The positive is a carbon rod with a cap.
On the Alkaline cells the negative is a disc and the "cap" (positive) is a moulded part of the can.
On modern stuff the battery holder is plastic, so no problems. But older stuff is metal and the Alkaline cell may have only a thin foil covering insulating the positive can from the chassis connected to negative. The foil is easily torn or scraped. Here is my solution:
A vintage battery label, two layers of paper and outer clear parcel tape
I had this (actually it was very poor and wrong size, I edited it a lot):
And a photo of an old Ever Ready U2. I copy / pasted the logo from a B114 and typed/drew the rest
Print at 150dpi gives enough ease for thin card.
Glue tab on battery (maybe peel off film).
top & bottom should overlap ends, put a little glue around and then fold a small part of overlap rotating the cell each time.
Don't block safety vents on bottom with glue.
This is a mk1, so the spacing may not be 100% correct. Looks nicer than brown tape or blank card.
All my designs are deliberately faded to save ink and also not be mistaken for real. You can adjust gamma to make the blue darker.