After battling for a while to get the darn battery out, with tweezers that were too big, tiny pliers, and a few other options, I finally had success with a teeny pair of tweezers.
I found a pair of REALLY TINY metal tweezers (see 2nd image below) out of an old Leatherman, which did the trick...