Walmart would certainly not be my go-to place for hard to find batteries, lithium or otherwise.
For common ones, there are multitudes of sources both brick and morter and on-line.

Not that I'd consider buying anything from Walmart anyway.