Your AA battery is probably dead. Having it work momentarily then die, only to come back for a bit after resting the cell is classic behaviour of a marginal cell.