Yes. When lightning bolt resolves, he has no cards in hand.
Even if that wasn't the case, the specter isn't destroyed until state based actions are checked which is after the stack is empty and lightning bolt is in the graveyard. By that time the specter is 5/5 for sure.
Just be careful he doesn't draw a card before his turn ends.
