West Brom goalkeeper Ben Foster saved from Martin Samuelsen and Lee Angol in the shootout as the English Premier League club won 4-3 following a 1-1 draw after extra time.
Tony Pulis' side will next play second-tier Reading.
Jon Taylor gave Peterborough the lead, only for Darren Fletcher to level for West Brom, who couldn't settle the match in regular time.
West Brom humbled West Ham at the Hawthorns