The world number one came back to win 3-6 7-5 6-0 in round three at Flushing Meadows. Williams, 33, is aiming to become the first player to win the calendar Grand Slam since 1988.
Men's top seed Novak Djokovic progressed, with former champion Rafael Nadal to play later on Thursday.
