Folarin Balogun and Malik Tillman scored as the USA overcame a controversial red card to beat Bosnia & Herzegovina 2-0 and reach the World Cup Round of 16.
The co-hosts had to dig deep at Levi's Stadium in Santa Clara, playing the final 26 minutes plus stoppage time with 10 men before extending their lead late on.
Balogun broke the deadlock on the stroke of half-time, rolling a low finish under Bosnia goalkeeper Nikola Vasilj after Tillman set him up following a first-time flick from Tyler Adams.
The forward marked the moment by performing LeBron James's "Silencer" celebration, capping a bright opening for Mauricio Pochettino's side.
The complexion of the game shifted in the 64th minute when Balogun was shown a straight red card following a VAR review for serious foul play, a stomp on the back of Tarik Muharemović's ankle.
Media and supporters described the decision as harsh, but it was officially confirmed after the review, leaving the USA to protect their lead a man down.
Rather than sit deep, the hosts found a second goal in the 82nd minute as Tillman curled a direct free kick from just outside the box over the wall and past Vasilj's outstretched hand.
The strike carried historical weight, with Tillman becoming only the second U.S. player on record since 1966 to score a direct free kick at a World Cup, joining Eric Wynalda from 1994.
Balogun also entered the record books, becoming the third player to score three or more goals in a single World Cup edition for the U.S., alongside Bert Patenaude and Landon Donovan.
The result marks only the second knockout-stage win in USMNT World Cup history and their first since 2002, with the USA joining fellow co-hosts Canada and Mexico in the last 16.
"That is what we wanted from the beginning, " said Pochettino. "It was difficult when Balogun received the red card. That was the moment we had to be a team.
The eyes of the players showed they were ready to fight."
"They are creating a legacy in this country, " the head coach added. "With these fans, anything is possible."
The USA now face Belgium at Seattle Stadium on Monday, July 6, though Balogun will be suspended for the tie following his dismissal.
For Bosnia & Herzegovina, the defeat ends a historic debut run, with their first appearance in the World Cup knockout stages coming to a close in California.
