Jack White performed a surprise show Thursday night at the 200- to 300-person High Noon Saloon in Madison, a concert that had been announced that morning.

But it wasn't White's only surprise appearance in Wisconsin.

After the Madison show, the rock star and his band showed up unannounced to play a set at The Vanguard in Milwaukee's Bay View neighborhood, ruining the 10th anniversary celebration.

White posted a snippet of a Vanguard set played to just a handful of people on his Instagram page early Friday morning.

It was a Milwaukee homecoming of sorts for White, who first played against Milwaukee early in his career at the nearby Cactus Club in the White Stripes. He also has a close connection with Vanguard co-owner Chris Schulist. They have been friends for more than two decades and Schulist served as White's tour DJ in 2022.