He was famous for his steady batting and his defence at shortstop, and received the NPB Best Nine Award nine times, in 1955–60, 1962, 1964–65. This is the best record until now. He was often compared with the famous 12th century general, Minamoto no Yoshitsune, and they called Yoshida "Ushiwakamaru", Yoshitune's name as a child.
After retirement, he became the manager of the Hanshin Tigers three times, in 1975–77, 1985–87, 1997–98. The 1985 season was his best. His Hanshin Tigers won the Central League's championship for the first time since 1964, and defeated the Seibu Lions in the Japan Series for their first ever championship. That year Yoshida was also named the winner of the Matsutaro Shoriki Award.