Cravy began the 2015 season with the Colorado Springs Sky Sox of the PCL. The Brewers added him to their 40-man roster and promoted to the major leagues on May 31.[8] He was optioned back to Colorado Springs on June 3.[9]
Spending spring training with the Brewers major league team, Cravy was the last player cut in spring training, the organization opting to send him to Triple–A Colorado Springs Sky Sox.[10] He was called up to the active roster on April 2, 2016, when Matt Garza was put on the DL.[11] The Brewers put Cravy in to more of a relieving role in 2016, and he appeared in 20 games.[12]
An "on-the-bubble" player heading in to 2017,[13] Cravy pitched around a 2.00 ERA in spring training and again was the final player cut, leading him to harshly criticize the Brewers management, saying that he may not report to the minor leagues but instead go to "a 9 to 5 job where I get treated like a human."[14] Cravy also was a returning roster member, which made getting cut for the second straight year harder.[15] He also took shots at the Brewers' management and general manager David Stearns, saying, "It says a lot about the integrity, or lack thereof, of the guys running the show." In later interviews Cravy labeled these comments as regrettable.[16] He spent the year with Triple–A Colorado Springs, struggling to a 6.24 ERA with 38 strikeouts across 42 appearances out of the bullpen. Cravy elected free agency following the season on November 6, 2017.[17]