The Rossoneri needed a Patrick Cutrone extra-time winner to defeat their crosstown rivals.
Gattuso has now called on his side to take that form into their upcoming league matches.
Perhaps I am the worst coach in Serie A, but I always want to win, even playing in the garden with my son,” Gattuso told Rai Sport.
“I want my lads to prove that what I saw tonight was not a fluke, then we’ll take it one game at a time.
Now there are two difficult games coming up in Serie A and we need points to climb the table.
“I didn’t see much difference between this performance and the defeat to Atalanta.
Some might call me crazy for saying that. We had the game with Verona in hand too until we conceded the first goal like dummies.
“This is a team that does well until it runs into the first hurdle and today we overcame the hurdles.