Kaapo Kakko's second goal in as many games gave the Rangers a 1-0 lead at 15:46 of the first period. He scored with a one-timer from the slot off a pass from Artemi Panarin. Kakko did not have a point in his first 10 games.
"I have been waiting for those goals, just going to the net and 'Bread' or Strome, they're going to find me, and I just have to shoot it to the empty net," Kakko said. "Sometimes it's so easy like that."
Dvorak tied it 1-1 at 2:17 of the second period.
Montreal rookie forward Michael Pezzetta then challenged Rangers forward Ryan Reaves to a fight 65 seconds later. Pezzetta took the worst of it and Reaves pumped up the home crowd after the officials broke up the fight.
Reaves, a known fighter, said he was surprised Pezzetta, who was playing in his eighth NHL game, wanted to fight him.
"I was very confused on what was going on," Reaves said. "That's the second time in my [NHL] career that I was confused on whether it was a guy from the minors, an absolute killer trying to make a name or something. But both ended the same way."
Kreider scored 32 seconds later.
Kreider started the rush from the defensive zone and moved the puck across to Mika Zibanejad. He then got behind Jeff Petry and Zibanejad found him with a right to left cross-ice pass for a redirection that gave New York a 2-1 lead at 3:50.
"The crowd was into it," Reaves said. "The boys got one for me there, which was good. It's always nice to be in the box after a fight and the boys go get one."