The name of the episode is a play on the old expression "new kid on the block". It could be referring to the boy band New Kids On The Block, who had been popular a few years before this episode, or to the Barenaked Ladies song which was popular before that, or directly to the expression itself.
The scene where Moe is about to cut Jimbo when he and Laura are making out is a reference to the rule in horror movies that when the couple makes love they get attacked or killed by the monster or the killer.
The theme song version from season 3 is used again in this episode along with the couch gag from Bart Gets an "F".
The "Northern Exposure" theme plays as Homer chases away a moose from the Simpsons' trash.
When Dolph says, "That chick's messin' with our minds!", he sounds like Jimbo (who is voiced by Pamela Hayden). Dolph's usual voice actor is Tress MacNeille.
According to Bart's phone call to Moe's Tavern, the Simpson family's original address was 1094 Evergreen Terrace, rather than 742. The family could've changed the number in their address later in the show to 742, or this could've been a continuity error.
One of the WB's ads for the show, titled "Homie: the Buffet Slayer" (a parody of the series Buffy the Vampire Slayer, complete with its theme music being used for the purposes of the ad.) featured scenes from this episode (specifically the scenes where Homer took the "all you can eat buffet" slogan for the Frying Dutchman literally).