Harry Shearer, a regular Simpsons voice actor, is also a member of Spinal Tap. He plays himself in this episode along with the rest of the band.
The scary story Otto told Lisa is similar to High Beams from Scary Stories to Tell In The Dark.
There appears to be gold bars, coins, necklaces, a crown, and a trident under Lisa's bedroom floorboards.
When Bart gives up the guitar due to its difficulty, Homer suggests he put it in his closet next to his short wave radio (a reference to "Radio Bart"), his karate outfit (a reference to "When Flanders Failed"), and his unicycle (not a reference to any previous episode, though Bart would later ride a unicycle in I, (Annoyed Grunt)-Bot).
In this episode, Comic Book Guy has a full beard instead of his usual stubble.
Bart's guitar is left-handed when he is learning how to play it, yet Otto plays it perfectly on the bus despite being right-handed. Later, when Otto is playing guitar with Bart in the garage, the guitar switches to a right-handed model, all in the same scene. We can only assume that Otto is good enough to play both left-handed and right-handed, and does so to stay in practice. Also there have been real-life left-handed guitarists, most notably Jimi Hendrix, whom Otto is partially based on, who simply played right-handed guitars upside down.