In a self-reference, one scene shows Marge criticizing a troll doll's bizarre hairdo.
When parents are flushing kids out of cattails and snaring some in nets, this is a reference to Planet of the Apes when Colonel Taylor and two of his fellow astronauts first encounter human life, only to be victims of an ape hunting party shortly afterwards.
After Bart is accused of stealing the money from the church collection plate, he is forced to wear a straitjacket and mask in church, which is a reference to Hannibal Lecter in The Silence of the Lambs.
Ned Flanders is heard singing Jesu, Joy of Man's Desiring by Johann Sebastian Bach in the church.
The music playing during Bart and Jessica's night on the town is the song Misirlou by Dick Dale. The same song is heard in the soundtrack for the 1994 Quentin Tarantino crime classic Pulp Fiction.
The line "with flaming swords, the Aramites did pierce the eyes of their fellow men" isn't in the Bible.
April 1st is shown to be a Monday, and yet there is a church service. It is possible that the Simpsons were too busy to attend church on Sunday.
The calendar that Bart marks off shows April having 31 days and May having 30 days. In real life, April has 30 days and May has 31. Later, after Bart marks off June, April and May switched to their appropriate number of days.
Apu is seen with the church congregation searching for the missing collection money, despite the fact that he is Hindu and had no reason to follow them.
Lisa proclaims that the collection money will be found in the Lovejoy's home, despite the fact that she was not shown to have any proof of the money's location. She may have just strongly suspected it since she knew that was where the thief lived.
Principal Skinner, despite not having the authority, gives Bart a detention for a prank which took place outside of school and on a weekend.
Helen Lovejoy was shown here to be offended whenever she hears the word "Butt" or "But", but in other episodes, she had no trouble with the words, even in "Itchy & Scratchy & Marge", she even said "We want you to get your big Italian "Butt" out of here!"
This episode was originally rated PG (suitable for children, but only with parental supervision) by the BBFC when it came out on VHS --- most likely due to a soft drug reference [Skinner admitting to smelling marijuana in Vietnam] comic violence [The parents capturing their children to go to church, Willie getting attacked by turtles, Bart falling down the hill on his skateboard and not having safety gear on, which, in the UK, is considered dangerous behavior likely to be imitated by children], imitable criminal behavior [Bart and Jessica covering the Jebediah Springfield statue in toilet paper, Jessica pulling the fire alarm, and Jessica stealing the church money], discriminatory behavior played for laughs [Bart and Jessica tease some fat dieters by eating ice cream in front of them and the town blaming Bart for stealing the church money], and rude language [Bart talking about an episode of Martin that has gratuitous use of the word "butt" and Bart's "Why the crap do we have to go to church?" line]. As of 2005, the episode is now uncut with a U (suitable for all audiences) rating for "mild comic violence" and "mild bad language".
At the end of the episode when Jessica is getting picked up by the boy on the bike, his appearance matches that of the boy Lisa fantasises about that works at the library.