I wasn't a fan at the time, either, but I knew who they were. I didn't know the music, although I'm sure I heard it inbetween "Grease" songs and disco songs on the radio. When I finally got my copy of Rumours in the '80s, I recognized almost every song on the thing. Mac mentions were everywhere. I distinctly remember 2 from TV sitcoms I watched.
One was on "One Day at a Time". Schneider was hitting on a girl, complimenting her on her hair. The girl said, "Oh, thank you! It's the new Stevie Nicks style..." And Schneider said, (you guessed it) "Who's he???".
The other was, strangely enough, on "Mork & Mindy". Someone was asking which Mac record to buy, and Mindy said something along the lines of, "If you want the full Fleetwood Mac experience, you definitely want to buy 'Rumours'."
(OK, so maybe the memories aren't so distinct nearly 30 years later...
)