And you know how reliable that phone conversation is.

I have occasionally/rarely seen IRS send a notice asking "Where's that return you filed an extension for?" 

Personally I would not file a return. If a letter comes reply with no return was required.

No harm in filing a zero return, though.