In the early-20th century, Fifth Avenue was known as where the wealthy and well-connected congregated in the city. Notable locations on this avenue were the Union League social club, the Metropolitan museum, and the New York Yacht yacht club. Several college clubs were also located on this street.
In The Big Good-Bye, the master criminal Silent Forrester was chauffeured onto this street to his final destination, the posh hotel known as the Plaza. His taxi was being tailed by Detective Jim Tierney and his squad. (TNG: "The Big Goodbye")