Police were called to remove the devotees surrounding the rental property in hopes of catching a glimpse of their idol, who was enjoying low-key drinks at a nearby pub.
A significant number of officers were called to Justin's rented mansion in the affluent suburb of Mosman following complaints from neighbouring homes.
Large groups of fans had gathered outside the luxury house, allegedly trying to get in. They were told to move on before the singer arrived back at the property.
While the police were handling the dedicated fans, the Canadian-born singer enjoyed drinks nearby at The Stoned Crow pub and then the Crows Nest Hotel.
Scores of young fans were spotted outside the mansion and treated to special doughnuts made by popular local chain Doughnut Time.
The teenagers, mostly young women, were all smiles as they posed in front of the rental property for photos with their limited edition 'Justin Time' treats.
Police managed to clear the crowds while Justin, his Hillsong pastor Carl Lentz, actor and model Patrick Schwarzenegger and friends hung out nearby before he finally returned.