Justin and Hailey Bieber are spending a celebratory weekend together, following the July 11 release of 'Swag,' Justin's first solo album in more than four years. A source familiar with the creation of the album tells PEOPLE that the Rhode founder supported her husband throughout the entire process.

Predictably, Bieber’s fans spent hours dissecting the lyrics of the 21 tracks to look for clues about his well-being and the state of his marriage. Vulture said the lyrics — on this “mediocre” new album — largely deal with his “complicated” marriage to Hailey and are “skewed toward ‘I still love you.'”