Taylor Swift wears striped bikini on vacation with boyfriend Joe Alwyn in Turks and Caicos

Taylor Swift is busy traveling the world for her massive Reputation Stadium Tour, but she took out some time for vacation with boyfriend Joe Alwyn over the Fourth of July holiday.

Taylor and Joe have dated secretly for months before their relationship became public last May — were photographed frolicking in the ocean together while on vacation in Turks and Caicos.

She wore a striped, retro-inspired two piece swimsuit for the outing and was seen cuddling up to her boyfriend in the water as they snorkeled and soaked up the sun.

Also Read: Pregnant Pippa Middleton looks elegant in white at Wimbledon

“They were lovey-dovey,” a source tells PEOPLE.

Both of didn't confess in public about their relationship, Taylor gave fans a peek at their private romance on her album reputation.

“Flashback to when you met me / Your buzz cut / And my hair bleached,” sings Swift on “Dress,” possibly referencing the haircut Alwyn sported while filming Billy Lynn’s Halftime Walk. The superstar had her hair bleached for a few months in the spring of 2016, and both stars attended the Met Gala that May.

Alwyn and his family have been spotted at several shows in the States and in the U.K. since Swift kicked off her hit tour in May.

“She seems to be in a great place both career and love wise,” a source recently told PEOPLE. “Joe is just an amazing boyfriend. He is very supportive. Taylor adores his family. She’s in a very good place.”

Also Read: Prince Harry and Meghan Markle don't hold hands in front of Queen Elizabeth