Taylor Swift and Travis Kelce found a way to make sweet memories in Europe!

A insider revealed the couple’s romantic hideaway in Lake Como, Italy, during Swift’s brief break between Eras Tour gigs. From late-night strolls to a day tour of Lake Como by boat, the power couple made the most of their “four relaxing days of rest” this week.

On the first night, they went for a long walk around the lake late at night [between 11 and midnight] to avoid running into fans and paparazzis,” the insider added of Swift and Kelce, who are both 34. “It was so romantic. They occasionally walked hand in hand. They would also kiss on occasion.

The trip began just one day after Swift’s fourth and final Eras Tour event in Paris, France, on Sunday, May 12, which Kelce attended alongside Swift’s mother Andrea and their pals Gigi Hadid and Bradley Cooper. On the final day of the trip, Friday, May 17, the pair toured Lake Como by boat, an event the “Fortnight” singer wanted to remember forever.

[Swift] got on the boat along the side and then went right away to the front and started taking photos of him,” said a source. “It was clear that she was trying to capture the moment for posterity, and the cute thing was that she didn’t use a phone but a little Olympus camera.”

After a nearly two-hour boat voyage through the rain near Bellagio, the pair reportedly docked and dined at Locanda La Tirlindana, a restaurant in front of Comacina Island. The restaurant serves local cuisine, such as fresh pastas and homemade sweets.

They were very affectionate with each other, always close and hugging,” a source told PEOPLE of the couple’s last day in Italy. Swift sang her new song about Kelce, “So High School,” in front of him for the first time on tour during The Tortured Poets Department era of her 46-song setlist, the day before departing on the romantic trip at the May 12 Eras Tour concert.

Later in the show, Swift sang an acoustic version of “The Alchemy,” which had football puns like, “So when I touch down, call the amateurs and cut ’em from the team.” Swift also mentioned throughout the show that it was the 87th gig on the Eras Tour, a reference to her NFL boyfriend’s No. 87 jersey.

During the show, the 14-time Grammy winner wore Kansas City Chiefs colors, including a stunning gold ombre crop top and a matched red ombre skirt.