President Donald Trump isn’t sorry that Meghan Markle and Prince Harry have moved back to the U.K.

Last week, the Duke and Duchess of Sussex arrived in the U.K. just days after PEOPLE revealed that they were relocating from California to Harry’s home country with their family for an extended period. Trump was asked about the couple’s U.K. return on Wednesday, Sept. 2, and told Oval Office reporters he was “happy about it.”

“I was not a fan,” the president added.

Trump said he had a “very good relationship” with the late Queen Elizabeth and has gotten to know King Charles “very well” throughout the years.

“I’ve known him for a long time,” he said of the monarch. “He’s a great, great guy, and I thought [Harry and Meghan] treated the royal family with great disrespect.”

“I didn’t like it. I didn’t like the way she acted,” he continued. “I thought she was terribly disrespectful to the Queen, to King Charles.”

“And I don’t know, maybe I’m different; I wouldn’t have taken them back,” Trump added. “Frankly, if I were the royal family, I would not have taken them back.”

This isn’t the first time that Trump has publicly expressed his dislike of the Sussexes, particularly Meghan. He made headlines in 2019 for calling her “nasty,” before later denying the remark.

During Trump’s 2016 presidential campaign, the then-Suits actress described him as “misogynistic” and “divisive” in a late-night interview. Years later, in an interview with The Sun, Trump reacted to Meghan’s comments.

“I didn’t know that,” he responded. “No, I didn’t know that she was nasty.”

Amid King Charles and Queen Camilla’s state visit to the U.S. in April, royal biographer Robert Hardman landed a private meeting with Trump, who was eager to talk about all things royals, including the feud between Harry and his brother, Prince William.

When Hardman admitted to Trump that he felt it “highly unlikely” that Harry would find his way back into the royal fold, the president reflected, “Too many things, I guess.”

He then seemed to place the blame on Meghan, saying, “That wife of his. Boy, what she’s done to that guy… I guess she got blocked out by William’s wife.”

Trump also fired back at Harry after the Duke of Sussex’s surprise trip to Ukraine in April, during which he called for “American leadership to step up” — without naming the U.S. president directly.

“The United States has a singular role in this story,” Harry said in a speech at the Kyiv Security forum. “Not only because of its power, but because when Ukraine gave up nuclear weapons, America was part of the assurance that Ukraine’s sovereignty and borders would be respected.”

“This is a moment for American leadership,” he continued. “A moment for America to show that it can honor its international treaty obligations, not out of charity, but out of its own enduring role in global security and strategic stability.”

Later that day, Trump was asked by reporters in the Oval Office about the prince’s remarks. He initially deflected, making a brief reference to Meghan: “Prince Harry? How’s he doing? How’s his wife? Please give her my regards.”

Trump then added, “I know one thing: Prince Harry is not speaking for the U.K. That’s for sure. I think I’m speaking for the U.K. more than Prince Harry. But I appreciate his advice.”

Meghan, Harry and their children — Prince Archie, 7, and Princess Lilibet, 5 — as well as their dogs, Pula and Mia, officially touched down in England on Aug. 26. PEOPLE revealed one week prior that they were relocating to Harry’s home country.

The family plans to make a private, non-royal residence in the U.K. their home base for an extended period, with Archie and Lilibet starting school in Britain this month. They will also maintain their home in California and vacation property in Portugal.

PEOPLE understands that King Charles was made aware of the couple’s plans on Sunday, Aug. 16, and welcomes the opportunity to see more of his son’s family in a private and personal capacity.

However, the move back does not mean a return to royal roles for Meghan and Harry. The King is said to have been clear that there will be no change to the couple’s status as non-working members of the royal family, in keeping with the agreement they previously reached with the late Queen Elizabeth.