“He wants to be a loving father and grandfather but that was being tested beyond endurance.

“He is not willing to be pushed around, nor to indulge a constant state of chaos.”

Meanwhile, sources close to Harry are even questioning if the offer for the Palace was genuine.

It is also understood Harry plans to issue a statement after the outcome of his lawsuit against Associated Newspapers Limited is revealed at 2pm tomorrow.

Sources say this added complexity, and the King’s constitutional position could not appear compromised.

Harry is due to begin his UK trip today and visit London and Birmingham to promote his Invictus Games.

It is still unknown if wife Meghan, 44, will join him this week — or if the King will meet Archie, seven, and Lilibet, five, for the first time in four years.

Charles had invited Harry to use Buckingham Palace several weeks ago after the Sussexes gave 28 days’ notice of intent to be in the UK.

Royal sources say Harry had complained the terms of the stay were unsuitable, while Sussex insiders were insisting he would end up accepting the invitation to stay at the Palace.

Harry formally rejected the offer on Saturday morning around the same time it was revealed Meghan, Archie and Lilibet would not join him in London, citing security reasons.

But hours later Harry apparently changed his mind and said he would like to use the Palace for one night this week.

But it is understood staying there requires a minimum level of notice as courtesy to staff.

So after aides consulted with the King, Harry was told on Saturday night it was too late.

The chain of events is disputed by sources close to Harry.

Morning “breaking news” reports claiming he would stay at the Palace proved to be false and were flatly denied.

Sources close to Harry claim he spent considerable time making alternative arrangements after learning last weekend that he will not receive extra taxpayer-funded ­security for his family.

They say he accepted the King’s invitation on Saturday when he was practically able to do so.

They allege the Palace’s reasons for the refusal to allow Harry’s stay at Royal HQ have changed over time — including raising concerns about the statement over his lawsuit.

A Sussex spokesman insisted Harry’s trip will still go ahead.

They said: “I am aware of multiple briefings from Buckingham Palace last week suggesting that the Duke had not accepted the offer of accommodation at a royal residence.

“Following the Royal and VIP Executive Committee (Ravec) decision not to provide security for his family, the Duke spent last week making alternative security arrangements.

“Once those were in place, he was able to formally accept the offer of accommodation for himself over the weekend.

“It is therefore disappointing that the offer has now been withdrawn, with Tuesday’s judgment in the Associated Newspapers Limited case cited as the reason.

“Buckingham Palace has, however, been aware of that judgment since last Thursday.

“It is therefore unclear why, having formally accepted the accommodation offer, it has now been withdrawn at the last moment.”

Buckingham Palace declined to comment but it is understood a royal residence will still be offered for future Sussex trips.

Charles and Harry are set to be half a mile apart today in London on separate engagements.

Harry has seen his father twice in the past 2½ years, and only briefly each time.

Charles has not seen Archie and Lilibet since Queen Elizabeth II’s Platinum Jubilee in June 2022.

Meghan has not visited since the Queen’s funeral that September.

She and the kids are thought to be in Europe and could yet jet in for an Invictus promo at Birmingham’s NEC later this week.

Harry has hopes of taking his children to mum Di’s grave at Althorp, Northants, for the first time.