Ms Roberts claims in a civil suit that she was trafficked by paedophile financier Jeffrey Epstein and forced to have sex with Andrew, 61, on three occasions when she was 17.
The gardener in question was allegedly flustered and upset by the outburst from the Duke.
A royal insider said it was ‘unfair’, especially as it was ‘only a few saplings’.
Prince Andrew ‘shouted at female gardener over wrongly-cut trees’ just days after he was served with a sex case writ from Virginia Roberts
The incident allegedly took place within the Queen’s Windsor estate. Pictured: Prince Andrew and Sarah Duchess of York leave Royal Lodge, Windsor
‘Andrew is under a great deal of stress but it’s no reason to take it out on staff doing their job,’ the insider told The Sun.
The Prince allegedly flew into a rage, ‘screaming and shouting’ in front of a team of gardeners at Royal Lodge, on the Queen’s estate at Windsor.
It comes as a leading expert has estimated Andrew faces a £14million payout if he agrees to settle the US lawsuit.
Queen Elizabeth II with her son Prince Andrew on the Buckingham Palace balcony during Trooping The Color in June 2019
Top US civil lawyer Spencer Kuvin, who represents several of Epstein’s victims, told the Daily Mirror: ‘To punish someone worth a billion dollars you have got to hit them in their pockets and punish them accordingly.
‘Damages against Andrew could range in excess of £14million. Easily.
‘There are going to be huge legal hurdles in the federal court before they will be able to even begin the process of litigating.’
Virginia Roberts will only accept a settlement from Prince Andrew if it ‘holds him to account’, according to her lawyer, as he described the Duke of York’s denial of ever meeting Ms Roberts as ‘incomprehensible’.
David Boies, Ms Roberts’ New York attorney, said Ms Roberts does not want a settlement that would allow Andrew to ‘escape’ responsibility due to his ‘position’ and ‘wealth’, according to reports.
The lawyer also said that M Roberts would also be unlikely to settle the lawsuit outside of court if the Duke of York continued to deny meeting her, as he did in his famous BBC Newsnight interview.
Virginia Roberts, now Virginia Giuffre, was photographed with Prince Andrew and Ghislaine Maxwell in London in 2001
Legal experts had predicted Andrew would seek a settlement, but Andrew has taken the dramatic decision to face his accusationr in court and become the first member of the modern royal family to submit to being cross-examined over serious claims.
The lawsuit has come during the same year as the Queen’s platinum jubilee, and Mr Boies admitted that he did feel pain for Her Majesty that the legal action was being out so ‘publicly’, describing it as a ‘mother’s worst nightmare’.
Yet Mr Boyes told The Telegraph the Queen, Prince Andrew’s daughters Beatrice and Eugenie, and his ex-wife Sarah, the Duchess of York will likely not be deposed if the case goes to court.
He added it is likely that Andrew’s conversations with his mother will not be used as he ‘probably’ won’t admit to them.
Top US civil lawyer Spencer Kuvin (left) represents several victims of the paedophile financier Jeffrey Epstein (right)
The Duke last week issued 41 denials, rejecting all claims of wrongdoing. In his official response, he stated a further 40 times that he ‘lacks sufficient information to admit or deny’ other claims.
Mr Boies is preparing to fly to Britain later this year to take a legal deposition from the Duke, which he expects to last ‘a day, or probably two’.
‘I’m going to try to get him to understand that this is not going to be combative,’ he told The Daily Telegraph. ‘Obviously, I’m going to ask him a lot of questions.
‘And although some of the questions may be uncomfortable, I’m not going to be aggressive or in any way offensive to him. I’m going to be respectful.’
Mr Boies is known as the ‘greatest deposition taker’ in America and has secured or won for clients nine settlements of more than a billion dollars. He represented Presidential candidate Al Gore after the disputed 2000 election and helped change the law in California to allow gay people to marry.
Andrew’s deposition must be taken before a July 14 deadline set by the judge.
MailOnline has contacted Buckingham Palace for comment.