It is reported that music mogul Simon Cowell and pop princess Cheryl Cole will not be returning to their seats as the X-Factor judges for the UK version of the show.

According to reports the pair have informed television bosses at ITV that they will not be making up the panel in this years series of the hit show.

A story in the News of the World newspaper said that the two famed judges would not be able to fit in appearances on the X-Factor in both the US and UK so were left with little choice than to quit the UK version.

According to the News of the World Simon Cowell told Peter Fincham from ITV: “I am committed to the American show and I'm not going to do both.”

The departure of the two stars has caused concern with television bosses: “There will be a massive shake-up. Simon is a huge, huge loss. He gives the judging panel such authority and there are fears that millions will switch off without him. And two million extra viewers tuned in when Cheryl joined the panel, To lose her as well is a nightmare,” an insider told the paper.

It is reported that for the sake of some continuity that both Dannii Minogue and Louis Walsh have been offered large pay rises to try and keep them in the show as the X-Factor UK has already lost 50% of its panel.

As for who will fill the very big shoes of Simon and Cheryl there are many rumours bouncing around with Robbie Williams and gary Barlow of Take That fame both having their names in the ring at the moment.

US singer Kate Perry and British sensation Adele have also both been rumoured to be favourites to take the place of Cheryl Cole. Although no official statement has been made either about Cowell and Cole leaving or about who could possibly replace them.