Now there are rumours of who could be set to replace her, despite the fact Ellen hasn't confirmed she's leaving her hosting role.
NBC Entertainment Chairman Paul Telegdy is on the executive team who will decide the future of Ellen's long running daytime series.
A source told the publication that Paul is a "huge fan of James" and has him "high on his wanted list for talent and a long term replacement for Ellen" in the instance that the role became available.
"This issue has fast tracked everything and made everyone look at the future today," the insider said.
"James Corden was being eyed for Ellen's job in the long term before any of this came to light. Now this shocking new development places a spotlight on the next step.
"James and his team have been trailblazers in modern TV, taking the once considered graveyard chat show slot into a cutting edge format with huge online, social media and global recognition."
They added that in five years he went from an "unknown to A-list star and creative".
James is only contracted with CBS until 2022 after turning down a five-year deal.
"Paul is a huge fan of what James does on screen. He already has a huge devoted audience, global appeal and is loved by Hollywood," the source added.
"Replacing Ellen was always going to be a tough challenge, but he is a natural fit and easy transition. James would freshen up daytime and with a free hand would be allowed to build a new afternoon era."
Will Ellen quit?
Rumours have been swirling that Ellen will quit the series because of the recent scandals.
Should she decide to quit the network will be left with a huge task of filling the empty slot in their schedule and only a "significant, successful, well-known name would do".
The source added, "James is always looking for new challenges .
"But he has expressed concerns about raising his family in LA so far from his and wife Julia's English families. They miss them greatly.
"They have milled over a return home, but adore their lives and business opportunities so much in LA."
Is James just as bad?
While people like Paul are huge fans of James, there are rumours that the host may actually have his own problems with some social media users saying he's not the "funny happy go lucky guy you see on TV".
In a Reddit thread asking users who the "most entitled actors you have ever met", the top comments are about James.
One user wrote, "James Corden is an absolute jack a**, not the funny happy go lucky guy you see on TV."
Another added, "My favourite James Corden moment was when Jimmy Kimmel won a round of Spill Your Guts or Fill Your Guts by asking Corden to name one camera man in the room right now."
"Can confirm. He has this thing where he won't talk to anyone bar the most senior crew," another added. "Once witnessed him have a meltdown because the script supervisor (who’s job is partly to ensure continuity and keep dialogue true to script) spoke to him directly when the Director was occupied (script supervisors normally filter issues via the director). He thinks he’s above everyone."
Another said, "I used to go to college with a guy whose uncle was on Gavin & Stacey. Apparently, the uncle didn’t have a single nice thing to say about James Corden."
Others are upset about the potential for James to replace Ellen because he's a "straight white man".
TV writer Jill Gutowitz tweeted, "Ellen’s show, though it came to be problematic, was once revolutionary and important. We should absolutely replace her with... a straight white man?"
Author Saeed Jones said, "If y’all give the show to a straight white man, I will snap. It’s obvious that [Laverne Cox] should take over."
Some viewers are keen on the idea, however, with one user writing, "James Corden is perfect to replace Ellen DeGeneres in the sense that I’ve never seen a clip of either one interviewing somebody where it wasn’t just them talking over their guest the whole time"