Jim Caldwell to take Cam Cameron's job for rest of season

BALTIMORE - With three games left in the regular season, the Ravens try to right the ship this weekend against the Denver Broncos.

And they'll be doing it without the man who's game-planned their offense for four years.

John Harbaugh said firing Cam Cameron was the hardest thing he's ever done as a coach, but after back to back losses -- including Sunday's overtime defeat to Washington, Ravens brass decided it was time to make a change.

This season

Baltimore ranks 18th in total offense, including 17th in rushing with all-pro Ray Rice. In Sunday's loss at Washington there three first half touchdowns, but only one in the second half including a Joe Flacco interception and fumble.

SLIDESHOW | See the 2012 season so far here .

Some say that loss was the final straw, but Coach Harbaugh wouldn't budge yesterday on exactly why Cameron was let go.

“At this time the move was made to give us a chance to be the best we can be," Harbaugh said.

“People are going to believe what they want to believe," he said. "It's what I believe is best going forward for our offense and for our football team."

Cam Cameron had been with Baltimore since 2008 after losing his head coaching job in Miami where he went 1-15.

Jim Caldwell will assume the coordinating duties for the remainder of the season.

He was hired as the Ravens' quarterbacks coach after being fired last season from the Indianapolis Colts.

Most notably with Caldwell he coached the Colts' quarterback Peyton Manning for seven seasons, during three of those Manning was league MVP.