James Caan Didn’t Think Will Ferrell Was ‘Funny’ on ‘Elf’ Set

"I love that the whole time, he's not acting. He's truly annoyed with me," Ferrell recalled of his late co-star.