The opposition's response came after External Affairs Minister S Jaishankar on Monday claimed that prime ministers from the Congress displayed indifference about Katchatheevu island and gave away Indian fishermen's rights despite legal views to the contrary.