The survey by life assistance group CPP found that 26 per cent of respondents have had their card used by fraudsters, up five per cent from a year ago.
Consumers lost an average of Â£650 to fraudulent transactions, with six per cent saying their losses topped Â£2,000.
Around 40 per cent of card fraud victims had their details used online, while another 21 per cent said their cards had been cloned when they used a cash machine or chip-and-pin machine.
Cardiff, Manchester and Brighton were the locations with the highest instances of card fraud behind the capital, the report added.
Kerry D'Souza of CPP said: "Fraudsters are becoming increasingly sophisticated, especially when it comes to online transactions which are a particular cause for concern."