Even simpler than that probably.
$Old = Import-CSV Old.csv
$New = Import-CSV New.csv
$New | ?{$Old -notmatch $_} | Export-CSV Output.csv -notype
Output is:
name place value
---- ----- -----
xyz us 2
That work for you?