So I found the answer on Jetbrains Developer Community. This is because Teamcity for security reasons uses "secure:svn-password" for SVN and "secure:passwd" for Perforce rather than simple password. So I changed my XML to something like:
<property name="secure:svn-password" value="testpwd"/>