You have to escape the single quote to 2 single quotes, there may be other special characters so you have to take care of them:
DataRow[] newDr = this.ds.Tables["TableName"]
.Select(string.Format("Name ='{0}'",drData["Name"].ToString().Replace("'","''")));
More examples on escaping special characters in a filter string (used in Select
method):
Row filter string examples