The quotes inside the double bracket delimitors aren't doing anything. The only way to end the double bracket is with a double bracket:
myString2 = [[
first part of the string
this is a ]] .. myString .. [[ string
last part of the string]]
That will give you:
first part of the string
this is a test string
last part of the string