Sinatr was right about changing the language after the form is showed: it can't be done. But if you know the wanted language before that, the following code should do it.
public Form1()
{
//Set the wanted language here
CultureInfo culture = CultureInfo.CreateSpecificCulture("en-US");
CultureInfo.DefaultThreadCurrentCulture = culture;
CultureInfo.DefaultThreadCurrentUICulture = culture;
Thread.CurrentThread.CurrentCulture = culture;
Thread.CurrentThread.CurrentUICulture = culture;
InitializeComponent();
}
private void Form1_Load(object sender, EventArgs e)
{
//...
}
Thank you for your help while figuring this out.