Regression Testing on Cloud Servers

Question

I have been asked by manager to do a research/study on using Cloud for regression testing. Currently we have a python script running on a central host that distributes test cases across different boxes, runs them, retrieves the results and compares them on the central host. We want to effectively replace these BOXES with cloud servers.

After doing my bit of research I have questions with regard to Cloud Servers:

1. How secure is the data in flight (while it will move between our central host and the cloud servers) Do any of the providers offer any encryption?

2. We require Red Hat Linux on all the cloud servers. If we need a Database on these servers, will we be charged even when no activity is going on the database? By activity I mean no Insertion/Updates etc.

3. Is there any charge for transferring data between the servers since we will sync a release across all servers before sending out test-cases to them?

Answer 1

1. Data in flight

As far as I know, you should think of the servers as any other server. If you do things in plain on the internet, they're still plain on the internet. If you want it encrypted, use encryption. Not everyone and everything needs encryption, as you have to strike a balance between performance, security, and utility. If you're transferring data via HTTPS, SSH/SCP, or SFTP you're probably fine.

Now, even if a provider says they encrypt your data for you, how much do you know about how they handle it? How do they handle keys? There are some services that will manage this for you, but even that is up to your own trust. Better evaluate what they're doing and what access it gives them.

At least to Rackspace, your data is your data. Treat it as you want.

2a. RedHat

Both Amazon and Rackspace have Red Hat Linux servers.

2b. Server Usage

Cloud providers charge for when servers are running, not based on what you're doing/processing. You can always image the server and/or shut it down if you're trying to cut down on costs. Alternatively, you can also look at this as having the ability to create as many servers as you need.

3. Data transfer

If you're transferring data within the same datacenter, there is no charge. Just make sure you're using the internal IP addresses.

Miscellany

If I have any suggestions for doing regression tests on any cloud provider, do use continuous integration (e.g. Jenkins, possibly your Python script) and configuration management (Chef, SaltStack, Ansible, or Puppet). The more you automate the better off you'll be in the long run. All the ones I listed are open source projects that you can run yourself (or get managed support for).