[Q&A - FAQ Neotys] Last answers

Can Neoloads Controller/Load Generator/Agents all run on a Virtual Machine?

Keith L. — Fri, 07 Jun 2013 02:50:28 GMT

There should be no real issues with this configuration. NeoLoad can be installed and run from a virtual environment. The only aspects that could cause a problem are if a VM image is not optimized and using the latest version, then there could be some instability issues.

Also, the nature of a VM image is that the network info could change from time to time. This can cause NeoLoad to become unusable if the license is activated on this system, and the network info does change from the original configuration in any way.

Chrome not picked up as an installed browser

Keith L. — Fri, 07 Jun 2013 02:46:11 GMT

For Chrome browser, you have to manually modify the proxy settings each time for recording and undo them when completed. Please see attached file for details.

Websockets recording - mobile hybrid application

Christophe M. — Mon, 13 May 2013 08:30:44 GMT

WebSocket will be supported in NeoLoad 4.2 planned for early Q4 2013. (Push module will be required)

Is it possible with NeoLoad to run a load test on Citrix XenApp?

Christophe M. — Thu, 25 Apr 2013 19:25:46 GMT

NeoLoad cannot test applications that run through Citrix XenApp or XenDesktop.

Upgrading the Neotys license server from 2.0 to 3.0.3

Nouredine A. — Fri, 15 Mar 2013 11:17:08 GMT

When you upgrade from NLS 2.0.xx to 3.0.xx, it's not necessary to deactivate your licenses.

Basically, you can uninstall NLS 2.0.xx and install NLS 3.0.xx. You should retrieve your licenses.

I would only recommend you to make sure that none of the licenses are still leased by any NeoLoad.

That should minimize the upgrade process time.

Delete cookies selected during recording

Nouredine A. — Fri, 15 Mar 2013 01:00:46 GMT

When you select the options to delete cache and cookies is to have a fresh new user without any old context. For example, this recordings will contain all the images from your application since they were not in the cache during the recordings.

Now, if you would like to simulate a cache full during the load test, you can configure it in the population and select a "returning user".

The cookies will still remain for the whole virtual user instance duration.

I had this "java.lang.OutOfMemoryError: unable to create new native thread" error during a load test, Why?

Nouredine A. — Mon, 21 Jan 2013 10:42:15 GMT

One possible issue is that the maximum thread that a process can create per user has been reached By default, it is limited and may need to be increased for load testing if it's not large enough.

Simply run the “ulimit -u” command with the same user that starts the load generator service and see the result.
To increase that limit for a specific user you have to modify the “/etc/security/limits.conf” file and add something like the following :

#<domain> <type> <item> <value>
<user> soft nproc 65534
<user> hard nproc 65534

Where <user> is the user that starts the load generator.

I installed NeoLoad on my network and would like to use a monitoring agent on the Microsoft Cloud Azure. How can i do?

Nouredine A. — Mon, 21 Jan 2013 10:36:31 GMT

Since your application is deployed on the Microsoft Cloud Azure you should be able to run a load test from any controller that has internet access.

Now if you would also like to monitor from NeoLoad your Servers that are also installed on the Cloud Azure, you will have to install a remote monitoring Agent on that Cloud.

The controller will contact the remote Agent on port TCP 7200. So if you have any firewall between the controller and the monitoring agent you will have to open that port.

For machines hosted in the Cloud Azure, you have a configuration page from the Cloud Azure that will allow you to open some port and this prior to open them on the machine itself.

Here is a snap shot of that console.

I got this error after a new recording " javax.net.ssl.SSLException: Received fatal alert: bad_record_mac". Why?

Nouredine A. — Mon, 21 Jan 2013 10:30:19 GMT

When you record with NeoLoad, there will be the NeoLoad proxy between your browser and your application server. For HTTPS applications, you can have different SSL versions that can be used for the SSL handshake.

By default, NeoLoad will use the SSLv2 version. But some Servers only accept SSLv3 version and so this can cause some errors like the one you've encountered.

In that case, you can configure NeoLoad to specifically use the SSLv3 for the handshake.

Here is the procedure:

Stop NeoLoad
Edit <install_dir>\conf\controller.properties
Go to [General] section and locate that key below:
https.protocols=SSLv2Hello,SSLv3,TLSv1
Remove the two options in order to keep only SSLv3 like below:
https.protocols=SSLv3
Save
Start NeoLoad

Now your NeoLoad recording should correctly work.

I made a new recording of my new HTTPS application with NeoLoad but I got an error?

Nouredine A. — Mon, 21 Jan 2013 10:22:47 GMT

When recording with NeoLoad, it is important to remember that there will be NeoLoad proxy between your browser and your application server. For HTTPS applications, the SSL handshake and connection will be made by the NeoLoad proxy and NOT your browser. NeoLoad sometimes uses some optimized code to speed up that SSL handshake connection.

With some servers, this can cause some errors like the one you've encountered.
In this case, you can configure NeoLoad to change the default behavior for the SSL communications.

Here is the procedure:

Stop NeoLoad
Edit <install_dir>\conf\controller.properties
Go to [General] section and in a new line add this parameter: https.invalidate.session=true
Save
Start NeoLoad

Now your NeoLoad recording should correctly work.

What is the meaning of that error “java.net.SocketTimeoutException: Read timed out”?

Nouredine A. — Mon, 21 Jan 2013 10:15:23 GMT

It is common during a load test of your application that the Server will be strained. Potentially, you will see high response times from the server.

When NeoLoad sends a request and acknowledged by the server, it will wait for the response. However, in order not to wait an infinite amount of time, there's a timeout so NeoLoad can give up and raise an error. That's why you got this “Read timed out” error.

By default, during the runtime, this timeout is set to 300s (5 minutes).This period of time is usually sufficient for most situations.

Nevertheless, in specific cases, you might not get any data from the server for more than 300s. In that case; here is the procedure to increase the runtime timeout in NeoLoad:

Stop NeoLoad
Edit <install_dir>\conf\controller.properties
Go to the [Runtime] section and locate that key: runtime.so.timeout=300000 Change the value to 600000 to set a 600 seconds timeout (it's in milliseconds)
Save
Start NeoLoad

Now, NeoLoad will only alert you the timeout error if it did not receive any data after 600 seconds.

For more information, see “Results” section in NeoLoad documentation.

I would like to run a SQL statement from a Javascript but I don't know how to do it.

Nouredine A. — Mon, 10 Dec 2012 15:29:43 GMT

NeoLoad has a built-in variable where you can run SQL requests against different type of databases such as MySQL, SQL server, Oracle, DB2 and PostgreSQL.

This variable will be evaluated at the beginning of the script only. So, if you have to run other SQL queries, you will have to do it from a Javascript using JAVA code.

As an example, Neotys has created JAVA code that will allow you to run such SQL queries from a Javascript.

First, you have to copy the nl-sql.jar.pdf (rename it nl-sql.jar) into your <neoload_project>\lib\jslib folder.

Then, create your Javascript in NeoLoad.

This is an example of connection:

var connection = new Packages.SQLConnection("mysql");
connection.connect("localhost", 3306, "mysql", "root", "admin");

The different types of SQL servers that can be used are : mysql, oracle, db2, postgresql, mssql.
The connection parameters are in this order: name of the server (or IP address), port, database name, username and password.

Then, to select multiple results:

var results = connection.getResults("SELECT * FROM user");
// we iterate on each item returned by the SQL statement

for (var i = 0 ; i < results.size() ; i++) {
var item = results.get(i);
// Each column of the database can be accessed through its name:
logger.debug("name = " + item.get("name"));
}

To select a single result:

var result = connection.getSingleResult("SELECT * FROM user WHERE name = 'user1'");
logger.debug("name = " + result.get("name")); // This will display: user1

At the end of the Javascript we have to close the connection:

connection.disconnect();

For more information, see “NeoLoad Javascript API” under “Appendixes” section in NeoLoad documentation.

How can I activate a license without the GUI?

Nouredine A. — Mon, 10 Dec 2012 15:24:27 GMT

It's not mandatory to use the GUI in order to activate a license. You can follow the procedure below in order to do so:

1. Copy your license file in the NeoLoad user directory. Under Linux, it should be there: $HOME/.neotys/neoload/vX.X
2. If necessary rename your license file to “license.lic” (mandatory)
3. Start NeoLoad like this: “./NeoloadCmd -noGUI”
4. NeoLoad will automatically create a “license.req” file that will be stored in the home folder of the logged user. This information should be displayed in the console where you started NeoLoad.
5. Connect to the Neotys web site and go to the activation web form to activate your license. You should get a new file called “license-activated.lic”.
6. Rename that “license-activated.lic” file to “license.lic”
7. Copy that “license.lic” file to that folder $HOME/.neotys/neoload/vX.X. Overwrite the original file.

That's it. Your NeoLoad will now use that license. You may have to restart NeoLoad for this to take affect from previous step above.

For more information, see “License Management” under “Installation” section in NeoLoad documentation.

How can I deactivate a license without the GUI?

Nouredine A. — Mon, 10 Dec 2012 15:22:33 GMT

The deactivation process starts when you click on the “Transfer to another computer...” button in the license management panel.

By doing this, it will generate a deactivation file called “license-inactivation.req” that has to be sent to “activation@neotys.com” by email or using the web form here: https://www.neotys.com/support/disableLicense.html

If you can't start the NeoLoad GUI, you can still deactivate your license running it through command line. This is the command and the option to use:

./NeoLoadCmd -inactivateKey -noGUI

The path of the “license-inactivation.req” file will be displayed on the console where you launched that command.

For more information, see “License Management” under “Installation” section in NeoLoad documentation.

I have configured 5s buffer length on my media request but it is going higher in the test result

Nouredine A. — Mon, 10 Dec 2012 15:20:38 GMT

A media request in NeoLoad has specific parameters that you can configure like buffer length and video bitrate.

The first time your video is played, NeoLoad will fill your buffer up to 5s. Then, it will start playing the video. In the meantime, the video will still be downloading.

Then, you may have three different behaviors:

1. The download and the video bitrate is equal. Your buffer will still be around 5s and you should not have any lag to play your video

2. The download is faster than your video bitrate. Your buffer will continue to increase (slowly) and it can be much higher than your 5s buffer. You should not see any lag to play your video

3. The download is slower than your video bitrate. Your buffer will decrease until around 0, you will start to see some lags i.e video playing is stopped until the buffer is filled up to 5s. Then, NeoLoad will start playing the video again.

To sum up, the buffer configured in your media request is a minimum value and so it can be reached in some circumstances.

For more information, see “Media requests” under “Design” section in NeoLoad documentation.

I have deactivated my license but still the activation server says that it is still activated

Nouredine A. — Mon, 10 Dec 2012 15:18:33 GMT

When you activate a license, it will be tied to the computer and the user account that made the activation.
Thus, multiple activations from the same machine but different user account is possible.

As a consequence, if you would like to use your license on a different machine, you will have to deactivate your license from all the user accounts where the license has been activated on.

It's only when you've completed all deactivation requests you will be able to activate your license on the new computer.

For more information, see “License management” under “Installation” section in NeoLoad documentation.

How can I know on which server my license is activated on?

Nouredine A. — Mon, 10 Dec 2012 15:15:29 GMT

11. A NeoLoad license can only be used on one computer at the same time. During the activation process, you have a field where you can put a description of the computer where the license is going to be activated.

By default, it is the network information of your computer like hostname and IP addresses but it can be changed with your own comments.

If you connect to your customer area here: https://www.neotys.com/support/login.html?from=/support/my-licenses.html

You will be able to see your licenses with the hostname of the machine where it is already activated.

For more information, see “License management” under “Installation” section in NeoLoad documentation.

I configured NLS 3.0 to use my Active Directory (AD) repository but it does not work. What could be the root cause?

Nouredine A. — Mon, 10 Dec 2012 15:13:52 GMT

Since NeoLoad 4.1, you have to use credentials to connect to a NLS 3.0 server. There are 3 types of credentials that you can use.
You can create local credential with the password in clear text, or encode the password with a third tool called “password scrambler”. And, the last way is to connect to an AD/LDAP directory.

If the test of connection worked that means that the credential provided to connect to your AD/LDAP are correct.

There's multiple reasons to not see any licenses available from NeoLoad:

1. By default, there's a filter of 50 Virtual users. Try to increase it until the maximum amount of users.
2. Your AD request may not return anything or not have the right group.
In that case you can enable a debug trace in the NLS to see the result of your AD request.

Procedure:

1. Stop NLS service
2. Edit <install_dir>\conf\nlslogs.xconfig
3. Add this category at the end of the file:

<category name="org.apache.shiro.realm.activedirectory.ActiveDirectoryRealm" log-level="DEBUG"> <log-target id-ref="logFile"/> </category>
4. Save and start the NLS service

From NeoLoad, try to connect to that NLS.

Then, to get the NLS server logs it depends on your OS and how you've started the NLS (through the service or manually).

Under Windows Seven/2008 64 bits:
C:\Windows\SysWOW64\config\systemprofile\AppData\Local\Neotys\NLS\logs

Under Windows XP:
C:\Documents and Settings\<USERNAME>\Local Settings\Application Data\Neotys\NLS\

Under Unix/Linux:
$HOME/.neotys/nls/logs/

The debug information will be stored in that file "nls.log.000001".
Check whether the AD request for the group worked.

Don't forget to reverse back the debug information when it's finished.

For more information, see “Security” section in NLS documentation.

I made a new HTTPS recording but I got an error with NeoLoad 4.1

Nouredine A. — Mon, 10 Dec 2012 15:11:04 GMT

In order to record an HTTPS application in NeoLoad, you have to load the NeoLoad root certificate in your browser like described in the documentation.

Since NeoLoad 4.1, JRE 1.7.xx is now used, whereas in earlier versions it was JRE 1.6.xx.
Since JRE 1.7.xx, the MD2 algorithm has been disabled for security reasons. As a consequence, the recording can't work anymore against servers that are still requesting it.

However, this algorithm can still be enabled following the procedure below:

1. Stop NeoLoad
2. Edit <install_dir>/jre/lib/security/java.security
3. Search and comment the line “jdk.certpath.disabledAlgorithms=MD2” by adding “#” character at the beginning of the line like this “#jdk.certpath.disabledAlgorithms=MD2”. Save the configuration file.
4. Start NeoLoad

For more information, see “Recording a test scenario” under “Design” section in NeoLoad documentation.

Can I create my own variable definition?

Nouredine A. — Mon, 10 Dec 2012 15:04:14 GMT

In order to design your script, you may need some variables that you can create through our variable manager. NeoLoad already provides a list of the most needed variables. But, for design purpose, you may want to create your own variable that does not exist in NeoLoad yet.

Since NeoLoad 4.1, there's a new type of variable that depends on Javascript. You can provide your own code to generate the values that you need.

This Javascript variable has exactly the same behavior, like the other ones. You can configure a change policy and also get an array of values as result.

For more information, see “Variables” under “Design” section in NeoLoad documentation.

Is there a quick way to check if a user validation worked?

Nouredine A. — Mon, 10 Dec 2012 15:01:32 GMT

When you run a user validation, NeoLoad will flag a response in error based on the HTTP status code of the response.

On some applications, the HTTP status code may be “200 OK” even if the content of the response contains errors.

Since NeoLoad 4.1, there's an automatic comparison feature that can display the percentage of difference between the recorded response and replayed one.

You will quickly see if you got the same kind of responses during validation and recording and if the script is correctly working.

For more information, see “Variables” under “Design” section in NeoLoad documentation.

I made a test with NeoLoad and I would like to import my own monitoring data. Is it possible?

Nouredine A. — Mon, 10 Dec 2012 14:57:28 GMT

NeoLoad provides multiple types of monitoring to monitor your infrastructure during a load test. Having all this data in NeoLoad allows you to compare this monitoring data with all the available statistics. For instance, you can quickly correlate some high response time or errors with some monitoring data.

In some environments these monitors are already in place. It might be easier to use the existing ones instead of using new ones from NeoLoad.

Since NeoLoad 4.1, NeoLoad provides a way to import monitoring output from other tools. Currently, you can import Windows Perfmon output data.

After importing this monitoring data, you will get a new monitor created in NeoLoad. Then, you can use that data like any other monitoring data as if it were run by NeoLoad.

For more information, see “Results” section in NeoLoad documentation.

I would like to kill or stop a specific virtual user instances during a test

Nouredine A. — Mon, 10 Dec 2012 14:55:05 GMT

NeoLoad allows you to increase or decrease the number of virtual users that are running during a test. Currently, you can decide to stop this virtual users at the population level but you cannot specify one virtual user in particular.

Since NeoLoad 4.1, there's a new feature that allows you to specifically stop a virtual user instance. You have the option to stop the user with the default stop policy, or immediately.
This is done on the Runtime users tab.

For more information, see “Runtime” section in NeoLoad documentation.

I would like to stop a VU when an error occurs ?

Nouredine A. — Mon, 10 Dec 2012 14:53:59 GMT

NeoLoad provides some default container to ease the design of your script. The “Init/End” containers are played once and usually contains the login and logout actions. Whereas the “Actions” container will be played multiple times to loop your business transactions.

Since NeoLoad 4.1, there's a “Stop” logical action that will allow you to stop a virtual user instance on purpose.
You will be able to manage the errors situation and decide if for example a new login is necessary within the script.
As an option, you will also be able to start a new virtual user instance to maintain the load.

For more information, see “Runtime” section in NeoLoad documentation.

I would like to emulate some latency and packet loss with NeoLoad. Is it possible?

Nouredine A. — Mon, 10 Dec 2012 14:53:34 GMT

When you configure a population with some users split, you can decide what will be the constraint at the network level. Currently, you can set some bandwidth limitations for the Download and the Upload.

Starting with NeoLoad 4.1, you have the ability to configure latency and packet loss values. You can define a percentage of packet loss with a duration latency.
There are some existing profiles, for Mobile or Wifi, but this can be customized to suit your needs.

For more information, see “Populations” under “Design” section in NeoLoad documentation.