{"id":687,"date":"2010-02-15T19:16:09","date_gmt":"2010-02-15T23:16:09","guid":{"rendered":"http:\/\/www.webperformanceinc.com\/load_testing\/blog\/?p=687"},"modified":"2012-03-14T16:54:41","modified_gmt":"2012-03-14T20:54:41","slug":"checklist-is-your-load-test-ready-to-run","status":"publish","type":"post","link":"https:\/\/www.webperformance.com\/load-testing-tools\/blog\/2010\/02\/checklist-is-your-load-test-ready-to-run\/","title":{"rendered":"Checklist: Is your Load Test ready to run?"},"content":{"rendered":"<p style=\"margin-bottom: 0in;\">Here are a few quick pointers for checking your Load Test, to see if you are ready to run. Feel free to check back, as this list may be updated from time to time.<\/p>\n<h2>Test Planning:<\/h2>\n<ol>\n<li>\n<p style=\"margin-bottom: 0in;\">Have the appropriate parties been notified of the test?<\/p>\n<\/li>\n<li>\n<p style=\"margin-bottom: 0in;\">Do any of the servers have scheduled jobs during the test window? Automatic backups or other maintenance windows that are scheduled during normal down-time or idle-time can have surprising results during a high volume test.<\/p>\n<\/li>\n<li>\n<p style=\"margin-bottom: 0in;\">Is the firewall going to be an issue? When using a small set of external IPs to generate load, make sure the firewall administrators have been notified of the test, and have ensured the firewall will not throttle or block traffic from the test IPs.<\/p>\n<\/li>\n<\/ol>\n<h2>From the Controller:<\/h2>\n<ol>\n<li>\n<p style=\"margin-bottom: 0in;\">Are all your engines enabled and ready? Check the Engines View (Window \u2192 Show View \u2192 Engines) to make sure all the test engines are enabled. If you need more engines, use the \u201cAdd Engine\u201d button to connect to a running engine, or to <a href=\"\/load-testing\/features\/cloud.html\">start up engines in the cloud<\/a>. If you have dedicated engines, it is advisable to make sure the \u201cLocal\u201d engine is <em>not<\/em> enabled, since using dedicated engines is generally advantageous for accuracy and reliability.<\/p>\n<\/li>\n<li>\n<p style=\"margin-bottom: 0in;\">Are all your servers enabled and ready? Check the Servers View (Window \u2192 Show View \u2192 Servers), and make sure that <a href=\"\/load-testing\/server_analysis\/\">monitoring<\/a> is enabled for each server used in your test.<\/p>\n<\/li>\n<li>\n<p style=\"margin-bottom: 0in;\">Do all of your testcases have a recent &amp; successful replay? If a testcase has not been used recently, run a replay to make sure that the testcase is still valid.<\/p>\n<\/li>\n<li>\n<p style=\"margin-bottom: 0in;\">Has a \u201cwarm-up\u201d test been run of the site? Warm-up tests exercise the server without applying excessive load, and give the servers a chance to compile &amp; cache any resources that would normally get compiled just after the server had been started up. At the same time, it can test that all load engines are able to connect to the site \u2013 which is particularly useful for test sites that may use an IP rule to prohibit access to the server from arbitrary IP addresses.<\/p>\n<\/li>\n<\/ol>\n<h2>For Server Agents:<\/h2>\n<ol>\n<li>\n<p style=\"margin-bottom: 0in;\">Check to make sure that the server agent console is up and running. Windows users should either run the agent as a service, or verify that the console is up in a local session. In the later case, make sure sure not to log off from the server during the test, and check that the local security policy is not going to enforce an automatic logoff during the testing window.<\/p>\n<\/li>\n<li>\n<p style=\"margin-bottom: 0in;\">For users who are running a server agent on a server which cannot be connected to from the Load Tester controller, go ahead and start manual data collection with the \u201cstart-log\u201d command. Make sure the sample period (the \u201c-p\u201d) option is set to the same period as in your Load Configuration.<\/p>\n<\/li>\n<\/ol>\n<h2>For Load Engines:<\/h2>\n<ol>\n<li>Make sure the Load Engine console is up and running.<\/li>\n<li>For new engine installs, make sure the engine is configured with an optimal amount of memory. Using an <a href=\"\/load-testing\/features\/cloud.html\">Amazon EC2 Cloud Engine<\/a> is automatically optimized and configured for use with Load Tester. If the server must be tested from inside the local network, download an \u201c<a href=\"\/load-testing\/features\/instantloadengine.html\">Instant Load Engine<\/a>\u201d ISO to automatically boot, configure, &amp; run the load engine on an existing workstation without other applications running. Use the \u201cConfigure IPs\u201d in the Engines View to configure which IPs each engine should use to originate load from.<\/li>\n<li>For Windows users, make sure either to run the engine as a service, or not to log-off from the engine while the test is running. For Linux users, we recommend launching the Load Engine with the \u201cscreen\u201d command, which ensures that a session &amp; console will remain open for the Load Engine application, while allowing you to logout of your primary console.<\/li>\n<\/ol>\n<h2>For all Windows Machines:<\/h2>\n<p>Except for Load Engines or Server Agents running as a Windows <a href=\"http:\/\/support.microsoft.com\/kb\/137890\">service<\/a>, do check to make sure that any automatic log-off and automatic shut-down settings have been disabled during the test window. If the system shuts down or logs off while one of the test applications is running, then the application will close, and no further data will be collected from that machine during the test. Depending on how much data had been collected, this may even contribute to partial data loss.<\/p>\n<p>Every system has different requirements, but I hope that this checklist serves as a good starting point!<\/p>\n<p>-Frank, Engineer at Web Performance, Inc.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Here are a few quick pointers for checking your Load Test, to see if you are ready to run. Feel free to check back, as this list may be updated from time to time.<br \/>\nTest Planning:<\/p>\n<p>Have the appropriate parties been notified of the test?<\/p>\n<p>Do any of the servers have scheduled jobs during the test window? Automatic backups or other maintenance windows that are scheduled during normal down-time or idle-time can have surprising results during a high volume test.<\/p>\n<p>Is the firewall going to be an issue? When using a small set of external IPs to generate load, make sure the firewall administrators &hellip; <a href=\"https:\/\/www.webperformance.com\/load-testing-tools\/blog\/2010\/02\/checklist-is-your-load-test-ready-to-run\/\">Continue reading &raquo;<\/a><\/p>\n","protected":false},"author":12,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8],"tags":[49],"class_list":["post-687","post","type-post","status-publish","format-standard","hentry","category-load-testing","tag-load-tester"],"_links":{"self":[{"href":"https:\/\/www.webperformance.com\/load-testing-tools\/blog\/wp-json\/wp\/v2\/posts\/687","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.webperformance.com\/load-testing-tools\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.webperformance.com\/load-testing-tools\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.webperformance.com\/load-testing-tools\/blog\/wp-json\/wp\/v2\/users\/12"}],"replies":[{"embeddable":true,"href":"https:\/\/www.webperformance.com\/load-testing-tools\/blog\/wp-json\/wp\/v2\/comments?post=687"}],"version-history":[{"count":10,"href":"https:\/\/www.webperformance.com\/load-testing-tools\/blog\/wp-json\/wp\/v2\/posts\/687\/revisions"}],"predecessor-version":[{"id":3271,"href":"https:\/\/www.webperformance.com\/load-testing-tools\/blog\/wp-json\/wp\/v2\/posts\/687\/revisions\/3271"}],"wp:attachment":[{"href":"https:\/\/www.webperformance.com\/load-testing-tools\/blog\/wp-json\/wp\/v2\/media?parent=687"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.webperformance.com\/load-testing-tools\/blog\/wp-json\/wp\/v2\/categories?post=687"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.webperformance.com\/load-testing-tools\/blog\/wp-json\/wp\/v2\/tags?post=687"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}