| New Feature | Description | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Instant Load Engine | Now large multi-engine load tests can be run without installing any software. Just boot from an Engine-on-a-disk using Knoppix-like linux boot CD-ROM or a USB memory stick, and the load engine will automatically boot and update itself to the latest version! The load engine will automatically configure itself to use up to 2G of RAM, and can handle multiple-NIC hardware. | ||||||||||||||||||
| New .NET Application Server Monitoring Module | The new Advanced Server Analysis™ module for .NET collects and analyzes .NET application server metrics to help locate bottlenecks and improve server performance. 23 important metrics are collected, and the server reports are integrated with the other performance reports. (Note: the .NET server monitoring module is sold separately.) | ||||||||||||||||||
| Major Report Improvements | The newly designed HTML version of the load test report now has a left-hand side index to make it easier to navigate to any part of the report quickly. The enhanced export to HTML feature can now export the entire report for alternate distribution methods, and includes the new table of contents. The reports are now customizable, so you can choose the sub-sections to be included in each section; only view the parts you want. The performance of very large reports has been improved by streaming content instead of caching.
|
||||||||||||||||||
| Test Case Configuration Improvements | Eight separate improvements were made in test case configuration, including dataset generation from pre-built lists of cities and names, regular expression support and scalable think times.
|
||||||||||||||||||
| Load Testing and Analysis Improvements |
|
||||||||||||||||||
| Vista Improvements | The underlying software libraries upon which the software is based, Eclipse, was upgraded to version 3.3, which brings Vista fixes, improvement in the text rendering performance, and many cosmetic improvements. | ||||||||||||||||||
| Internationalization | The 3.5 release is now ready for internationalization, which will take place in subsequent updates. The first new language to be supported is French. |
| New Feature | Description |
|---|---|
| Vista Support | With the release of version 3.4 all of the modules are now Vista-compatible. |
| New Server Monitoring Module | The new Advanced Server Analysis module collects and analyzes server metrics to help locate bottlenecks and improve server performance. 23 important metrics are collected on each platform, and the server reports are integrated with the other performance reports. The top six most important parameters are analyzed to make sure their fall within normal parameters, and problem spots are highlighted. (Note: the server monitoring modules are priced separately.) |
| Expert Test Case Config Wizard | The parts of configuring a test case that are rarely used have been moved into a "expert" part of the configuration wizard. |
| New Feature | Description |
|---|---|
| Advanced Configuration | Web Performance Analyzer™ extensively analyzes your testcase and automatically performs the routine configurations required for most testcases, saving many hours of labor on each testcase. For those testcases that require additional manual configuration, this task has previously required a high level of knowledge of the product and/or help from our support personnel. For help the user understand the new functionality there is a new tutorial that can help even the novice load-testers understand and configure complex testcases. Many of the new testcase configuration options for this release are addresses specifically in this tutorial. |
| User-defined Field-detection Rules | The ASM wizard uses an extensive set of default rules for finding and configuring client-state variables in web pages for accurate testcase simulation. With the addition of User-defined Field-detection rules, you can provide the ASM wizard with additional rules for locating and configuring these fields. Previously, this required the user to manually configure extractors and modifiers on each instance of a field. By specifying a detection rule, ASM can perform this work automatically, saving many hours of work for each testcase. |
| ASM Field-ignore Preferences | The run-time performance of Load Tester can be optimized by instructing the ASM wizard to ignore fields that will never change for a particular testcase. Previously, these fields must be selected each time the ASM wizard was executed. Now these fields may be specified in the Ignored Fields preference page and the ASM wizard will automatically ignore them each time. |
| Dynamically-named Fields support | Some application frameworks use groups of fields that are numbered based on the value of another field. In earlier releases, handling these cases was impossible without assistance from our support personnel. Dynamically-named field schemes may now be configured by novice users with relative ease, allowing you to get your tests up and running quickly. |
| Validation Rules | Building a good testcase sometimes requires configuration of validators on every page in a testcase. This can be an arduous and repetitive task consuming valuable testing hours. Validation rules may now be specified to automatically apply validators, as needed, to one or many pages in a testcase. This is especially useful when checking for common error messages that are generated automatically by application frameworks. |
| Domain and URL Blocking | Many testcases can be polluted with URLs that are not useful for load-testing purposes. These include URLs fetched automatically by toolbar plugins (Google, Yahoo, etc) and by advertising or usage-tracking URLs on external sites. Corporate portal pages may also references to many off-site URLs that should not be included in a load test. Previously, these transactions required manual deletion to get the desired load test results. Domains and individual URLs may now be blocked during the recording phase, automatically excluding them from the testcase. |
| Streaming Media Support | Some testcases with large resources, such as streaming media, resulted in metrics on a recorded testcases that was not as accurate as possible. Users may now turn on streaming-media support before recording these testcases to generate more accurate measurements and a more realistic testcase simulation. |
| Fixed-repeat Load Tests | Previous versions only allowed configuration of a load test with a fixed duration. A load test may now be configured to end after all testcases have completed a fixed number of iterations. |
| IP Aliasing Configuration | Load Tester has supported the use of multiple IP addresses for generating load to your server for many versions. However, using this feature required manually adding a line for each IP address to a text file on each engine. This task may now be accomplished with a few clicks from within the GUI. |
| Misc. Improvements |
|
| New Feature | Description |
|---|---|
| Customizable Playback Screen | Now you can customize the playback screen by adding real-time display of just the parameters you want to watch, including load times for particular web pages. |
| Dynamic Field Names | Support for complex frameworks that dynamically change the field names to encode state and session information. |
| Statistics View | A new GUI view has been added to interactively browse statistics outside of reports. |
| Test Case Report | A new printable and exportable report shows everything about a particular test case. This is great for showing baseline web page load times. |
| URL-level Statistics | Statistics for individual URLs can now be viewed and shown in reports. |
| Test Case Exports | The data for a particular test case can now be exported for outside reports or for inclusion in other software. |
| Custom Extractors | While the Automatic State Management™ feature automatically configures 99% of dynamic variables, in rare cases you may need to configure a test case by hand. Now custom extractors can be configured to dynamically parse values at playback. |
| Actors View | The new Actors View shows all of the dynamic logic associated with a page or test case in one place, including modifiers, validators, and extractors. |
| Command Line Control | Replays can now be run from the command-line making it possible to start a test case automatically or from another program. |
The Web Performance Suite™ 3.1 release concentrates on improving support for complicated SOAP architectures and improving quality and stability by implementing dozens of customer suggestions.
In the SOAP/web services world there's no single architecture, but many SOAP and web-services designs use complicated multi-part HTTP POSTS requests to communicate with the web server. Many times the client isn't even a web browser, but an automated process in a corporate datacenter.For those times where the client is especially complicated transactions can now be built by importing the raw transaction files. You can even export recorded transactions, edit them at the binary level, and them import them back into the test case.
Another major feature is improved support for applications which involve lots of uploads of different files. Now you can specify an unlimited number of files to upload, and each virtual use can upload a different file. As with all our data replacement features, this integrates easily into enterprise-level tests by automatic distribution and management of data replacement with the remote engines.
| New Feature | Description |
|---|---|
| Faster | Recorded page metrics are even more accurate, especially with large page sizes. |
| Improved Tooltips | Editor tooltips now show request and response sizes, time to first byte, etc. |
| Improved Data Generation | Dataset generation now has prefix, suffix, and sequential options. |
| Transaction Import/Export | Transactions can be imported and exported for creation/editing in external tools. |
| Multi-part POST | Improved support for multi-part POST content. |
| File Uploads | Extensive support for simulating large numbers of file uploads. |
| Improved Status Viewer | The status viewer has been improved to do a better job of showing what's happening when a test is starting or stopping. |
| Virtual User Error Handling | The virtual user can now restart from the beginning when an error during a load test. |
| Improved Error Handling | The error descriptions are now more user friendly and easier to understand. |
Almost all of the features from Web Performance Trainer™ 2.9 are now available in the Load Tester™ module of the Web Performance Suite™ 3.0. Note only is the user interface improved, but there are also plenty of competely new features as well.
| New Feature | Description |
|---|---|
| Reports | The Baseline and Load Test Performance Analysis is now available in report form and available to share via the web or modify in your favorite editor. Now its easy to create a formal report of your load testing efforts. |
| Improved Monitoring | Multiple web servers can now be monitored for CPU and memory usage. |
| Easier to Use | The new user interface has been completely redesigned to be easier to operate in so many ways its difficult to describe them all. |
| Save Performance Test Configurations | Now you can configure and run separate test configurations, keeping each configuration around so you can exactly run the same test as before. |




