History of Previous Changes

Changes sections are chronologically ordered from top (most recent) to bottom (least recent)

Version 5.6.2

Summary

[Bug fixes](#Bug fixes)

Bug fixes

General

PR#6042 Issue#6041Fix compatibility with Maven’s pom.xml parser by adding explicit versions for com.google.auto.service:auto-service-annotations (regression since 5.6)

Thanks

We thank all contributors mentioned in bug and improvement sections above:

We also thank bug reporters who helped us improve JMeter.

Apologies if we have omitted anyone else.

Known problems and workarounds

Issue#6043 Min is always 0 in Summary Report (fixed in 5.6.3)
The Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).
The numbers that appear to the left of the green box are the number of active threads / total number of threads, the total number of threads only applies to a locally run test, otherwise it will show 0 (see Bug 55510).
Note that under some windows systems you may have this WARNING: java.util.prefs.WindowsPreferences WARNING: Could not open/create prefs root node Software\JavaSoft\Prefs at root 0 x80000002. Windows RegCreateKeyEx(…) returned error code 5. The fix is to run JMeter as Administrator, it will create the registry key for you, then you can restart JMeter as a normal user and you won’t have the warning anymore.
You may encounter the following error: java.security.cert.CertificateException: Certificates does not conform to algorithm constraints if you run a HTTPS request on a web site with a SSL certificate (itself or one of SSL certificates in its chain of trust) with a signature algorithm using MD2 (like md2WithRSAEncryption) or with a SSL certificate with a size lower than 1024 bits. This error is related to increased security in Java 8+. To allow you to perform your HTTPS request, you can downgrade the security of your Java installation by editing the Java jdk.certpath.disabledAlgorithms property. Remove the MD2 value or the constraint on size, depending on your case. This property is in this file: JAVA_HOME/jre/lib/security/java.security See Bug 56357 for details.
Under Mac OSX Aggregate Graph will show wrong values due to mirroring effect on numbers. This is due to a known Java bug, see Bug JDK-8065373 The fix is to use JDK8_u45 or later.
View Results Tree may fail to display some HTML code under HTML renderer, see Bug 54586. This is due to a known Java bug which fails to parse “px” units in row/col attributes. See Bug JDK-8031109 The fix is to use JDK9 b65 or later.
JTable selection with keyboard (SHIFT + up/down) is totally unusable with Java 7 on Mac OSX. This is due to a known Java bug JDK-8025126 The fix is to use JDK 8 b132 or later.
Since Java 11 the JavaScript implementation Nashorn has been deprecated. Java will emit the following deprecation warnings, if you are using JavaScript based on Nashorn. Warning: Nashorn engine is planned to be removed from a future JDK release To silence these warnings, add -Dnashorn.args=--no-deprecation-warning to your Java arguments. That can be achieved by setting the enviroment variable JVM_ARGS export JVM_ARGS="-Dnashorn.args=--no-deprecation-warning"
With Java 15 the JavaScript implementation Nashorn has been removed. To add back a JSR-223 compatible JavaScript engine you have two options: Use Mozilla Rhino : Copy rhino-engine-1.7.14.jar into $JMETER_HOME/lib/ext. Use OpenJDK Nashorn : The OpenJDK Nashorn implementation comes as a module. To use it, you will have to download it and add it to the module path. A hacky way to download the version 15.0 (or later) and its dependencies and set the module path is outlined below: mkdir lib/modules pushd lib/modules wget https://repo1.maven.org/maven2/org/openjdk/nashorn/nashorn-core/15.3/nashorn-core-15.3.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm/9.5/asm-9.5.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-commons/9.5/asm-commons-9.5.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-util/9.5/asm-util-9.5.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-tree/9.5/asm-tree-9.5.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-analysis/9.5/asm-analysis-9.5.jar popd export JVM_ARGS="--module-path $PWD/lib/modules" ./bin/jmeter

Version 5.6.1

Summary

[New and Noteworthy](#New and Noteworthy)
[Incompatible changes](#Incompatible changes)
[Bug fixes](#Bug fixes)
Improvements
[Non-functional changes](#Non-functional changes)
[Known problems and workarounds](#Known problems and workarounds)
Thanks

New and Noteworthy

Improvements

HTTP Samplers and Test Script Recorder

PR#6010Use UTF-8 as a default encoding in HTTP sampler. It enables sending parameter names, and filenames with unicode characters
PR#6010Test Recorder will use UTF-8 encoding by default, so it will infer human-readable arguments rather than percent-encoded ones

Non-functional changes

PR#6000Add release-drafter for populating GitHub releases info based on the merged PRs
PR#5989Use Gradle toolchains for JDK provisioning, enable building and testing with different JDKs, start testing with Java 21
PR#5991Update jackson-core, jackson-databind, jackson-annotations to 2.15.2 (from 2.15.1)
PR#5993Update ph-commons to 10.2.5 (from 10.2.4)
PR#6017Update kotlin-stdlib to 1.8.22 (from 1.8.21)
PR#6020Update error_prone_annotations to 2.20.0 (from 2.19.1)
PR#6023Update checker-qual to 3.35.0 (from 3.34.0)

Other Samplers

PR#6028 Change default value for sampleresult.default.encoding to UTF-8 (it inherits default HTTP encoding which was modified in PR#6010)

Bug fixes

Thread Groups

PR#6011Regression since 5.6: ThreadGroups are running endlessly in non-gui mode: use default value for LoopController.continue_forever rather than initializing it in the constructor

Other Samplers

PR#6012 Java Request sampler cannot be enabled again after disabling in UI (regression since 5.6)

Thanks

We thank all contributors mentioned in bug and improvement sections above:

Alex Schwartz, @alexsch01

We also thank bug reporters who helped us improve JMeter.

David Getzlaff, @dgetzlaf
LeeBaul, @libaolu

Apologies if we have omitted anyone else.

Known problems and workarounds

pom.xml misses <version> tags for auto-service-annotations, so Maven can’t infer transitive dependencies. The issue is resolved in 5.6.2
Issue#6043 Min is always 0 in Summary Report (fixed in 5.6.3)
The Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).
The numbers that appear to the left of the green box are the number of active threads / total number of threads, the total number of threads only applies to a locally run test, otherwise it will show 0 (see Bug 55510).
Note that under some windows systems you may have this WARNING: java.util.prefs.WindowsPreferences WARNING: Could not open/create prefs root node Software\JavaSoft\Prefs at root 0 x80000002. Windows RegCreateKeyEx(…) returned error code 5. The fix is to run JMeter as Administrator, it will create the registry key for you, then you can restart JMeter as a normal user and you won’t have the warning anymore.
You may encounter the following error: java.security.cert.CertificateException: Certificates does not conform to algorithm constraints if you run a HTTPS request on a web site with a SSL certificate (itself or one of SSL certificates in its chain of trust) with a signature algorithm using MD2 (like md2WithRSAEncryption) or with a SSL certificate with a size lower than 1024 bits. This error is related to increased security in Java 8+. To allow you to perform your HTTPS request, you can downgrade the security of your Java installation by editing the Java jdk.certpath.disabledAlgorithms property. Remove the MD2 value or the constraint on size, depending on your case. This property is in this file: JAVA_HOME/jre/lib/security/java.security See Bug 56357 for details.
Under Mac OSX Aggregate Graph will show wrong values due to mirroring effect on numbers. This is due to a known Java bug, see Bug JDK-8065373 The fix is to use JDK8_u45 or later.
View Results Tree may fail to display some HTML code under HTML renderer, see Bug 54586. This is due to a known Java bug which fails to parse “px” units in row/col attributes. See Bug JDK-8031109 The fix is to use JDK9 b65 or later.
JTable selection with keyboard (SHIFT + up/down) is totally unusable with Java 7 on Mac OSX. This is due to a known Java bug JDK-8025126 The fix is to use JDK 8 b132 or later.
Since Java 11 the JavaScript implementation Nashorn has been deprecated. Java will emit the following deprecation warnings, if you are using JavaScript based on Nashorn. Warning: Nashorn engine is planned to be removed from a future JDK release To silence these warnings, add -Dnashorn.args=--no-deprecation-warning to your Java arguments. That can be achieved by setting the enviroment variable JVM_ARGS export JVM_ARGS="-Dnashorn.args=--no-deprecation-warning"
With Java 15 the JavaScript implementation Nashorn has been removed. To add back a JSR-223 compatible JavaScript engine you have two options: Use Mozilla Rhino : Copy rhino-engine-1.7.14.jar into $JMETER_HOME/lib/ext. Use OpenJDK Nashorn : The OpenJDK Nashorn implementation comes as a module. To use it, you will have to download it and add it to the module path. A hacky way to download the version 15.0 (or later) and its dependencies and set the module path is outlined below: mkdir lib/modules pushd lib/modules wget https://repo1.maven.org/maven2/org/openjdk/nashorn/nashorn-core/15.3/nashorn-core-15.3.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm/9.5/asm-9.5.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-commons/9.5/asm-commons-9.5.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-util/9.5/asm-util-9.5.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-tree/9.5/asm-tree-9.5.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-analysis/9.5/asm-analysis-9.5.jar popd export JVM_ARGS="--module-path $PWD/lib/modules" ./bin/jmeter

Version 5.6

Summary

[New and Noteworthy](#New and Noteworthy)
[Incompatible changes](#Incompatible changes)
[Bug fixes](#Bug fixes)
Improvements
[Non-functional changes](#Non-functional changes)
[Known problems and workarounds](#Known problems and workarounds)
Thanks

New and Noteworthy

Improvements

Thread Groups

Issue#5682 PR#717 Open Model Thread Group: avoid skipping rows from CSV Data Set Config
Support custom thread group implementations in “Add think time” and “Save as test fragment” actions
Open Model Thread Group: interrupt pending HTTP requests and other Interruptible test elements on test stop

HTTP Samplers and Test Script Recorder

PR#5911 Use Caffeine for caching HTTP headers instead of commons-collections4 LRUMap
PR#5947 Fetch resources referenced in <link "rel"="preload"...> elements
PR#5869 Allow more templates to format sampler names in the recorder: #{url}, #{method}, #{scheme}, #{host}, #{port}

Other samplers

PR#5909 Use Caffeine for caching compiled scripts in JSR223 samplers instead of commons-collections4 LRUMap

General

PR#5792Add KeyStroke for start_no_timers (Start no pauses: CRTL+SHIFT+n)
PR#5899Speed up CPU-bound tests by skipping recoverRunningVersion for elements that are shared between threads (the ones that implement NoThreadClone)
PR#5914Use Locale.ROOT instead of default locale for toUpperCase, and toLowerCase to avoid surprises with dotless I in tr_TR locale
PR#5885Use Java’s ServiceLoader for loading plugins instead of classpath scanning. It enables faster startup
PR#5788FunctionProperty no longer caches the value. Previously it cached the values based on iteration number only which triggered wrong results on concurrent executions. The previous behavior can be temporary restored with function.cache.per.iteration property.
PR#5920Improve HTTP HeaderManager performance when it contains many headers: skip reinitialization on each iteration
PR#5920Use AtomicInteger and AtomicLong instead of synchronized primitives for JMeterContextService#numberOfThreads
PR#5920Cache bean properties in TestBeanHelper and avoid synchronization, so test plans with TestBean-based elements is faster
PR#5920Improve computation when many threads actively produce samplers by using LongAdder and similar concurrency classes to avoid synchronization in Calculator
PR#5920Reduce synchronization contention on AbstractTestElement that are shared between threads (the ones that implement NoThreadClone)
PR#5934Added caching for date formatters for __time function
PR#710 Issue#5666Added Shortcut key event for Reset search: ctrl + alt + F, cmd + alt + F
PR#5959TestElement has been migrated to Kotlin, so nullable types are annotated better
PR#5944Add PI for declaring TestElement schemas so element properties are easier to access in code (see TestElementSchema, TestElement#getSchema(), TestElement#getProps())
PR#5944Enable usage of \${...} expressions for checkbox controls (see context menus for checkboxes, however, the individual components should be adapted individually)
PR#678Experimental Kotlin and Java DSL for programmatic test plan generation (see Creating a plan with Kotlin DSL)

Non-functional changes

PR#725Add Chinese Simplified Translation for Open Model Thread Group
PR#5710Add GitHub Issue templates
PR#5910Use Caffeine for caching customizers in TestBeanGUI instead of commons-collections4 LRUMap
PR#5713 PR#5931Update Spock to 2.3-groovy-3.0 (from 2.1-groovy-3.0)
Issue#5718Update Apache commons-text to 1.10.0 (from 1.9)
PR#5731Update docs for changeCase function. UPPER is the default
PR#5924Update Apache commons-io to 2.12.0 (from 2.11.0)
PR#5921Update Jackson Core to 2.15.1 (from 2.13.3)
PR#5921Update Jackson Databind to 2.15.1 (from 2.13.3)
PR#5725Update Tika Parser to 1.28.5 (from 1.28.3)
PR#5725Update JSoup to 1.16.1 (from 1.15.1)
PR#5725Update Apache commons-net to 3.9.0 (from 3.8.0)
PR#5725Update XStream to 1.4.20 (from 1.4.19)
PR#5763 PR#5814Updated Gradle to 8.1.1 (from 7.2)
PR#5854Added Apache Httpclient5 5.1.3
PR#5833Update Apache Freemarker to 2.3.32 (from 2.3.31)
PR#5830Update Apache Groovy to 3.0.17 (from 3.0.11)
PR#5862Update Apache Httpclient to 4.5.14 (from 4.5.13)
PR#5880Update Apache Xalan to 2.7.3 (from 2.7.2)
PR#5854Update Saxon-HE to 11.5 (from 11.5)
PR#5840 PR#5930Update accessors-smart to 2.4.11 (from 2.4.8)
PR#5837Update asm to 9.5 (from 9.3)
PR#5840 PR#5930Update json-smart to 2.4.11 (from 2.4.8)
PR#5814Update kotlin-stdlib to 1.8.21 (from 1.6.21)
PR#5889 PR#5918 PR#5814Update kotlinx-coroutines-core to 1.8.21 (from 1.6.21)
PR#5889 PR#5918 PR#5814Update kotlinx-coroutines-swing to 1.8.21 (from 1.6.21)
PR#5907Update lets-plot-batik to 3.2.0 (from 2.1.1)
PR#5907Update lets-plot-jvm to 4.3.0 (from 3.1.1)
PR#5859Update log4j-1.2-api to 2.20.0 (from 2.17.2)
PR#5859Update log4j-api to 2.20.0 (from 2.17.2)
PR#5859Update log4j-core to 2.20.0 (from 2.17.2)
PR#5859Update log4j-slf4j-impl to 2.20.0 (from 2.17.2)
PR#5861Update neo4j-java-driver to 4.4.11 (from 4.4.6)
PR#5853Update org.jetbrains:annotations to 24.0.1 (from 23.0.0)
PR#5868 PR#5886Update ph-commons to 10.2.4 (from 10.1.6)
PR#5861Update reactive-streams to 1.0.4 (from 1.0.3)
PR#5847Update rsyntaxtextarea to 3.3.3 (from 3.2.0)
PR#5839Update svgSalamander to 1.1.4 (from 1.1.2.4)
PR#5852Update xmlgraphics-commons to 2.8 (from 2.7)
PR#5854Update xmlresolver to 4.6.4 (from 4.2.0)
PR#693Added randomized test GitHub Actions matrix for better coverage of locales and time zones
PR#5960Add OpenJDK JMH for creating microbenchmarks in JMeter code
Issue#5961Deprecate TestElement.threadName as it is not related to TestElement

Bug fixes

HTTP Samplers and Test Script Recorder

PR#5901Fix NumberFormatException when counter is empty or not a digit on Proxy Settings panel
PR#5987 Issue#4546Encode unicode characters in filenames when sending files in HTTP Sampler

Other Samplers

PR#5736 Issue#5733Allow SampleResult#setEndTime be set in JSR223Sampler

Listeners

Issue#5740 PR#5741Fix Aggregated Graph component to cope with empty names of samplers
Issue#5807Fix an ArrayIndexOutOfBoundsException on HTTP parameters line on special case when key and value are empty, i.e.: “k1=v1&=&k2=v2”
Issue#5654 PR#5785 Fix InfluxDBRawBackendListenerClient missing data. Allow InfluxDB to insert multiple entries with the same timestamp but with different threadName. Contributed by Victor Peralta (vperaltac at github)

Timers, Assertions, Config, Pre- & Post-Processors

PR#5717Add jsonpath string to JSON Path Assertion error message so the error is easier to understand
PR#723Use correct number format on JSON Path Assertion. Contributed by andreaslind01 (andreaslind01 at gmail.com)

Report / Dashboard

Bug 66140Guess the delimiter of the CSV source, when configured one seems wrong. This is in line with the behaviour of CSVSaveService.

Documentation

Issue#5694Document changed formatter for __time(). A warning will be logged, if the code u is found in the format string, as the meaning for that code has changed from day-of-week to year.

General

Bug 66157 PR#719Correct theme for darklaf on rsyntaxtextarea
Issue#5872 PR#5874Trim name in Argument objects.
PR#693Avoid wrong results when Object.hashCode() happen to collide. Use IdentityHashMap instead of HashMap when key is TestElement
Refresh UI when dragging JMeter window from one monitor to another, so rich syntax text areas are properly editable after window movement
PR#5984AbstractTestElement#clone might produce non-identical clones if element constructor adds a non-default property value

Thanks

We thank all contributors mentioned in bug and improvement sections above:

Alex Schwartz, @alexsch01
Andreas Lind, @andreaslind01
Arnout Engelen, @raboof
Clay Johnson, @clayburn
David Getzlaff, @dgetzlaf
Kai Lehmann, @lehmannk
kaola89, @kaola89
Matt Tansley, @matthewt-assurity
Mohamed Ibrahim, @rollno748
Ori Marko, @orimarko
PJ Fanning, @pjfanning
Sandra Thieme, @sandra-thieme
Stefan Seide, @sseide
Victor Peralta, @vperaltac
Vincent DABURON, @vdaburon

We also thank bug reporters who helped us improve JMeter.

Apologies if we have omitted anyone else.

Known problems and workarounds

Issue#6008 ThreadGroups are running endlessly in non-gui mode (fixed in 5.6.1, see PR#6011)
Issue#6043 Min is always 0 in Summary Report (fixed in 5.6.3)
PR#5987HTTP sampler sends filenames with percent-encoded UTF-8, however it is not aligned with the browsers. The workaround is to refrain non-ASCII filenames
Issue#6004Java Request sampler cannot be enabled again after disabling in UI (fixed in 5.6.1, PR#6012)
The Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).
The numbers that appear to the left of the green box are the number of active threads / total number of threads, the total number of threads only applies to a locally run test, otherwise it will show 0 (see Bug 55510).
Note that under some windows systems you may have this WARNING: java.util.prefs.WindowsPreferences WARNING: Could not open/create prefs root node Software\JavaSoft\Prefs at root 0 x80000002. Windows RegCreateKeyEx(…) returned error code 5. The fix is to run JMeter as Administrator, it will create the registry key for you, then you can restart JMeter as a normal user and you won’t have the warning anymore.
You may encounter the following error: java.security.cert.CertificateException: Certificates does not conform to algorithm constraints if you run a HTTPS request on a web site with a SSL certificate (itself or one of SSL certificates in its chain of trust) with a signature algorithm using MD2 (like md2WithRSAEncryption) or with a SSL certificate with a size lower than 1024 bits. This error is related to increased security in Java 8+. To allow you to perform your HTTPS request, you can downgrade the security of your Java installation by editing the Java jdk.certpath.disabledAlgorithms property. Remove the MD2 value or the constraint on size, depending on your case. This property is in this file: JAVA_HOME/jre/lib/security/java.security See Bug 56357 for details.
Under Mac OSX Aggregate Graph will show wrong values due to mirroring effect on numbers. This is due to a known Java bug, see Bug JDK-8065373 The fix is to use JDK8_u45 or later.
View Results Tree may fail to display some HTML code under HTML renderer, see Bug 54586. This is due to a known Java bug which fails to parse “px” units in row/col attributes. See Bug JDK-8031109 The fix is to use JDK9 b65 or later.
JTable selection with keyboard (SHIFT + up/down) is totally unusable with Java 7 on Mac OSX. This is due to a known Java bug JDK-8025126 The fix is to use JDK 8 b132 or later.
Since Java 11 the JavaScript implementation Nashorn has been deprecated. Java will emit the following deprecation warnings, if you are using JavaScript based on Nashorn. Warning: Nashorn engine is planned to be removed from a future JDK release To silence these warnings, add -Dnashorn.args=--no-deprecation-warning to your Java arguments. That can be achieved by setting the enviroment variable JVM_ARGS export JVM_ARGS="-Dnashorn.args=--no-deprecation-warning"
With Java 15 the JavaScript implementation Nashorn has been removed. To add back a JSR-223 compatible JavaScript engine you have two options: Use Mozilla Rhino : Copy rhino-engine-1.7.14.jar into $JMETER_HOME/lib/ext. Use OpenJDK Nashorn : The OpenJDK Nashorn implementation comes as a module. To use it, you will have to download it and add it to the module path. A hacky way to download the version 15.0 (or later) and its dependencies and set the module path is outlined below: mkdir lib/modules pushd lib/modules wget https://repo1.maven.org/maven2/org/openjdk/nashorn/nashorn-core/15.3/nashorn-core-15.3.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm/9.5/asm-9.5.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-commons/9.5/asm-commons-9.5.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-util/9.5/asm-util-9.5.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-tree/9.5/asm-tree-9.5.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-analysis/9.5/asm-analysis-9.5.jar popd export JVM_ARGS="--module-path $PWD/lib/modules" ./bin/jmeter

Version 5.5

Summary

[New and Noteworthy](#New and Noteworthy)
[Incompatible changes](#Incompatible changes)
[Bug fixes](#Bug fixes)
Improvements
[Non-functional changes](#Non-functional changes)
[Known problems and workarounds](#Known problems and workarounds)
Thanks

New and Noteworthy

JMeter now supports Java 17

JMeter 5.5 ships with log4j2 2.17.2

Open Model Thread Group

New component: [Open Model Thread Group](/./usermanual/component-reference/#Open_Model_Thread_Group) allows creating load profiles with variable load.

For example, if you need to gradually increase load from 0/sec to 10/sec during minute you could previously use Thread Group + Timer combinations. However, then you need to compute the expected number of threads, ensure they are created only when needed, and so on.

With Open Model Thread Group you can configure the same load profile as rate(0/sec) random_arrivals(1 minute) rate(10/sec). The thread group would spawn threads as needed to drive the configured load. The load profile can use properties, so you can launch the same script with slightly different load levels, however, the profile can’t be updated while the test is running.

The new thread group is experimental in JMeter 5.5, so please feel free to submit your feedback.

Open Model Thread Group sample

Preparing the deprecation of Oro Regex usage

Another experimental feature in JMeter 5.5 is the ability to replace the Oro based Regex implementation by the built-in Java based one. To choose the Java based one, set the JMeter property jmeter.regex.engine to the value java.

Core improvements

Kotlin language is now used in some core classes and tests (e.g. Open Model Thread Group). JMeter is compiled with apiTarget=1.5, and it ships with kotlin-stdlib 1.6.

lets-plot-kotlin charting library is added, so it will be easier to refine and create new charts in UI in the future.

Improvements

Thread Groups

New component: [Open Model Thread Group](/./usermanual/component-reference/#Open_Model_Thread_Group)

HTTP Samplers and Test Script Recorder

Bug 65027Detect mime-type for files automatically when adding files to HTTP Sampler
Bug 65020HTTP Sampler/Files upload tab - add missing buttons
PR#650HTTP Sampler timestamp fix when exception is caught. Contributed by Konstantin Kalinin (konstantin at kkalinin.pro)
Bug 65328 PR#666HTTP 308 Permanent Redirect is not supported. Contributed by Baptiste Gaillard (baptiste.gaillard at gmail.com)

Other samplers

Bug 65149 PR#644Encode the personal part of email addresses in SMTP Sampler
PR#638Various additions to the Bolt Sampler. Added transaction timeout, database option required for Neo4j 4.x (with multi-database support) and access mode option, that allows running against a Neo4j Enterprise Causal Cluster. Contributed by David Pecollet (david.pecollet at gmail.com)

Controllers

PR#665Increase visible lines of code in IfController and WhileController. Based on an idea by David Getzlaff (david.getzlaff at t-systems.com>).

Listeners

Bug 64988Sort properties and variables in a human expected order for DebugPostProcessor and DebugSampler
Bug 63061Sort View Results in Table in a human expected order
PR#706Try to keep UI responsive when displaying large text results. Can be configured with the new property view.results.tree.simple_view_limit

Timers, Assertions, Config, Pre- & Post-Processors

PR#638Bolt Connection Configuration: added ConnectionPoolMaxSize parameter. Contributed by David Pecollet (david.pecollet at gmail.com)
Bug 65515Allow pooling of Prepared Statements in JDBC
Bug 65299JSONPathAssertion attributes are out of order/Compare JSON objects and not their string representations.

Report / Dashboard

Bug 65353Make the estimator used for calculating percentiles on the dashboard configurable

General

Bug 61805 PR#663Add simple HTTP request template. Contributed by Ori Marko (orimarko at gmail.com)
Bug 65611 PR#673Add support for IPv6 addresses when specifying a remote worker node. Based on a patch by Peter Wong (peter.wong at csexperts.com)
Reduce memory consumption by the logging panel (disable undo events for it)
Bug 63620 PR#694Fix GUI freeze when viewing response body with long line breaks
PR#699Add documentation for Graphite Backend Listener. Contributed by Ji Hun (jihunkimkw at gmail.com)
Bug 57672 PR#700Add a switch (jmeter.regex.engine) to replace Oro Regex implementation by the built-in Java one.

Non-functional changes

Added Kotlin 1.6.21 for JMeter engine implementation (apiVersion=1.5). The set of JSR 223 languages is intact.
Bug 65128 PR#643Add missing documentation about Same user on each iteration for Thread Groups. Contributed by njkuzas.
PR#648Updated xmlgraphics-commons to 2.6 (from 2.3). Contributed by Stefan Seide (stefan at trilobyte-se.de)
PR#655 PR#667 PR#675 PR#698Updated x-stream to 1.4.19 (from 1.4.15). Contributed by Stefan Seide (stefan at trilobyte-se.de)
PR#656 PR#668Updated json-smart to 2.4.8 (from 2.3), accessors-smart to 2.4.8 (from 1.2) and asm 9.3 (from 9.0). Contributed by Stefan Seide (stefan at trilobyte-se.de)
Bug 64831Log truststore entries in debug level for logger org.apache.jmeter.util.keystore.JmeterKeyStore
Bug 65232Hide splash screen when an error is displayed because the test plan could not be parsed.
Updated Groovy to 3.0.11 (from 3.0.7).
Updated Darklaf to 2.7.3 (from 2.5.4).
Updated Apache ActiveMQ to 15.6.4 (from 15.6.0).
Updated Asm to 9.2 (from 9.1).
Updated Bouncycastle to 1.70 (from 1.67).
Updated Caffeine to 2.9.3 (from 2.8.8).
Updated Apache commons-dbcp2 to 2.9.0 (from 2.8.0).
Updated Apache commons-io to 2.11.0 (from 2.8.0).
Updated Apache commons-lang3 to 3.12.0 (from 3.11).
Updated Apache commons-net to 3.8.0 (from 3.7.2).
Updated Apache commons-pool2 to 2.11.1 (from 2.9.0).
Updated equalsverifier to 3.10 (from 3.4.2).
Updated Apache Freemarker to 2.3.31 (from 2.3.30).
Updated hsqldb to 2.5.2 (from 2.5.0).
Updated Apache HttpClient to 4.5.13 (from 4.5.12).
Updated Apache HttpCore to 4.4.15 (from 4.4.13).
Updated jacoco to 0.8.7 (from 0.8.5).
Updated json-path to 2.7.0 (from 2.4.0).
Updated jsoup to 1.15.1 (from 1.13.1).
Updated JUnit to 4.13.2 and 5.8.2 (from 4.13.1 and 5.7.0).
Updated Apache log4j2 to 2.17.2 (from 2.13.3).
Updated Miglayout to 5.3 (from 5.2).
Updated Neo4j Java driver to 4.4.6 (from 4.2.0).
Updated Objenesis to 3.2 (from 2.6).
Updated ktlint to 0.40.0
Updated PH CSS and PH commons to 6.5.4 and 10.1.6 (from 6.2.3 and 9.5.1).
Updated RSyntaxTextArea to 3.2.0 (from 3.1.1).
Updated SLF4J to 1.7.36 (from 1.7.30).
Updated SvgSalamander to 1.1.2.4 (from 1.1.2.1).
PR#698Updated Apache Tika to 1.28.3 (from 1.26).
Updated WireMock-JRE8 to 2.30.0 (from 2.24.1).
Updated com.github.vlsi.vlsi-release-plugins 1.76 (from 1.74).
Updated jackson to 2.13.3 (from 2.10.5)
Updated jmespath to 0.5.1
Updated Saxon-HE to 11.2 (from 9.9.1-8)
Updated Apache xmlgraphics commons to 2.7 (from 2.6)
PR#671Move example definition of property jmeter.reportgenerator.statistic_window to user.properties, as it is read from that place. Contributed by Rithvik Patibandla (rithvikp98 at gmail.com)
Bug 65456Updated commons-jexl 3 to 3.2.1 (from 3.1). Contributed by Ori Marko (orimarko at gmail.com>)
PR#654Try do give better feedback while loading keystores
PR#672Add more details to documentation for timeShift function. Contributed by Mariusz (mawasak at gmail.com)
Updated Gradle to 7.3 (from 7.2)
PR#689Code clean up in StringFromFile. Contributed by Sampath Kumar Krishnasamy (sampathkumar.krishnasamykuppusamy at aexp.com)
PR#690Refactor a few unit tests. Contributed by Sampath Kumar Krishnasamy (sampathkumar.krishnasamykuppusamy at aexp.com)
PR#692>Fix a few deprecation warnings for Gradle. Contributed by Sampath Kumar Krishnasamy (sampathkumar.krishnasamykuppusamy at aexp.com)
PR#697>Junit 5 tests to use asserts from Junit 5 API. Contributed by Sampath Kumar Krishnasamy (sampathkumar.krishnasamykuppusamy at aexp.com)
Bug 65983 PR#707Use current screenshot for save-to-file listener in documentation. Based on patch by NaveenKumar Namachivayam (catch.nkn at gmail.com)
PR#708Make errorprone happier. Based on patch by Wilson Kurniawan (wilson at visenze.com)>
Updated Rhino JavaScript to 1.7.14 (from 1.7.13)

Bug fixes

HTTP Samplers and Test Script Recorder

Bug 65310Don’t let users override multipart/form-data content-type header in HC4 sampler.
Bug 65363NullPointerException in HTTPHC4Impl$ManagedCredentialsProvider.getAuthorizationForAuthScope when 401 response from remote and httpclient4.auth.preemptive=false
Bug 65692HTTP(s) Test Script Recorder: Enable setting enabled cipher suite and enabled protocols on SSLContext/ Align SSL properties between Java and HC4 implementation
Bug 65108Support JMeter variables in GraphQL HTTP Request
Bug 65864Catch NullPointerException from JSoup when recording a test plan

Other Samplers

Bug 65152OS Process Sampler - Cannot Add from Clipboard Command parameters
PR#638Bolt Sampler: fixed error displaying results when “Record Query Results” is enabled. Contributed by David Pecollet (david.pecollet at gmail.com)

Controllers

Listeners

Bug 64962Save CSV sub-results recursively from View Results Tree
Bug 65784No Graphs displayed in Aggregate Report/Response Time Graph
Bug 65884GUI doesn’t display response for multipart request manually encoded

Timers, Assertions, Config, Pre- & Post-Processors

Bug 65257JMESPathExtractor writes error log entries if JMESPath filter returns empty result
Bug 65259JMESPathExtractor Attribute Match No. Required
Bug 65269JSON Extractor and JSON JMESPath Extractor ignore sub-samples
Bug 65352Warning logged when Boundary Extractor doesn’t find any match
Bug 65681Use default values for null values when extracting with JSONPostProcessor
Allow setters in ConstantThroughputTimer to update the values during run time
Bug 65782Use correct message format for MessageFormat in HTMLAssertion
Bug 65794JSON Assertion always successful with indefinite paths

Functions

I18N

Report / Dashboard

Documentation

PR#658Improve javadoc. Contributed by Ori Marko (orimarko at gmail.com)

General

Bug 64318DNS Cache Manager - custom DNS resolver does not use system resolver by default
PR#641 PR#698Updated xercesImpl to 2.12.2 (from 2.12.0). Based on patch by Stefan Seide (stefan at trilobyte-se.de).
PR#645Add escaping for new lines in AbstractInfluxdbMetricsSender. Contributed by David Getzlaff (david.getzlaff at t-systems.com>)
Bug 65198Can’t copy generated function from FunctionHelper
PR#661Fix wording in doc. Contributed by BugKing (wangzhen at fit2cloud.com)
PR#664Allow whitespace in path. Contributed by Till Neunast (github.com/tilln)
Bug 65270POST application/x-www-form-urlencoded cURL code generated from Postman is not imported correctly
Silence warnings of missing font Arial on startup under Linux
Bug 65300IllegalAccessError when opening file dialog with Java 16
Bug 65336Blank labels when different elements had the same name
Bug 65522Restart doesn’t work, when parameters contain spaces
Bug 63914Simplify :src:dist:clean configuration, ensure /lib/junit/test.jar is removed on clean
PR#696Keep JSyntaxTextArea text value for use in headless mode. Contributed by Peter Paul Bakker (peter.paul.bakker at stokpop.nl)

Thanks

We thank all contributors mentioned in bug and improvement sections above:

Stefan Seide (stefan at trilobyte-se.de)
njzukas (github.com/njzukas)
David Getzlaff (david.getzlaff at t-systems.com>)
Konstantin Kalinin (konstantin at kkalinin.pro)
David Pecollet (david.pecollet at gmail.com)
Ori Marko (orimarko at gmail.com)
BugKing (wangzhen at fit2cloud.com)
Till Neunast (github.com/tilln)
Baptiste Gaillard (baptiste.gaillard at gmail.com)
Rithvik Patibandla (rithvikp98 at gmail.com)
Mariusz (mawasak at gmail.com)
peter.wong@csexperts.com
Woonsan Ko (woonsan.ko at bloomreach.com)
Chromico Rek (atech5122 at gmail.com)
Magnus Spångdal (magnus.spangdal as avanza.se)
Piotr Smietana (piotrsmietana1998 at gmail.com)
Sampath Kumar Krishnasamy (sampathkumar.krishnasamykuppusamy at aexp.com)
Ji Hun (jihunkimkw at gmail.com)
Peter Paul Bakker (peter.paul.bakker at stokpop.nl)
NaveenKumar Namachivayam (catch.nkn at gmail.com)
Wilson Kurniawan (wilson at visenze.com)

We also thank bug reporters who helped us improve JMeter.

Nikola Aleksic (nalexic at gmail.com)
Vladimir Rosu (rosuvladimir at gmail.com)

Apologies if we have omitted anyone else.

Known problems and workarounds

The Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).
The numbers that appear to the left of the green box are the number of active threads / total number of threads, the total number of threads only applies to a locally run test, otherwise it will show 0 (see Bug 55510).
Note that under some windows systems you may have this WARNING: java.util.prefs.WindowsPreferences WARNING: Could not open/create prefs root node Software\JavaSoft\Prefs at root 0 x80000002. Windows RegCreateKeyEx(…) returned error code 5. The fix is to run JMeter as Administrator, it will create the registry key for you, then you can restart JMeter as a normal user and you won’t have the warning anymore.
You may encounter the following error: java.security.cert.CertificateException: Certificates does not conform to algorithm constraints if you run a HTTPS request on a web site with a SSL certificate (itself or one of SSL certificates in its chain of trust) with a signature algorithm using MD2 (like md2WithRSAEncryption) or with a SSL certificate with a size lower than 1024 bits. This error is related to increased security in Java 8+. To allow you to perform your HTTPS request, you can downgrade the security of your Java installation by editing the Java jdk.certpath.disabledAlgorithms property. Remove the MD2 value or the constraint on size, depending on your case. This property is in this file: JAVA_HOME/jre/lib/security/java.security See Bug 56357 for details.
Under Mac OSX Aggregate Graph will show wrong values due to mirroring effect on numbers. This is due to a known Java bug, see Bug JDK-8065373 The fix is to use JDK8_u45 or later.
View Results Tree may fail to display some HTML code under HTML renderer, see Bug 54586. This is due to a known Java bug which fails to parse “px” units in row/col attributes. See Bug JDK-8031109 The fix is to use JDK9 b65 or later.
JTable selection with keyboard (SHIFT + up/down) is totally unusable with Java 7 on Mac OSX. This is due to a known Java bug JDK-8025126 The fix is to use JDK 8 b132 or later.
Since Java 11 the JavaScript implementation Nashorn has been deprecated. Java will emit the following deprecation warnings, if you are using JavaScript based on Nashorn. Warning: Nashorn engine is planned to be removed from a future JDK release To silence these warnings, add -Dnashorn.args=--no-deprecation-warning to your Java arguments. That can be achieved by setting the enviroment variable JVM_ARGS export JVM_ARGS="-Dnashorn.args=--no-deprecation-warning"
With Java 15 the JavaScript implementation Nashorn has been removed. To add back a JSR-223 compatible JavaScript engine you have two options: Use Mozilla Rhino : Copy rhino-engine-1.7.14.jar into $JMETER_HOME/lib/ext. Use OpenJDK Nashorn : The OpenJDK Nashorn implementation comes as a module. To use it, you will have to download it and add it to the module path. A hacky way to download the version 15.0 (or later) and its dependencies and set the module path is outlined below: mkdir lib/modules pushd lib/modules wget https://repo1.maven.org/maven2/org/openjdk/nashorn/nashorn-core/15.3/nashorn-core-15.3.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm/9.2/asm-9.2.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-commons/9.2/asm-commons-9.2.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-util/9.2/asm-util-9.2.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-tree/9.2/asm-tree-9.2.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-analysis/9.2/asm-analysis-9.2.jar popd export JVM_ARGS="--module-path $PWD/lib/modules" ./bin/jmeter

Version 5.4.3

Summary

This version is a fix release against the vulnerability CVE-2021-45105: Apache Log4j2 versions 2.0-alpha1 through 2.16.0 (excluding 2.12.3) did not protect from uncontrolled recursion from self-referential lookups. This allows an attacker with control over Thread Context Map data to cause a denial of service when a crafted string is interpreted.

[Non-functional changes](#Non-functional changes)
[Known problems and workarounds](#Known problems and workarounds)

Non-functional changes

Updated Apache log4j2 to 2.17.0 (from 2.16.0).

Known problems and workarounds

The Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).
The numbers that appear to the left of the green box are the number of active threads / total number of threads, the total number of threads only applies to a locally run test, otherwise it will show 0 (see Bug 55510).
Note that under some windows systems you may have this WARNING: java.util.prefs.WindowsPreferences WARNING: Could not open/create prefs root node Software\JavaSoft\Prefs at root 0 x80000002. Windows RegCreateKeyEx(…) returned error code 5. The fix is to run JMeter as Administrator, it will create the registry key for you, then you can restart JMeter as a normal user and you won’t have the warning anymore.
You may encounter the following error: java.security.cert.CertificateException: Certificates does not conform to algorithm constraints if you run a HTTPS request on a web site with a SSL certificate (itself or one of SSL certificates in its chain of trust) with a signature algorithm using MD2 (like md2WithRSAEncryption) or with a SSL certificate with a size lower than 1024 bits. This error is related to increased security in Java 8+. To allow you to perform your HTTPS request, you can downgrade the security of your Java installation by editing the Java jdk.certpath.disabledAlgorithms property. Remove the MD2 value or the constraint on size, depending on your case. This property is in this file: JAVA_HOME/jre/lib/security/java.security See Bug 56357 for details.
Under Mac OSX Aggregate Graph will show wrong values due to mirroring effect on numbers. This is due to a known Java bug, see Bug JDK-8065373 The fix is to use JDK8_u45 or later.
View Results Tree may fail to display some HTML code under HTML renderer, see Bug 54586. This is due to a known Java bug which fails to parse “px” units in row/col attributes. See Bug JDK-8031109 The fix is to use JDK9 b65 or later.
JTable selection with keyboard (SHIFT + up/down) is totally unusable with Java 7 on Mac OSX. This is due to a known Java bug JDK-8025126 The fix is to use JDK 8 b132 or later.
Since Java 11 the JavaScript implementation Nashorn has been deprecated. Java will emit the following deprecation warnings, if you are using JavaScript based on Nashorn. Warning: Nashorn engine is planned to be removed from a future JDK release To silence these warnings, add -Dnashorn.args=--no-deprecation-warning to your Java arguments. That can be achieved by setting the enviroment variable JVM_ARGS export JVM_ARGS="-Dnashorn.args=--no-deprecation-warning"
With Java 15 the JavaScript implementation Nashorn has been removed. To add back a JSR-223 compatible JavaScript engine you have two options: Use Mozilla Rhino : Copy rhino-engine-1.7.13.jar into $JMETER_HOME/lib/ext. Use OpenJDK Nashorn : The OpenJDK Nashorn implementation comes as a module. To use it, you will have to download it and add it to the module path. A hacky way to download the version 15.0 and its dependencies and set the module path is outlined below: mkdir lib/modules pushd lib/modules wget https://repo1.maven.org/maven2/org/openjdk/nashorn/nashorn-core/15.0/nashorn-core-15.0.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm/9.0/asm-9.0.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-commons/9.0/asm-commons-9.0.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-util/9.0/asm-util-9.0.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-tree/9.0/asm-tree-9.0.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-analysis/9.0/asm-analysis-9.0.jar popd export JVM_ARGS="--modulepath $PWD/lib/modules" ./bin/jmeter

Version 5.4.2

Summary

This version is a fix release against the vulnerability CVE-2021-44228: Apache Log4j2 JNDI features do not protect against attacker controlled LDAP and other JNDI related endpoints.

[Non-functional changes](#Non-functional changes)
[Known problems and workarounds](#Known problems and workarounds)

Non-functional changes

Updated Apache log4j2 to 2.16.0 (from 2.13.3).

Known problems and workarounds

The Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).
The numbers that appear to the left of the green box are the number of active threads / total number of threads, the total number of threads only applies to a locally run test, otherwise it will show 0 (see Bug 55510).
Note that under some windows systems you may have this WARNING: java.util.prefs.WindowsPreferences WARNING: Could not open/create prefs root node Software\JavaSoft\Prefs at root 0 x80000002. Windows RegCreateKeyEx(…) returned error code 5. The fix is to run JMeter as Administrator, it will create the registry key for you, then you can restart JMeter as a normal user and you won’t have the warning anymore.
You may encounter the following error: java.security.cert.CertificateException: Certificates does not conform to algorithm constraints if you run a HTTPS request on a web site with a SSL certificate (itself or one of SSL certificates in its chain of trust) with a signature algorithm using MD2 (like md2WithRSAEncryption) or with a SSL certificate with a size lower than 1024 bits. This error is related to increased security in Java 8+. To allow you to perform your HTTPS request, you can downgrade the security of your Java installation by editing the Java jdk.certpath.disabledAlgorithms property. Remove the MD2 value or the constraint on size, depending on your case. This property is in this file: JAVA_HOME/jre/lib/security/java.security See Bug 56357 for details.
Under Mac OSX Aggregate Graph will show wrong values due to mirroring effect on numbers. This is due to a known Java bug, see Bug JDK-8065373 The fix is to use JDK8_u45 or later.
View Results Tree may fail to display some HTML code under HTML renderer, see Bug 54586. This is due to a known Java bug which fails to parse “px” units in row/col attributes. See Bug JDK-8031109 The fix is to use JDK9 b65 or later.
JTable selection with keyboard (SHIFT + up/down) is totally unusable with Java 7 on Mac OSX. This is due to a known Java bug JDK-8025126 The fix is to use JDK 8 b132 or later.
Since Java 11 the JavaScript implementation Nashorn has been deprecated. Java will emit the following deprecation warnings, if you are using JavaScript based on Nashorn. Warning: Nashorn engine is planned to be removed from a future JDK release To silence these warnings, add -Dnashorn.args=--no-deprecation-warning to your Java arguments. That can be achieved by setting the enviroment variable JVM_ARGS export JVM_ARGS="-Dnashorn.args=--no-deprecation-warning"
With Java 15 the JavaScript implementation Nashorn has been removed. To add back a JSR-223 compatible JavaScript engine you have two options: Use Mozilla Rhino : Copy rhino-engine-1.7.13.jar into $JMETER_HOME/lib/ext. Use OpenJDK Nashorn : The OpenJDK Nashorn implementation comes as a module. To use it, you will have to download it and add it to the module path. A hacky way to download the version 15.0 and its dependencies and set the module path is outlined below: mkdir lib/modules pushd lib/modules wget https://repo1.maven.org/maven2/org/openjdk/nashorn/nashorn-core/15.0/nashorn-core-15.0.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm/9.0/asm-9.0.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-commons/9.0/asm-commons-9.0.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-util/9.0/asm-util-9.0.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-tree/9.0/asm-tree-9.0.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-analysis/9.0/asm-analysis-9.0.jar popd export JVM_ARGS="--modulepath $PWD/lib/modules" ./bin/jmeter

Version 5.4.1

Summary

[Incompatible changes](#Incompatible changes)
[Non-functional changes](#Non-functional changes)
[Known problems and workarounds](#Known problems and workarounds)
Thanks

Incompatible changes

Restart after LAF change has been reinstated, it had been removed in JMeter 5.3

Improvements

General

Bug 65028Add documentation for the property client.rmi.localport
Bug 65012Better handling of displaying long comments in the GUI

Non-functional changes

Updated SaxonHE to 9.9.1-8 (from 9.9.1-7)
Updated asm to 9.0 (from 7.3.1)
Updated bouncycastle to 1.67 (from 1.66)
Updated caffeine to 2.8.8 (from 2.8.0)
Updated commons-codec to 1.15 (from 1.14)
Updated commons-io to 2.8.0 (from 2.7)
Updated commons-net to 3.7.2 (from 3.7)
Updated jackson to 2.10.5 (from 2.10.3)
Updated junit to 4.13.1 (from 4.13)
Updated ph-commons to 9.5.1 (from 9.4.1)
Updated ph-css to 6.2.3 (from 6.2.1)
Updated groovy to 3.0.7 (from 3.0.5)
Updated xstream to 1.4.15 (from 1.4.14)

Bug fixes

HTTP Samplers and Test Script Recorder

Bug 64955Keystore password not reset on reload
Bug 65002HTTP(S) Test Script recorder creates an invalid Basic authentication URL. Contributed by Ubik Load Pack (https://ubikloadpack.com)
Bug 65004HTTP(S) Test Script recorder computes wrong HTTP Request breaking the application. Contributed by Ubik Load Pack (https://ubikloadpack.com)
Bug 64543On MacOSX, Darklaf- IntelliJ Theme throws NPE in javax.swing.ToolTipManager.initiateToolTip
Bug 65024Sending mime type with parameter throws IllegalArgumentException
Bug 65029Try harder to correctly guess the URL for applets, when download embedded URLs is enabled

Other Samplers

Bug 65034Ignore SocketTimeoutException on BinaryTCPClientImpl, when no EOM Byte is set. Regression introduced by commit c190641e4f0474a34a366a72364b0a8dd25bfc81 which fixed Bug 52104. That bug was bout handling the case of waiting for an EOM.

Listeners

Bug 64821When importing XML formatted jtl files, sub samplers will get renamed
Bug 65052XPath2 Tester and JSON JMESPath Tester are missing in view.results.tree.renderers_order property

Documentation

Bug 64960Change scheduler reference in Thread Group documentation. Contributed by Ori Marko
Bug 65006Illustration for completed HTTP Request Defaults element (Figure 4.4) contains misleading info

General

Bug 64957When importing example test plan JMeter displays an NullPointerException
Bug 64961Darklaf: On Windows 7, NPE in BasicEditorPaneUI.cleanDisplayProperties with Darklaf Intellij
Bug 64963Blank comment tooltip is visible
Bug 64969RemoteJMeterEngineImpl#rexit doesn’t unexport RemoteJMeterEngineImpl on exit. Contributed by luo_isaiah at qq.com
Bug 64984Darklaf LAF: Selecting a Test element does not work under certain screen resolutions on Windows. With the help of Jannis Weis
Bug 65008SampleResult.setIgnore() called from PostProcessor is not considered
Bug 64993Daklaf LAF: Menu navigation not working with keyboard shortcuts. With the help of Jannis Weis
Bug 65013POST multipart/form-data cURL code with quoted arguments is not imported correctly

Thanks

We thank all contributors mentioned in bug and improvement sections above:

Ori Marko (orimarko at gmail.com)
罗寅卓 (luo_isaiah at qq.com)
Ubik Load Pack
Jannis Weis

We also thank bug reporters who helped us improve JMeter.

Apologies if we have omitted anyone else.

Known problems and workarounds

The Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).
The numbers that appear to the left of the green box are the number of active threads / total number of threads, the total number of threads only applies to a locally run test, otherwise it will show 0 (see Bug 55510).
Note that under some windows systems you may have this WARNING: java.util.prefs.WindowsPreferences WARNING: Could not open/create prefs root node Software\JavaSoft\Prefs at root 0 x80000002. Windows RegCreateKeyEx(…) returned error code 5. The fix is to run JMeter as Administrator, it will create the registry key for you, then you can restart JMeter as a normal user and you won’t have the warning anymore.
You may encounter the following error: java.security.cert.CertificateException: Certificates does not conform to algorithm constraints if you run a HTTPS request on a web site with a SSL certificate (itself or one of SSL certificates in its chain of trust) with a signature algorithm using MD2 (like md2WithRSAEncryption) or with a SSL certificate with a size lower than 1024 bits. This error is related to increased security in Java 8+. To allow you to perform your HTTPS request, you can downgrade the security of your Java installation by editing the Java jdk.certpath.disabledAlgorithms property. Remove the MD2 value or the constraint on size, depending on your case. This property is in this file: JAVA_HOME/jre/lib/security/java.security See Bug 56357 for details.
Under Mac OSX Aggregate Graph will show wrong values due to mirroring effect on numbers. This is due to a known Java bug, see Bug JDK-8065373 The fix is to use JDK8_u45 or later.
View Results Tree may fail to display some HTML code under HTML renderer, see Bug 54586. This is due to a known Java bug which fails to parse “px” units in row/col attributes. See Bug JDK-8031109 The fix is to use JDK9 b65 or later.
JTable selection with keyboard (SHIFT + up/down) is totally unusable with Java 7 on Mac OSX. This is due to a known Java bug JDK-8025126 The fix is to use JDK 8 b132 or later.
Since Java 11 the JavaScript implementation Nashorn has been deprecated. Java will emit the following deprecation warnings, if you are using JavaScript based on Nashorn. Warning: Nashorn engine is planned to be removed from a future JDK release To silence these warnings, add -Dnashorn.args=--no-deprecation-warning to your Java arguments. That can be achieved by setting the enviroment variable JVM_ARGS export JVM_ARGS="-Dnashorn.args=--no-deprecation-warning"
With Java 15 the JavaScript implementation Nashorn has been removed. To add back a JSR-223 compatible JavaScript engine you have two options: Use Mozilla Rhino : Copy rhino-engine-1.7.13.jar into $JMETER_HOME/lib/ext. Use OpenJDK Nashorn : The OpenJDK Nashorn implementation comes as a module. To use it, you will have to download it and add it to the module path. A hacky way to download the version 15.0 and its dependencies and set the module path is outlined below: mkdir lib/modules pushd lib/modules wget https://repo1.maven.org/maven2/org/openjdk/nashorn/nashorn-core/15.0/nashorn-core-15.0.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm/9.0/asm-9.0.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-commons/9.0/asm-commons-9.0.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-util/9.0/asm-util-9.0.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-tree/9.0/asm-tree-9.0.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-analysis/9.0/asm-analysis-9.0.jar popd export JVM_ARGS="--modulepath $PWD/lib/modules" ./bin/jmeter

Version 5.4

Summary

[New and Noteworthy](#New and Noteworthy)
[Incompatible changes](#Incompatible changes)
[Bug fixes](#Bug fixes)
Improvements
[Non-functional changes](#Non-functional changes)
[Known problems and workarounds](#Known problems and workarounds)
Thanks

New and Noteworthy

UX improvements

Bug 62179 Bug 64658The splash screen is now application-modal rather than system-modal, so it does not block other applications when JMeter is starting up.

Incompatible changes

Remove LogKit logger functionality from some classes. This was intended to completely remove LoggingManager class (it has been deprecated since JMeter 3.2), but as jmeter-plugins depended on it, LoggingManager and our LogKit-adapter will remain for this version (but is still deprecated).

Improvements

HTTP Samplers and Test Script Recorder

Bug 53848 Bug 63527Implement a new setting to allow the exclusion of embedded URLs
Bug 64696 PR#571 PR#595Freestyle format for names in (Default)SamplerCreater. Based on a patch by Vincent Daburon (vdaburon at gmail.com)
Bug 64752Add GraphQL/HTTP Request Sampler. Contributed by woonsan.

Other samplers

Bug 64555Set JMSType header field through JMSProperties. Contributed by Daniel van den Ouden

Controllers

Listeners

PR#544Add BackendListener that sends “raw” results to InfluxDB. Contributed by Graham Russell (graham at ham1.co.uk)

Timers, Assertions, Config, Pre- & Post-Processors

Functions

I18N

Report / Dashboard

Bug 64824Dashboard/HTML Report: Rename KO to FAIL
Bug 64936Increase generate_report_ui.generation_timeout to 5 minutes to handle large performance test

General

Bug 64446Better parse curl commands with backslash at line endings and support PUT method with data arguments
PR#599Ensure all buttons added to the toolbar behave/look consistently. Contributed by Jannis Weis
Bug 64581Allow SampleResult#setIgnore to influence behaviour on Sampler Error
Bug 64680Fall back to JMETER_HOME on startup to detect JMeter’s installation directory
Bug 64787 PR#630Add Korean translation. Contributed by Woonsan Ko (woonsan at apache.org)
Bug 64776Add the ability to install additional SecurityProvider. Contributed by Timo (ASF.Software.Timo at Leefers.eu)

Non-functional changes

Build system upgraded from Gradle to 6.7 (from 6.6)
PR#594Updated neo4j-java-driver to 4.2.0 (from 1.7.5)
Bug 64454More precise error message, when no datasource value can be found in JDBC sampler
Bug 64440Log exeptions reported via JMeterUtils#reportToUser even when in GUI mode
PR#591Remove deprecated sudo flag from travis file. Deng Liming (liming.d.pro at gmail.com)
Updated Darklaf to 2.4.10 (from 2.1.1)
Updated Groovy to 3.0.5 (from 3.0.3)
PR#596Use neutral words in documentation
Bug 63809 PR#557Updated commons-collections to 4.4 (from 3.2.2) while keeping the jars for the old commons-collections 3.x for compatibility
PR#598Add another option for creating diffs to the building page. Contributed by jmetertea (github.com/jmetertea)
PR#609Make use of newer API for darklaf installation. Jannis Weis
PR#612Correct typos in README.md. Based on patches by Pooja Chandak (poojachandak002 at gmail.com)
PR#613Add documentation for Darklaf properties. Jannis Weis
Update SpotBugs to 4.1.2 (from 4.1.1), upgrade spotbugs-gradle-plugin to 4.5.0 (from 2.0.0)
Update org.sonarqube Gradle plugin to 3.0 (from 2.7.1)
Update Apache ActiveMQ to 5.16.0 (from 5.15.11)
Update Bouncycastle to 1.66 (from 1.64)
Update Apache commons-io to 2.7 (from 2.6)
Update Apache commons-lang3 to 3.11 (from 3.10)
Update Apache commons-net to 3.7 (from 3.6)
Update Apache commons-pool2 to 2.9.0 (from 2.8.0)
Update Apache commons-text to 1.9 (from 1.8)
Update equalsverifier to 3.4.2 (from 3.1.13)
Update junit5 to 5.6.2 (from 5.6.0)
Update Apache log4j2 to 2.13.3 (from 2.13.1)
Update rsyntaxtextarea to 3.1.1 (from 3.1.0)
Update JUnit5 to 5.7.0 (from 5.6.2)
Update Rhino to 1.7.13 (from 1.7.12)
Update XStream to 1.4.14 (from 1.4.14.1)
Update Apache commons-dbcp2 to 2.8.0 (from 2.7.0)
PR#635Correct some image ratios in the documentation. Patch provided by Vincent Daburon (vdaburon at gmail.com)

Bug fixes

HTTP Samplers and Test Script Recorder

Bug 64479Regression: HTTP(s) Script Recorder prevents proper shutdown in non-GUI mode
Bug 64653Exclude Javascript and JSON from parsing for charsets from forms by proxy

Other Samplers

Controllers

Bug 64795Generate summary report may not output a summary line in the configured interval (summariser.interval): Clarify documentation

Listeners

Timers, Assertions, Config, Pre- & Post-Processors

Bug 64638JSON JMESPath Assertion / JSON Assertion: Opening GUI shows a horizontal scrollbar that keeps sliding
Bug 64915JMeter Cache Manager misbehaving when “Use Cache-Control/Expires header” is checked

Functions

I18N

Report / Dashboard

Bug 64547Report/Dashboard: Ensure graphs Response codes per second is not broken by empty response code in SampleResult. Contributed by Ubik Load Pack (https://ubikloadpack.com)
Bug 64617HTML report: In graph Response Time Percentiles Over Time 90,95,99th percentile correspond in reality to 0.90, 0.95 and 0.99 percentiles
Bug 64553When using Transaction Controller, send Bytes and Received Bytes are displayed as 0 in the influxdb(BackendListener)
Bug 64624Use less aggressive escaping for JSON Strings in reports error messages

Documentation

PR#571Correct documented name of generated CA when using proxy script recorder. Part of a bigger PR. Vincent Daburon (vdaburon at gmail.com)
Change documentation of the special header functionality of the mirror server to reflect the implementation.

General

Bug 64448User Defined Variable Duplication in Right Click Context Menu
Bug 64499Exiting JMeter when jmeterengine.stopfail.system.exit=true takes too much time if threads are not stopped
Bug 64510Darklaf- IntelliJ Theme throws NPE in DarkTreeUI on MacOS
Bug 64594Unable to enter variable values instead of numeric values in components using PowerTableModel (Impacts 3rd party plugins like Throughput Shaping Timer)
Bug 64475Menu Generate HTML Report: When report generation fails due to timeout, error message is not explicit. Contributed by Ubik Load Pack (https://ubikloadpack.com)
Bug 64627Programmatic manipulation of the control flow via API methods of JMeterContext is not working as it used to before 5.0. Contributed by Till Neunast
Bug 64647groovy-dateutil is missing in distribution
Bug 64640Darklaf: NPE at com.github.weisj.darklaf.ui.DarkPopupFactory.getPopupType(DarkPopupFactory.java:96)
Bug 64641Darklaf: NPE at com.github.weisj.darklaf.ui.tree.DarkTreeUI.isChildOfSelectionPath(DarkTreeUI.java:603) ~[darklaf-core-2.4.2-SNAPSHOT.jar:2.4.2-SNAPSHOT]
Bug 64453Darklaf: Save Test Plan as New Folder failure
Bug 64625Darklaf: trying to select a folder in Browse leads to an error popup and stacktrace
Bug 64711Textarea Colors are not good in dark modes. Contributed by Jannis Weis
Bug 64935A broken plugin class should not prevent JMeter from starting

Thanks

We thank all contributors mentioned in bug and improvement sections above:

Michael Weidmann (https://github.com/michaelweidmann)
Deng Liming (liming.d.pro at gmail.com)
jmetertea (https://github.com/jmetertea)
Ubik Load Pack
Jannis Weis
Daniel van den Ouden
Till Neunast (https://github.com/tilln)
Pooja Chandak (poojachandak002 at gmail.com)
Vincent Daburon (vdaburon at gmail.com)
Woonsan Ko (woonsan at apache.org)
Timo (ASF.Software.Timo at Leefers.eu)
Graham Russell (graham at ham1.co.uk)

We also thank bug reporters who helped us improve JMeter.

Hiroyoshi Mitsumori (mitsumori at mis.dev)

Apologies if we have omitted anyone else.

Known problems and workarounds

The Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).
The numbers that appear to the left of the green box are the number of active threads / total number of threads, the total number of threads only applies to a locally run test, otherwise it will show 0 (see Bug 55510).
Note that under some windows systems you may have this WARNING: java.util.prefs.WindowsPreferences WARNING: Could not open/create prefs root node Software\JavaSoft\Prefs at root 0 x80000002. Windows RegCreateKeyEx(…) returned error code 5. The fix is to run JMeter as Administrator, it will create the registry key for you, then you can restart JMeter as a normal user and you won’t have the warning anymore.
You may encounter the following error: java.security.cert.CertificateException: Certificates does not conform to algorithm constraints if you run a HTTPS request on a web site with a SSL certificate (itself or one of SSL certificates in its chain of trust) with a signature algorithm using MD2 (like md2WithRSAEncryption) or with a SSL certificate with a size lower than 1024 bits. This error is related to increased security in Java 8+. To allow you to perform your HTTPS request, you can downgrade the security of your Java installation by editing the Java jdk.certpath.disabledAlgorithms property. Remove the MD2 value or the constraint on size, depending on your case. This property is in this file: JAVA_HOME/jre/lib/security/java.security See Bug 56357 for details.
Under Mac OSX Aggregate Graph will show wrong values due to mirroring effect on numbers. This is due to a known Java bug, see Bug JDK-8065373 The fix is to use JDK8_u45 or later.
View Results Tree may fail to display some HTML code under HTML renderer, see Bug 54586. This is due to a known Java bug which fails to parse “px” units in row/col attributes. See Bug JDK-8031109 The fix is to use JDK9 b65 or later.
JTable selection with keyboard (SHIFT + up/down) is totally unusable with Java 7 on Mac OSX. This is due to a known Java bug JDK-8025126 The fix is to use JDK 8 b132 or later.
Since Java 11 the JavaScript implementation Nashorn has been deprecated. Java will emit the following deprecation warnings, if you are using JavaScript based on Nashorn. Warning: Nashorn engine is planned to be removed from a future JDK release To silence these warnings, add -Dnashorn.args=--no-deprecation-warning to your Java arguments. That can be achieved by setting the enviroment variable JVM_ARGS export JVM_ARGS="-Dnashorn.args=--no-deprecation-warning"
With Java 15 the JavaScript implementation Nashorn has been removed. To add back a JSR-223 compatible JavaScript engine you have two options: Use Mozilla Rhino : Copy rhino-engine-1.7.13.jar into $JMETER_HOME/lib/ext. Use OpenJDK Nashorn : The OpenJDK Nashorn implementation comes as a module. To use it, you will have to download it and add it to the module path. A hacky way to download the version 15.0 and its dependencies and set the module path is outlined below: mkdir lib/modules pushd lib/modules wget https://repo1.maven.org/maven2/org/openjdk/nashorn/nashorn-core/15.0/nashorn-core-15.0.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm/9.0/asm-9.0.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-commons/9.0/asm-commons-9.0.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-util/9.0/asm-util-9.0.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-tree/9.0/asm-tree-9.0.jar wget https://repo1.maven.org/maven2/org/ow2/asm/asm-analysis/9.0/asm-analysis-9.0.jar popd export JVM_ARGS="--modulepath $PWD/lib/modules" ./bin/jmeter

Version 5.3

Summary

[New and Noteworthy](#New and Noteworthy)
[Incompatible changes](#Incompatible changes)
[Bug fixes](#Bug fixes)
Improvements
[Non-functional changes](#Non-functional changes)
[Known problems and workarounds](#Known problems and workarounds)
Thanks

New and Noteworthy

UX improvements

Added Darklaf look and feel that improves several components.

Tree indentation level is easier to follow:

JMeter tree with Darklaf Darcula theme

JMeter tree with Darklaf IntelliJ theme

New look and feel themes. Light: IntellJ, Solarized Light, HighContrast Light. Dark: OneDark, Solarized Dark, HighContrast Dark.

When an element in tree is disabled, all its descendants are shown in gray. For instance, While Contoller is disabled in the following tree, so its children are gray. It is purely a UI change, and the behavior is not altered.

While controller is disabled, so its children are gray

Tree context menu is shown even in case the node selection is changed. Previously the popup did disappear and it was required to select a node first and only then launch popup.

Look and feel can now be updated without a restart

Use CTRL + ALT + wheel for zooming fonts. Previous shortcut was CTRL + SHIFT + wheel, however, it conflicted with horizontal scrolling.

In-app zoom is more consistent (e.g. sometimes not all the labels or even panels were scaled). For instance: log viewer, JSR223 code editor were not previously scaled with zoom-in/out feature

Tree context menu is shown for the full row, not for the label only

Undo and redo support for editable fields. Keystrokes are CTRL + Z / CTRL + SHIFT + Z, or CMD + Z/ CMD + SHIFT + Z depending on the operating system. Undo is implemented on a field level basis (each fields has its own history), and the history is invalidated when tree selection changes.

Mark the currently selected language in the options menu.

Mark the currently selected log level in the options menu.

Rework of many Test Element UI (JUnit Request, ForEach Controller, If Controller, Throughput Controller, WhileController, Counter Config, XPath2 Extractor, Function Helper Dialog, Search popup, JMS Elements)

Incompatible changes

Default value of httpclient4.time_to_live has been modified from 2000 to 60000, this means HTTP connections will live longer than before. This has impact on connection creation and SSL handshake, see Bug 64289
The update to Groovy 3 (PR#590) might break some old Groovy code of your tests. Have a look at the update notes for Groovy 3

Improvements

HTTP Samplers and Test Script Recorder

Bug 64160Test HTTP/S Test Script Recorder: Name transaction controller/ simple controller using prefix without “-XXXX” suffix
Bug 64289Make httpclient4.time_to_live to 60000 to be closer to typical browser behavior

Other samplers

Bug 64288JUnit Request: Improve UX
Bug 64407Improve JMS Publisher UX. Contributed by Ubik Load Pack (https://ubikloadpack.com)
Bug 64408Improve JMS Subscriber UX. Contributed by Ubik Load Pack (https://ubikloadpack.com)

Controllers

Bug 64277ForEach Controller: Improve UX
Bug 64280If Controller: Improve UX
Bug 64282Throughput Controller: Improve UX
Bug 64287WhileController: Improve UX

Listeners

Bug 64150View Results Tree: Allow editing of response data in testers
Bug 63822View Results Tree: Keep position of split pane while switching renderer mode

Timers, Assertions, Config, Pre- & Post-Processors

Bug 64091Precise Throughput Timer schedule generation is improved significantly (e.g. 2 seconds for 10M samples)
Bug 64281Counter Config: Improve UX
Bug 64283XPath2 Extractor: Improve UX

Functions

Bug 64070_timeshift function does not work with offset formatters
Bug 64275Function Helper Dialog: Improve UX

I18N

Bug 64102Add Chinese translation for Tools menu. Contributed by Liu XP (liu_xp2003 at sina.com)

Report / Dashboard

Bug 64380Add a ‘Median’ field to the dashboard and make the response time percentile fields support floating-point numbers. Contributed by Keith Mo(https://github.com/keithmork)
Bug 64378HTML report generation should not fail if a plugin has registered a graph and is not more present in classpath, issue a warning instead

General

Bug 63458 PR#551Add new template “Functional Testing Test Plan [01]”. Contributed by Sebastian Boga (sebastian.boga at endava.com)
Bug 64119Use first renderer from view.results.tree.renderers_order property as default in View Results Tree
Bug 64148Use gray icons for disabled elements in the tree, display subtree as gray
Bug 64198Allow spaces in \${...} expressions around functions.
Bug 64276Search popup: Improve UX
PR#573Improve the startup time: skip test plan UI initialization
PR#585Added JEXL3 as a syntax alias for JSyntaxTextArea. Contributed by drivera-armedia (https://github.com/drivera-armedia)
PR#590Update Groovy to 3.0.3.

Non-functional changes

Build system upgraded from Gradle to 6.3 (from 6.1), Java 14 can be used now for the build
Bug 63963 PR#546Updated jackson to 2.10.3 (from 2.9.10)
Bug 64120Updated jsoup to 1.13.1 (from 1.12.1)
Bug 63809Updated commons-dbcp2 to 2.7.0 (from 2.5.0)
Updated Apache ActiveMQ to 5.15.11 (from 5.15.8)
Updated bouncycastle to 1.64 (from 1.60)
Updated asm to 7.3.1 (from 7.1)
Updated Apache commons-codec to 1.14 (from 1.13)
Updated Apache commons-pool to 2.8.0 (from 2.7.0)
Updated equalsverifier to 3.1.9 (from 3.1.12)
Updated Apache Groovy to 2.4.18 (from 2.4.16)
Updated hsqldb to 2.5.0 (from 2.4.1)
Updated hamcrest to 2.2 (from 2.1)
Updated Apache httpclient and httpmime to 4.5.12 (from 4.5.10)
Updated Apache httpcore and httpcore-nio to 4.4.13 (from 4.4.12)
Updated Apache Tika to 1.24.1 (from 1.22)
Updated jmespath to 0.5.0 (from 0.3.0)
Updated Apache log4j to 2.13.1 (from 2.12.1)
Updated junit4 to 4.13 (from 4.12)
Updated junit5 to 5.6.0 (from 5.5.1)
Updated slf4j to 1.7.30 (from 1.7.28)
Updated ph-commons to 9.4.1 (from 9.3.7)
Updated ph-css to 6.2.2 (from 6.2.0)
Updated rsyntaxtextarea to 3.1.0 (from 3.0.4)
Updated rhino to 1.7.12 (from 1.7.11)
Updated SaxonHE to 9.9.1-7 (from 9.9.1-5)
Updated cglib to 3.2.12 (from 3.2.9)
Updated commons-lang3 to 3.10 (from 3.9)
Updated freemarker to 2.3.30 (from 2.3.29)
Updated hamcrest-date to 2.0.7 (from 2.0.4)
Updated equalsverifier to 3.1.13 (from 3.1.12)
Updated xstream to 1.4.11.1 (from 1.4.11)
PR#559Add a note to the source of TrustAllSSLSocketFactory, that it is not secure to trust everyone. Based on a PR from YYTVicky (yytvicky at github)
PR#588Add documentation on usage of InfluxDB v2 for real-time results. Based on PR from Jakub Bednář (jakub.bednar at gmail.com)

Bug fixes

HTTP Samplers and Test Script Recorder

Bug 64400Make sorting recorded samples into transaction controllers more predictable
Bug 64267When preemptive auth is disabled HTTP Sampler does not automatically respond to Basic Auth challenge

Other Samplers

Controllers

Listeners

Timers, Assertions, Config, Pre- & Post-Processors

Bug 64091Precise Throughput Timer might produce less samples when low test duration is used
Bug 64142Presence of DebugPostProcessor in Test plan breaks ActiveThread Over time in report due to missing information
Bug 64196Recurse into sub samplers more deeply when checking assertions
Bug 64196Recurse into sampleResults for AbstractScopedTestElement#getSampleList
Bug 64381PreciseThroughputTimer: On termination, log message contains negative value

Functions

I18N

Report / Dashboard

Bug 64059Response Time Percentiles Over Time, unable to change the percentiles

Documentation

PR#547Correct Log level documentation. Contributed by jmetertea
PR#548Correct typos in documentation. Contributed by jmetertea
Bug 64022Correct Chinese translation for “Ignore Sub-Controller blocks”. Provided by yangxiaofei77 (yangxiaofei77 at gmail.com)
PR#552Fix client.rmi.localport port allocation description. Contributed by anant-93
PR#543Clarify documentation of __StringToFile function regarding default value of Append to file? parameter. Contributed by Ori Marko
Bug 64302Correct links to JMeter API in printable docs and BeanShell best practices and to JavaFX implementation website in all docs. Reported by 2477441814 (2477441814 at qq.com)

General

Bug 63945NPE when opening a file after file system change
Bug 64034Shell scripts fail if space in JAVA_HOME path. Contributed by ray7219 (ray7219 at hotmail.com)
Bug 63856Set connectTime on parent samples when using a transaction controller
Bug 64227Error when loading Templates on Windows
TestPlan UI: skip adding the entry to the classpath if the user clicks cancel

Thanks

We thank all contributors mentioned in bug and improvement sections above:

Jannis Weis
Stefan Seide (stefan at trilobyte-se.de)
jmetertea
ray7219
Sebastian Boga (sebastian.boga at endava.com)
Liu XP (liu_xp2003 at sina.com)
anant-93 (https://github.com/anant-93)
Ori Marko (orimarko at gmail.com)
Keith Mo(https://github.com/keithmork)
drivera-armedia (https://github.com/drivera-armedia)
Ubik Load Pack
Jakub Bednář (jakub.bednar at gmail.com)

We also thank bug reporters who helped us improve JMeter.

Michael McDermott (mcdermott.michaelj at gmail.com)
yangxiaofei77 (yangxiaofei77 at gmail.com)
Markus Wolf (wolfm at t-systems.com)
Pierre Astruc (pierre.astruc at evertest.com)
YYTVicky (yytvicky at github)
2477441814 at qq.com

Apologies if we have omitted anyone else.

Known problems and workarounds

The Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).
The numbers that appear to the left of the green box are the number of active threads / total number of threads, the total number of threads only applies to a locally run test, otherwise it will show 0 (see Bug 55510).
Note that under some windows systems you may have this WARNING: java.util.prefs.WindowsPreferences WARNING: Could not open/create prefs root node Software\JavaSoft\Prefs at root 0 x80000002. Windows RegCreateKeyEx(…) returned error code 5. The fix is to run JMeter as Administrator, it will create the registry key for you, then you can restart JMeter as a normal user and you won’t have the warning anymore.
You may encounter the following error: java.security.cert.CertificateException: Certificates does not conform to algorithm constraints if you run a HTTPS request on a web site with a SSL certificate (itself or one of SSL certificates in its chain of trust) with a signature algorithm using MD2 (like md2WithRSAEncryption) or with a SSL certificate with a size lower than 1024 bits. This error is related to increased security in Java 8+. To allow you to perform your HTTPS request, you can downgrade the security of your Java installation by editing the Java jdk.certpath.disabledAlgorithms property. Remove the MD2 value or the constraint on size, depending on your case. This property is in this file: JAVA_HOME/jre/lib/security/java.security See Bug 56357 for details.
Under Mac OSX Aggregate Graph will show wrong values due to mirroring effect on numbers. This is due to a known Java bug, see Bug JDK-8065373 The fix is to use JDK8_u45 or later.
View Results Tree may fail to display some HTML code under HTML renderer, see Bug 54586. This is due to a known Java bug which fails to parse “px” units in row/col attributes. See Bug JDK-8031109 The fix is to use JDK9 b65 or later.
JTable selection with keyboard (SHIFT + up/down) is totally unusable with Java 7 on Mac OSX. This is due to a known Java bug JDK-8025126 The fix is to use JDK 8 b132 or later.
Since Java 11 the JavaScript implementation Nashorn has been deprecated. Java will emit the following deprecation warnings, if you are using JavaScript based on Nashorn. Warning: Nashorn engine is planned to be removed from a future JDK release To silence these warnings, add -Dnashorn.args=--no-deprecation-warning to your Java arguments. That can be achieved by setting the enviroment variable JVM_ARGS export JVM_ARGS="-Dnashorn.args=--no-deprecation-warning"

Version 5.2.1

Summary

[New and Noteworthy](#New and Noteworthy)
[Incompatible changes](#Incompatible changes)
[Bug fixes](#Bug fixes)
Improvements
[Non-functional changes](#Non-functional changes)
[Known problems and workarounds](#Known problems and workarounds)
Thanks

New and Noteworthy

This release is a minor bugfix release. Please see the Changes history page to view the last release notes of version 5.2.

Incompatible changes

Improvements

HTTP Samplers and Test Script Recorder

Other samplers

Bug 63926JDBC Connection Configuration: Add ability to set connection properties

Controllers

Listeners

Timers, Assertions, Config, Pre- & Post-Processors

Functions

I18N

Report / Dashboard

General

Non-functional changes

Bug fixes

HTTP Samplers and Test Script Recorder

Other Samplers

Controllers

Listeners

Bug 63906NPE for InfluxDB backend listener during failover testing

Timers, Assertions, Config, Pre- & Post-Processors

Functions

I18N

Report / Dashboard

Documentation

General

Bug 63910Broken maven poms in released 5.2 version
Bug 63911ApacheJMeter_config.jar content has changed (bin moved to run and missing files)

Thanks

We thank all contributors mentioned in bug and improvement sections above:

Vincent Lee

We also thank bug reporters who helped us improve JMeter.

Apologies if we have omitted anyone else.

Known problems and workarounds

The Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).
The numbers that appear to the left of the green box are the number of active threads / total number of threads, the total number of threads only applies to a locally run test, otherwise it will show 0 (see Bug 55510).
Note that under some windows systems you may have this WARNING: java.util.prefs.WindowsPreferences WARNING: Could not open/create prefs root node Software\JavaSoft\Prefs at root 0 x80000002. Windows RegCreateKeyEx(…) returned error code 5. The fix is to run JMeter as Administrator, it will create the registry key for you, then you can restart JMeter as a normal user and you won’t have the warning anymore.
You may encounter the following error: java.security.cert.CertificateException: Certificates does not conform to algorithm constraints if you run a HTTPS request on a web site with a SSL certificate (itself or one of SSL certificates in its chain of trust) with a signature algorithm using MD2 (like md2WithRSAEncryption) or with a SSL certificate with a size lower than 1024 bits. This error is related to increased security in Java 8+. To allow you to perform your HTTPS request, you can downgrade the security of your Java installation by editing the Java jdk.certpath.disabledAlgorithms property. Remove the MD2 value or the constraint on size, depending on your case. This property is in this file: JAVA_HOME/jre/lib/security/java.security See Bug 56357 for details.
Under Mac OSX Aggregate Graph will show wrong values due to mirroring effect on numbers. This is due to a known Java bug, see Bug JDK-8065373 The fix is to use JDK8_u45 or later.
View Results Tree may fail to display some HTML code under HTML renderer, see Bug 54586. This is due to a known Java bug which fails to parse “px” units in row/col attributes. See Bug JDK-8031109 The fix is to use JDK9 b65 or later.
JTable selection with keyboard (SHIFT + up/down) is totally unusable with Java 7 on Mac OSX. This is due to a known Java bug JDK-8025126 The fix is to use JDK 8 b132 or later.
Since Java 11 the JavaScript implementation Nashorn has been deprecated. Java will emit the following deprecation warnings, if you are using JavaScript based on Nashorn. Warning: Nashorn engine is planned to be removed from a future JDK release To silence these warnings, add -Dnashorn.args=--no-deprecation-warning to your Java arguments. That can be achieved by setting the enviroment variable JVM_ARGS export JVM_ARGS="-Dnashorn.args=--no-deprecation-warning"

Version 5.2

Summary

[New and Noteworthy](#New and Noteworthy)
[Incompatible changes](#Incompatible changes)
[Bug fixes](#Bug fixes)
Improvements
[Non-functional changes](#Non-functional changes)
[Known problems and workarounds](#Known problems and workarounds)
Thanks

New and Noteworthy

This release is a major release. Please see the Changes history page to view the last release notes of version 5.1.1.

Incompatible changes

HTTP(S) Test Script Recorder now appends number at end of names, while previously it added it at beginning. See Bug 63450
When using XPath Assertion with an XPath expression returning a boolean, True if nothing matches had no effect and always returned true, see Bug 63455
XML parsing now refuses unsecure XML, this has impacts on the following features: - XMLAssertion - XMLSchemAssertion - XPath function - XPath 1 & 2 Extractors - XPath 1 & 2 Assertions

Improvements

HTTP Samplers and Test Script Recorder

Bug 63450HTTP(S) Test Script Recorder: Put number at end instead of beginning
Bug 63790Embedded Resources download: Optimize CSS parsing by removing source location

Other samplers

Bug 63406JDBC connection configuration: new option for pre-initialize to initialize the connection pool. Contributed by Franz Schwab (franz.schwab at exasol.com)
Bug 63561JDBC Request: Allow to only fetch a certain number of rows. Contributed by Franz Schwab (franz.schwab at exasol.com)
Bug 63801Add Bolt protocol support for Neo4j database. Contributed by GraphAware (www.graphaware.com)

Controllers

Bug 63565If Controller: GC issue with JMeter during the endurance run when using with “Interpret Condition as Variable Expression?” unchecked => Improve documentation

Listeners

Bug 63720BackendListener: InfluxDBBackendListenerClient Add support for InfluxDB 2. Contributed by Jakub Bednář (https://github.com/bednar)
Bug 63770View Results Tree: Add JMESPath Tester. Contributed by Ubik Load Pack (support at ubikloadpack.com)

Timers, Assertions, Config, Pre- & Post-Processors

Bug 62863Enable PKCS11 keystores for usage with KeyStore Manager. Based on patch by Clifford Harms (clifford.harms at gmail.com).
PR#457Slight performance improvement in PoissonRandomTimer by using ThreadLocalRandom. Based on a patch by Xia Li.
Bug 62787New XPath2 Assertion supporting XPath2 with better performances than XPath Assertion. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 63643Skip BOM on files opened through FileServer and use the BOM to detect the character encoding, if none is given explicitly. Reported by Havlicek Honza (havlicek.honza at gmail.com)
Bug 63727New JMESPath Extractor element to ease extraction from JSON using JMESPath technology. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 63763New JMESPath Assertion element to ease assertion on JSON using JMESPath technology. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 63775Allow Boundary Extractor to accept empty boundaries

Functions

Bug 63219New function __StringToFile to save/append a string into a file. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Use AtomicInteger for __counter instead of synchronization on our own

I18N

Report / Dashboard

Bug 63471StringConverters used for report generation should ignore white space around numbers.

General

Bug 63396JSR223 Test Elements: Description of Parameters is misleading, same for Script
Bug 63480XPathAssertion and XPathAssertion2: Improve test coverage for input coming from variable. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 63452Tools / Import from cURL: Complete coverage of all command line options that are valid in JMeter use case. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 63419Tools / Import from cURL: Add ability to import a set of cURL commands from a file. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 63760JOrphanUtils: add random alphanumeric password generator
Bug 63355View Results Tree: Browser view option is not Available since Java 11, document how to make it available, see this
Bug 62861Thread Group: Provide ability to configure whether a new iteration is a new user or same user (Would be applied on Cookie Manager, Cache Manager and httpclient.reset_state_on_thread_group_iteration). Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 63616Fix Javadoc: JMeterContext#getThreadNum() starts at 0 and not 1. Contributed by Ori Marko (orimarko at gmail.com)
Updated to httpclient/httpmime 4.5.10 (from 4.5.7)
Updated to dnsjava 2.1.9 (from 2.1.8)
Updated to jsoup 1.12.1 (from 1.11.3)
Updated to rsyntaxtextarea 3.0.4 (from 3.0.2)
Updated to caffeine 2.8.0 (from 2.6.2)
Updated to commons-codec 1.13 (from 1.11)
Updated to commons-lang3 3.9 (from 3.8.1)
Updated to commons-pool 2.7 (from 2.6)
Updated to commons-text 1.8 (from 1.6)
Updated to freemarker 2.3.29 (from 2.3.28)
Updated to httpcore/httpcore-nio 4.12 (from 4.11)
Updated to jodd 5.0.13 (from 5.0.6)
Updated to log4j 2.12.1 (from 2.11.1)
Updated to ph-commons 9.3.7 (from 9.2.1)
Updated to ph-css 6.2.0 (from 6.1.1)
Updated to Mozilla Rhino 1.7.11 (from 1.7.10)
Updated to Saxon-HE 9.9.1-5 (from 9.9.1-1)
Updated to slf4j 1.7.28 (from 1.7.25)
Updated to tika-core and tika-parsers 1.22 (from 1.21)
Updated jackson-annotations, jackson-core and jackson-databind to 2.9.10 (from 2.9.8)

Non-functional changes

Migrated from subversion to Git
Bug 63630Switch build from Apache Ant to Gradle
Bug 63529Add more unit tests for org.apache.jorphan.util.JOrphanUtils. Contributed by John Bergqvist(John.Bergqvist at diffblue.com)
Updated to latest checkstyle (version 8.22)
Clean-up of code in CompareAssertion and other locations. Based on patch by Graham Russell (graham at ham1.co.uk)
PR#491Increase Graphite metrics coverage. Contributed by Graham Russell (graham at ham1.co.uk)
PR#520Replace anonymous classes with lambda expressions. Contributed by Graham Russell (graham at ham1.co.uk).
PR#524Migration from JUnit 4 to JUnit 5. Contributed by Graham Russell (graham at ham1.co.uk).

Bug fixes

HTTP Samplers and Test Script Recorder

Bug 63298HTTP Requests with encoded URLs are being sent in decoded format
Bug 63364When setting subresults.disable_renaming=true, sub results are still renamed using their parent SampleLabel while they shouldn’t. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 63129JMeter can not identify encoding during first time page submission. Based partly on analysis and PR made by Naveen Nandwani (naveen.nandwani at india.nec.com)
Bug 62672HTTP Request sends double requests when using proxy with authentication. Based on patch by Artem Fedorov (artem.fedorov at blazemeter.com) and contributed by BlazeMeter.
Bug 63574HTTP Cache Manager does not cache resource if Cache-Control header is missing.

Other Samplers

Bug 63442Reduce scanning for LogParser implementations in AccessLogSamplerBeanInfo.
Bug 63563LdapExtSampler: When sampler fails with exception differing from NamingException, no SampleResult is generated
Bug 63469JMSPublisher: Race condition in jms.client.ClientPool#clearClient

Controllers

Listeners

Bug 63319ArrayIndexOutOfBoundsException in Aggregate Graph when selecting 90 % or 95 % columns
Bug 63423Selection of table rows in Aggregate Graph gets lost too often
Bug 63347View result tree: The search field is so small that even a single character is not visible on Windows 7
Bug 63433ListenerNotifier: Detected problem in Listener NullPointerException if filename is null. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 63674Strip results with subresults deeper in their hierarchy when DataStripping is enabled

Timers, Assertions, Config, Pre- & Post-Processors

Bug 63455XPath Assertion: True if nothing matches does not work if XPath expression returns a boolean. Contributed by Ubik Load Pack (support at ubikloadpack.com)

Functions

I18N

Report / Dashboard

Documentation

Bug 63513Add MariaDB examples to JDBC documentation. Contributed by Ori Marko (orimarko at gmail.com)
Bug 63484Add notes to use Apache Velocity as JSR223 script language. Based on a patch by Ori Marko (orimarko at gmail.com)
Bug 63519 PR#471Use correct method getLabelResource() in JMeter tutorial. Contributed by Sun Tao (buzzerrookie at hotmail.com>)

General

Bug 63394JMeter should fail with non-zero when test execution fails (due to missing test plan or other reason). Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 63464image/svg+xml is wrongly considered as binary
Bug 63490At end of scheduler duration lots of Samplers gets executed at the same time
PR#480 PR#482Fix a few typos in comments and log messages. Based on patch by Anass Benomar (anassbenomar at gmail.com)
Bug 63751Correct a typo in Chinese translations. Reported by Jinliang Wang (wjl31802 at 126.com)
Bug 63723Distributed testing: JMeter controller node ends distributed test though some threads still are active
Bug 63614Distributed testing: Unable to generate Dashboard report at end of load test
Bug 63862 Search Dialog / Search in View Results Tree: Uncaught exception if regex is checked and regex is invalid
Bug 63793Fix unsecure XML Parsing

Thanks

We thank all contributors mentioned in bug and improvement sections above:

Clifford Harms (clifford.harms at gmail.com)
Ubik Load Pack
Xia Li
Naveen Nandwani (naveen.nandwani at india.nec.com)
Artem Fedorov (artem.fedorov at blazemeter.com)
Ori Marko (orimarko at gmail.com)
Sun Tao (buzzerrookie at hotmail.com)
John Bergqvist (John.Bergqvist at diffblue.com)
Franz Schwab (franz.schwab at exasol.com)
Graham Russell (graham at ham1.co.uk)
Anass Benomar (anassbenomar at gmail.com)
Jakub Bednář
Pascal Schumacher (pascalschumacher at apache.org)
GraphAware

We also thank bug reporters who helped us improve JMeter.

Sergiy Iampol (sergiy.iampol at playtech.com)
Brian Tully (brian.tully at acquia.com)
Amer Ghazal (amerghazal at gmail.com)
Stefan Seide (stefan at trilobyte-se.de)
Havlicek Honza (havlicek.honza at gmail.com)
Pierre Astruc (pierre.astruc at evertest.com)
Jinliang Wang (wjl31802 at 126.com)

Apologies if we have omitted anyone else.

Known problems and workarounds

The Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).
The numbers that appear to the left of the green box are the number of active threads / total number of threads, the total number of threads only applies to a locally run test, otherwise it will show 0 (see Bug 55510).
Note that under some windows systems you may have this WARNING: java.util.prefs.WindowsPreferences WARNING: Could not open/create prefs root node Software\JavaSoft\Prefs at root 0 x80000002. Windows RegCreateKeyEx(…) returned error code 5. The fix is to run JMeter as Administrator, it will create the registry key for you, then you can restart JMeter as a normal user and you won’t have the warning anymore.
You may encounter the following error: java.security.cert.CertificateException: Certificates does not conform to algorithm constraints if you run a HTTPS request on a web site with a SSL certificate (itself or one of SSL certificates in its chain of trust) with a signature algorithm using MD2 (like md2WithRSAEncryption) or with a SSL certificate with a size lower than 1024 bits. This error is related to increased security in Java 8+. To allow you to perform your HTTPS request, you can downgrade the security of your Java installation by editing the Java jdk.certpath.disabledAlgorithms property. Remove the MD2 value or the constraint on size, depending on your case. This property is in this file: JAVA_HOME/jre/lib/security/java.security See Bug 56357 for details.
Under Mac OSX Aggregate Graph will show wrong values due to mirroring effect on numbers. This is due to a known Java bug, see Bug JDK-8065373 The fix is to use JDK8_u45 or later.
View Results Tree may fail to display some HTML code under HTML renderer, see Bug 54586. This is due to a known Java bug which fails to parse “px” units in row/col attributes. See Bug JDK-8031109 The fix is to use JDK9 b65 or later.
JTable selection with keyboard (SHIFT + up/down) is totally unusable with Java 7 on Mac OSX. This is due to a known Java bug JDK-8025126 The fix is to use JDK 8 b132 or later.
Since Java 11 the JavaScript implementation Nashorn has been deprecated. Java will emit the following deprecation warnings, if you are using JavaScript based on Nashorn. Warning: Nashorn engine is planned to be removed from a future JDK release To silence these warnings, add -Dnashorn.args=--no-deprecation-warning to your Java arguments. That can be achieved by setting the enviroment variable JVM_ARGS export JVM_ARGS="-Dnashorn.args=--no-deprecation-warning"

Version 5.1.1

Summary

[New and Noteworthy](#New and Noteworthy)
[Incompatible changes](#Incompatible changes)
[Bug fixes](#Bug fixes)
Improvements
[Non-functional changes](#Non-functional changes)
[Known problems and workarounds](#Known problems and workarounds)
Thanks

New and Noteworthy

This release is mainly a bugfix release. Please see the Changes history page to view the last major behaviors with the version 5.1.

Live Reporting and Web Report

A new menu entry has been added to the Tools menu. It’s allow to generate a results report from a previous CSV/JTL file. changes/5.1.1/01_menu_generate_report.png

changes/5.1.1/02_windows_generate_report.png

Incompatible changes

Improvements

HTTP Samplers and Test Script Recorder

Bug 62977Allow sending HTTP requests without a default User-Agent header

Other samplers

Bug 63185LDAP related elements: Add option to implicitly trust SSL/TLS connections/Disable hostname verification. Based on contribution by Brian Wolfe (wolfebrian2120 at gmail.com)

Controllers

Listeners

Timers, Assertions, Config, Pre- & Post-Processors

Bug 63178CSS Selector Extractor: Improve performance of JODD (JoddExtractor) based implementation

Functions

I18N

Report / Dashboard

Bug 59896 Report / Dashboard: Add a menu entry to generate a report on demand from a CSV file. Contributed by Ubik Load Pack (support at ubikloadpack.com)

General

PR#444Update to latest Spock v1.2 (was 1.0). Contributed by Graham Russell (graham at ham1.co.uk)
PR#446Improve Unit tests readability and use of Spock. Contributed by Graham Russell (graham at ham1.co.uk)

Non-functional changes

Bug 63203Unit Tests: Replace use of @Deprecated by @VisibleForTesting for methods/constructors/classes made public for Unit Testing only
PR#449Refactor and Test ResponseTimePercentilesOverTimeGraphConsumer. Contributed by Graham Russell (graham at ham1.co.uk)
PR#450Abstract graph consumer improvements. Contributed by Graham Russell (graham at ham1.co.uk)
PR#451Improve a few unit tests and classes. Contributed by Graham Russell (graham at ham1.co.uk)

Bug fixes

HTTP Samplers and Test Script Recorder

Other Samplers

Bug 63202JMS Publisher: ObjectMessageRenderer creates XStream instance with uninitialized security

Controllers

Listeners

Bug 63204RenderAsJSON#prettyJSON: JSONParser#parse cannot return JSONValue

Timers, Assertions, Config, Pre- & Post-Processors

Bug 62446Counter documentation is wrong in required fieds. Contributed by orimarko at gmail.com
Bug 62327TestPlan: In library table if path is modified and plan saved, the modification is lost on file reload

Functions

Bug 63241__threadGroupName causes a NullPointerException if called from non Test threads

I18N

Report / Dashboard

Bug 63198Response Time Vs Request and Latency Vs Request graphs don’t line up with throughput. Contributed by Ubik Load Pack (support at ubikloadpack.com)

Documentation

General

Bug 63201SearchTreeDialog disappears behind master JFrame. Contributed by Benoit Vatan (benoit.vatan at gmail.com)
Bug 63220Function Helper Dialog, Export transactions for report and Import from cURL disappear being master JFrame. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 63207java.lang.NullPointerException: null when run JMeter 5.1 with proxy options
Bug 58183Rampup may not be respected if thread take time to start leading to threads continuing to start post ramp up time

Thanks

We thank all contributors mentioned in bug and improvement sections above:

Ubik Load Pack
Benoit Vatan (benoit.vatan at gmail.com)
Graham Russell (graham at ham1.co.uk)
Brian Wolfe (wolfebrian2120 at gmail.com)
orimarko at gmail.com

We also thank bug reporters who helped us improve JMeter.

Apologies if we have omitted anyone else.

Known problems and workarounds

The Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).
The numbers that appear to the left of the green box are the number of active threads / total number of threads, the total number of threads only applies to a locally run test, otherwise it will show 0 (see Bug 55510).
Note that under some windows systems you may have this WARNING: java.util.prefs.WindowsPreferences WARNING: Could not open/create prefs root node Software\JavaSoft\Prefs at root 0 x80000002. Windows RegCreateKeyEx(…) returned error code 5. The fix is to run JMeter as Administrator, it will create the registry key for you, then you can restart JMeter as a normal user and you won’t have the warning anymore.
You may encounter the following error: java.security.cert.CertificateException: Certificates does not conform to algorithm constraints if you run a HTTPS request on a web site with a SSL certificate (itself or one of SSL certificates in its chain of trust) with a signature algorithm using MD2 (like md2WithRSAEncryption) or with a SSL certificate with a size lower than 1024 bits. This error is related to increased security in Java 8+. To allow you to perform your HTTPS request, you can downgrade the security of your Java installation by editing the Java jdk.certpath.disabledAlgorithms property. Remove the MD2 value or the constraint on size, depending on your case. This property is in this file: JAVA_HOME/jre/lib/security/java.security See Bug 56357 for details.
Under Mac OSX Aggregate Graph will show wrong values due to mirroring effect on numbers. This is due to a known Java bug, see Bug JDK-8065373 The fix is to use JDK8_u45 or later.
View Results Tree may fail to display some HTML code under HTML renderer, see Bug 54586. This is due to a known Java bug which fails to parse “px” units in row/col attributes. See Bug JDK-8031109 The fix is to use JDK9 b65 or later.
JTable selection with keyboard (SHIFT + up/down) is totally unusable with Java 7 on Mac OSX. This is due to a known Java bug JDK-8025126 The fix is to use JDK 8 b132 or later.

Version 5.1

Summary

[New and Noteworthy](#New and Noteworthy)
[Incompatible changes](#Incompatible changes)
[Bug fixes](#Bug fixes)
Improvements
[Non-functional changes](#Non-functional changes)
[Known problems and workarounds](#Known problems and workarounds)
Thanks

New and Noteworthy

Core improvements

JDBC testing has been improved with ability to set init SQL statements and add compatibility with JDBC drivers that do not support QueryTimeout changes/5.1/jdbc-connection-config-init-request.png

Various bug fixes have been implemented, like gathering the correct headers when recording requests through the HTTP(S) Test Script Recorder using HTTPS
In version 5.0, JMeter was changed to rename Sub results using a custom Naming Policy (Bug 62550). This change could be annoying for Functional Testing, a new property subresults.disable_renaming=true has been introduced to revert if needed to previous behaviour. An alternative is to check Functional Test Mode in Test Plan, see Bug 63055

UX improvements

Templates can provide parameters that are filled in on test plan generation, Recording template uses this feature changes/5.1/templates-parametes.png

A new Tools menu has been introduced to collect those entries, that are used for general usage around JMeter, like:

Function Helper Dialog
Export transactions for report
Generate Schematic View which provides an overview as HTML of the Test plan
Import from cURL which allows you to create or update your test plan by importing a cURL command
Compile JSR223 Test Elements
Create a heap dump
Create a thread dump

Test Plan

Ability to create a Test plan from a cURL command. changes/5.1/http-request-from-curl-request.png

Scripting / Debugging enhancements

A menu item to compile all JSR223 Elements is now available in Tools menu

Live Reporting and Web Report

A JSON file containing summary of a load test statistics is now generated when using -e or -g options.
Percentiles computing graphed over time algorithm has been modified to restart for each time slot
More user-friendly behaviour when reporting folder does not exist or is not empty through -f command line option

Incompatible changes

In Response Time Percentiles Over Time (successful responses) graph of the HTML report, before this version, percentile computation of each time slot used the percentile data of previous time slot as a base. Starting with this version, each time slot is independant. See Bug 62883
ClientJMeterEngine#rsetProperties signature has been changed to use HashMap<String,String> instead of Properties, see Bug 63034
A new Menu item Tools has been introduced, some menu items that were in Help menu are now under this new menu item. See Bug 63094
slf4j-ext has been removed from libraries (lib folder) and JMeter pom. It was not used by default and due to CVE-2018-8088 and unavailability of a stable version containing a fix to this issue, we decided to remove it. If you still needed, you can add it in lib folder.

Improvements

HTTP Samplers and Test Script Recorder

Bug 62840HTTP Request: Add option httpclient4.gzip_relax_mode to avoid error when unzipping what seems to be invalid streams
Bug 63025Enhance Search & Replace functionality for HTTP Request to include port and protocol field. Initial code fix by Mohamed Ibrahim (rollno748 at gmail.com)

Other samplers

Bug 62934Add compatibility for JDBC drivers that do not support QueryTimeout
Bug 62935Pass custom mail.* properties to Mail Reader Sampler. Implemented by Artem Fedorov (artem.fedorov at blazemeter.com) and contributed by BlazeMeter.
Bug 63055Don’t rename SampleResult Label when test is running in Functional mode or property subresults.disable_renaming=true. Implemented by Artem Fedorov (artem.fedorov at blazemeter.com) and contributed by BlazeMeter.

Controllers

Listeners

Bug 62822 PR#407Render uninitialized min and max values in Summary Report as #N/A

Timers, Assertions, Config, Pre- & Post-Processors

Bug 62766Keystore Config: We should load all aliases by default. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 62832JDBC Connection Configuration: Be able to set init SQL statements. Contributed by Ubik Load Pack (support at ubikloadpack.com)

Functions

Bug 63037When using CSVRead search the script base path for files, too.

I18N

Report / Dashboard

Bug 62883Report / Dashboard: Change the way percentiles are computed for Response Time Percentiles Over Time (successful responses) graph
Bug 63060Report Generator: A generator should only check for folder/files it generates and only delete those ones
Bug 63059Create a new JsonExporter that exports as JSON the content of data computed for HTML Dashboard Statistics table. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 63081Command line Option -f does not delete report folder when using generation only through command line option -g. Contributed by Ubik Load Pack (support at ubikloadpack.com)

General

Bug 62959Ability to create a Test plan from a cURL command. Contributed by Ubik Load Pack (support at ubikloadpack.com)
PR#394Allow null values in FieldStringEditor. Based on patch by Mingun (alexander_sergey at mail.ru)
Bug 62826When changing LAF, make JMeter restart if user clicks yes to popup
Bug 62257 PR#401Expand/Collapse short key (minus sign) on numpad doesn’t work. Contributed by Ori Marko (orimarko at gmail.com)
Bug 62752Add to Documentation: ctx.getThreadNum() is zero-based while \${__threadNum} is one-based
PR#411Use SHA-1 instead of SHA1 in org.apache.jmeter.save.SaveService. Contributed by Paco (paco.xu at daocloud.io)
Bug 62914Add a hint in Thread Group UI about duration of test
Bug 62925Add support for ThreadDump to the JMeter non-GUI
Bug 62870Templates: Add ability to provide parameters. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 62829Allow specifying Proxy server scheme for HTTP request sampler, Advanced tab and command line option. Contributed by Hitesh Patel (hitesh.h.patel at gmail.com)
Bug 59633Menus Save Test Plan as, Save as Test Fragment and Save Selection as ... should use a new file name in File Dialog
Bug 61486Make jmeter-server and non GUI mode run headless
Bug 63093Add Compile JSR223 Test Elements menu item. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 63094Introduce a new Tools menu
Bug 63101Propose a menu item to generate readable overview of Test Plan
Bug 63144View listener tree take a long time to open response that has huge text. Contributed by Ubik Load Pack (support at ubikloadpack.com)

Non-functional changes

PR#408Log an informational message instead of an stack trace, when JavaFX is not found for the RenderInBrowser component.
PR#412Update Chinese translation. Contributed by 刘士 (liushilive at outlook.com).
PR#406Add a short paragraph on how to use a security manager with JMeter.
Bug 62893Use StringEscapeUtils from commons-text (version 1.6) instead of the deprecated ones from commons-lang3.
Bug 62972 PR#435Replace calls to deprecated method Class#newInstance.
Bug 63034ClientJMeterEngine: Make rsetProperties use HashMap<String,String> instead of Properties
Updated to httpclient/httpmime 4.5.7 (from 4.5.6)
Updated to httpcore 4.4.11 (from 4.4.10)
Updated to httpcore-nio 4.4.11 (from 4.4.10)
Updated to tika-core and tika-parsers 1.20 (from 1.18)
Updated to commons-dbcp2-2.5.0 (from commons-dbcp2-2.4.0)
Updated to commons-lang3-3.8.1 (from commons-lang3-3.8)
Updated to groovy-all-2.4.16 (from groovy-all-2.4.15)
Updated to httpasyncclient-4.1.4.jar (from 4.1.3)
Updated to jsoup-1.11.3 (from 1.11.2)
Updated to cglib-nodep-3.2.9 (from cglib-nodep-3.2.7)
Updated to ph-commons-9.2.1 (from ph-commons-9.1.2)
Updated to log4j-2.11.1 (from log4j-2.11.0)
Updated to xmlgraphics-commons 2.3 (from 2.2)
Bug 63033Updated to Saxon-HE 9.9.1-1 (from 9.8.0-12). Thanks at Saxonica
Updated to xstream 1.4.11 (from 1.4.10)
Updated to jodd 5.0.6 (from 4.1.4)
Updated to asm-7.0 (from 6.1)
Update to ActiveMQ 5.15.8 (from 5.5.16)
Updated to rsyntaxtextarea-3.0.2 (from 2.6.1)
Updated to apache-rat-0.13 (from 0.12)
Updated to jacocoant-0.8.3 (from 0.8.2)
Updated to hsqldb-2.4.1 (from 2.4.0)
Updated to mina-core-2.0.19 (from 2.0.16)
Bug 62818Updated to xercesImpl to 2.12.0 (from 2.11.0). Reported by Stefan Seide (stefan at trilobyte-se.de)
Bug 62744Upgrade jquery to version 3.3.1, jquery-ui to 1.12.1, bootstrap to 3.3.7
Bug 62821 PR#405Use SHA-512 checksums instead of MD5 to verify jar downloads
Bug 63053Remove referrals to never implemented internals from user documentation. Reported by U. Poblotzki (u.poblotzki at thalia.de)
Bug 63082 PR#437Use utf-8 for properties files in source
Bug 63177Rename NON GUI mode into CLI Mode in documentation

Bug fixes

HTTP Samplers and Test Script Recorder

Bug 62785 PR#400Incomplete search path applied to the filenames used in the upload functionality of the HTTP sampler. Implemented by Artem Fedorov (artem.fedorov at blazemeter.com) and contributed by BlazeMeter.
Bug 62842HTTP(S) Test Script Recorder: Brotli compression is not supported leading to “Content Encoding Error”
Bug 60424Hessian Burlap application: JMeter inserts 0x0D before 0x0A automatically (http binary post data)
Bug 62940Use different cn and type of SAN extension when we are generating certificates based on IP addresses.
Bug 62916HTTP Test Script Recorder fails with UnsupportedOperationException if recording is started after a distributed test has been run
Bug 62987A TestBean element under HTTP(S) Test Script recorder does not work. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 63015Abnormal NoHttpResponseException when running request through proxy HTTP(S) Test Script Recorder after a first failing request. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 62852HTTP Request Header missing information when using a proxy. Thanks to Oleg Kalnichevski (olegk at apache.org)
Bug 63048JMeter does not retrieve link resources of type “shortcut icon” or “icon”. Contributed by Ubik Load Pack (support at ubikloadpack.com)

Other Samplers

Bug 62775If many jars are in a folder referenced by user.classpath, startup can be extremely slow due to JUnit
Bug 63031Incorrect JDBC driver class: org.firebirdsql.jdbc.FBDrivery. Contributed by Sonali (arora.sonali99 at gmail.com)

Controllers

Bug 62806ModuleController cloning by Run behaves differently whether in GUI or Non GUI mode. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 62847If Controller cannot use variable for index exposed by LoopController/WhileController/ForEachController
Bug 63064Ignore spaces at the end and beginning of expressions used in IfController

Listeners

Bug 62770Aggregate Graph throws ArrayIndexOutOfBoundsException
Bug 63069ResultCollector does not write end of XML file if user exits while a Recording or a test is running. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 63138InfluxDB BackendListenerClient: In case of error, log is in debug, it should be in error

Timers, Assertions, Config, Pre- & Post-Processors

Bug 62774XPath2Extractor: Scope variable is broken. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 62860JSON Extractor: Avoid NPE and noisy error message “Error processing JSON content in” when variable is not found

Functions

I18N

Report / Dashboard

Bug 62777Web Report / Dashboard: Hide All in Response Time Percentiles Over Time (successful responses) fails.
Bug 62780Web Report / Dashboard: Display All in Response Time Vs Request fails.
Bug 62781Web Report / Dashboard: Display All in Response Time Overview fails.
Bug 62782Web Report / Dashboard: Remove duplicate/unused dependencies
Bug 62894Report / Dashboard: Throughput is in wrong column which is confusing as unit is millisecond
Bug 63016Empty HTML report if source csv contains labels with quotes. Contributed by Ubik Load Pack (support at ubikloadpack.com)

Documentation

Change Test Action (old name) to Flow Control Action in Component Reference documentation. Contributed by Ori Marko (orimarko at gmail.com)

General

Bug 62745Fix undefined disabled icon. Contributed by Till Neunast (https://github.com/tilln)
Bug 62743Client auth must be enabled on distributed testing
Bug 62767NPE when searching under certain conditions. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 62790ArrayIndexOutOfBoundsException when calling replace without selecting the first match
Bug 62795JMeter controller node sometimes ends distributed test even though some of the worker nodes have not finished
Bug 62336 PR#396Some shortcuts are not working correctly on windows. Contributed by Michael Pavlov (michael.paulau at gmail.com)
Bug 62889Format JSON Arrays when displayed with JSON Path Tester.
Bug 62900ObjectProperty#getStringValue() can throw NullPointerException
Bug 63099Escape commata in function helper dialog only outside of variable replacement structures.
Bug 63105Export Transactions for Report: fix 2 bugs
Bug 63106Apply naming policy does not refresh UI
Bug 63180Apply Naming Policy allows multi selection but only considers first node
Bug 63090Remove slf4j-ext due to CVE-2018-8088

Thanks

We thank all contributors mentioned in bug and improvement sections above:

Oleg Kalnichevski (olegk at apache.org)
Till Neunast (https://github.com/tilln)
Mingun (alexander_sergey at mail.ru)
Ubik Load Pack
Artem Fedorov (artem.fedorov at blazemeter.com)
Stefan Seide (stefan at trilobyte-se.de)
刘士 (liushilive at outlook.com)
Michael Pavlov (michael.paulau at gmail.com)
Ori Marko (orimarko at gmail.com)
Paco (paco.xu at daocloud.io)
Hitesh Patel (hitesh.h.patel at gmail.com)
Sonali (arora.sonali99 at gmail.com)
Mohamed Ibrahim (rollno748 at gmail.com)
U. Poblotzki (u.poblotzki at thalia.de)
Saxonica

We also thank bug reporters who helped us improve JMeter.

Apologies if we have omitted anyone else.

Known problems and workarounds

The Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).
The numbers that appear to the left of the green box are the number of active threads / total number of threads, the total number of threads only applies to a locally run test, otherwise it will show 0 (see Bug 55510).
Note that under some windows systems you may have this WARNING: java.util.prefs.WindowsPreferences WARNING: Could not open/create prefs root node Software\JavaSoft\Prefs at root 0 x80000002. Windows RegCreateKeyEx(…) returned error code 5. The fix is to run JMeter as Administrator, it will create the registry key for you, then you can restart JMeter as a normal user and you won’t have the warning anymore.
You may encounter the following error: java.security.cert.CertificateException: Certificates does not conform to algorithm constraints if you run a HTTPS request on a web site with a SSL certificate (itself or one of SSL certificates in its chain of trust) with a signature algorithm using MD2 (like md2WithRSAEncryption) or with a SSL certificate with a size lower than 1024 bits. This error is related to increased security in Java 8+. To allow you to perform your HTTPS request, you can downgrade the security of your Java installation by editing the Java jdk.certpath.disabledAlgorithms property. Remove the MD2 value or the constraint on size, depending on your case. This property is in this file: JAVA_HOME/jre/lib/security/java.security See Bug 56357 for details.
Under Mac OSX Aggregate Graph will show wrong values due to mirroring effect on numbers. This is due to a known Java bug, see Bug JDK-8065373 The fix is to use JDK8_u45 or later.
View Results Tree may fail to display some HTML code under HTML renderer, see Bug 54586. This is due to a known Java bug which fails to parse “px” units in row/col attributes. See Bug JDK-8031109 The fix is to use JDK9 b65 or later.
JTable selection with keyboard (SHIFT + up/down) is totally unusable with Java 7 on Mac OSX. This is due to a known Java bug JDK-8025126 The fix is to use JDK 8 b132 or later.

Version 5.0

Summary

[New and Noteworthy](#New and Noteworthy)
[Incompatible changes](#Incompatible changes)
[Bug fixes](#Bug fixes)
Improvements
[Non-functional changes](#Non-functional changes)
[Known problems and workarounds](#Known problems and workarounds)
Thanks

New and Noteworthy

Core improvements

Rest support has been improved in many fields

Multipart/form-data requests now work for PUT, DELETE …
It is now also possible to send a JSON Body with attached file
Parameters entered in Parameters Tab are now used in body instead of being ignored

changes/5.0/jmeter_5_rest1.png

changes/5.0/jmeter_5_rest2.png

In distributed testing, JMeter now automatically prefixes thread names with engine host and port, this makes the counting of threads correct in the HTML report without any other configuration as it was required before changes/5.0/jmeter_5_distributed.png

XPath 2.0 is supported in a new element called XPath2 extractor providing easier XML namespaces handling, up to date XPath syntax and better performances changes/5.0/jmeter_5_xpath2_extractor.png

changes/5.0/jmeter_5_xpath2_tester.png

Upgrade to HTTP Components 4.6 last APIs has been completed and JMeter does not rely anymore on deprecated APIs of this library

It is now possible to control in an easier way Loop breaking and Loop switching to next iteration. This is available in Flow Control Action and Result Status Action Handler elements changes/5.0/jmeter_5_flow_control_action.png

changes/5.0/jmeter_5_result_status_handler.png

While Controller now exports a variable containing its current index named __jm__<Name of your element>__idx. So for example, if your While Controller is named WC, then you can access the looping index through \${__jm__WC__idx}

Scripting / Debugging enhancements

Search feature has been improved to allow you to iterate in the tree over search results and do necessary replacements through Next/Previous/Replace/Replace/Find buttons changes/5.0/jmeter_5_search_feature.png

In View Results Tree, the request and response headers/body are clearly separated to allow you to better inspect requests and responses. You can also search in all those tabs for a particular value changes/5.0/jmeter_5_vrt_request_body.png

changes/5.0/jmeter_5_vrt_response_body.png

Recording feature has been improved to provide a popup that is always on top when you navigate in browser allowing you to name transactions while you navigate in your application. changes/5.0/jmeter_5_recording.png

You can now restart JMeter from menu File → Restart changes/5.0/jmeter_5_restart.png

Live Reporting and Web Report

Reporting feature has been enhanced A new Graph Total Transactions per second has been added to the HTML Web Report changes/5.0/jmeter_5_total_trans_per_sec.png

It is now possible to graph over time custom metrics available as JMeter Variables through sample_variables. Those custom metrics graphs will be available in the HTML Report in Custom Graphs section changes/5.0/jmeter_5_custom_graphs.png

Hits per second graph now takes into account the embedded resources changes/5.0/jmeter_5_hits_per_sec.png

In Live reporting, the sent and received bytes are now sent to Backends (InfluxDB or Graphite)

Functions

A New function [__threadGroupName](/user-manual/functions/#__threadGroupName) has been introduced to obtain ThreadGroup name.

Incompatible changes

Since JMeter 5.0, when using default HC4 Implementation, JMeter will reset HTTP state (SSL State + Connections) on each thread group iteration. If you don’t want this behaviour, set httpclient.reset_state_on_thread_group_iteration=false
Since JMeter 5.0, in relation to above remark, https.use.cached.ssl.context is deprecated and not used anymore.
Since JMeter 5.0, when using CSV output, sub results will now be also output to CSV file. To revert to previous behaviour set jmeter.save.saveservice.subresults=false, see Bug 62470, Bug 60917, Bug 62550.
Since JMeter 5.0, CSS/JQuery Extractor has been renamed to CSS Selector Extractor
Since JMeter 5.0, Test Action has been renamed to Flow Control Action
Since JMeter 5.0, JMeter renames subResults to parentName-N where N is a number to ensure that Hits Per Second graph includes resources downloads, see Bug 62550, Bug 62470 and Bug 60917

Improvements

HTTP Samplers and Test Script Recorder

Bug 62260Improve Rest support. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 58757HTTP Request : Updated deprecated methods of HttpComponents to last APIs of httpclient-4.5.X. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 62212Recorder : Improve UX by providing a popup above all windows to be able to change Transaction names and pauses while using Browser. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 62248HTTP Request : Parameters entered in Parameters Tab should be used in body instead of being ignored. Partly based on a patch by Artem Fedorov contributed by Blazemeter.
Bug 60015Multipart/form-data works only for POST using HTTPClient4 while it should for PUT, DELETE, … Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 62317HTTP(S) Test Script Recorder: allow to add ResultSaver to created sampler

Other samplers

PR#376JUnitSampler logs exceptions except assertion-failures from test cases as warnings. Contributed by Davide Angelocola (davide.angelocola at fisglobal.com)
Bug 62244Rename Test Action to Flow Control Action
Bug 62302Move JSR223 Sampler up the menu. Contributed by Ori Marko (orimarko at gmail.com)
Bug 62595SMTPSampler does not allow configuring the SSL/TLS protocols to be used on handshake. Contributed by Felipe Cuozzo (felipe.cuozzo at gmail.com)

Controllers

Bug 62237While Controller : Export variable containing current index of iteration. Contributed by Ubik Load Pack (support at ubikloadpack.com)

Listeners

Bug 62195Save Responses to a file : Improve component and UI. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 62209InfluxBackendListenerClient: First Assertion Failure Message must be sent if error code and response code are empty or OK
Bug 62269Bug 62269 - View Results Tree : Response and Request Tabs should contains Header and Body tabs. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 62270View Results Tree : Allow searching in Request headers, Response Headers, and Request body. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 62276InfluxDBBackendListenerClient / GraphiteBackendListenerClient : Add sent and received bytes to metrics. Contributed by Ubik Load Pack (support at ubikloadpack.com)

Timers, Assertions, Config, Pre- & Post-Processors

Bug 62320Counter : Reference Name property is not clear
Bug 60991XPath Extractor : Implement XPath 2.0. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 62593Rename CSS/JQuery Extractor to CSS Selector Extractor. Contributed by Ori Marko (orimarko at gmail.com)

Functions

Bug 62178Add default value to [__V](/user-manual/functions/#__V) function. Contributed by Ori Marko (orimarko at gmail.com)
Bug 62178Add function [__threadGroupName](/user-manual/functions/#__threadGroupName) function to obtain ThreadGroup name. Mainly contributed by Ori Marko (orimarko at gmail.com)
Bug 62533Allow use epoch time as Date String value in function [__dateTimeConvert](/user-manual/functions/#__dateTimeConvert)
Bug 62541Allow [__jexl3](/user-manual/functions/#__jexl3), [__jexl2](/user-manual/functions/#__jexl2) functions to support new syntax as var x;. Contributed by Ori Marko (orimarko at gmail.com)
Bug 61834Function Helper Dialog : Improve tests by showing variables and keeping them available between evaluations

I18N

Report / Dashboard

Bug 62243Dashboard : make option “--forceDeleteResultFile”/“-f” option delete folder referenced by “-o” option
Bug 62367HTML Report Generator: Add Graph Total Transactions per Second. Contributed mainly by Martha Laks (laks.martha at gmail.com)
Bug 62166Report/Dashboard: Provide ability to register custom graphs and metrics in the JMeter Dashboard. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 62542Report/Dashboard : Display more information on filters when graph is empty. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 62426Optimize performance of report generation. Based on feedback by Allen (444104595 at qq.com)
Bug 62550Modify SubResult Naming Policy
Bug 60917Load Test with embedded resources download : Hits per seconds does not take into account the downloaded resources

General

Bug 62684Distributed Testing : Add automatically to thread name a prefix to identify engine. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 62155Search Feature: Make Search text field get focus
Bug 62156Search Feature : Distinguish between node that matches search and node that contains a child that matches search
Bug 62234Search/Replace Feature : Enhance UX and add Replace/Next/Previous/Replace & Find features. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 62238Add ability to Switch to next iteration of Current Loop. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 62239Add ability to Break Current Loop
Bug 61635Add a menu to restart JMeter
Bug 62470CSV Output : Enable logging of sub results when jmeter.save.saveservice.subresults=true. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 62473Setting “saveservice_properties” has counter intuitive behaviour
Bug 62354Correct calculation and usage of units for second per user (reported by jffagot05 at gmail.com)
Bug 62700Introduce jsr223.init.file to allow calling a JSR-223 script on JMeter startup
Bug 62128Try to guess JMETER_HOME correctly, when jmeter.bat is called from a batch file in another directory. Contributed by logox01 (logox01 at gmx.at)
PR#386Add parameter support for RMI keystore creation scripts. Contributed by Logan Mauzaize (t524467 at airfrance.fr)
Bug 62065Use Maven artifact for JAF Module instead of embedded module
Bug 61714Update Real-time results documentation
PR#382Correct typo in documentation. Reported by Perze Ababa (perze.ababa at gmail.com>)
PR#392Correct typo in documentation. Reported by Aaron Levin
PR#379 Improve chinese translations. Contributed by XmeterNet

Non-functional changes

PR#358 PR#365 PR#366 PR#375Updated to latest checkstyle (v8.8). Expanded Checkstyle to files in src and test; fixed newly checked files. Based on contribution by Graham Russell (graham at ham1.co.uk)
Bug 62095Correct description for right boundary parameter in Boundary Extractor. Contributed by Ori Marko (orimarko at gmail.com)
Bug 62113Updated to latest Bouncycastle (v1.60). Based on contribution by Olaf Flebbe (oflebbe at apache.org)
Bug 62171Remove .md5 checksums and keep only .sha512 checksums for source and binary archives
Updated to groovy-all-2.4.15 (from groovy-all-2.4.13)
Updated to asm-6.1 (from 6.0)
Updated to tika-core and tika-parsers 1.18 (from 1.17)
Bug 62482Sync documentation to the implementation of the ForEachController. Based on contribution by Ori Marko (orimarko at gmail.com)
Bug 62529Updated to httpclient-4.5.6 (from httpclient 4.5.5) and updated to freemarker-2.3.28 (from freemarker-2.3.23). Based on patch by Ori Marko (orimarko at gmail.com)
Updated to httpmime-4.5.6 (from httpmime-4.5.5)
Updated to caffeine-2.6.2 (from caffeine-2.6.1)
Updated to cglib-nodep-3.2.7 (from cglib-nodep-3.2.6)
Updated to commons-dbcp2-2.4.0 (from commons-dbcp2-2.2.0)
Updated to commons-pool2-2.6.0 (from commons-pool2-2.5.0)
Updated to httpcore-4.4.10 (from httpcore-4.4.9)
Updated to httpcore-nio-4.4.10 (from httpcore-nio-4.4.9)
Updated to log4j-2.11.0 (from log4j-2.10.0)
Updated to ph-css-6.1.1 (from ph-css-6.0.0)
Updated to ph-commons-9.1.2 (from ph-commons-9.0.0)
Updated to rhino-1.7.10 (from +rhino-1.7.7.2)
Updated to commons-lang3-3.8 (from commons-lang3-3.7)

Bug fixes

HTTP Samplers and Test Script Recorder

Bug 62114HTTP(S) Test Script Recorder : Client certificate authentication uses the first SSLManager created. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 61058HTTP Request : Add option httpclient4.deflate_relax_mode to avoid “Unexpected end of ZLIB input stream” when deflating what seems to be invalid streams. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 43612HTTP PUT does not honor request parameters. Implemented by Artem Fedorov (artem.fedorov at blazemeter.com) and contributed by BlazeMeter Ltd.
Bug 60190Content-Type is added for POST unconditionally. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 62462 PR#387Make delegation of credentials in SPNEGO possible again.
Bug 58807Reset SSL State on Thread Group iteration only (was https.use.cached.ssl.context=false is broken)
Bug 62716When Recording, JMeter removes Authorization from generated Header Manager when using Bearer Token

Other Samplers

Bug 62235Java 9 - illegal reflective access by org.apache.jmeter.util.HostNameSetter
Bug 62464Set start- and end-time on JMS publisher sampler, even if initialization fails.
Bug 62616FTPSampler: Upload file-size is not counted in sentBytes

Controllers

Bug 62265ModuleController behaves strangely

Listeners

Bug 62097Update JTable in Aggregate Report only when new data has arrived. That way selections of rows will be kept longer around.
Bug 62203Influxdb BackendListener client: store user tags to annotation and internal transaction. Contributed by Sergey Batalin (sergey_batalin at mail.ru)
Bug 62251TextGraphiteMetricsSender does not invalidate lost connections in case of network errors
Bug 60705Fix headers of Aggregate Reports and friends when columns are moved around.
Bug 62463Distributed client/server setup: use different RMI ports for the remote objects when using SSL

Timers, Assertions, Config, Pre- & Post-Processors

Bug 61664HTTP Authorization Manager : Digest works only with legacy RFC 2069, RFC 2617 is not implemented. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 62252HTTP header merging logic does not correspond to the documentation
Bug 62554BoundaryExtractor : Field to check is not reset
Bug 62553Random element might return same value even if property “Per thread user (User)” is set to TRUE
Bug 62637Take scheduler into account when calcuting delay for Synchronizing Timer

Functions

I18N

Bug 62310French translation of Precise Throughput Timer label

Report / Dashboard

Bug 62333Report Dashboard - When one series contains no value, the graph colors logic is wrong. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 62283Report Dashboard - Date is not correctly displayed on chart when granularity is ≤ 1 day
Bug 62520The tool-tip text when we hover on the point in ‘Latency Vs Request’ graph should be ‘Median Latency’

Documentation

Bug 62211Fix HTTP Request Server Documentation. Contributed by Ori Marko (orimarko at gmail.com)
PR#388Fix a typo. Contributed by Giancarlo Romeo (giancarloromeo at gmail.com)

General

Bug 62107JMeter fails to start under Windows when JM_LAUNCH contains spaces
Bug 62110A broken JUnit class (due to missing dependency) breaks JMeter menus. Contributed by Ubik Load Pack (support at ubikloadpack.com)
PR#377Small fix of the docs. Contributed by Peter Doornbosch (peter.doornbosch at luminis.eu)
Bug 62124Recording templates : Add more exclusions and use Transaction Name by default
Bug 62127Store filename as String instead of File in FileEditor. This will prevent conversion of filenames from Unix style path separators to Windows style when used for example in CSV Data Set Config.
Bug 56150Keep the index right, when scrolling through the menu items.
Bug 62240If SampleMonitor implementation is a TestBean if will not be initialized correctly
Bug 62295Correct order of elements when duplicating a selection of multiple elements.
Bug 62397Don’t break lines at commata when using JSON Path Tester
Bug 62281Prevent NPE in MapProperty. Patch by belugabehr (dam6923 at gmail.com)
Bug 62457In usermanual, the UUID Function’s example is wrong. Contributed by helppass (onegaicimasu at hotmail.com)
Bug 62478Escape commata in parameters when constructing function strings in the GUI function helper. Reported by blue414 (blue414 at 163.com)
Bug 62463Fix usage of ports, when client.rmi.localport is set for distributed runs.
Bug 62545Don’t use a colon as part of the “tab” string when indenting JSON in RenderAsJSON.
Part of Bug 62637 Avoid Integer overrun when dealing with very large values in TimerService#adjustDelay
Bug 62683Error dialog has no text when user opens completely invalid test plan.

Thanks

We thank all contributors mentioned in bug and improvement sections above:

Graham Russell (graham at ham1.co.uk)
Ori Marko (orimarko at gmail.com)
Davide Angelocola (davide.angelocola at fisglobal.com)
Ubik Load Pack
Olaf Flebbe (oflebbe at apache.org)
Peter Doornbosch (peter.doornbosch at luminis.eu)
logox01 (logox01 at gmx.at)
Sergey Batalin (sergey_batalin at mail.ru)
XMeter
Imane Ankhila (iankhila at ahlane.net)
jffagot05 (jffagot05 at gmail.com)
Perze Ababa (perze.ababa at gmail.com)
Martha Laks (laks.martha at gmail.com)
Logan Mauzaize (t524467 at airfrance.fr)
belugabehr (dam6923 at gmail.com)
Giancarlo Romeo (giancarloromeo at gmail.com)
helppass (onegaicimasu at hotmail.com)
blue414 (blue414 at 163.com)
Aaron Levin
Allen (444104595 at qq.com)
Felipe Cuozzo (felipe.cuozzo at gmail.com)
bangnab (ambrosetti.nicola at gmail.com)

We also thank bug reporters who helped us improve JMeter.

Apologies if we have omitted anyone else.

Known problems and workarounds

View Results Tree may freeze rendering large response particularly if this response has no spaces, see Bug 60816. This is due to an identified Java Bug UI stuck when calling JEditorPane.setText() or JTextArea.setText() with long text without space.
The Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).
The numbers that appear to the left of the green box are the number of active threads / total number of threads, the total number of threads only applies to a locally run test, otherwise it will show 0 (see Bug 55510).
Note that under some windows systems you may have this WARNING: java.util.prefs.WindowsPreferences WARNING: Could not open/create prefs root node Software\JavaSoft\Prefs at root 0 x80000002. Windows RegCreateKeyEx(…) returned error code 5. The fix is to run JMeter as Administrator, it will create the registry key for you, then you can restart JMeter as a normal user and you won’t have the warning anymore.
You may encounter the following error: java.security.cert.CertificateException: Certificates does not conform to algorithm constraints if you run a HTTPS request on a web site with a SSL certificate (itself or one of SSL certificates in its chain of trust) with a signature algorithm using MD2 (like md2WithRSAEncryption) or with a SSL certificate with a size lower than 1024 bits. This error is related to increased security in Java 8+. To allow you to perform your HTTPS request, you can downgrade the security of your Java installation by editing the Java jdk.certpath.disabledAlgorithms property. Remove the MD2 value or the constraint on size, depending on your case. This property is in this file: JAVA_HOME/jre/lib/security/java.security See Bug 56357 for details.
Under Mac OSX Aggregate Graph will show wrong values due to mirroring effect on numbers. This is due to a known Java bug, see Bug JDK-8065373 The fix is to use JDK8_u45 or later.
View Results Tree may fail to display some HTML code under HTML renderer, see Bug 54586. This is due to a known Java bug which fails to parse “px” units in row/col attributes. See Bug JDK-8031109 The fix is to use JDK9 b65 or later.
JTable selection with keyboard (SHIFT + up/down) is totally unusable with Java 7 on Mac OSX. This is due to a known Java bug JDK-8025126 The fix is to use JDK 8 b132 or later.

Version 4.0

Summary

[New and Noteworthy](#New and Noteworthy)
[Incompatible changes](#Incompatible changes)
[Bug fixes](#Bug fixes)
Improvements
[Non-functional changes](#Non-functional changes)
[Known problems and workarounds](#Known problems and workarounds)
Thanks

New and Noteworthy

Core improvements

JMeter now supports JAVA 9.

New Boundary Extractor element available which provides easy extraction with better performances changes/4.0/boundary_extractor.png

New JSON Assertion element available to assert on JSON responses. changes/4.0/json_assertion.png

New Precise Throughput Timer element available which produces Poisson arrivals with given constant throughput. changes/4.0/precise_throughput_timer.png

JMS Point-to-Point sampler has been enhanced with read, browse, clear options. changes/4.0/jmsptp_communication_styles.png

Best property values are now selected on many Test Elements to ensure best practices are the defaults:

Newly added If Controller now uses by default Expression which is the most performing option.
Newly added JSR223 Test Element now cache compiled script by default if language used provides this feature.

Loop controller and ForEach Controller now expose their current iteration as a variable named __jm__<Name of your element>__idx that you can use like this for example for a Loop Controller named MyLoopController:

\${__jm__MyLoopController__idx}

. See Bug 61802

Cookies are now shown in View Results Tree during recording. They were previously always shown as empty.

Response Assertion now allows you to customize assertion message and assert on Request Data. changes/4.0/response_assertion_enhancements.png

UX improvements

JMeter now uses Darcula LAF by default

Workbench has been dropped from UI, you can now use Non Test Elements as immediate children of Test Plan. changes/4.0/goodbye_workbench.png

Menu UX have been improved to make most used elements available more rapidly. changes/4.0/menu_organization.png

HTTP(S) Test Script Recorder now allows you to name your transactions while recording in a more human readable way. changes/4.0/recorder_naming_samplers.png

UX improvements made on, among the most notable :

Module Controller informs user at least one Controller is required
Function Helper Dialog (The wizard that helps using and testing functions) has been improved in many fields.
Switch Controller trims text to avoid issues when a space is introduced before/after name
Test Plan is now saved before running the test plan

Functions

New Function __digest provides easy computing of SHA-XXX, MDX hashes:

\${__digest(MD5,Apache JMeter 4.0 rocks !,,,)}

will return 0e16c3ce9b6c9971c69ad685fd875d2b

New Function __dateTimeConvert provides easy conversion between date formats:

\${__dateTimeConvert(01 Jan 2017,dd MMM yyyy,dd/MM/yyyy,)}

will return 01/01/2017

New Function __changeCase provides ability to switch to Upper / Lower / Capitalized cases

\${__changeCase(Avaro omnia desunt\, inopi pauca\, sapienti nihil,UPPER,)}

will return AVARO OMNIA DESUNT, INOPI PAUCA, SAPIENTI NIHIL

New Functions __isVarDefined and __isPropDefined provide testing of properties and variables availability

\${__isPropDefined(START.HMS)}

will return true

\${__isVarDefined(JMeterThread.last_sample_ok)}

will return true

Scripting and Plugin Development

You can now call SampleResult#setIgnore() if you don’t want your sampler to be visible in results

JavaSamplerContext used by AbstractJavaSamplerClient has been enhanced with new methods to easy plugin development.

JMeter now distributes additional Maven sources and javadoc artifacts into Maven repository

Plugins can now register listeners to be notified when a Test Plan is opened/closed

Live Reporting and Web Report

InfluxDB backend listener now allows you to add custom tags by adding them with prefix TAG_, see Bug 61794

In Web Report responseTime distribution graph is more precise

Some bugfixes have been made on report generation, see Bug 61900, Bug 6190061956, Bug 61899. Graphs Latency Vs Request and Response Time Vs Request did not exceed 1000 RPS due to Bug 61962

Configuration of JMeter environment

JVM settings for the JMeter start scripts can be placed in a separate file (bin/setenv.sh on Unix and bin\setenv.bat on Windows), that gets called on startup. The startup script itself does not have to be edited anymore.

Incompatible changes

Start time and End date of Thread Group have been removed, see Bug 61549
In distributed testing, mode Hold has been removed. Use alternative and more efficient modes
For 3rd party plugins, the following method in org.apache.jmeter.gui.tree.JMeterTreeNode has been dropped for migration to Java 9 (Bug 61529) java public Enumeration<JMeterTreeNode> children()
tearDown Thread Group will now run on stop and shutdown of a test by default. If you don’t want this behaviour, uncheck Run tearDown Thread Groups after shutdown of main threads on Test Plan element, see Bug 61656
Properties sampleresult.getbytes.headers_size and sampleresult.getbytes.body_real_size have been dropped, see Bug 61587
JMeter will now save your test plan whenever you run it. This behaviour can be controlled by property save_automatically_before_run, see Bug 61731
Workbench element has been dropped, you now directly add Non Test Element as children of Test Plan. When loading a Test Plan that contains the element JMeter will move the Mirror Server, Property Display and HTTP(s) Test Script Recorder elements as direct children of Test Plan. For any other element, it will create a Test Fragment element called Workbench Test Fragment and move the elements in it.
Following classes have been dropped (org.apache.jmeter.functions.util.ArgumentEncoder, org.apache.jmeter.functions.util.ArgumentDecoder), see PR#335
In JMS Point-to-Point sampler, setting timeout to 0 will now mean infinite timeout while previously it would be switched to 2000 ms, see Bug 61829
When Assertions are at different scopes, they are executed starting with the most OUTER one to the most INNER one. See Bug 61846
JMeter now starts by default using English locale. This change is due to missing translations in many supported languages. You can change locale by modifying in jmeter and jmeter.bat (or preferably setenv.sh/setenv.bat) the JVM_ARGS system property values. We’d also be very grateful if you can contribute translations in supported languages.
SwitchController now trims by default the content of switch to avoid issue related to unwanted spaces. See Bug 61771
JMeter JVM heap settings have changed from -Xms512m -Xmx512m to -Xms1g -Xmx1g
Beanshell version has been upgraded to bsh-2.0b6 which introduces breaking changes and more strict parsing rules

Improvements

HTTP Samplers and Test Script Recorder

PR#316Warn about empty truststore loading. Contributed by Vincent Herilier (https://github.com/vherilier)
Bug 61639HTTP(S) Test Script Recorder: In request filtering tab, uncheck by default “Notify Child Listeners of filtered samplers”
Bug 61672HTTP(S) Test Script Recorder: Have the ability to choose the sampler name while keeping the ability to just add a prefix
Bug 53957HTTP Request: In Parameters tab, allow pasting of content coming from Firefox and Chrome (unparsed)
Bug 61587Drop properties sampleresult.getbytes.headers_size and sampleresult.getbytes.body_real_size
Bug 61843HTTP(S) Test Script Recorder: Add SAN to JMeter generated CA Certificate. Contributed by Matthew Buckett
Bug 61901Support for https.cipherSuites System property. Contributed by Jeremy Arnold (jeremy at arnoldzoo.org)

Other samplers

Bug 61544JMS Point-to-Point Sampler: Enhance communication styles with read, browse, clear. Based on a contribution by Benny van Wijngaarden (benny at smaragd-it.nl)
Bug 61829JMS Point-to-Point: If Receive Queue is empty and a timeout is set, it is not taken into account. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 61739Java Request / JavaSamplerClient: Improve org.apache.jmeter.protocol.java.sampler.JavaSamplerContext
Bug 61762Start Next Thread Loop should be used everywhere

Controllers

Bug 61675If Controller: Use expression by default and add a warning when the other mode is used. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 61770Module Controller: Inform user in UI that he needs to have at least one Controller in his plan. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 61771SwitchController: Switch field should be trimmed by safety

Listeners

Bug 57760View Results Tree: Cookie Header is wrongly shown as empty (no cookies) when viewing a recorder Sample Result. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 61769View Results Tree: Use syntax highlighter in XPath Tester, JSON Path Tester and CSS/JQuery Tester. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 61776View Results Tree: Expansion of Add expand/collapse all menu in render XML view. Contributed by Maxime Chassagneux and Graham Russell
Bug 61852View Results Tree: Add a Boundary Extractor Tester
Bug 61794Influxdb backend: Add as many custom tags as wanted by just create new lines and prefix theirs name by “TAG_” on the GUI backend listener

Timers, Assertions, Config, Pre- & Post-Processors

Bug 60213New component: Boundary based extractor
Bug 61845New Component JSON Assertion based on AtlanBH JSON Path Assertion donated to JMeter-Plugins and migrated into JMeter core by Artem Fedorov (artem at blazemeter.com)
Bug 61931New Component: Precise Throughput Timer, timer that produces Poisson arrivals with given constant throughput. Contributed by Vladimir Sitnikov (sitnikov.vladimir at gmail.com)
Bug 61644HTTP Cache Manager: “Use Cache-Control/Expires header when processing GET requests” should be checked by default
Bug 61645Response Assertion: Add ability to assert on Request Data
Bug 51140Response Assertion: add ability to set a specific error/failure message that is later shown in the Assertion Result. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 61534Convert AssertionError to a failed assertion, allowing users to use assert in their code. Fixing a regression introduced in 3.2
Bug 61756Extractors: Improve label name “Reference name” to make it clear what it makes
Bug 61758Apply to: field in Extractors, Assertions: When entering a value in JMeter Variable Name, the radio box JMeter Variable Name should be selected by default. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 61846Scoped Assertion should follow same order of evaluation as Post Processors

Functions

Bug 61724Add __digest function to provide computing of Hashes (SHA-XXX, MDX). Based on a contribution by orimarko at gmail.com
Bug 61735Add __dateTimeConvert function to provide date formats conversions. Based on a contribution by orimarko at gmail.com
Bug 61760Add __isPropDefined and __isVarDefined functions to know if property or variable exist. Contributed by orimarko at gmail.com
Bug 61759Add __changeCase function to change different cases of a string. Based on a contribution by orimarko at gmail.com
Bug 61561Function helper dialog should display exception in result
Bug 61738Function Helper Dialog: Add Copy in Generate and clarify labels. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 62027Help: Introduce property help.local to allow choosing between local (offline) documentation and online documentation
Bug 61593Remove Detail, Add, Add from Clipboard, Delete buttons in Function Helper GUI

I18N

Bug 61606Translate button Browse… in some elements (which use FileEditor class)
Bug 61747HTTP(S) Test Script Recorder: add the missing doc to “Create transaction after request (ms)”

Report / Dashboard

Bug 61871Reduce jmeter.reportgenerator.graph.responseTimeDistribution.property.set_granularity default value from 500ms to 100ms
Bug 61879Remove useless files in HTML report template

General

Bug 61591Drop Workbench from test tree. Implemented by Artem Fedorov (artem at blazemeter.com) and contributed by BlazeMeter Ltd.
Bug 61549Thread Group: Remove start and end date
Bug 61529Migration to Java 9. Partly contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 61709SampleResult: Add a method setIgnore() to make JMeter ignore the SampleResult and not send it to listeners
Bug 61806Allow to use SampleResult#setIgnore() in post-processors and assertions script (JSR223 elements)
Bug 61607Add browse button in all BeanShell elements to select BeanShell script
Bug 61627Don’t clear LogView anymore when clicking on Warning/Errors Indicator
Bug 61629Add Think Times to Children menu should not consider disabled elements
Bug 61655SampleSender: Drop HoldSampleSender implementation
Bug 61656tearDown Thread Group should run by default at stop or shutdown of test
Bug 61659JMeterVariables#get() should apply toString() on non string objects
Bug 61555Metaspace should be restricted as default
Bug 61693JMeter aware of Docker (-XX:+UnlockExperimentalVMOptions -XX:+UseCGroupMemoryLimitForHeap)
Bug 61694Add -server option in jmeter.bat
Bug 61697Introduce Darcula Look And Feel to make JMeter UI more attractive
Bug 61704Toolbar: Improve a bit the right part
Bug 61731Enhance Test plan Backup with option to save before run. Based on a contribution by orimarko at gmail.com
Bug 61640JSR223 Test Elements: Enable by default caching. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 61785Add Help → Useful links to create issues and download nightly build
Bug 61808Fix main frame position. Implemented by Artem Fedorov (artem at blazemeter.com) and contributed by BlazeMeter Ltd.
Bug 61802Loop / ForEach Controller should expose a variable for current iteration. Contributed by Ubik Load Pack (support at ubikloadpack.com)
PR#349Add i18n resources(zh_CN). Contributed by Helly Guo (https://github.com/hellyguo)
PR#351Fixed about dialog position on first view. Contributed by Graham Russell (graham at ham1.co.uk)
PR#352Menu bar - added mnemonics to more menu items. Contributed by Graham Russell (graham at ham1.co.uk)
PR#353Re-wrote some existing tests in Spock. Contributed by Graham Russell (graham at ham1.co.uk)
Bug 61919UX: Reorder Menus. Contributed by Graham Russell (graham at ham1.co.uk)
Bug 61920Plugins: Add ability to listen to Test Plan loading/closing. Contributed by Peter Doornbosch (https://bitbucket.org/pjtr/)
Bug 61935Plugins: Let GUI component (dynamically) decide whether it can be added via the menu or not. Contributed by Peter Doornbosch (https://bitbucket.org/pjtr/)
Bug 61969When changing LAF through GUI, user should be informed that it is better to restart
Bug 61970JMeter now uses English as default locale to avoid missing translations in some locales make UI look weird
Bug 56368Create and Deploy source artifacts to Maven central
Bug 61973Create and Deploy javadoc artifacts to Maven central
PR#371Fix example in documentation for XPath Assertion. Contributed by Konstantin Kalinin (kkalinin at hotmail.com)
Bug 62039Distributed testing: Provide ability to use SSL

Non-functional changes

Updated to bsh-2.0b6 (from bsh-2.0b5)
Updated to groovy-all-2.4.13 (from groovy-all-2.4.12)
Updated to rhino-1.7.7.2 (from rhino-1.7.7.1)
Updated to tika-core and tika-parsers 1.17 (from 1.16)
Updated to commons-dbcp2-2.2.0 (from 2.1.1)
Updated to caffeine 2.6.1 (from 2.5.5)
Updated to commons-codec-1.11 (from 1.10)
Updated to commons-io-2.6 (from 2.5)
Updated to commons-lang3-3.7 (from 3.6)
Updated to commons-pool2-2.5.0 (from 2.4.2)
Updated to asm-6.0 (from 5.2)
Updated to jsoup-1.11.2 (from 1.10.3)
Updated to cglib-nodep-3.2.6 (from 3.2.5)
Updated to ph-css 6.0.0 (from 5.0.4)
Updated to ph-commons 9.0.0 (from 8.6.6)
Updated to log4j2 2.10.0 (from 2.8.2)
Updated to httpcore 4.4.9 (from 4.4.7)
Updated to httpclient 4.5.5 (from 4.5.3)
Updated to jodd 4.1.4 (from 3.8.6)
Bug 61642Improve FTP test coverage
Bug 61641Improve JMS test coverage
Bug 61651Improve TCP test coverage
Bug 61651Improve OS test coverage. Partly contributed by Aleksei Balan (abalanonline at gmail.com)
PR#319Removed commented out code. Contributed by Graham Russell (graham at ham1.co.uk)
PR#322General JavaDoc cleanup. Contributed by Graham Russell (graham at ham1.co.uk)
PR#323Extracted method and used streams to improve readability. Contributed by Graham Russell (graham at ham1.co.uk)
PR#324Save backup refactor. Contributed by Graham Russell (graham at ham1.co.uk)
PR#327Utilising more modern Java, simplifying code and formatting code and comments. Contributed by Graham Russell (graham at ham1.co.uk)
PR#332Add the spock framework for groovy unit tests. Contributed by Graham Russell (graham at ham1.co.uk)
PR#334Enable running of JUnit tests from within IntelliJ with default config. Contributed by Graham Russell (graham at ham1.co.uk)
PR#335Removed functions.util.* as they don’t seem to be used (for many years). Contributed by Graham Russell (graham at ham1.co.uk)
Bug 61867 PR#345Updated to latest checkstyle (v8.5), Added many more rules to checkstyle, Included checking of test files and more file types. Contributed by Graham Russell (graham at ham1.co.uk)
PR#350Parallelised unit tests. Contributed by Graham Russell (graham at ham1.co.uk)
Bug 61966Setup Test Results Analyzer in jenkins
PR#343Reduce the size of some images in the documentation. Contributed by Graham Russell (graham at ham1.co.uk)

Bug fixes

HTTP Samplers and Test Script Recorder

Bug 61569JMS Point-to-Point Test Plan: Synchronization issue when putting reply. Contributed by Igor Panainte (panainte.i at gmail.com)

Other Samplers

Bug 61698Test Action: It stop is selected, samplers following Test Action can run
Bug 61707Test Action: Target is ignored when pause is selected, so it should be disabled
Bug 61827JMSPublisher: Don’t add new line at the end of the file. Contributed by Graham Russell (graham at ham1.co.uk)

Controllers

Bug 61556Clarify in documentation performance impacts of \${} var usage in IfController and groovy. Contributed by Justin McCartney (be_strew at yahoo.co.uk)
Bug 61713Test Fragment has option to Change Controller and Insert Parent. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 61965Module and Include Controller should not allow to add meaningless elements in their context.
Bug 62062ThroughputController: StackOverFlowError triggered when throughput=0 (Total Executions or Percentage Executions) Partly implemented by Artem Fedorov (artem.fedorov at blazemeter.com) and contributed by BlazeMeter Ltd.

Listeners

Bug 61742BackendListener: fix default value for backend_graphite.send_interval
Bug 61878BackendListener: NPE if BackendListenerClient#getDefaultParameters returns null
Bug 61950View Results Tree: Content-Type audio/mpegurl is wrongly considered as binary

Timers, Assertions, Config, Pre- & Post-Processors

Bug 61716Header Manager: When pasting Headers from Firefox or Chrome spaces are introduced as first character of value

Functions

Bug 61588Better log message for __RandomDate() function
Bug 61619In Function Helper Dialog, the 1st function doesn’t display default parameters
Bug 61628If split string has empty separator default separator is not used
Bug 61752__RandomDate: Function does not allow missing last parameter used for variable name

I18N

Report / Dashboard

Bug 61807Web Report: fix error in getTop5ErrorMetrics. Contributed by Graham Russell (graham at ham1.co.uk)
Bug 61900Report Generator: Report generation fails if separator is a regex reserved char like |
Bug 61925CsvSampleReader does not increment row in nextSample(). Contributed by Graham Russell (graham at ham1.co.uk)
Bug 61956Report Generation: -f of -forceDeleteResultFile option does not work. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 61899Report Generation: When jmeter.save.saveservice.print_field_names is false and sample_variables are set report generation fails. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 61962Latency Vs Request and Response Time Vs Request graphs do not exceed 1000 RPS. Contributed by Ubik Load Pack (support at ubikloadpack.com)

General

Bug 61661Avoid startup/shutdown problems due to 3rd party Thread Listener plugins throwing RuntimeException
Bug 61625File Editor used in BeanInfo behaves strangely under all LAFs with impact on CSVDataSet, JSR223, BSF, Beanshell Element
Bug 61844Maven pom.xml: Libraries used in testing should have scope test
Bug 61842Saving with no changes causes a save and duplicate, identical backup file

Thanks

We thank all contributors mentioned in bug and improvement sections above:

Igor Panainte (panainte.i at gmail.com)
Emilian Bold (emi at apache.org)
Ubik Load Pack
Justin McCartney (be_strew at yahoo.co.uk)
Vincent Herilier (https://github.com/vherilier)
Aleksei Balan (abalanonline at gmail.com)
Graham Russell (graham at ham1.co.uk)
orimarko at gmail.com
Artem Fedorov (artem at blazemeter.com)
BlazeMeter Ltd
Benny van Wijngaarden (benny at smaragd-it.nl)
Matthew Buckett (https://github.com/buckett)
Helly Guo (https://github.com/hellyguo)
Peter Doornbosch (https://bitbucket.org/pjtr/)
Jeremy Arnold (jeremy at arnoldzoo.org)
Vladimir Sitnikov (sitnikov.vladimir at gmail.com)
Konstantin Kalinin (kkalinin at hotmail.com)

We also thank bug reporters who helped us improve JMeter.

For this release we want to give special thanks to the following reporters for the clear reports and tests made after our fixes:

user7294900 on Stackoverflow (orimarko at gmail.com)

Apologies if we have omitted anyone else.

Known problems and workarounds

View Results Tree may freeze rendering large response particularly if this response has no spaces, see Bug 60816. This is due to an identified Java Bug UI stuck when calling JEditorPane.setText() or JTextArea.setText() with long text without space.
The Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).
The numbers that appear to the left of the green box are the number of active threads / total number of threads, the total number of threads only applies to a locally run test, otherwise it will show 0 (see Bug 55510).
Note that under some windows systems you may have this WARNING: java.util.prefs.WindowsPreferences WARNING: Could not open/create prefs root node Software\JavaSoft\Prefs at root 0 x80000002. Windows RegCreateKeyEx(…) returned error code 5. The fix is to run JMeter as Administrator, it will create the registry key for you, then you can restart JMeter as a normal user and you won’t have the warning anymore.
You may encounter the following error: java.security.cert.CertificateException: Certificates does not conform to algorithm constraints if you run a HTTPS request on a web site with a SSL certificate (itself or one of SSL certificates in its chain of trust) with a signature algorithm using MD2 (like md2WithRSAEncryption) or with a SSL certificate with a size lower than 1024 bits. This error is related to increased security in Java 8+. To allow you to perform your HTTPS request, you can downgrade the security of your Java installation by editing the Java jdk.certpath.disabledAlgorithms property. Remove the MD2 value or the constraint on size, depending on your case. This property is in this file: JAVA_HOME/jre/lib/security/java.security See Bug 56357 for details.
Under Mac OSX Aggregate Graph will show wrong values due to mirroring effect on numbers. This is due to a known Java bug, see Bug JDK-8065373 The fix is to use JDK8_u45 or later.
View Results Tree may fail to display some HTML code under HTML renderer, see Bug 54586. This is due to a known Java bug which fails to parse “px” units in row/col attributes. See Bug JDK-8031109 The fix is to use JDK9 b65 or later.
JTable selection with keyboard (SHIFT + up/down) is totally unusable with Java 7 on Mac OSX. This is due to a known Java bug JDK-8025126 The fix is to use JDK 8 b132 or later.

Version 3.3

Summary

[New and Noteworthy](#New and Noteworthy)
[Incompatible changes](#Incompatible changes)
[Bug fixes](#Bug fixes)
Improvements
[Non-functional changes](#Non-functional changes)
[Known problems and workarounds](#Known problems and workarounds)
Thanks

New and Noteworthy

Core improvements

HTTP Sampler now supports Brotli decompression.

CacheManager now completely supports Vary header.

InfluxDB BackendListener now supports sending results to InfluxDB through UDP protocol. changes/3.3/influxdb_udp.png

It has also been enhanced to send number of errors by response code and message for each transaction

TCP Sampler now computes latency, see Bug 60156

Upgraded dependencies to last available versions bringing performance improvements and bug fixes

Continued to improve the quality of our code and tests coverage. See Quality report

UX improvements

More work has been done to better support HiDPI.

Some bugs, that crept in with the work on lowering the memory usage of View Results Tree, were fixed.

The constant DEFAULT_IMPLEMENTATION was removed from CookieManager, as it lost it purpose with the removal of the alternate HTTP Client implementation in the last release

JDBC Sampler UX has been improved by adding select boxes for drivers and validation queries. changes/3.3/jdbc_config_validation_driver_url.png

changes/3.3/jdbc_config_validation_query.png

If Controller and While Controller UX have been improved changes/3.3/jmeter_if_controller.png

Report/Dashboard improvements

A new Help menu item has been added to simplify configuration of report generation. changes/3.3/jmeter_export_transactions_menu.png

changes/3.3/jmeter_export_transactions_result.png

Documentation improvements

Incorporated feedback about unclear documentation.

Functions

Function Helper Dialog: a new field that shows execution result has been added. changes/3.3/jmeter_function_result.png

New functions:

[__timeShift](/user-manual/functions/#__timeShift) - return a date in various formats with the specified amount of seconds/minutes/hours/days added.
[__RandomDate](/user-manual/functions/#__RandomDate) - generate random date within a specific date range.

Incompatible changes

In InfluxDbBackendListenerClient, statut property has been renamed to status
In CookieManager, DEFAULT_POLICY and DEFAULT_IMPLEMENTATION constants are now private. :::note If you’re using ignorecookies with HC3CookieHandler (< JMeter 3.1) configuration will be reset, ensure you put it back. :::
JMeter will not truncate anymore by default responses exceeding 10 MB. If you want to enable this truncation, see property httpsampler.max_bytes_to_store_per_request
org.apache.jmeter.protocol.tcp.sampler.TCPClient.read(InputStream) has been deprecated in favor or org.apache.jmeter.protocol.tcp.sampler.TCPClient.read(InputStream, SampleResult), ensure you update your implementation to be able to compute latency, see Bug 60156

Removed elements or functions

_StringFromFile function has been dropped, use [__StringFromFile](/user-manual/functions/#__StringFromFile) instead

Improvements

HTTP Samplers and Test Script Recorder

Bug 61056HTTP : Support brotli decoding
Bug 61135CookieManager : Drop Implementation select box and cleanup class
Bug 61492HTTP(S) Test Script Recorder : Add the possibility to change the value of proxy.pause in the GUI

Other samplers

Bug 61320Test Action : Set duration to 0 by default
Bug 61504JDBC Connection Configuration : Set Max Number of Connections to 0 by default
Bug 61505JDBC Connection Configuration : Set “Validation Query” to empty by default to use isValid method of JDBC driver
Bug 61506JDBC Connection Configuration : Add a list for main databases validation queries for “Validation Query” attribute
Bug 61507JDBC Connection Configuration : Add a list for main databases JDBC driver class name for “JDBC Driver class” attribute
Bug 61525OS Process Sampler : Add browser button to Command and Working directory fields
Bug 60156TCPSampler : Latency is not measured for TCP Sampler. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 61039CSV data set config : Add browser button to Filename field
Bug 61527CSV data set config : Add a list for main file encoding values for File encoding attribute

Controllers

Bug 61131IfController and WhileController : Improve UX

Listeners

Bug 61167InfluxdbBackendListener : add number of errors by response code and message for each transaction
Bug 61068Introduce property resultcollector.action_if_file_exists to control the popup “File already exists” when starting a test
Bug 61457InfluxDB backend listener client : Support sending result to InfluxDB through UDP protocol. Partly based on PR#302 by Junlong Wu (github id mybreeze77)

Timers, Assertions, Config, Pre- & Post-Processors

Bug 61176 PR#298 Cache responses that have vary header in the CacheManager.

Functions

Bug 61040Add a time shifting function
Bug 61126Function Helper Dialog : Add a field that shows execution result
Bug 61508Add a random date within a specific date range function

I18N

Bug 61509Better label/translation/documentation for labels start and max for Counter element

Report / Dashboard

Bug 61481Help Menu Item to export transaction for Web report

General

When looking for classes in ActionRouter, fall back to location of the jar, where ActionRouter is loaded from. Provided by Emilian Bold (emi at apache.org)
Bug 61510Set ‘Max Number of Connections’ to 0 into ‘JDBC Connection Configuration’ for the ‘JDBC Load Test template’
Bug 61399Make some bin and extras scripts Shellcheck compatible. Contributed by Wolfgang Wagner (internetwolf2000 at hotmail.com)

Non-functional changes

Updated to groovy 2.4.12 (from 2.4.10)
Updated to caffeine 2.5.5 (from 2.4.0)
Updated to commons-jexl3 3.1 (from 3.0)
Updated to ph-css 5.0.4 (from 5.0.3)
Updated to ph-commons 8.6.6 (from 8.6.0)
Updated to log4j2 2.8.2 (from 2.8.1)
Updated to xmlgraphics-commons 2.2 (from 2.1)
Updated to jodd 3.8.6 (from 3.8.1)
Updated to xstream 1.4.10 (from 1.4.9)
Updated to Apache Tika 1.16 (from 1.14)
Updated to jsoup-1.10.3 (from 1.10.2)
Updated to commons-lang3 3.6 (from 3.5)
Updated to json-path 2.4.0 (from 2.2.0)
Updated to httpcore 4.4.7 (from 4.4.6)
Bug 61438Change the cryptographic signature of packages from sha-1 to sha-512

Bug fixes

HTTP Samplers and Test Script Recorder

Bug 61384Don’t set the charset on enclosing multipart/form-data header. It irritates some servers. The charset was added sometime back while refactoring to use a newer API of http client. See Bug 56141 for more info.
Bug 61456java.lang.ArrayIndexOutOfBoundsException when recording with JMeter and weird Basic Auth Authorization header
Bug 61395Large server response truncation can impact recording

Other Samplers

Bug 60889JMeter JDBC sample calls SELECT USER() when testing with MySQL JDBC due to Connection#toString call for response headers.
Bug 61259JDBC Request : since JMeter 3.0, when JDBC auto-commit is false, a rollback statement happens each time a Request is executed. Partly contributed by Liu XP (liu_xp2003 at sina.com)
Bug 61319Fix regression: SMTP Sampler could not send mails, when no attachments were specified.

Controllers

Bug 61375Use system DNS resolver as last resort, when resolving entries in the static host table.

Listeners

Bug 61005View Results Tree - Browser Response Data is not clearing
Bug 61121InfluxdbBackendListenerClient: Only all percentiles are sent, not KO and OK
Bug 60961Try to keep status of selected and expanded elements in View Results Tree when new elements are added.
Bug 61198Backend Listener does not work properly in main script when included scripts also contain Backend Listener
Bug 61493Max/Min threads are interchanged in Graphite and InfluxDB backend listener

Timers, Assertions, Config, Pre- & Post-Processors

Bug 58743 PR#293 TableEditor can’t be saved, when using two or more instances. Bugfix provided by Emilian Bold (emi at apache.org)
Bug 61314HTTP URL Re-writing Modifier doesn’t replace existing jsessionid in http sampler, but adds it to the end
Bug 61336BeanShell Assertion : mistake in Chinese translation

Functions

Bug 61258StringFromFile function is mentioned twice in the Function helper dialog
Bug 61260[__XPath](/user-manual/functions/#__XPath) function returns null despite XPath checker founds matches
Bug 58876TestPlanName function returns null for a newly saved Test Plan and uses previously opened one for a new one

I18N

Report / Dashboard

Bug 61129Report/Dashboard : If response code is empty but a failureMessage is present, Errors and Top 5 Errors are not accurate. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 61151Report/Dashboard : Top 5 Errors by Sampler and Errors : If assertion contains html code, the html part is hidden

General

Bug 60743Stopping / Shutting down Test might create a deadlock due to HTTPCORE-446, fixed by HttpCore upgrade to 4.4.7
Bug 60994Fix some typo in comments or log messages. PR#289 and PR#290
Bug 61011Replace occurrences count is not correct (Path and Host replacement are counted twice)
Bug 61026Cannot run program “keytool”: CreateProcess error=2 when starting JMeter 3.2 in GUI mode
Bug 61054Endless loop in JOrphanUtils#replaceAllWithRegex when regex is contained in replacement
Bug 60995HTTP Test Script Recorder: Port field is very small under some L&F
Bug 61073HTTP(S) Test Script Recorder panel have some fields with bad size on HiDPI screen or GTK+ L&F on Linux/XWayland
Bug 57958Fix transaction sample not generated if thread stops/restarts. Implemented by Artem Fedorov (artem at blazemeter.com) and contributed by BlazeMeter Ltd.
Bug 61050Handle uninitialized RessourceBundle more gracefully, when calling JMeterUtils#getResString.
Bug 61100Invalid GC Log Filename on Windows
Bug 57962Allow to use variables (from User Defined Variables only) in all listeners in worker node mode
Bug 61270Fixed width fonts too small in text areas to read under HiDPI (user manual bug)
Bug 61292Make processing of samples in reporter more robust.
Bug 61359When cutting an element from Tree, Test plan is not marked as dirty
Bug 61380JMeter shutdown using timers releases thundering herd of interrupted samplers
Bug 57055CheckDirty.doAction should clear previousGuiItems for SUB_TREE_SAVED

Thanks

We thank all contributors mentioned in bug and improvement sections above:

Anass Benomar (abenomar at umanis.com, Mithrandir0407 at github)
Anthony Kearns (anthony.kearns atrightside.co)
Emilian Bold (emi at apache.org)
Liu XP (liu_xp2003 at sina.com)
Ubik Load Pack
Wolfgang Wagner (internetwolf2000 at hotmail.com)
Junlong Wu (github id mybreeze77)

We also thank bug reporters who helped us improve JMeter.

For this release we want to give special thanks to the following reporters for the clear reports and tests made after our fixes:

Liu XP (liu_xp2003 at sina.com)
Alexander Podelko (apodelko at yahoo.com)

Apologies if we have omitted anyone else.

Known problems and workarounds

View Results Tree may freeze rendering large response particularly if this response has no spaces, see Bug 60816. This is due to an identified Java Bug UI stuck when calling JEditorPane.setText() or JTextArea.setText() with long text without space.
The Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).
The numbers that appear to the left of the green box are the number of active threads / total number of threads, the total number of threads only applies to a locally run test, otherwise it will show 0 (see Bug 55510).
Note that under some windows systems you may have this WARNING: java.util.prefs.WindowsPreferences WARNING: Could not open/create prefs root node Software\JavaSoft\Prefs at root 0 x80000002. Windows RegCreateKeyEx(…) returned error code 5. The fix is to run JMeter as Administrator, it will create the registry key for you, then you can restart JMeter as a normal user and you won’t have the warning anymore.
You may encounter the following error: java.security.cert.CertificateException: Certificates does not conform to algorithm constraints if you run a HTTPS request on a web site with a SSL certificate (itself or one of SSL certificates in its chain of trust) with a signature algorithm using MD2 (like md2WithRSAEncryption) or with a SSL certificate with a size lower than 1024 bits. This error is related to increased security in Java 8+. To allow you to perform your HTTPS request, you can downgrade the security of your Java installation by editing the Java jdk.certpath.disabledAlgorithms property. Remove the MD2 value or the constraint on size, depending on your case. This property is in this file: JAVA_HOME/jre/lib/security/java.security See Bug 56357 for details.
Under Mac OSX Aggregate Graph will show wrong values due to mirroring effect on numbers. This is due to a known Java bug, see Bug JDK-8065373 The fix is to use JDK8_u45 or later.
View Results Tree may fail to display some HTML code under HTML renderer, see Bug 54586. This is due to a known Java bug which fails to parse “px” units in row/col attributes. See Bug JDK-8031109 The fix is to use JDK9 b65 or later.
JTable selection with keyboard (SHIFT + up/down) is totally unusable with Java 7 on Mac OSX. This is due to a known Java bug JDK-8025126 The fix is to use JDK 8 b132 or later.

Version 3.2

Summary

[New and Noteworthy](#New and Noteworthy)
[Incompatible changes](#Incompatible changes)
[Bug fixes](#Bug fixes)
Improvements
[Non-functional changes](#Non-functional changes)
[Known problems and workarounds](#Known problems and workarounds)
Thanks

New and Noteworthy

IMPORTANT CHANGES

JMeter now requires Java 8. Ensure you use the most up to date version.

JMeter logging has been migrated to SLF4J and Log4j 2. This affects configuration and 3rd party plugins, see below “Logging changes”.

Starting with JMeter version 3.2 the number of results in View Results Tree is limited by default to 500 entries. If you want more entries, you have to set the property view.results.tree.max_results to a higher value, or to 0, if you don’t want to impose any limit. You can set the property in bin/user.properties. More info might be found here.

Core improvements

JMeter now provides a new BackendListener implementation that interfaces InfluxDB. This implementation sends data using Asynchronous HTTP calls to InfluxDB through its HTTP API and give you the following graphs with annotations:
DNS Cache Manager now has a table to allow static host resolution.
JMS Publisher and Subscriber now allow reconnection on error with pause.
Variables in JMS Publisher are now supported for all types of messages. Add the encoding type of the file to parse its content
XPath Extractor now allows extraction randomly, by index or for all matches.
Response Assertion now allows to work on Request Header, provides a “OR” combination and has a better cell renderer
JMeter now uses Oracle Nashorn Javascript engine instead of Rhino. This provides a faster execution of Javascript.
HTTP HC4 Implementation now provides preemptive Basic Auth enabled by default
Embedded resources download in CSS has been improved to avoid useless repetitive parsing to find the resources
An important work on code quality and code coverage with tests has been done since Sonar has been setup on the project. You can see Sonar report here.

UX improvements

When running a Test, GUI is now more responsive and less impacting on memory usage thanks to a limitation on the number of Sample Results listeners hold and a rework of the way GUI is updated
HTTP Request GUI has been simplified and provides more place for parameters and body.
HTTP(S) Test Script Recorder has been simplified and clarified.
A replace feature has been added to Search feature to allow replacement in some elements. :::note ReplaceAll does not do replacement on all elements, it does it on: - HeaderManager: Replacement in values - Http Request: Replacement in Arguments, Path and Host :::
View Results Tree now provides a more up to date Browser renderer which requires JavaFX.
You can now add through a contextual menu think times, this will add think times between samplers and Transaction Controllers of selected node.
You can now apply a naming policy to children of a Transaction Controller. A default policy exists but you can implement your own through [org.apache.jmeter.gui.action.TreeNodeNamingPolicy](/./api/org/apache/jmeter/gui/action/TreeNodeNamingPolicy/) and configuring property naming_policy.impl
Sorting per column has been added to View Results in Table, Summary Report, Aggregate Report and Aggregate Graph elements.

Report/Dashboard improvements

Statistics have been reorganized to clarify report:
It is now possible to customize APDEX thresholds per transaction based on regular expression or sample name. The below example will apply different thresholds for samples sample(\d+), sampleA and scenarioB than default ones (500 and 1500 for satisfied and tolerated thresholds) declared: jmeter.reportgenerator.apdex_satisfied_threshold=500 jmeter.reportgenerator.apdex_tolerated_threshold=1500 jmeter.reportgenerator.apdex_per_transaction=sample(\\d+):1000|2000;\ sampleA:3000|4000;\ scenarioB:5000|6000

Documentation improvements

PDF Documentations have been migrated and updated to HTML user manual

Incompatible changes

JMeter requires now at least a Java 8 version to run.
JMeter logging has been migrated to SLF4J and Log4j 2, this involves changes in the way configuration is done. JMeter now relies on standard Log4j 2 configuration in file log4j2.xml See Logging changes section below for further details.
The following jars have been removed after migration from LogKit to SLF4J (see Bug 60589): - ApacheJMeter_slf4j_logkit.jar - avalon-framework-4.1.4.jar - commons-logging-1.2.jar - excalibur-logger-1.1.jar - logkit-2.0.jar
The commons-httpclient-3.1.jar has been removed after drop of HC3.1 support(see Bug 60727)
JMeter now sets through -Djava.security.egd=file:/dev/urandom the algorithm for secure random
Process Sampler now returns error code 500 when an error occurs. It previously returned an empty value.
In org.apache.jmeter.protocol.http.sampler.HTTPHCAbstractImpl two protected static fields (localhost and nonProxyHostSuffixSize) have been renamed to (LOCALHOST and NON_PROXY_HOST_SUFFIX_SIZE) to follow static fields naming convention
JMeter now uses by default Oracle Nashorn engine instead of Mozilla Rhino for better performances. This should not have an impact unless you use some advanced features. You can revert back to Rhino by settings property javascript.use_rhino=true. You can read this migration guide for more details on Nashorn. See Bug 60672
Bug 60729The Random Variable Config Element now allows minimum==maximum. Previous versions logged an error when minimum==maximum and did not set the configured variable.
Bug 60730The JSON PostProcessor now sets the _ALL variable (assuming Compute concatenation var was checked) even if the JSON path matches only once. Previous versions did not set the _ALL variable in this case.

Removed elements or functions

SOAP/XML-RPC Request has been removed as part of Bug 60727. Use HTTP Request element as a replacement. See Building a WebService Test Plan
Bug 60423Drop Monitor Results listener
Drop deprecated class org.apache.jmeter.protocol.system.NativeCommand
Drop deprecated class org.apache.jmeter.protocol.http.config.gui.MultipartUrlConfigGui
Drop deprecated class org.apache.jmeter.testelement.TestListener
Drop deprecated class org.apache.jmeter.reporters.FileReporter
Drop deprecated class org.apache.jmeter.protocol.http.modifier.UserSequence
Drop deprecated class org.apache.jmeter.protocol.http.parser.HTMLParseError
Drop unused methods org.apache.jmeter.protocol.http.control.HeaderManager#getSOAPHeader and org.apache.jmeter.protocol.http.control.HeaderManager#setSOAPHeader(Object)
org.apache.jmeter.protocol.http.util.Base64Encode has been deprecated, you can use java.util.Base64 as a replacement

Logging changes

JMeter logging has been migrated to SLF4J and Log4j 2. This affects logging configuration and 3rd party plugins (if they use JMeter logging). The following sections describe what changes need to be made.

Setting the logging level and log file

The default logging level can be changed on the command-line using the -L parameter. Likewise the -l parameter can be used to change the name of the log file. However the log_level properties no longer work.

The default logging levels and file name are defined in the log4j2.xml configuration file in the launch directory (usually JMETER_HOME/bin)

If you need to change the level programmatically from Groovy code or Beanshell, you need to do the following:

import org.apache.logging.log4j.core.config.Configurator;
    ⋮
    final String loggerName = te.getClass().getName(); // te being a JMeter class
    Configurator.setAllLevels(loggerName, Level.DEBUG);

Changes to 3rd party plugin logging

3rd party plugins should migrate their logging code from logkit to slf4j. This is fairly easy and can be done by replacing:

import org.apache.jorphan.logging.LoggingManager;
        import org.apache.log.Logger;
        ⋮
        private static final Logger log = LoggingManager.getLoggerForClass();

By:

import org.slf4j.Logger;
        import org.slf4j.LoggerFactory;
        ⋮
        private static final Logger log = LoggerFactory.getLogger(YourClassName.class);

Improvements

HTTP Samplers and Test Script Recorder

Bug 59934Fix race-conditions in CssParser. Based on a patch by Jerome Loisel (loisel.jerome at gmail.com)
Bug 60543HTTP Request / Http Request Defaults UX: Move to advanced panel Timeouts, Implementation, Proxy. Implemented by Philippe Mouawad (p.mouawad at ubik-ingenierie.com) and contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 60548HTTP Request : Allow Upper Panel to be collapsed
Bug 57242HTTP Authorization is not pre-emptively set with HttpClient4
Bug 60727Drop commons-httpclient-3.1 and related elements. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 60790HTTP(S) Test Script Recorder : Improve information on certificate expiration and have better UX for Start/Stop
Bug 60888HttpRequest : Add option to allow retrial of all requests including NON Idempotent HTTP methods
Bug 60896HTTP(S) Test Script Recorder : Improve UX by reducing number of properties on screen

Other samplers

Bug 60740Support variable for all JMS messages (bytes, object, …) and sources (file, folder), based on PR#241. Contributed by Maxime Chassagneux (maxime.chassagneux at gmail.com).
Bug 60585JMS Publisher and JMS Subscriber : Allow reconnection on error and pause between errors. Based on PR#240 from by Logan Mauzaize (logan.mauzaize at gmail.com) and Maxime Chassagneux (maxime.chassagneux at gmail.com).
PR#259 - Refactored and reformatted SmtpSampler. Contributed by Graham Russell (graham at ham1.co.uk)

Controllers

Bug 60672JavaScript function / IfController : use Nashorn engine by default

Listeners

Bug 60144View Results Tree : Add a more up to date Browser Renderer to replace old Render
Bug 60542View Results Tree : Allow Upper Panel to be collapsed. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 52962Allow sorting by columns for View Results in Table, Summary Report, Aggregate Report and Aggregate Graph. Based on a PR#245 by Logan Mauzaize (logan.mauzaize at gmail.com) and Maxime Chassagneux (maxime.chassagneux at gmail.com).
Bug 60590BackendListener : Add Influxdb BackendListenerClient implementation to JMeter. Partly based on PR#246 by Logan Mauzaize (logan.mauzaize at gmail.com) and Maxime Chassagneux (maxime.chassagneux at gmail.com).
Bug 60591BackendListener : Add a time boxed sampling. Based on a PR#237 by Logan Mauzaize (logan.mauzaize at gmail.com) and Maxime Chassagneux (maxime.chassagneux at gmail.com).
Bug 60678View Results Tree : Text renderer, search should not popup “Text Not Found”
Bug 60691View Results Tree : In Renderers (XPath, JSON Path Tester, RegExp Tester and CSS/JQuery Tester) lower panel is sometimes not visible as upper panel is too big and cannot be resized
Bug 60687Make GUI more responsive when it gets a lot of events.
Bug 60791View Results Tree: Trigger search on Enter key in Search Feature and display red background if no match
Bug 60822ResultCollector does not ensure unique file name entries in files HashMap

Timers, Assertions, Config, Pre- & Post-Processors

Bug 60154User Parameters GUI: allow rows to be moved up & down in the list. Contributed by Murdecai777 (https://github.com/Murdecai777).
Bug 60507Added ‘Or’ Function into ResponseAssertion. Based on a contribution from 忻隆 (298015902 at qq.com)
Bug 58943Create a Better Think Time experience. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 60602XPath Extractor : Add Match No. to allow extraction randomly, by index or all matches
Bug 60710XPath Extractor : When content on which assertion applies is not XML, in View Results Tree the extractor is marked in Red and named SAXParseException. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 60712Response Assertion : Improve Renderer of Patterns
Bug 59174Add a table with static hosts to the DNS Cache Manager. This enables better virtual hosts testing with HttpClient4.

Functions

Bug 60883 PR#288 - Add \${__escapeXml()} function. Contributed by Michael Osipov (michaelo at apache.org)

I18N

Improve translation “save_as” in French. Based on a PR#252 by Maxime Chassagneux (maxime.chassagneux at gmail.com).
Bug 60785Improvement of Japanese translation. Patch by Kimono (kimono.outfit.am at gmail.com).

Report / Dashboard

Bug 60637Improve Statistics table design
Bug 60112Report / Dashboard : Add ability to customize APDEX thresholds per Transaction name. Contributed by Stephane Leplus (s.leplus at ubik-ingenierie.com)

General

Bug 58164Check if file already exists on ResultCollector listener before starting the loadtest
Bug 54525Search Feature : Enhance it with ability to replace
Bug 60530Add API to create JMeter threads while test is running. Based on a contribution by Logan Mauzaize (logan.mauzaize at gmail.com) and Maxime Chassagneux (maxime.chassagneux at gmail.com).
Bug 60514Ability to apply a naming convention on Children of a Transaction Controller. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 60711Improve Delete button behaviour for Assertions / Header Manager / User Parameters GUIs / Exclude, Include in HTTP(S) Test Script Recorder
Bug 60593Switch to G1 GC algorithm
Bug 60595Add a SplashScreen at the start of JMeter GUI. Contributed by Maxime Chassagneux (maxime.chassagneux at gmail.com).
Bug 55258Drop “Close” icon from toolbar and add “New” to menu. Partly based on contribution from Sanduni Kanishka (https://github.com/SanduniKanishka)
Bug 59995Allow user to change font size with two new menu items and use jmeter.hidpi.scale.factor for scaling fonts. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 60654Validation Feature : Be able to ignore BackendListener. Contributed by Maxime Chassagneux (maxime.chassagneux at gmail.com).
Bug 60646Workbench : Save it by default
Bug 60684Thread Group: Validate ended prematurely by Scheduler with 0 or very short duration. Contributed by Andrew Burton (andrewburtonatwh at gmail.com).
Bug 60589Migrate LogKit to SLF4J - Drop Avalon, LogKit and Excalibur with backward compatibility for 3rd party modules. Contributed by Woonsan Ko (woonsan at apache.org)
Bug 60565Migrate LogKit to SLF4J - Optimize logging statements. e.g, message format args, throwable args, unnecessary if-enabled-logging in simple ones, etc. Contributed by Woonsan Ko (woonsan at apache.org)
Bug 60564Migrate LogKit to SLF4J - Replace LogKit loggers with SLF4J ones and keep the current LogKit binding solution for backward compatibility with plugins. Contributed by Woonsan Ko (woonsan at apache.org)
Bug 60664Add a UI menu to set log level. Contributed by Woonsan Ko (woonsan at apache.org)
PR#276 - Added some translations for polish locale. Contributed by Bartosz Siewniak (barteksiewniak at gmail.com)
Bug 60792Create a new Help menu item to create a thread dump
Bug 60813JSR223 Test element : Take into account JMeterStopTestNowException, JMeterStopTestException and JMeterStopThreadException
Bug 60814Menu : Add Open Recent menu item to make recent files loading more obvious
Bug 60815Drop “Reset GUI” from menu
Bug 60886Build improvements to better enable builds in environments that are behind a proxy. Partly contributed by Michael Osipov (michaelo at apache.org)

Non-functional changes

Bug 60415Drop support for Java 7.
Updated to dnsjava-2.1.8.jar (from 2.1.7)
Updated to groovy 2.4.10 (from 2.4.7)
Updated to httpcore 4.4.6 (from 4.4.5)
Updated to httpclient 4.5.3 (from 4.5.2)
Updated to jodd 3.8.1 (from 3.7.1.jar)
Updated to jsoup-1.10.2 (from 1.10.1)
Updated to ph-css 5.0.3 (from 4.1.6)
Updated to ph-commons 8.6.0 (from 6.2.4)
Updated to slf4j-api 1.7.25 (from 1.7.21)
Updated to asm 5.2 (from 5.1)
Updated to rsyntaxtextarea-2.6.1 (from 2.6.0)
Updated to commons-net-3.6 (from 3.5)
Updated to json-smart-2.3 (from 2.2.1)
Updated to accessors-smart-1.2 (from 1.1)
Converted the old pdf tutorials to xml.
PR#255 - Utilised Java 8 (and 7) features to tidy up code. Contributed by Graham Russell (graham at ham1.co.uk)
Bug 59435JMeterTestCase no longer supports JUnit3

Bug fixes

HTTP Samplers and Test Script Recorder

Bug 60531HTTP Cookie Manager : changing Implementation does not update Cookie Policy
Bug 60575HTTP GET Requests could have a content-type header without a body.
Bug 60682HTTP Request : Get method may fail on redirect due to Content-Length header being set
Bug 60643HTTP(S) Test Script Recorder doesn’t correctly handle restart or start after stop. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 60652HTTP PUT Requests might leak file descriptors.
Bug 60689httpclient4.validate_after_inactivity has no impact leading to usage of potentially stale/closed connections
Bug 60690Default values for “httpclient4.validate_after_inactivity” and “httpclient4.time_to_live” which are equal to each other makes validation useless
Bug 60758HTTP(s) Test Script Recorder : Number request may generate duplicate numbers. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 56939Parameters are not passed with OPTIONS HTTP Request
Bug 60778Http Java Impl does not show Authorization header in SampleResult even if it is sent
Bug 60837GET with body, PUT are not retried even if httpclient4.retrycount is higher than 0
Bug 60842Trim extracted URLs when loading embedded resources using the Lagarto based HTML Parser.
Bug 60928Http Request : Connection Leak when keepalive is used with Embedded Resources

Other Samplers

Bug 603982Guard Exception handler of the JDBCSampler against null messages
Bug 55652JavaSampler silently resets classname if class can not be found

Controllers

Listeners

Bug 60648GraphiteBackendListener can lose some metrics at end of test if test is very short
Bug 60650AbstractBackendListenerClient does not reset UserMetric between runs
Bug 60759View Results Tree : Search feature does not search in URL. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 60859Save Responses to a file : 2 elements with different configuration will overlap

Timers, Assertions, Config, Pre- & Post-Processors

Bug 60438 PR#235 - Clear old variables before extracting new ones in JSON Extractor. Based on a patch by Qi Chen (qi.chensh at ele.me)
Bug 60607DNS Cache Manager configuration is ignored
Bug 60729The Random Variable Config Element should allow minimum==maximum
Bug 60730The JSON PostProcessor should set the _ALL variable even if the JSON path matches only once.
Bug 60747Response Assertion : Add Request Headers to Field to Test
Bug 60763XMLAssertion should not leak errors to console
Bug 60797TestAction in pause mode can last beyond configured duration of test

Functions

Bug 60819Function __fileToString does not honor the documentation contract when file is not found

I18N

Report / Dashboard

Bug 60726Report / Dashboard : Top 5 errors by samplers must not take into account the series filtering
Bug 60919Report / Dashboard : Latency Vs Request and Response Time Vs Request are wrong if granularity is different from 1000 (1 second)

General

Bug 60775NamePanel ctor calls overrideable method
Bug 60428JMeter Graphite Backend Listener throws exception when test ends and useRegexpForSamplersList is set to true. Based on patch by Liu XP (liu_xp2003 at sina.com)
Bug 60442Fix a typo in build.xml (gavin at 16degrees.com.au)
Bug 60449JMeter Tree : Annoying behaviour when node name is empty
Bug 60494Add sonar analysis task to build
Bug 60501Search Feature : Performance issue when regexp is checked
Bug 60444Intermittent failure of TestHTTPMirrorThread#testSleep(). Contributed by Thomas Schapitz (ts-nospam12 at online.de)
Bug 60621The “report-template” folder is missing from ApacheJMeter_config-3.1.jar in maven central
Bug 60744GUI elements are not cleaned up when reused during load of Test Plan which can lead them to be partially initialized with a previous state for a new Test Element
Bug 60812JMeterThread does not honor contract of JMeterStopTestNowException
Bug 60857SaveService omits XML header if _file_encoding is not defined in saveservice.properties
Bug 60830Timestamps in CSV file could be corrupted due to sharing a SimpleDateFormatter across threads

Thanks

We thank all contributors mentioned in bug and improvement sections above:

Jerome Loisel (loisel.jerome at gmail.com)
Liu XP (liu_xp2003 at sina.com)
Qi Chen (qi.chensh at ele.me)
(gavin at 16degrees.com.au)
Thomas Schapitz (ts-nospam12 at online.de)
Murdecai777 (https://github.com/Murdecai777)
Logan Mauzaize (logan.mauzaize at gmail.com)
Maxime Chassagneux (maxime.chassagneux at gmail.com)
忻隆 (298015902 at qq.com)
Ubik Load Pack
Graham Russell (graham at ham1.co.uk)
Sanduni Kanishka (https://github.com/SanduniKanishka)
Andrew Burton (andrewburtonatwh at gmail.com)
Woonsan Ko (woonsan at apache.org)
Bartosz Siewniak (barteksiewniak at gmail.com)
Kimono (kimono.outfit.am at gmail.com)
Michael Osipov (michaelo at apache.org)
Stephane Leplus (s.leplus at ubik-ingenierie.com)

We also thank bug reporters who helped us improve JMeter.

For this release we want to give special thanks to the following reporters for the clear reports and tests made after our fixes:

Tuukka Mustonen (tuukka.mustonen at gmail.com) who gave us a lot of useful feedback which helped resolve Bug 60689 and Bug 60690
Amar Darisa (amar.darisa at gmail.com) who helped us with his feedback on Bug 60682

Apologies if we have omitted anyone else.

Known problems and workarounds

View Results Tree may freeze rendering large response particularly if this response has no spaces, see Bug 60816. This is due to an identified Java Bug UI stuck when calling JEditorPane.setText() or JTextArea.setText() with long text without space.
The Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).
The numbers that appear to the left of the green box are the number of active threads / total number of threads, the total number of threads only applies to a locally run test, otherwise it will show 0 (see Bug 55510).
Note that under some windows systems you may have this WARNING: java.util.prefs.WindowsPreferences WARNING: Could not open/create prefs root node Software\JavaSoft\Prefs at root 0 x80000002. Windows RegCreateKeyEx(…) returned error code 5. The fix is to run JMeter as Administrator, it will create the registry key for you, then you can restart JMeter as a normal user and you won’t have the warning anymore.
You may encounter the following error: java.security.cert.CertificateException: Certificates does not conform to algorithm constraints if you run a HTTPS request on a web site with a SSL certificate (itself or one of SSL certificates in its chain of trust) with a signature algorithm using MD2 (like md2WithRSAEncryption) or with a SSL certificate with a size lower than 1024 bits. This error is related to increased security in Java 8+. To allow you to perform your HTTPS request, you can downgrade the security of your Java installation by editing the Java jdk.certpath.disabledAlgorithms property. Remove the MD2 value or the constraint on size, depending on your case. This property is in this file: JAVA_HOME/jre/lib/security/java.security See Bug 56357 for details.
Under Mac OSX Aggregate Graph will show wrong values due to mirroring effect on numbers. This is due to a known Java bug, see Bug JDK-8065373 The fix is to use JDK8_u45 or later.
View Results Tree may fail to display some HTML code under HTML renderer, see Bug 54586. This is due to a known Java bug which fails to parse “px” units in row/col attributes. See Bug JDK-8031109 The fix is to use JDK9 b65 or later (but be aware that Java 9 is not certified yet for JMeter).
JTable selection with keyboard (SHIFT + up/down) is totally unusable with JAVA 7 on Mac OSX. This is due to a known Java bug JDK-8025126 The fix is to use JDK 8 b132 or later.

Version 3.1

Summary

[New and Noteworthy](#New and Noteworthy)
[Incompatible changes](#Incompatible changes)
[Bug fixes](#Bug fixes)
Improvements
[Non-functional changes](#Non-functional changes)
[Known problems and workarounds](#Known problems and workarounds)
Thanks

New and Noteworthy

Improve Report/Dashboard

The Dashboard has been improved with 3 new graphs and 1 summary table:

Connect Time over Time graph :
Response Time Percentiles Over Time (successful responses) graph :
Response Time Overview graph :
Top 5 errors by Sampler table :
More details on errors in Errors table
Average response time added to Statistics table :
Active Threads table now stacks threads :

New Metrics

A new sent_bytes metric has been introduced which reports the bytes sent to server.

Another metric connect_time has been enabled by default in this version

Handling Big responses

JMeter is now able to handle in terms of metrics responses bigger than 2GB, limit has been increased to 9223372 TB.

To handle such big responses, it can also now truncate part of the response to avoid overflooding memory. See httpsampler.max_bytes_to_store_per_request property.

New `__groovy` function

Introduce a new function __groovy that enables Groovy functions. This can be handy, as JavaScript can be quite slow (same for BeanShell), when used in highly concurrent test plans.

Use Groovy as default for JSR-223 elements

Groovy is now set as the default language for JSR-223 elements. If you want to use another of the supported language, you have to make an explicit choice.

Formatted HTML source view in Results Tree View

The HTML source code in the Results Tree View can now be viewed formatted. This is extremely useful, if the code of the webpage has been stripped of all superfluous whitespace.

New formatted HTML source view

Ability to update all timers in Test plan with a new property

A new property timer.factor=1.0f has been introduced which allows you to multiply pause times computed by Gaussian, Uniform and Poisson Timers by it. This allows you to update Think Times from one place and let you gain productivity.

Core improvements

Various GUI and UX fixes
Memory usage improvements
JDBC Request is now able to return Blob/Clob and computes latency and connect time
CSS Parsing introduced in 3.0 has been optimized by introduction of a parsing cache
HTTP Request is now able to handle body in GET request, this is useful for Elastic Search requests for example.

Documentation improvements

Documentation review and improvements for easier startup
New properties reference documentation section

Incompatible changes

A cache for CSS Parsing of URLs has been introduced in this version, it is enabled by default. It is controlled by property css.parser.cache.size. It can be disabled by setting its value to 0. See Bug 59885
ThroughputController defaults have changed. Now defaults are Percent Executions which is global and no more per user. See Bug 60023
Since version 3.1, HTML report ignores empty Transaction Controller (possibly generated by If Controller or Throughput Controller) when computing metrics. This provides more accurate metrics
Since version 3.1, Summariser ignores SampleResults generated by Transaction Controller when computing the live statistics, see Bug 60109
Since version 3.1, when using Stripped modes (by default StrippedBatch is used), response will be stripped also for failing SampleResults, you can revert this to previous behaviour by setting sample_sender_strip_also_on_error=false in user.properties, see Bug 60137
Since version 3.1, jmeter.save.saveservice.connect_time property value is true, meaning CSV file for results will contain an additional column containing connection time, see Bug 60106
Since version 3.1, Random Timer subclasses (Gaussian Random Timer, Uniform Random Timer and Poisson Random Timer) implement interface [org.apache.jmeter.timers.ModifiableTimer](/./api/org/apache/jmeter/timers/ModifiableTimer/)
Since version 3.1, if you don’t select any language in JSR223 Test Elements, Apache Groovy language will be used. See Bug 59945
Since version 3.1, CSV DataSet now trims variable names to avoid issues due to spaces between variables names when configuring CSV DataSet. This should not have any impact for you unless you use space at the beginning or end of your variable names. See Bug 60221
Since version 3.1, HTTP Request is able when using HttpClient4 (default) implementation to handle responses bigger than 2147483647 Bytes, that is 2GB. To allow this two properties have been introduced: - httpsampler.max_bytes_to_store_per_request (defaults to 10MB) will control what is held in memory. By default JMeter will only keep in memory the first 10MB of a response. If you have responses larger than this value and use assertions that are after the first 10MB, then you must increase this value - httpsampler.max_buffer_size will control the buffer used to read the data. Previously JMeter used a buffer equal to Content-Length header which could lead to failures and make JMeter less resistant to faulty applications, but note this may impact response times and give slightly different results than previous versions if your application returned a Content-Length header higher than current default value (65KB) See Bug 53039

Deprecated and removed elements or functions

Bug 60222Remove deprecated elements Distribution Graph, Spline Visualizer
Bug 60224Deprecate [Monitor Results](/./usermanual/component-reference/#Monitor_Results_(DEPRECATED)) listener. It will be dropped in next version.
Bug 60323Deprecate BSF Elements (Use JSR223 Elements instead). They will probably be dropped in N+2 version. The following elements are deprecated: - [BSF Sampler](/./usermanual/component-reference/#BSF_Sampler_(DEPRECATED)) - [BSF Listener](/./usermanual/component-reference/#BSF_Listener_(DEPRECATED)) - [BSF Assertion](/./usermanual/component-reference/#BSF_Assertion_(DEPRECATED)) - [BSF Timer](/./usermanual/component-reference/#BSF_Timer_(DEPRECATED)) - [BSF PreProcessor](/./usermanual/component-reference/#BSF_PreProcessor_(DEPRECATED)) - [BSF PostProcessor](/./usermanual/component-reference/#BSF_PostProcessor_(DEPRECATED))
Bug 60225Drop deprecated __jexl function, jexl support in BSF and dependency on commons-jexl-1.1.jar. This function can be easily replaced with [__jexl3](/./usermanual/functions/#__jexl3) function
Bug 60268Drop org.apache.jmeter.gui.action.Analyze and deprecate org.apache.jmeter.reporters.FileReporter (will be removed in next version)

Improvements

HTTP Samplers and Test Script Recorder

Bug 59882Reduce memory allocations for better throughput. Contributed by Benoit Wiart (b.wiart at ubik-ingenierie.com) through PR#217 and PR#228
Bug 59885Optimize css parsing for embedded resources download by introducing a cache. Contributed by Benoit Wiart (b.wiart at ubik-ingenierie.com) through PR#219
Bug 60092View Result Tree: Add shortened version of the PUT body to sampler result.
Bug 60229Add a new metric : sent_bytes. Implemented by Philippe Mouawad (p.mouawad at ubik-ingenierie.com) and contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 53039HTTP Request : Be able to handle responses which size exceeds 2147483647 bytes (that is 2GB)
Bug 60265HTTP Request : In Files Upload Tab you cannot resize columns
Bug 60318Ignore CSS warnings when parsing with ph-css library.
Bug 60358Http Request : Allow sending Body Data for HTTP GET request

Other samplers

PR#211Differentiate the timing for JDBC Sampler. Use latency and connect time. Contributed by Thomas Peyrard (thomas.peyrard at murex.com)
Bug 59620Fix button action in “JMS Publisher → Random File from folder specified below” to allow to select a directory
Bug 60066Handle CLOBs and BLOBs and limit them if necessary when storing them in result sampler.

Controllers

Bug 59351Improve log/error/message for IncludeController. Partly contributed by Antonio Gomes Rodrigues (ra0077 at gmail.com)
Bug 60023ThroughputController : Make “Percent Executions” and global the default values. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 60082Validation mode : Be able to force Throughput Controller to run as if it was set to 100%
Bug 59349Trim spaces in input filename in IncludeController.
Bug 60081Interleave Controller : Add an option to alternate across threads

Listeners

Bug 59953GraphiteBackendListener : Add Average metric. Partly contributed by Maxime Chassagneux (maxime.chassagneux at gmail.com)
Bug 59975View Results Tree : Text renderer annoyingly scrolls down when content is bulky. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 60109Summariser : Make it ignore TC generated SampleResult in its summary computations
Bug 59948Add a formatted and sane HTML source code render to View Results Tree
Bug 60252Add sent kbytes/s to Aggregate Report and Summary report
Bug 60267UX : In View Results Tree it should be possible to close the Configure popup by typing escape. Contributed by Ubik Load Pack (support at ubikloadpack.com)

Timers, Assertions, Config, Pre- & Post-Processors

Bug 59845Log messages about JSON Path mismatches at debug level instead of error.
PR#212Allow multiple selection and delete in HTTP Authorization Manager. Based on a patch by Benoit Wiart (b.wiart at ubik-ingenierie.com)
Bug 59816 PR#213Allow multiple selection and delete in HTTP Header Manager. Based on a patch by Benoit Wiart (b.wiart at ubik-ingenierie.com)
Bug 59967CSS/JQuery Extractor : Allow empty default value. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 59974Response Assertion : Add button “Add from clipboard”. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 60050CSV Data Set : Make it clear in the logs when a thread will exit due to this configuration
Bug 59962Cache Manager does not update expires date when response code is 304.
Bug 60018Timer : Add a factor to apply on pauses. Partly based on a patch by Ubik Load Pack (support at ubikloadpack.com)
Bug 60203Use more available space for textarea in XPath Assertion.
Bug 60220Rename JSON Path Post Processor to JSON Extractor
Bug 60221CSV DataSet : trim variable names
Bug 59329Trim spaces in input filename in CSVDataSet.

Functions

Bug 59963New function __RandomFromMultipleVars: Ability to compute a random value from values of one or more variables. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 59991New function __groovy to evaluate Groovy Script. Contributed by Ubik Load Pack (support at ubikloadpack.com)

I18N

PR#214Add spanish translation for delayed starting of threads. Contributed by Asier Lostalé (asier.lostale at openbravo.com).
Bug 60348Change chinese translation for Save as. Contributed by XMeter (support at xmeter.net).

Report / Dashboard

Bug 59954Web Report/Dashboard : Add average metric
Bug 59956Web Report / Dashboard : Add ability to generate a graph for a range of data
Bug 60065Report / Dashboard : Improve Dashboard Error Summary by adding response message to “Type of error”. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 60079Report / Dashboard : Add a new “Response Time Overview” graph
Bug 60080Report / Dashboard : Add a new “Connect Time Over Time “ graph. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 60091Report / Dashboard : Have a new report containing min/max and percentiles graphs.
Bug 60108Report / Dashboard : In Requests Summary rounding is too aggressive
Bug 60098Report / Dashboard : Reduce default value for “jmeter.reportgenerator.statistic_window” to reduce memory impact
Bug 60115Add date format property for start/end date filter into Report generator
Bug 60171Report / Dashboard : Active Threads Over Time should stack lines to give the total amount of threads running
Bug 60250Report / Dashboard : Need to Add Sent KB/s in Statistics Report of HTML Dashboard
Bug 60287Report / Dashboard : Have a new Top5 Errors by sampler table in Dashboard. Implemented by Philippe Mouawad (p.mouawad at ubik-ingenierie.com) and contributed by Ubik Load Pack (support at ubikloadpack.com)

General

Bug 59803Use isValid() method from JDBC driver, if no validationQuery is given in JDBC Connection Configuration.
Bug 57493Create a documentation page for properties
Bug 59924The log level of XXX package is set to DEBUG if log_level._XXXX_ property value contains spaces, same for __log function
Bug 59777Extract SLF4J binding into its own jar and make it a JMeter lib. :::note If you get a warning about multiple SLF4J bindings on startup. Remove either the Apache JMeter provided binding lib/ApacheJMeter_slf4j_logkit.jar, or all of the other reported bindings. For more information you can have a look at SLF4Js own info page. :::
Bug 60085Remove cache for prepared statements, as it didn’t work with the current JDBC pool implementation and current JDBC drivers should support caching of prepared statements themselves.
Bug 60137In Distributed testing when using StrippedXXXX modes strip response also on error
Bug 60106Settings defaults : Switch “jmeter.save.saveservice.connect_time” to true (after 3.0)
PR#229 tiny memory allocation improvements. Contributed by Benoit Wiart (b.wiart at ubik-ingenierie.com)
Bug 59945For all JSR223 elements, if script language has not been chosen on the UI, the script will be interpreted as a groovy script.
Bug 60266Usability/ UX : It should not be possible to close/exit/Revert/Load/Load a recent project or create from template a JMeter plan or open a new one if a test is running
Bug 57305Remove dependency of ProxyControl on GuiPackage. Based on patches by jarek102 (jarek102 at gmail.com) and Wyatt Epp (wyatt.epp at gmail.com)

Non-functional changes

Updated to jsoup-1.10.1 (from 1.8.3)
Updated to ph-css 4.1.6 (from 4.1.4)
Updated to tika-core and tika-parsers 1.14 (from 1.12)
Updated to commons-io 2.5 (from 2.4)
Updated to commons-lang3 3.5 (from 3.4)
Updated to commons-net 3.5 (from 3.4)
Updated to groovy 2.4.7 (from 2.4.6)
Updated to httpcore 4.4.5 (from 4.4.4)
Updated to slf4j-api 1.7.21 (from 1.7.13)
Updated to rsyntaxtextarea-2.6.0 (from 2.5.8)
Updated to xstream 1.4.9 (from 1.4.8)
Updated to jodd 3.7.1 (from 3.6.7.jar)
Updated to xmlgraphics-commons 2.1 (from 2.0.1)
PR#215Reduce duplicated code by using the newly added method GuiUtils#cancelEditing. Contributed by Benoit Wiart (b.wiart at ubik-ingenierie.com)
PR#218Misc cleanup. Contributed by Benoit Wiart (b.wiart at ubik-ingenierie.com)
PR#216Re-use pattern when possible. Contributed by Benoit Wiart (b.wiart at ubik-ingenierie.com)
Bug 60364Document Test Coverage. Contributed by Thomas Schapitz (ts-nospam12 at online.de)

Bug fixes

HTTP Samplers and Test Script Recorder

Bug 58888HTTP(S) Test Script Recorder (ProxyControl) does not add TestElement’s returned by SamplerCreator#createChildren()
Bug 59902Https handshake failure when setting httpclient.socket.https.cps property
Bug 60084JMeter 3.0 embedded resource URL is silently encoded
Bug 60376Http Test Script Recorder : If deflate is used by server then recording may break application

Other Samplers

Bug 59113JDBC Connection Configuration : Transaction Isolation level not correctly set if constant used instead of numerical

Controllers

Bug 60361ModuleController : If a Test plan contains a Module Controller which references an unexistant Controller, JMeter in GUI mode will not stop

Listeners

Bug 59712Display original query in RequestView when decoding fails. Based on a patch by Teemu Vesala (teemu.vesala at qentinel.com)
Bug 60278Since 2.13 (and Bug 57514), Aggregate Graph, Summary Report and Aggregate Report lost precision in the Error, Rate and Bandwidth values saved in the saved file csv
Bug 60360View Result Tree : Request Tab does not show body of a DELETE request

Timers, Assertions, Config, Pre- & Post-Processors

Bug 59964JSR223 Test Element : Cache compiled script if available is not correctly reset. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 59609Format extracted JSON Objects in JSON Post Processor correctly as JSON.
Bug 60332View Results Tree : With Windows LAF, JSON Extractor does not show JSON Path Expression and Result panel

Functions

I18N

General

Bug 59400Get rid of UnmarshalException on stopping when -X option is used.
Bug 59607JMeter crashes when reading large test plan (greater than 2GB). Based on fix by Felix Draxler (felix.draxler at sap.com)
Bug 59621Error count in report dashboard is one off.
Bug 59657Only set font in JSyntaxTextArea, when property jsyntaxtextarea.font.family is set.
Bug 59720Batch test file comparisons fail on Windows as XML files are generated as EOL=LF
Code cleanups. Patches by Graham Russell (graham at ham1.co.uk)
Bug 59722Use StandardCharsets to reduce the possibility of misspelling Charset names.
Bug 59723Use jmeter.properties for testing whenever possible
Bug 59726Unit test to check that CSV header text and sample format don’t change unexpectedly
Bug 59889Change encoding to UTF-8 in reports for dashboard.
Bug 60053In Non GUI mode, a Stacktrace is shown at end of test while report is being generated
Bug 60049When using Timers with high delays or Constant Throughput Timer with low throughput, Scheduler may take a lot of time to exit, same for Shutdown test
Bug 60089Report / Dashboard : Bytes throughput Over Time has reversed Sent and Received bytes. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 60090Report / Dashboard : Empty Transaction Controller should not count in metrics
Bug 60103Report / Dashboard : Requests summary includes Transaction Controller leading to wrong percentage
Bug 60105Report / Dashboard : Report requires Transaction Controller “generate parent sample” option to be checked, fix related issues
Bug 60107Report / Dashboard : In StatisticSummary, TransactionController SampleResult makes Total line wrong
Bug 60110Report / Dashboard : In Response Time Percentiles, slider is useless
Bug 60135Report / Dashboard : Active Threads Over Time should be in OverTime section
Bug 60125Report / Dashboard : Dashboard cannot be generated if the default delimiter is \t. Based on a report from Tamas Szabadi (tamas.szabadi at rightside.co)
Bug 59439Report / Dashboard : AbstractOverTimeGraphConsumer.createGroupInfos() should be abstract
Bug 59918Ant generated HTML report is broken (extras folder)
Bug 60295JSON Extractor doesn’t index array elements when only one element is found. Based on a patch by Roberto Braga (roberto.braga at sociale.it)
Bug 60299Thread Group with Scheduler : Weird behaviour when End-Time is in the past

Thanks

We thank all contributors mentioned in bug and improvement sections above:

Felix Draxler (felix.draxler at sap.com)
Antonio Gomes Rodrigues (ra0077 at gmail.com)
Graham Russell (graham at ham1.co.uk)
Teemu Vesala (teemu.vesala at qentinel.com)
Asier Lostalé (asier.lostale at openbravo.com)
Thomas Peyrard (thomas.peyrard at murex.com)
Benoit Wiart (b.wiart at ubik-ingenierie.com)
Maxime Chassagneux (maxime.chassagneux at gmail.com)
Ubik Load Pack
Tamas Szabadi (tamas.szabadi at rightside.co)
Roberto Braga (roberto.braga at soziale.it)
jarek102 at gmail.com
Wyatt Epp (wyatt.epp at gmail.com)
Thomas Schapitz (ts-nospam12 at online.de)

We also thank bug reporters who helped us improve JMeter.

For this release we want to give special thanks to the following reporters for the clear reports and tests made after our fixes:

Apologies if we have omitted anyone else.

Known problems and workarounds

The Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).
The numbers that appear to the left of the green box are the number of active threads / total number of threads, the total number of threads only applies to a locally run test, otherwise it will show 0 (see Bug 55510).
Note that there is a bug in Java on some Linux systems that manifests itself as the following error when running the test cases or JMeter itself: json [java] WARNING: Couldn't flush user prefs: java.util.prefs.BackingStoreException: java.lang.IllegalArgumentException: Not supported: indent-number This does not affect JMeter operation. This issue is fixed since Java 7b05.
Note that under some windows systems you may have this WARNING: java.util.prefs.WindowsPreferences WARNING: Could not open/create prefs root node Software\JavaSoft\Prefs at root 0 x80000002. Windows RegCreateKeyEx(…) returned error code 5. The fix is to run JMeter as Administrator, it will create the registry key for you, then you can restart JMeter as a normal user and you won’t have the warning anymore.
With Oracle Java 7 and Mac Book Pro Retina Display, the JMeter GUI may look blurry. This is a known Java bug, see Bug JDK-8000629. A workaround is to use a Java 7 update 40 runtime which fixes this issue.
You may encounter the following error: java.security.cert.CertificateException: Certificates does not conform to algorithm constraints if you run a HTTPS request on a web site with a SSL certificate (itself or one of SSL certificates in its chain of trust) with a signature algorithm using MD2 (like md2WithRSAEncryption) or with a SSL certificate with a size lower than 1024 bits. This error is related to increased security in Java 7 version u16 (MD2) and version u40 (Certificate size lower than 1024 bits), and Java 8 too. To allow you to perform your HTTPS request, you can downgrade the security of your Java installation by editing the Java jdk.certpath.disabledAlgorithms property. Remove the MD2 value or the constraint on size, depending on your case. This property is in this file: JAVA_HOME/jre/lib/security/java.security See Bug 56357 for details.
Under Mac OSX Aggregate Graph will show wrong values due to mirroring effect on numbers. This is due to a known Java bug, see Bug JDK-8065373 The fix is to use JDK7_u79, JDK8_u45 or later.
View Results Tree may fail to display some HTML code under HTML renderer, see Bug 54586. This is due to a known Java bug which fails to parse “px” units in row/col attributes. See Bug JDK-8031109 The fix is to use JDK9 b65 or later.
JTable selection with keyboard (SHIFT + up/down) is totally unusable with JAVA 7 on Mac OSX. This is due to a known Java bug JDK-8025126 The fix is to use JDK 8 b132 or later.

Version 3.0

Summary

[New and Noteworthy](#New and Noteworthy)
[Known bugs](#Known bugs)
[Incompatible changes](#Incompatible changes)
[Bug fixes](#Bug fixes)
Improvements
[Non-functional changes](#Non-functional changes)
Thanks

New and Noteworthy

Test plan creation and debugging improvements

New Search Feature in View Results Tree to allow searching for text / regexp in Request/Responses/Headers/Cookies/… This will ease correlation and Test plans creation

changes/3.0/view_results_tree_search_feature.png

New JSON Post Processor to better extract data from JSON content using user friendly JSON-PATH syntax

JSON is now a first class citizen in JMeter with the introduction of a new JSONPath post processor. This post processor is very similar to Regular Expression Post Processor but is well suited for JSON code. It is based on Jayway JSON Path library

changes/3.0/json_path_extractor.png

New validation feature, in one click run a selection of Thread Groups with `1` user, no pause and `1` iteration

changes/3.0/thread_group_validate.png

JSR223 Test Elements do not require a Cache Compilation Key anymore

Just check Cache compiled script if available checkbox and the elements (Pre-Processor, Post-Processor, Assertions, Listeners, …) will pre-compile the script and cache the compiled code if the underlying language supports it

changes/3.0/jsr223_cache_compiled.png

Nashorn can now be used as Javascript engine providing better performance and easier usage

To enable Nashorn, you need to set in user.properties:

javascript.use_rhino=false

Nashorn can be used with Java 8 in the following elements:

IfController
JSR223 Test elements with javascript language selected
__javaScript function

Jexl3 has been integrated. It provides new scripting features and much better documentation

JEXL3 can now be used thanks to a new function __jexl3. JEXL is a language very similar to JSTL.

Simplified HTTP Request UI

A new “Advanced” tab has been added to HTTP Request to simplify configuration. The file upload feature has been moved into a dedicated tab. This increases the space available for parameters in UI and simplifies the UX.

changes/3.0/http_request_basic.png

changes/3.0/http_request_advanced.png

HTTP Request Defaults improvements

You can now configure Source Address (IP Spoofing like feature) and “Save response as MD5 hash” in Advanced Tab

changes/3.0/http_request_defaults_advanced.png

Reporting improvements

New Reporting Feature generating dynamic Graphs in HTML pages (APDEX, Summary report and Graphs)

A dynamic HTML report can now be generated either at the end of a load test or from a result file whenever you want. See Generating dashboard for more details. This report provides the following metrics:

APDEX (Application Performance Index) table that computes the APDEX based on configurable values for tolerated and satisfied thresholds
A request summary graph showing the Success and failed transaction percentage:
A Statistics table providing in one table a summary of all metrics per transaction including 3 configurable percentiles :
An error table providing a summary of all errors and their proportion in the total requests :
Zoomable chart where you can check/uncheck every transaction to show/hide it for: - Response times Over Time : - Bytes throughput Over Time : - Latencies Over Time : - Hits per second : - Response codes per second : - Transactions per second : - Response Time vs Request per second : - Latency vs Request per second : - Response times percentiles : - Active Threads Over Time : - Times vs Threads : - Response Time Distribution :

GraphiteBackendListener has a new Server Hits metric

Summariser displays a more readable duration

Now duration are display in the format hours:minutes:seconds

Generate Summary Results +      1 in 00:00:01 =    1.7/s Avg:     1 Min:     1 Max:     1 Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
Generate Summary Results +    138 in 00:00:09 =   16.2/s Avg:     0 Min:     0 Max:     1 Err:     0 (0.00%) Active: 9 Started: 9 Finished: 0
Generate Summary Results =    139 in 00:00:09 =   15.3/s Avg:     0 Min:     0 Max:     1 Err:     0 (0.00%)
Generate Summary Results +    467 in 00:00:10 =   47.0/s Avg:     0 Min:     0 Max:     1 Err:     0 (0.00%) Active: 19 Started: 19 Finished: 0
Generate Summary Results =    606 in 00:00:19 =   31.9/s Avg:     0 Min:     0 Max:     1 Err:     0 (0.00%)
⋮
Generate Summary Results +   1662 in 00:00:10 =  166.1/s Avg:     0 Min:     0 Max:     1 Err:     0 (0.00%) Active: 50 Started: 50 Finished: 0
Generate Summary Results =  28932 in 00:03:19 =  145.4/s Avg:     0 Min:     0 Max:     1 Err:     0 (0.00%)
Generate Summary Results +   1664 in 00:00:10 =  166.4/s Avg:     0 Min:     0 Max:     1 Err:     0 (0.00%) Active: 50 Started: 50 Finished: 0
Generate Summary Results =  30596 in 00:03:29 =  146.4/s Avg:     0 Min:     0 Max:     1 Err:     0 (0.00%)
Generate Summary Results +   1661 in 00:00:10 =  166.1/s Avg:     0 Min:     0 Max:     1 Err:     0 (0.00%) Active: 50 Started: 50 Finished: 0
Generate Summary Results =  32257 in 00:03:39 =  147.3/s Avg:     0 Min:     0 Max:     1 Err:     0 (0.00%)

BackendListener now allows you to define sampler list as a regular expression

You can now use a regular expression to select the samplers you want to filter. Use parameter: useRegexpForSamplersList=true and put a regex in parameter samplersList

changes/3.0/graphite_backend_listener_regex.png

Protocols and Load Testing improvements

Migration to HttpClient 4.5.2 has been started. Although not completely finished, it improves many areas in JMeter

Migration to HttpClient 4.5.2 improves the following fields of JMeter:

Support of recent RFC like HTTP State Management Mechanism RFC-6265 for Cookies, you should use now HC4CookieHandler in HTTP Cookie Manager component and select standard Cookie policy
Server Name Indication (SNI) support for HttpClient4 implementation
Improved and better performing validation mechanism for Stale connections and Keep-Alive management, see properties httpclient4.validate_after_inactivity and httpclient4.time_to_live
Many bug fixes since previous version 4.2.6 used in JMeter 2.13, see HttpClient 4.5.X release notes
Better support of HTTP RFC 2616 / RFC 7230 and fixes to issues with deflate compression management

Parallel Downloads is now realistic and scales much better:

Parsing of CSS imported files (through @import) or embedded resources (background, images, …)
Lazy initialization of SSL context: For 15 Threads 138% more sampling in 5 minutes for HTTP only tests. Gain increases as number of threads increases
Rework of Connection management for Parallel Download: This better simulates current browser behaviour and improves throughput. For 15 Threads 135% extra samples in 5 minutes.
Reuse of Threads used for Parallel downloads through a ThreadPool: This improves throughput and increases JMeter scalability for such tests
Total of 750% more throughput found on test with 15 threads, the more threads you have the more the gain
You can now compute and store just the MD5 of embedded resources instead of storing the entire response, this can be done by setting the property httpsampler.embedded_resources_use_md5=true

Introduction of Sample Timeout feature

This new Sample Timeout Pre-Processor allows you to apply a Timeout on the elements that are in its scope. In the screenshot below the 10 second timeout applies to the Debug Sampler and HTTP Request elements.

changes/3.0/sample_timeout.png

JDBC request now uses DBCP2 pool

JDBC Request and JDBC Connection Configuration have been updated to replace old Excalibur Pool by Apache Commons DBCP2 pool. As a consequence properties have been migrated to equivalent when available and UI has been updated. Note that unlike Excalibur, Commons DBCP uses the validation query when creating the pool. So make sure the query is valid. The default query suits many databases, but not all - for example Oracle requires ‘SELECT 1 FROM DUAL’ or similar.

changes/3.0/jdbc_connection_configuration.png

UX Improvements:

Better display in HiDPI screens

See JMeter with a HiDPI screen on Linux or Windows in Hints and Tips section in user manual

New Icon look and Logo

JMeter has a new Logo created by Felix Schumacher. Icons have also been refreshed to give a more modern style and make them more meaningful

Lots of fixes of annoying little bugs

Around 40 UI fixes have been made to either fix buggy, confusing behaviour or simplify usage by not allowing incompatible options to be selected

Improved Thread Group UI and related actions (`Start`, `Start No Timers`, `Validate`)

Creating and testing a Test Plan before Load Test has been much simplified by allowing you to only start a selection of Thread Group, start them without applying Timers (thus gaining time) or start them using a new Validation mode. This validation mode allows you to start a Thread Group (without modifying it) with 1 thread, 1 iteration and without applying timers. This validation mode can be customized.

changes/3.0/thread_group_starters.png

New shortcuts

Add most used elements (Ctrl + 0 … Ctrl + 9), configurable through gui.quick__XXX_ properties
Shortcuts to expand nodes

Core improvements

Configuration simplification with better defaults

Default values for many properties have been modified to make JMeter configuration optimal Out of the box. Read “Incompatible changes” section for more details.

Apache Groovy bundled with JMeter

Apache Groovy, the well-known JVM scripting language, is now bundled with Apache JMeter in lib folder. This allows you to use it immediately through JSR223 Elements by selecting the Groovy language.

Superfluous and old properties removed

Old properties that existed to maintain backward compatibility or to offer some superfluous customization have been removed. Read “Incompatible changes” section to see which properties have been removed.

Code and documentation improvements

Migration to Java7 source code and use of its syntactic sugar
Major code cleanups
Full review of documentation and improvement both in content and presentation

Improvements to unit tests

Migration of many tests to JUnit 4
Better management of Headless tests
More Unit Tests

Dependencies refresh

Deprecated Libraries dropped or replaced by up to date ones:

Excalibur replaced by commons-dbcp
htmllexer, htmlparser removed
soap removed
jdom removed

Slf4j can now be used within Plugins and core code

You can now use SLF4J logging wrapper in your custom plugins or org.apache.jmeter.protocol.java.sampler.AbstractJavaSamplerClient subclasses.

Incompatible changes

Since version 3.0, Groovy-2.4.6 is bundled with JMeter (lib folder), ensure you remove old version or referenced versions through properties search_paths or user.classpath
Since version 3.0, jmeter.save.saveservice.assertion_results_failure_message property value is true, meaning CSV file for results will contain an additional column containing assertion result response message, see Bug 58978
Since version 3.0, jmeter.save.saveservice.print_field_names property value is true, meaning CSV file for results will contain field names as first line in CSV, see Bug 58991
Since version 3.0, jmeter.save.saveservice.idle_time property value is true, meaning CSV/XML result files will contain an additional column containing idle time between samplers, see Bug 57182
In RandomTimer class, protected instance timer field has been replaced by getTimer() protected method, this is related to Bug 58100. This may impact 3rd party plugins.
Since version 3.0, you can use Nashorn Engine (default javascript engine is Rhino) under Java8 for Elements that use Javascript Engine (__javaScript, IfController). If you want to use it, use property javascript.use_rhino=false, see Bug 58406. :::note Note: in a future version, we will switch to Nashorn by default. Users are encouraged to report any issue related to using Nashorn instead of Rhino. :::
Since version 3.0, JMS Publisher will reload contents of file if Message source is “From File” and the “Filename” field changes (e.g. if it uses a variable that has changed)
org.apache.jmeter.gui.util.ButtonPanel has been removed, if you use it in your 3rd party plugin or custom development ensure you update your code. See Bug 58687
Property jmeterthread.startearlier has been removed. See Bug 58726
Property jmeterengine.startlistenerslater has been removed. See Bug 58728
Property jmeterthread.reversePostProcessors has been removed. See Bug 58728
Property jmeter.toolbar.display has been removed, the toolbar is now always displayed. See Bug 59236
Property jmeter.errorscounter.display has been removed, the errors/warnings counter is now always displayed. See Bug 59236
Property xml.parser has been removed, it is not used anymore as org.apache.jmeter.util.JMeterUtils#getXMLParser has been deprecated and is not used either. See Bug 59236
Summariser listener now shows the duration in the format HH:mm:ss (Hour:Minute:Second), it previously showed the duration in seconds. See Bug 58776
org.apache.jmeter.protocol.http.visualizers.RequestViewHTTP.getQueryMap signature has changed, if you use it ensure you update your code. See Bug 58845
JMS Subscriber will consider a sample to be an error if the number of received messages is not equal to expected number of messages. It previously considered a sample OK if at least 1 message was received. See Bug 58980
Since version 3.0, HTTP(S) Test Script recorder defaults to using port 8888 (as configured when using Recording Template). See Bug 59006
Since version 3.0, the parser for embedded resources (replaced since 2.10 by Lagarto based implementation) which relied on the htmlparser library (HtmlParserHTMLParser) has been dropped along with its dependencies.
Since version 3.0, support for reading old Avalon format JTL (result) files has been removed, see Bug 59064
Since version 3.0, the default property value for http.java.sampler.retries has been changed to 0 (no retry by default) to align it with the behaviour of HttpClient4. :::note Note also that its meaning has changed: before 3.0, http.java.sampler.retries=1 meant No Retry (i.e. total tries = 1), since 3.0 http.java.sampler.retries=1 means 1 retry. (Note: this only applies to the Java HTTP Sampler) ::: See Bug 59103
Since 3.0, the following deprecated classes have been dropped - org.apache.jmeter.protocol.http.modifier.UserParameterXMLContentHandler - org.apache.jmeter.protocol.http.modifier.UserParameterXMLErrorHandler - org.apache.jmeter.protocol.http.modifier.UserParameterXMLParser
httpsampler.await_termination_timeout has been replaced by httpsampler.parallel_download_thread_keepalive_inseconds which is now the keep alive time for the parallel download threads (in seconds).
JDBC Request has been updated to use commons-dbcp2, since then the behaviour is slightly different, ensure you have a correct “Validation Query” for your database. See Bug 58786
The following jars have been removed: - excalibur-datasource-2.1.jar (see Bug 59156) - excalibur-instrument-1.0.jar (see Bug 58786) - excalibur-pool-api-2.1.jar (see Bug 58786) - excalibur-pool-impl-2.1.jar (see Bug 58786) - excalibur-pool-instrumented-2.1.jar (see Bug 58786) - htmllexer-2.1.jar (see Bug 59037) - htmlparser-2.1.jar (see Bug 59037) - soap-2.3.1.jar - jdom-1.1.3.jar (see Bug 59156)
Maximum number of redirects allowed by JMeter is now 20, it was previously 5. This can be changed with the property httpsampler.max_redirects. See Bug 59382

Deprecated and removed elements

MongoDB elements (MongoDB Source Config, MongoDB Script) have been deprecated and will be removed in the next version of JMeter. They do not appear anymore in the menu, if you need them modify not_in_menu property. The JMeter team advises not to use them anymore. See Bug 58772
WebService(SOAP) Request and HTML Parameter Mask which were deprecated in 2.13 version, have now been removed following our deprecation strategy. Classes and properties which were only used by those elements have been dropped: - org.apache.jmeter.protocol.http.util.DOMPool - org.apache.jmeter.protocol.http.util.WSDLException - org.apache.jmeter.protocol.http.util.WSDLHelper - Property soap.document_cache - JAR soap-2.3.1 has been also removed
__jexl function (i.e. JEXL 1) has been deprecated and will be removed in next version. See Bug 58903
Spline Visualizer listener and Distribution Graph listener have been deprecated and will be removed in the next version of JMeter. They do not appear anymore in the menu, if you need them modify not_in_menu property. JMeter team advises not to use them anymore. See Bug 58791

Improvements

HTTP Samplers and Test Script Recorder

Bug 57696HTTP Request : Improve responseMessage when resource download fails. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 57995Use FileServer for HTTP Request files. Implemented by Andrey Pokhilko (andrey at blazemeter.com) and contributed by BlazeMeter Ltd.
Bug 58843Improve the usable space in the HTTP sampler GUI. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 58852Use less memory for PUT requests. The uploaded data will no longer be stored in the Sampler. This is the same behaviour as with POST requests.
Bug 58860HTTP Request : Add automatic variable generation in HTTP parameters table by right click. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 58923normalize URIs when downloading embedded resources.
Bug 59005HTTP Sampler : Added WebDAV verb (SEARCH).
Bug 59006Change Default proxy recording port to 8888 to align it with Recording Template. Contributed by Antonio Gomes Rodrigues (ra0077 at gmail.com)
Bug 58099Performance : Lazily initialize HttpClient SSL Context to avoid its initialization even for HTTP only scenarios
Bug 57577HttpSampler : Retrieve All Embedded Resources, add property “httpsampler.embedded_resources_use_md5” to only compute md5 and not keep response data. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 59023HttpSampler UI : rework the embedded resources labels and change default number of parallel downloads to 6. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 59028Use SystemDefaultDnsResolver singleton. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 59036FormCharSetFinder : Use JSoup instead of deprecated HTMLParser
Bug 59034Parallel downloads connection management is not realistic. Contributed by Benoit Wiart (benoit dot wiart at gmail.com) and Philippe Mouawad
Bug 59060HTTP Request GUI : Move File Upload to a new Tab to have more space for parameters and prevent incompatible configuration. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 59103HTTP Request Java Implementation: Change default “http.java.sampler.retries” to align it on HttpClient behaviour and make the name meaningful
Bug 59083HTTP Request : Make Method field editable so that additional methods (WebDAV) can be added easily
Bug 59118Add comment in recorded think time by proxy recorder. Contributed by Antonio Gomes Rodrigues (ra0077 at gmail.com)
Bug 59116Add the possibility to setup a prefix to sampler name recorded by proxy. Partly based on a patch by Antonio Gomes Rodrigues (ra0077 at gmail.com)
Bug 59129HTTP Request : Simplify GUI with simple/advanced Tabs
Bug 59033Parallel Download : Rework Parser classes hierarchy to allow plug-in parsers for different mime types
Bug 52073Embedded Resources Parallel download : Improve performances by avoiding shutdown of ThreadPoolExecutor at each sample. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 59190HTTP(S) Test Script Recorder : Suggested excludes should ignore case. Contributed by Antonio Gomes Rodrigues (ra0077 at gmail.com)
Bug 59140Parallel Download : Add CSS Parsing to extract links from CSS files
Bug 59249Http Request Defaults : Add “Source address” and “Save responses as MD5”
Bug 59382More realistic default value for httpsampler.max_redirects

Other samplers

Bug 57928Add ability to define protocol (http/https) to AccessLogSampler GUI. Contributed by Jérémie Lesage (jeremie.lesage at jeci.fr)
Bug 58300Make existing Java Samplers implement Interruptible
Bug 58160JMS Publisher : reload file content if file name changes. Based partly on a patch contributed by Maxime Chassagneux (maxime.chassagneux at gmail.com)
Bug 58786JDBC Sampler : Replace Excalibur DataSource by more up to date library commons-dbcp2
Bug 59205TCP Sampler: Set connect time in sampler when connection is established.
Bug 59381JMSPublisher : FileChooserDialog filter does not work for browser buttons. Based partly on a patch contributed by Antonio Gomes Rodrigues (ra0077 at gmail.com)

Controllers

Bug 58406IfController : Allow use of Nashorn Engine if available for JavaScript evaluation
Bug 58281RandomOrderController : Improve randomization algorithm performance. Contributed by Graham Russell (jmeter at ham1.co.uk)
Bug 58675Module controller : error message can easily be missed. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 58673Module controller : when the target element is disabled the default jtree icons are displayed. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 58674Module controller : it should not be possible to select more than one node in the tree. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 58680Module Controller : ui enhancement. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 58989Record controller gui : add a button to clear all the recorded samples. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)

Listeners

Bug 58041Tree View Listener should show sample data type
Bug 58122GraphiteBackendListener : Add Server Hits metric. Partly based on a patch from Amol Moye (amol.moye at thomsonreuters.com)
Bug 58681GraphiteBackendListener : Don’t send data if no sampling occurred
Bug 58776Summariser should display a more readable duration
Bug 58791Deprecate listeners: Distribution Graph (alpha) and Spline Visualizer
Bug 58849View Results Tree : Add a search panel to the request http view to be able to search in the parameters table. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 58857View Results Tree : the request view http does not allow to resize the parameters table first column. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 58955Request view http does not correctly display http parameters in multipart/form-data. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 55597View Results Tree: Add a search feature to search in recorded samplers
Bug 59102View Results Tree: Better default value for “view.results.tree.max_size”
Bug 59099Backend listener : Add the possibility to consider samplersList as a Regular Expression. Contributed by Antonio Gomes Rodrigues (ra0077 at gmail.com)
Bug 59424Visualizer : Add “Clear” in popup menu

Timers, Assertions, Config, Pre- & Post-Processors

Bug 58303Change usage of bouncycastle api in SMIMEAssertion to get rid of deprecation warnings.
Bug 58515New JSON related components : JSON-PATH Extractor and JSON-PATH Renderer in View Results Tree. Donated by Ubik Load Pack (support at ubikloadpack.com).
Bug 58698Correct parsing of auth-files in HTTP Authorization Manager.
Bug 58756CookieManager : Cookie Policy select box content must depend on Cookie implementation.
Bug 56358Cookie manager supports cross port cookies and RFC6265. Thanks to Oleg Kalnichevski (olegk at apache.org)
Bug 58773TestCacheManager : Add tests for CacheManager that use HttpClient 4
Bug 58742CompareAssertion : Reset data in TableEditor when switching between different CompareAssertions in gui. Based on a patch by Vincent Herilier (vherilier at gmail.com)
Bug 59108TableEditor: Allow rows to be moved up and down. Contributed by Vincent Herilier (vherilier at gmail.com)
Bug 58848Argument Panel : when adding an argument (add button or from clipboard) scroll the table to the new line. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 58865Allow empty default value in the Regular Expression Extractor. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 59156XMLAssertion : drop jdom dependency by using XMLReader
Bug 59328Better tooltip for Variable Names in CSVDataSet. Contributed by Antonio Gomes Rodrigues (ra0077 at gmail.com)

Functions

Bug 58477 __javaScript function : Allow use of Nashorn engine for Java8 and later versions
Bug 58903Provide __jexl3 function that uses commons-jexl3 and deprecated __jexl (1.1) function

I18N

General

Bug 58736Add Sample Timeout support
Bug 57913Automated backups of last saved JMX files. Contributed by Benoit Vatan (benoit.vatan at gmail.com)
Bug 57988Shortcuts (Ctrl + 1 … Ctrl + 9) to quickly add elements into test plan. Implemented by Andrey Pokhilko (andrey at blazemeter.com) and contributed by BlazeMeter Ltd.
Bug 58100Performance enhancements : Replace Random by ThreadLocalRandom.
Bug 58677TestSaveService#testLoadAndSave use the wrong set of files. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 58689Add shortcuts to expand / collapse a part of the tree. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 58696Create Ant task to setup Eclipse project
Bug 58653New JMeter Dashboard/Report with Dynamic Graphs, Tables to help analyzing load test results. Developed by Ubik-Ingenierie and contributed by Decathlon S.A. and Ubik-Ingenierie / UbikLoadPack
Bug 58699Workbench changes neither saved nor prompted for saving upon close. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 58728Drop old behavioural properties
Bug 57319Upgrade to HttpClient 4.5.2. With the big help from Oleg Kalnichevski (olegk at apache.org) and Gary Gregory (ggregory at apache.org).
Bug 58772Deprecate MongoDB related elements
Bug 58782ThreadGroup : Improve ergonomy
Bug 58165Show the time elapsed since the start of the load test in GUI mode. Partly based on a contribution from Maxime Chassagneux (maxime.chassagneux at gmail.com)
Bug 58814JVM no longer recognizes option MaxLiveObjectEvacuationRatio; remove from comments
Bug 58810Config Element Counter (and others): Check Boxes Toggle Area Too Big
Bug 56554JSR223 Test Element : Generate compilation cache key automatically. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 58911Header Manager : it should be possible to copy/paste between Header Managers. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 58864Arguments Panel : when moving parameter with up / down, ensure that the selection remains visible. Based on a contribution by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 58968Add a new template to allow to record script with think time included. Contributed by Antonio Gomes Rodrigues (ra0077 at gmail.com)
Bug 58978Settings defaults : Switch “jmeter.save.saveservice.assertion_results_failure_message” to true (after 2.13)
Bug 58991Settings defaults : Switch “jmeter.save.saveservice.print_field_names” to true (after 2.13)
Bug 57182Settings defaults : Switch “jmeter.save.saveservice.idle_time” to true (after 2.13)
Bug 58870TableEditor: minimum size is too small. Contributed by Vincent Herilier (vherilier at gmail.com)
Bug 58933JSyntaxTextArea : Ability to set font. Contributed by Denis Kirpichenkov (denis.kirpichenkov at gmail.com)
Bug 58793Create developers page explaining how to build and contribute
Bug 59046JMeter Gui Replace controller should keep the name and the selection. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 59038Deprecate HTTPClient 3.1 related elements
Bug 59094Drop support of old JMX file format
Bug 59082Remove the “TestCompiler.useStaticSet” parameter. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 59093Option parsing error message can be ‘lost’
Bug 58715Feature request: Bundle groovy-all with JMeter
Bug 58426Improve display of JMeter on high resolution devices (HiDPI) (part 1 of enhancement)
Bug 59105TableEditor : Add ability to paste rows from clipboard and delete multiple selection. Contributed by Vincent Herilier (vherilier at gmail.com)
Bug 59197Thread Group : it should be possible to only run a single threadgroup or a selection of threadgroups with a popup menu. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 59207Change the font color of errorsOrFatalsLabel to red when an error occurs. Contributed by Antonio Gomes Rodrigues (ra0077 at gmail.com)
Bug 58941Create a new Starter that runs thread groups in validation mode (1 thread only, 1 iteration, no pause all customizable)
Bug 59236JMeter Properties : Make some cleanup
Bug 59240Introduce a slf4j adapter for Logkit (this allows using slf4j within plugins and core code)
Bug 59153Stop test if CSVDataSet is accessing non-existing file. Contributed by Antonio Gomes Rodrigues (ra0077 at gmail.com)
Bug 59320Better tooltip in GUI with GenericTestBeanCustomizer (CSV Data Set Config, JDBC Connection Configuration, Keystore Configuration, …) . Based on a patch by Antonio Gomes Rodrigues (ra0077 at gmail.com)
Bug 59171Sample Result SaveConfig Dialog is generated in random order
Bug 59425Display error about missing help page inside the help pane

Non-functional changes

Updated to httpclient, httpmime 4.5.2 (from 4.2.6)
Updated to tika-core and tika-parsers 1.12 (from 1.7)
Updated to commons-math3 3.6.1 (from 3.4.1)
Updated to commons-pool2 2.4.2 (from 2.3)
Updated to commons-lang 3.4 (from 3.3.2)
Updated to rhino-1.7.7.1 (from 1.7R5)
Updated to jodd-3.6.7.jar (from 3.6.4)
Updated to jsoup-1.8.3 (from 1.8.1)
Updated to rsyntaxtextarea-2.5.8 (from 2.5.6)
Updated to slf4j-1.7.12 (from 1.7.10)
Updated to xmlgraphics-commons-2.0.1 (from 1.5)
Updated to commons-collections-3.2.2 (from 3.2.1)
Updated to commons-net 3.4 (from 3.3)
Updated to slf4j 1.7.13 (from 1.7.12)
Bug 57981Require a minimum of Java 7. Partly contributed by Graham Russell (jmeter at ham1.co.uk)
Bug 58684JMeterColor does not need to extend java.awt.Color. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 58687ButtonPanel should die. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 58705Make org.apache.jmeter.testelement.property.MultiProperty iterable. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 58729Cleanup extras folder for maintainability
Bug 57110Fixed spelling+grammar, formatting, removed commented out code etc. Contributed by Graham Russell (jmeter at ham1.co.uk)
Correct instructions on running JMeter in help.txt. Contributed by Pascal Schumacher (pascalschumacher at gmx.net)
Bug 58704Non regression testing : Ant task batchtest fails if tests and run in a non en_EN locale and use a JMX file that uses a CSV DataSet
Bug 58897Improve JUnit Test code. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 58949Cleanup of LDAP code. Based on a patch by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 58897Improve JUnit Test code. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 58967Use JUnit categories to exclude tests that need a gui. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 59003ClutilTestCase testSingleArg8 and testSingleArg9 are identical
Bug 59064Remove OldSaveService which supported very old Avalon format JTL (result) files
Bug 59165RSyntaxTextArea not compatible with headless testing
Bug 59021Use Double#compare instead of reimplementing it in NumberProperty#compareTo
Bug 59037Drop HtmlParserHTMLParser and dependencies on htmlparser and htmllexer
Bug 58465JMS Read response field is badly named and documented
Bug 58601Change check for modification of saveservice.properties from SVN Revision ID to sha1 sum of the file itself.
Bug 58726Remove the jmeterthread.startearlier parameter. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 58784Make JMeterUtils#runSafe sync/async awt invocation configurable and change the visualizers to use the async version.
Bug 58790Issue in CheckDirty and its relation to ActionRouter
Bug 59095Remove UserParameterXMLParser that was deprecated eight years ago. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 59262Add list of binary jars to LICENSE; use that for unit tests
Bug 59353Add “Deprecated and removed elements” in “Incompatible changes” part in changes.xml. Contributed by Antonio Gomes Rodrigues (ra0077 at gmail.com)

Bug fixes

HTTP Samplers and Test Script Recorder

Bug 57806“audio/x-mpegurl” mime type is erroneously considered as binary by ViewResultsTree. Contributed by Ubik Load Pack (support at ubikloadpack.com).
Bug 57858Don’t call sampleEnd twice in HTTPHC4Impl when a RuntimeException or an IOException occurs in the sample method.
Bug 57921HTTP/1.1 without keep-alive “Connection” response header no longer uses infinite keep-alive.
Bug 57956The hc.parameters reference in jmeter.properties doesn’t work when JMeter is not started in bin.
Bug 58137JMeter fails to download embedded URLs that contain illegal characters in URL (it does not escape them).
Bug 58201Make usage of port in the host header more consistent across the different http samplers.
Bug 58453HTTP Test Script Recorder : NullPointerException when disabling Capture HTTP Headers
Bug 57804HTTP Request doesn’t reuse cached SSL context when using Client Certificates in HTTPS (only fixed for HttpClient4 implementation)
Bug 58800proxy.pause default value: fix documentation
Bug 58844Buttons enable / disable is broken in the arguments panel. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 58861When clicking on up, down or detail while in a cell of the argument panel, newly added content is lost. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 57935SSL SNI extension not supported by HttpClient 4.2.6
Bug 59044Http Sampler : It should not be possible to select the multipart encoding if the method is not POST. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 59008Http Sampler: Infinite recursion SampleResult on frame depth limit reached
Bug 58881HTTP Request : HTTPHC4Impl shows exception when server uses “deflate” compression
Bug 58583HTTP client fails to close connection if server misbehaves by not sending “connection: close”, violating HTTP RFC 2616 / RFC 7230
Bug 58950NoHttpResponseException when Pause between samplers exceeds keepalive sent by server
Bug 59085Http file panel : data lost on browse cancellation. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 56141Application does not behave correctly when using HTTP Recorder. With the help of Dan (java.junkee at yahoo.com)
Bug 59079“httpsampler.max_redirects” property is not enforced when “Redirect Automatically” is used
Bug 58811When pasting arguments between http samplers the column “Encode” and “Include Equals” are lost. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)

Other Samplers

Bug 58013Enable all protocols that are enabled on the default SSLContext for usage with the SMTP Sampler.
Bug 58209JMeter hang when testing javasampler because HashMap.put() is called from multiple threads without sync.
Bug 58301Use typed methods such as setInt, setDouble, setDate, … for prepared statement #27
Bug 58851Add a dependency on hamcrest-core to allow JUnit tests with annotations to work
Bug 58947Connect metric is wrong when ConnectException occurs
Bug 58980JMS Subscriber will return successful as long as 1 message is received. Contributed by Harrison Termotto (harrison dot termotto at stonybrook.edu)
Bug 59075JMS Publisher: NumberFormatException is thrown if priority or expiration field is empty
Bug 59345SMTPSampler connection leak. Based on a patch by Luca Maragnani (luca dot maragnani at gmail dot com)

Controllers

Bug 58600Display correct filenames, when they are searched by IncludeController
Bug 58678Module Controller : limit target element selection. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 58714Module controller : it should not be possible to add a timer as child. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 59067JMeter fails to iterate over Controllers that are children of a TransactionController having “Generate parent sample” checked after an assertion error occurs on a Thread Group with “Start Next Thread Loop”. Contributed by Benoit Wiart(benoit dot wiart at gmail.com)
Bug 59076Test should fail if a module controller cannot find its replacement subtree

Listeners

Bug 58033SampleResultConverter should note that it cannot record non-TEXT data
Bug 58845Request http view doesn’t display all the parameters. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 58413ViewResultsTree : Request HTTP Renderer does not show correctly parameters that contain ampersand (&). Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 59172SampleResult SaveConfig does not allow some fields to be disabled
Bug 58329Response Time Graph and Aggregate Graph : Save graph to file does not take into account the settings changed since last click on Graph. Contributed by David Coppens (d.l.coppens at gmail.com)

Timers, Assertions, Config, Pre- & Post-Processors

Bug 58079Do not cache HTTP samples that have a Vary header when using a HTTP CacheManager.
Bug 58912Response assertion gui : Deleting more than 1 selected row deletes only one row. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)

Functions

Bug 57825__Random function fails if min value is equal to max value (regression related to Bug 54453)

I18N

General

Bug 54826Don’t fail on long strings in JSON responses when displaying them as JSON in View Results Tree.
Bug 57734Maven transient dependencies are incorrect for 2.13 (Fixed group ids for Commons Pool and Math)
Bug 57731TESTSTART.MS has always the value of the first Test started in Server mode in NON GUI Distributed testing
Bug 58016 Error type casting using external SSL Provider. Contributed by Kirill Yankov (myworkpostbox at gmail.com)
Bug 58293SOAP/XML-RPC Sampler file browser generates NullPointerException
Bug 58685JDatefield : Make the modification of the date with up/down arrow work. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 58693Fix “Cannot nest output folder ‘jmeter/build/components’ inside output folder ‘jmeter/build’” when setting up eclipse
Bug 58781Command line option “-?” shows Unknown option
Bug 57821Command-line option “-X --remoteexit” doesn’t work since 2.13 (regression related to Bug 57500)
Bug 58795NPE may occur in GuiPackage#getTestElementCheckSum with some 3rd party plugins
Bug 58913When closing JMeter should not interpret cancel as “destroy my test plan”. Contributed by Benoit Wiart (benoit dot wiart at gmail.com)
Bug 59096Search Feature : Case insensitive search is not really case insensitive
Bug 59193ant run_gui fails with ClassNotFoundException or IllegalAccessError when accessing classes from dependencies not loaded through Thread.currentThread().getContextClassLoader()
Bug 59225Bad display of running indicator icon. Contributed by Antonio Gomes Rodrigues (ra0077 at gmail.com)
Bug 56927Disable language change during a test
Bug 59391In Distributed mode, the client exits abnormally at the end of test
Bug 59397build.xml does not make dist.executables executable on Unix systems

Thanks

We thank all contributors mentioned in bug and improvement sections above:

Ubik Load Pack
Benoit Vatan (benoit.vatan at gmail.com)
Jérémie Lesage (jeremie.lesage at jeci.fr)
Kirill Yankov (myworkpostbox at gmail.com)
Amol Moye (amol.moye at thomsonreuters.com)
Samoht-fr (https://github.com/Samoht-fr)
Graham Russell (jmeter at ham1.co.uk)
Maxime Chassagneux (maxime.chassagneux at gmail.com)
Benoit Wiart (benoit.wiart at gmail.com)
Decathlon S.A.
Ubik-Ingenierie S.A.S.
Oleg Kalnichevski (olegk at apache.org)
Pascal Schumacher (pascalschumacher at gmx.net)
Vincent Herilier (vherilier at gmail.com)
Florent Sabbe (f dot sabbe at ubik-ingenierie.com)
Antonio Gomes Rodrigues (ra0077 at gmail.com)
Harrison Termotto (harrison dot termotto at stonybrook.edu
Denis Kirpichenkov (denis.kirpichenkov at gmail.com)
Gary Gregory (ggregory at apache.org)
David Coppens (d.l.coppens at gmail.com)
Luca Maragnani (luca dot maragnani at gmail dot com)
Philip Helger (http://www.helger.com) for his CSS Parser and for taking into account our bug reports very rapidly
Irek Pastusiak (the.automatic.tester at gmail.com)

We also thank bug reporters who helped us improve JMeter.

For this release we want to give special thanks to the following reporters for the clear reports and tests made after our fixes:

purnasatyap at gmail dot com for the tests and reports on nightly build
Sergey Batalin (sergey_batalin at mail dot ru) for the tests and reports on nightly build
Vincent Daburon (vdaburon at gmail dot com) for the tests and reports on nightly build

Apologies if we have omitted anyone else.

Known problems and workarounds

The Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).
The numbers that appear to the left of the green box are the number of active threads / total number of threads, the total number of threads only applies to a locally run test, otherwise it will show 0 (see Bug 55510).
Note that there is a bug in Java on some Linux systems that manifests itself as the following error when running the test cases or JMeter itself: json [java] WARNING: Couldn't flush user prefs: java.util.prefs.BackingStoreException: java.lang.IllegalArgumentException: Not supported: indent-number This does not affect JMeter operation. This issue is fixed since Java 7b05.
Note that under some windows systems you may have this WARNING: java.util.prefs.WindowsPreferences WARNING: Could not open/create prefs root node Software\JavaSoft\Prefs at root 0 x80000002. Windows RegCreateKeyEx(…) returned error code 5. The fix is to run JMeter as Administrator, it will create the registry key for you, then you can restart JMeter as a normal user and you won’t have the warning anymore.
With Oracle Java 7 and Mac Book Pro Retina Display, the JMeter GUI may look blurry. This is a known Java bug, see Bug JDK-8000629. A workaround is to use a Java 7 update 40 runtime which fixes this issue.
You may encounter the following error: java.security.cert.CertificateException: Certificates does not conform to algorithm constraints if you run a HTTPS request on a web site with a SSL certificate (itself or one of SSL certificates in its chain of trust) with a signature algorithm using MD2 (like md2WithRSAEncryption) or with a SSL certificate with a size lower than 1024 bits. This error is related to increased security in Java 7 version u16 (MD2) and version u40 (Certificate size lower than 1024 bits), and Java 8 too. To allow you to perform your HTTPS request, you can downgrade the security of your Java installation by editing the Java jdk.certpath.disabledAlgorithms property. Remove the MD2 value or the constraint on size, depending on your case. This property is in this file: JAVA_HOME/jre/lib/security/java.security See Bug 56357 for details.
Under Mac OSX Aggregate Graph will show wrong values due to mirroring effect on numbers. This is due to a known Java bug, see Bug JDK-8065373 The fix is to use JDK7_u79, JDK8_u45 or later.
View Results Tree may fail to display some HTML code under HTML renderer, see Bug 54586. This is due to a known Java bug which fails to parse “px” units in row/col attributes. See Bug JDK-8031109 The fix is to use JDK9 b65 or later.
JTable selection with keyboard (SHIFT + up/down) is totally unusable with JAVA 7 on Mac OSX. This is due to a known Java bug JDK-8025126 The fix is to use JDK 8 b132 or later.

Version 2.13

Summary

[New and Noteworthy](#New and Noteworthy)
[Known bugs](#Known bugs)
[Incompatible changes](#Incompatible changes)
[Bug fixes](#Bug fixes)
Improvements
[Non-functional changes](#Non-functional changes)
Thanks

New and Noteworthy

New Elements

New Async BackendListener with Graphite implementation

A new Async BackendListener has been added to allow sending result data to a backend listener. JMeter ships with a GraphiteBackendListenerClient that allows sending results to a Graphite server using Pickle or Plaintext protocols. You can implement your own backend by extending AbstractBackendListenerClient. This backend could be a database (JDBC), a Message Oriented Middleware (JMS), a Webservice or anything you want.

changes/2.13/backend_listener_graphite.png

This is the kind of Live Dashboard you can obtain using Grafana and InfluxDB

Read this for more details.

Grafana dashboard

Core Improvements

New connect time metric

Starting with this version a new metric called connectTime has been added. It represents the time to establish connection. By default it is not saved to CSV or XML, to have it saved add to user.properties:

jmeter.save.saveservice.connect_time=true

changes/2.13/connect_time_table.png

changes/2.13/connect_time_tree.png

Aggregate Graph and Report

The listeners Aggregate Graph and Aggregate Report previously showed only the 90 percentile (historical behavior), the 95 percentile and the 99 percentile have been added and are customizable. To setup the percentiles value you want, add to user.properties:

` aggregate_rpt_pct1=90

aggregate_rpt_pct2=95

aggregate_rpt_pct3=99 ` changes/2.13/aggregate_graph_new_percentile.png

HTTP(S) Test Script Recorder

Now component is able to detect authentication schemes and automatically adds a pre-configured HTTP Authorization Manager with the correct Mechanism.

HTTP Request

The CalDAV verbs (Calendar extensions to WebDAV) REPORT and MKCALENDAR have been added in the HTTP Request sampler. changes/2.13/new_methods_caldav.png

JDBC Request

The ResultSet can be get as a object, this allows to handle more easily the results after in BeanShell, JSR223 scripts, … changes/2.13/jdbc_resultset_handler.png

Distributed Testing

To allow better usage of Distributed Testing in the cloud, retry behaviour has been added when starting test on servers. Read this for more details. changes/2.13/distributed_retry.png

Distributed Testing performance

Since JMeter 2.13, Stripping modes (StrippingBatch being the default mode) now also strip responses from SubResults improving consumed network bandwidth.

Documentation refresh

A new style for website (responsive and more up to date) has been created by Felix Schumacher. Documentations have been refreshed particularly:

GUI Improvements

Module Controller

The Module Controller now shows the target controller in a tree view (instead of combo list). changes/2.13/module_controller_tree_view.png

JMeter’s toolbar has been refreshed for some icons (start, toggle, etc.). Three sizes are now available for the icons: 22x22, 32x32 and 48x48.

The toolbar with 22x22 pixels icons changes/2.13/toolbar_22x22.png

The toolbar with 32x32 pixels icons changes/2.13/toolbar_32x32.png

The toolbar with 48x48 pixels icons changes/2.13/toolbar_48x48.png

HTTP(S) Test Script Recorder

If your Test Plan does not contains a Recording Controller, a new warning message will appear if the HTTP(S) Test Script Recorder is configured to send the samples into a Recording Controller. changes/2.13/warning_message_proxy.png

Incompatible changes

Since 2.13, Aggregate Graph, Summary Report and Aggregate Report now export percentages to %, before they exported the decimal value which differed from what was shown in GUI
Third party plugins may be impacted by fix of Bug 57586, ensure that your subclass of HttpTestSampleGui implements ItemListener if you relied on parent class doing so.
Report package has been removed, ApacheJMeter_report.jar is not generated anymore as a consequence, see Bug 57269

Improvements

HTTP Samplers and Test Script Recorder

Bug 25430HTTP(S) Test Script Recorder : Make it populate HTTP Authorization Manager. Partly based on a patch from Dzmitry Kashlach (dzmitrykashlach at gmail.com)
Bug 57381HTTP(S) Test Script Recorder should display an error if Target Controller references a Recording Controller and no Recording Controller exists. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 57488Performance : Improve SSLContext reset for Two-way SSL Authentication
Bug 57565SamplerCreator : Add method to allow implementations to add children to created sampler
Bug 57606HTTPSamplerBase#errorResult changes the sample label on exception
Bug 57613HTTP Sampler : Added CalDAV verbs (REPORT, MKCALENDAR). Contributed by Richard Brigham (richard.brigham at teamaol.com)
Bug 48799Add time to establish connection to available sample metrics. Implemented by Andrey Pokhilko (andrey at blazemeter.com) and contributed by BlazeMeter Ltd. and Pieter Ennes (apache.org at spam.ennes.nl)
Bug 57500Introduce retry behavior for distributed testing. Implemented by Andrey Pokhilko and Dzimitry Kashlach and contributed by BlazeMeter Ltd.

Other samplers

Bug 57322JDBC Test elements: add ResultHandler to deal with ResultSets(cursors) returned by callable statements. Contributed by Yngvi Þór Sigurjónsson (blitzkopf at gmail.com)

Controllers

Bug 57561Module controller UI : Replace combobox by tree. Contributed by Maciej Franek (maciej.franek at gmail.com)
Bug 57648TestFragment should be disabled when created. Contributed by Ubik Load Pack (support at ubikloadpack.com)

Listeners

Bug 55932Create a Async BackendListener to allow easy plug of new listener (Graphite, JDBC, Console, …)
Bug 57246BackendListener : Create a Graphite implementation
Bug 57217Aggregate graph and Aggregate report improvements (3 configurable percentiles, same data in both, factor out code). Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 57537BackendListener : Allow implementations to drop samples

Timers, Assertions, Config, Pre- & Post-Processors

Functions

Bug 54453Performance enhancements : Replace Random by ThreadLocalRandom in __Random function

I18N

General

Bug 57518Icons for toolbar with several sizes
Bug 57605When there is an error loading Test Plan, SaveService.loadTree returns null leading to NPE in callers
Bug 57269Drop org.apache.jmeter.reports package
Bug 53764Website : Create a new style for website

Non-functional changes

Updated to jsoup-1.8.1.jar (from 1.7.3)
Updated to tika-core and tika-parsers 1.7 (from 1.6)
Updated to commons-codec-1.10.jar (from 1.9)
Updated to dnsjava-2.1.7.jar (from 2.1.6)
Updated to jodd-3.6.4.jar (from 3.6.1)
Updated to junit-4.12.jar (from 4.11)
Updated to rhino-1.7R5 (from 1.7R4)
Updated to rsyntaxtextarea-2.5.6 (from 2.5.3)
Updated to slf4j-1.7.10 (from 1.7.5)
Bug 57276RMIC no longer needed since Java 5
Bug 57310Replace System.getProperty("file.separator") with File.separator throughout (Also “path.separator" with File.pathSeparator)
Bug 57389Fix potential NPE in converters
Bug 57417Remove unused method isTemporary from NullProperty. This was a leftover from a refactoring done in 2003.
Bug 57418Remove unused constructor from Workbench
Bug 57419Remove unused interface ModelListener.
Bug 57466IncludeController : Remove an unneeded set creation. Contributed by Benoit Wiart (benoit.wiart at gmail.com)
Added property loggerpanel.usejsyntaxtext to disable the use of JSyntaxTextArea for the Console Logger (in case of memory or other issues)
Bug 57586HttpTestSampleGui: Remove interface ItemListener implementation

Bug fixes

HTTP Samplers and Test Script Recorder

Bug 57385Getting empty thread name in xml result for HTTP requests with “Follow Redirects” set. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 57579NullPointerException error is raised on main sample if “RETURN_NO_SAMPLE” is used (default) and “Use Cache-Control / Expires header…” is checked in HTTP Cache Manager

Other Samplers

Controllers

Bug 57447Use only the user listed DNS Servers, when “use custom DNS resolver” option is enabled.

Listeners

Bug 57262Aggregate Report, Aggregate Graph and Summary Report export : headers use keys instead of labels
Bug 57346Summariser : The + (difference) reports show wrong elapsed time and throughput
Bug 57449Distributed Testing: Stripped modes do not strip responses from SubResults (affects load tests that use Download of embedded resources). Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 57562View Results Tree CSS/JQuery Tester : Nothing happens when there is an error in syntax and an exception occurs in jmeter.log
Bug 57514Aggregate Graph, Summary Report and Aggregate Report show wrong percentage reporting in saved file

Timers, Assertions, Config, Pre- & Post-Processors

Bug 57607Constant Throughput Timer : Wrong throughput computed in shared modes due to rounding error

General

Bug 57365Selected LAF is not correctly setup due to call of UIManager.setLookAndFeel too late. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 57364Options < Look And Feel does not update all windows LAF. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 57394When constructing an instance with ClassTools#construct(String, int) the integer was ignored and the default constructor was used instead.
Bug 57440OutOfMemoryError after introduction of JSyntaxTextArea in LoggerPanel due to disableUndo not being taken into account.
Bug 57569FileServer.reserveFile - inconsistent behaviour when hasHeader is true
Bug 57555Cannot use JMeter 2.12 as a maven dependency. Contributed by Pascal Schumacher (pascal.schumacher at t-systems.com)
Bug 57608Fix start script compatibility with old Unix shells, e.g. on Solaris

Thanks

We thank all contributors mentioned in bug and improvement sections above:

Ubik Load Pack
Yngvi Þór Sigurjónsson (blitzkopf at gmail.com)
Dzmitry Kashlach (dzmitrykashlach at gmail.com)
BlazeMeter Ltd.
Benoit Wiart (benoit.wiart at gmail.com)
Pascal Schumacher (pascal.schumacher at t-systems.com)
Maciej Franek (maciej.franek at gmail.com)
Richard Brigham (richard.brigham at teamaol.com)
Pieter Ennes (apache.org at spam.ennes.nl)

We also thank bug reporters who helped us improve JMeter.

For this release we want to give special thanks to the following reporters for the clear reports and tests made after our fixes:

Chaitanya Bhatt (bhatt.chaitanya at gmail.com) for his thorough testing of new BackendListener and Graphite Client implementation.
Marcelo Jara (marcelojara at hotmail.com) for his clear report on Bug 57607.

Apologies if we have omitted anyone else.

Known bugs

The Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).
The numbers that appear to the left of the green box are the number of active threads / total number of threads, the total number of threads only applies to a locally run test, otherwise it will show 0 (see Bug 55510).
Note that there is a bug in Java on some Linux systems that manifests itself as the following error when running the test cases or JMeter itself: [java] WARNING: Couldn't flush user prefs: java.util.prefs.BackingStoreException: java.lang.IllegalArgumentException: Not supported: indent-number This does not affect JMeter operation. This issue is fixed since Java 7b05.
Note that under some windows systems you may have this WARNING: java.util.prefs.WindowsPreferences WARNING: Could not open/create prefs root node Software\JavaSoft\Prefs at root 0 x80000002. Windows RegCreateKeyEx(…) returned error code 5. The fix is to run JMeter as Administrator, it will create the registry key for you, then you can restart JMeter as a normal user and you won’t have the warning anymore.
With Java 1.6 and Gnome 3 on Linux systems, the JMeter menu may not work correctly (shift between mouse’s click and the menu). This is a known Java bug (see Bug 54477). A workaround is to use a Java 7 runtime (OpenJDK or Oracle JDK).
With Oracle Java 7 and Mac Book Pro Retina Display, the JMeter GUI may look blurry. This is a known Java bug, see Bug JDK-8000629. A workaround is to use a Java 7 update 40 runtime which fixes this issue.
You may encounter the following error: java.security.cert.CertificateException: Certificates does not conform to algorithm constraints if you run a HTTPS request on a web site with a SSL certificate (itself or one of SSL certificates in its chain of trust) with a signature algorithm using MD2 (like md2WithRSAEncryption) or with a SSL certificate with a size lower than 1024 bits. This error is related to increased security in Java 7 version u16 (MD2) and version u40 (Certificate size lower than 1024 bits), and Java 8 too. To allow you to perform your HTTPS request, you can downgrade the security of your Java installation by editing the Java jdk.certpath.disabledAlgorithms property. Remove the MD2 value or the constraint on size, depending on your case. This property is in this file: JAVA_HOME/jre/lib/security/java.security See Bug 56357 for details.

Version 2.12

Summary

[New and Noteworthy](#New and Noteworthy)
[Known bugs](#Known bugs)
[Incompatible changes](#Incompatible changes)
[Bug fixes](#Bug fixes)
Improvements
[Non-functional changes](#Non-functional changes)
Thanks

New and Noteworthy

Java 8 support

Now, JMeter 2.12 is compliant with Java 8.

New Elements

Critical Section Controller

The Critical Section Controller allow to serialize the execution of a section in your tree. Only one instance of the section will be executed at the same time during the test.

changes/2.12/01_critical_section_controller.png

DNS Cache Manager

The new configuration element DNS Cache Manager(see Bug 56841) improves the testing of:

CDN (Content Delivery Network)
DNS load balancing.
Load Balancers like Amazon Elastic Load Balancer

changes/2.12/02_dns_cache_manager.png

Core Improvements

Smarter Recording of Http Test Plans

Test Script Recorder has been improved in many ways

Better matching of Variables in Requests, making Test Script Recorder variabilize your sampler during recording more versatile
Ability to filter from View Results Tree the Samples that are excluded from recording, this lets you concentrate on recorded Samplers analysis and not bother with useless Sample Results
Better defaults for recording, since this version Recorder will number created Samplers letting you find them much easily in View Results Tree. Grouping of Samplers under Transaction Controller will be smarter making all requests emitted by a web page be children as new Transaction Controller

Support of Webdav requests

You can now test against WebDav server using HttpClient4 Implementation of Http Request

changes/2.12/13_webdav.png

Better handling of embedded resources

When download embedded resources is checked, JMeter now uses User Agent header to download or not resources embedded within conditional comments as per About conditional comments.

Ability to customize Cache Manager (Browser cache simulation) handling of cached resources

You can now configure the behaviour of JMeter when a resource is found in Cache, this can be controlled with cache_manager.cached_resource_mode property

changes/2.12/12_cache_resource_mode.png

JMS Publisher / JMS Point-to-Point

Add JMSPriority and JMSExpiration fields for these samplers.

changes/2.12/04_jms_publisher.png

changes/2.12/05_jms_point_to_point.png

Mail Reader Sampler

You can now specify the number of messages that want you retrieve (before all messages were retrieved). In addition, you can fetch only the message header now.

changes/2.12/03_mail_reader_sampler.png

SMTP Sampler

Adding the Connection timeout and the Read timeout to the SMTP Sampler.

changes/2.12/06_smtp_sampler.png

Synchronizing Timer

Adding a timeout to define the maximum time to waiting of the group of virtual users.

changes/2.12/09_synchronizing_timer.png

Performance improvements

A big improvement in performances of Functions has been made by lifting useless synchronization. It concerns all functions except __StringFromFile, __XPath and __BeanShell, see Bug 57114

__jexl2 performances have been improved to avoid contention point, see Bug 56708

GUI Improvements

Undo/Redo support

Undo / Redo has been introduced and allows user to undo/redo changes made on Test Plan Tree. This feature (ALPHA MODE) is disabled by default, to enable it set property undo.history.size=25

changes/2.12/10_undo_redo.png

View Results Tree

Improve the ergonomics of View Results Tree by changing placement of Renderers and allowing custom ordering (with the property view.results.tree.renderers_order).

changes/2.12/07_view_results_tree.png

Response Time Graph

Adding the ability for the Response Time Graph listener to save/restore format its settings in/from the jmx file.

changes/2.12/08_response_time_graph.png

Log Viewer

Starting with this version, the last lines of JMeter’s log file (jmeter.log) can be viewed directly in GUI by clicking on Warning icon in the upper right corner. This will unfold the Log Viewer panel and show logs.

changes/2.12/11_log_viewer.png

File Opening

Now, “Open File dialog” uses last opened file folder as start folder, see Bug 52707

Known bugs

The Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).
The numbers that appear to the left of the green box are the number of active threads / total number of threads, the total number of threads only applies to a locally run test, otherwise it will show 0 (see Bug 55510).
Note that there is a bug in Java on some Linux systems that manifests itself as the following error when running the test cases or JMeter itself: [java] WARNING: Couldn't flush user prefs: java.util.prefs.BackingStoreException: java.lang.IllegalArgumentException: Not supported: indent-number This does not affect JMeter operation. This issue is fixed since Java 7b05.
Note that under some windows systems you may have this WARNING: java.util.prefs.WindowsPreferences WARNING: Could not open/create prefs root node Software\JavaSoft\Prefs at root 0 x80000002. Windows RegCreateKeyEx(…) returned error code 5. The fix is to run JMeter as Administrator, it will create the registry key for you, then you can restart JMeter as a normal user and you won’t have the warning anymore.
With Java 1.6 and Gnome 3 on Linux systems, the JMeter menu may not work correctly (shift between mouse’s click and the menu). This is a known Java bug (see Bug 54477). A workaround is to use a Java 7 runtime (OpenJDK or Oracle JDK).
With Oracle Java 7 and Mac Book Pro Retina Display, the JMeter GUI may look blurry. This is a known Java bug, see Bug JDK-8000629. A workaround is to use a Java 7 update 40 runtime which fixes this issue.
You may encounter the following error: java.security.cert.CertificateException: Certificates does not conform to algorithm constraints if you run a HTTPS request on a web site with a SSL certificate (itself or one of SSL certificates in its chain of trust) with a signature algorithm using MD2 (like md2WithRSAEncryption) or with a SSL certificate with a size lower than 1024 bits. This error is related to increased security in Java 7 version u16 (MD2) and version u40 (Certificate size lower than 1024 bits), and Java 8 too. To allow you to perform your HTTPS request, you can downgrade the security of your Java installation by editing the Java jdk.certpath.disabledAlgorithms property. Remove the MD2 value or the constraint on size, depending on your case. This property is in this file: JAVA_HOME/jre/lib/security/java.security See Bug 56357 for details.

Incompatible changes

Since JMeter 2.12, active threads in all thread groups and active threads in current thread group are saved by default to CSV or XML results, see Bug 57025. This is usually the expected behaviour as you want to have the number of running threads during the test. But if you want to revert to previous behaviour, set property jmeter.save.saveservice.thread_counts=false
Since JMeter 2.12, Mail Reader Sampler will show 1 for number of samples instead of number of messages retrieved, see Bug 56539
Since JMeter 2.12, when using Cache Manager, if resource is found in cache no SampleResult will be created, in previous version a SampleResult with empty content and 204 return code was returned, see Bug 54778. You can choose between different ways to handle this case, see cache_manager.cached_resource_mode in jmeter.properties.
Since JMeter 2.12, Log Viewer will no more clear logs when closed and will have logs available even if closed. See Bug 56920. Read Hints and Tips > Enabling Debug logging for details on configuring this component.

Bug fixes

HTTP Samplers and Test Script Recorder

Bug 55998 - HTTP recording – Replacing port value by user defined variable does not work
Bug 56178 - keytool error: Invalid escaped character in AVA: - some characters must be escaped
Bug 56222 - NPE if jmeter.httpclient.strict_rfc2616=true and location is not absolute
Bug 56263 - DefaultSamplerCreator should set BrowserCompatible Multipart true
Bug 56231 - Move redirect location processing from HC3/HC4 samplers to HTTPSamplerBase#followRedirects()
Bug 56207 - URLs get encoded on redirects in HC3.1 & HC4 samplers
Bug 56303 - The width of target controller’s combo list should be set to the current panel size, not on label size of the controllers
Bug 54778 - HTTP Sampler should not return 204 when resource is found in Cache, make it configurable with new property cache_manager.cached_resource_mode

Other Samplers

Bug 55977 - JDBC pool keepalive flooding
Bug 55999 - Scroll bar on jms point-to-point sampler does not work when content exceeds display
Bug 56198 - JMSSampler : NullPointerException is thrown when JNDI underlying implementation of JMS provider does not comply with Context.getEnvironment contract
Bug 56428 - MailReaderSampler - should it use mail.pop3s.* properties?
Bug 46932 - Alias given in select statement is not used as column header in response data for a JDBC request. Based on report and analysis of Nicola Ambrosetti
Bug 56539 - Mail reader sampler: When Number of messages to retrieve is superior to 1, Number of samples should only show 1 not the number of messages retrieved
Bug 56809 - JMSSampler closes InitialContext too early. Contributed by Bradford Hovinen (hovinen at gmail.com)
Bug 56761 - JMeter tries to stop already stopped JMS connection and displays “The connection is closed”
Bug 57068 - No error thrown when negative duration is entered in Test Action
Bug 57078 - LagartoBasedHTMLParser fails to parse page that contains input with no type
Bug 57183 - JMSSampler: For input string: “” java.lang.NumberFormatException (for Expiration or Priority fields)

Controllers

Bug 56243 - Foreach works incorrectly with indexes on subsequent iterations
Bug 56276 - Loop controller becomes broken once loop count evaluates to zero
Bug 56160 - StackOverflowError when using WhileController within IfController
Bug 56811 - “Start Next Thread Loop” in Result Status Action Handler or on Thread Group and “Go to next Loop iteration” in Test Action behave incorrectly with TransactionController that has “Generate Parent Sampler” checked

Listeners

Bug 56706 - SampleResult#getResponseDataAsString() does not use encoding in response body impacting PostProcessors and ViewResultsTree. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 57052 - ArithmeticException: / by zero when sampleCount is equal to 0

Timers, Assertions, Config, Pre- & Post-Processors

Bug 56162 - HTTP Cache Manager should not cache PUT/POST etc.
Bug 56227 - AssertionGUI : NPE in assertion on mouse selection
Bug 41319 - URLRewritingModifier : Allow Parameter value to be url encoded

Functions

I18N

Bug 56111 - “comments” in german translation is not correct

General

Bug 56059 - Older TestBeans incompatible with 2.11 when using TextAreaEditor
Bug 56080 - Conversion error com.thoughtworks.xstream.converters.ConversionException with Java 8 Early Access Build
Bug 56182 - Can’t trigger bsh script using bshclient.jar; socket is closed unexpectedly
Bug 56360 - HashTree and ListedHashTree fail to compile with Java 8
Bug 56419 - JMeter silently fails to save results
Bug 56662 - Save as xml in a listener is not remembered
Bug 56367 - JMeter 2.11 on maven central triggers a not existing dependency rsyntaxtextarea 2.5.1, upgrade to 2.5.3
Bug 56743 - Wrong mailing list archives on mail2.xml. Contributed by Felix Schumacher (felix.schumacher at internetallee.de)
Bug 56763 - Removing the Oracle icons, not used by JMeter (and missing license)
Bug 54100 - Switching languages fails to preserve toolbar button states (enabled/disabled)
Bug 54648 - JMeter GUI on OS X crashes when using CMD+C (keyboard shortcut or UI menu entry) on an element from the tree
Bug 56962 - JMS GUIs should disable all fields affected by jndi.properties checkbox
Bug 57061 - Save as Test Fragment fails to clone deeply selected node. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 57075 - BeanInfoSupport.MULTILINE attribute is not processed
Bug 57076 - BooleanPropertyEditor#getAsText() must return a value that is in getTags()
Bug 57088 - NPE in ResultCollector.testEnded

Improvements

HTTP Samplers and Test Script Recorder

Bug 55959 - Improve error message when Test Script Recorder fails due to I/O problem
Bug 52013 - Test Script Recorder’s Child View Results Tree does not take into account Test Script Recorder excluded/included URLs. Based on report and analysis of James Liang
Bug 56119 - File uploads fail every other attempt using timers. Enable idle timeouts for servers that don’t send Keep-Alive headers.
Bug 56272 - MirrorServer should support query parameters for status and redirects
Bug 56772 - Handle IE Conditional comments when parsing embedded resources
Bug 57026 - HTTP(S) Test Script Recorder : Better default settings. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 57107 - Patch proposal: Add DAV verbs to HTTP Sampler. Contributed by Philippe Jung (apache at famille-jung.fr)
Bug 56357 - Certificates does not conform to algorithm constraints: Adding a note to indicate how to remove of the Java installation these new security constraints

Other samplers

Bug 56033 - Add Connection timeout and Read timeout to SMTP Sampler
Bug 56429 - MailReaderSampler - no need to fetch all Messages if not all wanted
Bug 56427 - MailReaderSampler enhancement: read message header only
Bug 56510 - JMS Publisher/Point to Point: Add JMSPriority and JMSExpiration

Controllers

Bug 56728 - New Critical Section Controller to serialize blocks of a Test. Based partly on a patch contributed by Mikhail Epikhin(epihin-m at yandex.ru)
Bug 57145 - RandomController : Use ThreadLocalRandom instead of Random for better performances

Listeners

Bug 56228 - View Results Tree : Improve ergonomy by changing placement of Renderers and allowing custom ordering
Bug 56349 - “summary” is a bad name for a Generate Summary Results component, documentation clarified
Bug 56769 - Adds the ability for the Response Time Graph listener to save/restore format settings in/from the jmx file
Bug 57025 - SaveService : Better defaults, save thread counts by default

Timers, Assertions, Config, Pre- & Post-Processors

Bug 56691 - Synchronizing Timer : Add timeout on waiting
Bug 56701 - HTTP Authorization Manager/ Kerberos Authentication: add port to SPN when server port is neither 80 nor 443. Based on patches from Dan Haughey (dan.haughey at swinton.co.uk) and Felix Schumacher (felix.schumacher at internetallee.de)
Bug 56841 - New configuration element: DNS Cache Manager to improve the testing of CDN. Based on patch from Dzmitry Kashlach (dzmitrykashlach at gmail.com), and contributed by BlazeMeter Ltd.
Bug 52061 - Allow access to Request Headers in Regex Extractor. Based on patch from Dzmitry Kashlach (dzmitrykashlach at gmail.com), and contributed by BlazeMeter Ltd.

Functions

Bug 56708 - __jexl2 doesn’t scale with multiple CPU cores. Based on analysis and patch contributed by Mikhail Epikhin(epihin-m at yandex.ru)
Bug 57114 - Performance : Functions that only have values as instance variable should not synchronize execute. Based on analysis by Ubik Load Pack support and Vladimir Sitnikov, patch contributed by Vladimir Sitnikov (sitnikov.vladimir at gmail.com)

I18N

General

Bug 21695 - Unix jmeter start script assumes it is on PATH, not a link
Bug 56292 - Add the check of the Java’s version in startup files and disable some options when is Java v8 engine
Bug 56298 - JSR223 language display does not show which engine will be used
Bug 56455 - Batch files: drop support for non-NT Windows shell scripts
Bug 52707 - Make Open File dialog use last opened file folder as start folder. Based on patch from Dzmitry Kashlach (dzmitrykashlach at gmail.com), and contributed by BlazeMeter Ltd.
Bug 56807 - Ability to force flush of ResultCollector file. Contributed by Andrey Pohilko (apc4 at ya.ru)
Bug 56921 - Templates : Improve Recording template to ignore embedded resources case and URL parameters. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 42248 - Undo-redo support on Test Plan tree modification. Developed by Andrey Pohilko (apc4 at ya.ru) and contributed by BlazeMeter Ltd. Additional contribution by Ubik Load Pack (support at ubikloadpack.com)
Bug 56920 - LogViewer : Make it receive all log events even when it is closed. Contributed by Ubik Load Pack (support at ubikloadpack.com)
Bug 57083 - simplified the CachedResourceMode enum. Contributed by Graham Russel (graham at ham1.co.uk)
Bug 57082 - ComboStringEditor : Added hashCode to an inner class which overwrote equals. Contributed by Graham Russel (graham at ham1.co.uk)
Bug 57081 - Updating checkstyle to only check for tabs in java, xml, xsd, dtd, htm, html and txt files (not images!). Contributed by Graham Russell (graham at ham1.co.uk)
Bug 56178 - Really replace backslashes in user name before generating proxy certificate. Contributed by Graham Russel (graham at ham1.co.uk)
Bug 57084 - Close socket after usage in BeanShellClient. Contributed by Graham Russel (graham at ham1.co.uk)

Non-functional changes

Bug 57117 - Increase the default cipher for HTTPS Test Script Recorder from SSLv3 to TLS
Updated to commons-lang3 3.3.2 (from 3.1)
Updated to commons-codec 1.9 (from 1.8)
Updated to commons-logging 1.2 (from 1.1.3)
Updated to tika 1.6 (from 1.4)
Updated to xercesImpl 2.11.0 (from 2.9.1)
Updated to xml-apis 1.4.01 (from 1.3.04)
Updated to xstream 1.4.8 (from 1.4.4)
Updated to jodd 3.6.1 (from 3.4.10)
Updated to rsyntaxtextarea 2.5.3 (from 2.5.1)
Updated xalan and serializer to 2.7.2 (from 2.7.1)
Updated to jsoup-1.8.1.jar (from 1.7.3)

Thanks

We thank all contributors mentioned in bug and improvement sections above:

James Liang (jliang at andera.com)
Emmanuel Bourg (ebourg at apache.org)
Nicola Ambrosetti (ambrosetti.nicola at gmail.com)
Ubik Load Pack
Mikhail Epikhin (epihin-m at yandex.ru)
Dan Haughey (dan.haughey at swinton.co.uk)
Felix Schumacher (felix.schumacher at internetallee.de)
Dzmitry Kashlach (dzmitrykashlach at gmail.com)
Andrey Pohilko (apc4 at ya.ru)
Bradford Hovinen (hovinen at gmail.com)
BlazeMeter Ltd.
Graham Russell (graham at ham1.co.uk)
Philippe Jung (apache at famille-jung.fr)
Vladimir Sitnikov (sitnikov.vladimir at gmail.com)

We also thank bug reporters who helped us improve JMeter.

For this release we want to give special thanks to the following reporters for the clear reports and tests made after our fixes:

Oliver LLoyd (email at oliverlloyd.com) for his help on Bug 56119
Vladimir Ryabtsev (greatvovan at gmail.com) for his help on Bug 56243 and Bug 56276
Adrian Speteanu (asp.adieu at gmail.com) and Matt Kilbride (matt.kilbride at gmail.com) for their feedback and tests on Bug 54648
Shmuel Krakower (shmulikk at gmail.com) for his tests and reports on Undo/Redo feature

Apologies if we have omitted anyone else.

Version 2.11

Summary

[New and Noteworthy](#New and Noteworthy)
[Known bugs](#Known bugs)
[Incompatible changes](#Incompatible changes)
[Bug fixes](#Bug fixes)
Improvements
[Non-functional changes](#Non-functional changes)
Thanks

New and Noteworthy

HTTP(S) Test Script Recorder improvements

Following improvements have been made since major changes introduced in JMeter 2.10 on HTTP(S) Test Script Recorder:

Better detection of missing or invalid configuration of keytool utility
New system property keytool.directory (see system.properties) lets you configure directory containing keytool in case on non-standard installation

JMS Publisher/Point to Point : Add ability to set typed values in JMS header properties

In the samplers JMS Publisher and JMS Point-to-Point, you can now set up the class of values for the JMS header properties. Previously only String was possible.

changes/2.11/01_jms_properties_typed_values.png

View Results Tree : Add an XPath Tester

In View Results Tree listener, a new XPath tester can be used to test XPATH expressions.

changes/2.11/03_xpath_tester.png

Ability to choose the client alias for the cert key in JsseSslManager such that Mutual SSL auth testing can be made more flexible

When testing client based certificate authentications you have now better control on certificate you use through a new field “Variable name holding certificate alias”, this field lets you select the certificate you want to send to server to authenticate. You can use a CSV Data Set as a holder for the variable value.

changes/2.11/07_keystore_config.png

Add a “Save as Test Fragment” option

In the file menu, a new option allow to save a group of elements as a Test fragment.

changes/2.11/05_save_as_fragement.png

Summariser is be enabled by default in Non GUI mode

When you run JMeter from command line, now JMeter displays some statistics from the Summariser mode.

changes/2.11/06_summariser.png

Transaction Controller:Change default property “Include duration of timer…” for newly created element

Starting from 2.11, Transaction Controller is configured by default to exclude processing time of pre/post processors as long as timers pause.

changes/2.11/02_transaction_controller.png

Known bugs

The Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).
Listeners don’t show iteration counts when a If Controller has a condition which is always false from the first iteration (see Bug 52496). A workaround is to add a sampler at the same level as (or superior to) the If Controller. For example a Test Action sampler with 0 wait time (which doesn’t generate a sample), or a Debug Sampler with all fields set to False (to reduce the sample size).
The numbers that appear to the left of the green box are the number of active threads / total number of threads, the total number of threads only applies to a locally run test, otherwise it will show 0 (see Bug 55510).
Note that there is a bug in Java on some Linux systems that manifests itself as the following error when running the test cases or JMeter itself: [java] WARNING: Couldn't flush user prefs: java.util.prefs.BackingStoreException: java.lang.IllegalArgumentException: Not supported: indent-number This does not affect JMeter operation. This issue is fixed since Java 7b05.
With Java 1.6 and Gnome 3 on Linux systems, the JMeter menu may not work correctly (shift between mouse’s click and the menu). This is a known Java bug (see Bug 54477). A workaround is to use a Java 7 runtime (OpenJDK or Oracle JDK).
With Oracle Java 7 and Mac Book Pro Retina Display, the JMeter GUI may look blurry. This is a known Java bug, see Bug JDK-8000629. A workaround is to use a Java 7 update 40 runtime which fixes this issue.

Incompatible changes

When creating a new Transaction Controller, property “Include duration of timer and pre-post processors in generated sample” will be unchecked starting from version 2.11
In Non GUI mode, since 2.11 summariser is enabled with a 30 seconds frequency
JMeter is more lenient with redirect handling and relaxes on RFC2616 by allowing relative locations. See property “jmeter.httpclient.strict_rfc2616” in jmeter.properties to change this behaviour, see Bug 55717
When creating a new Response Assertion, property “Pattern Matching Rules” now defaults to Substring starting from version 2.11

Bug fixes

HTTP Samplers and Test Script Recorder

Bug 55815 - Proxy#getDomainMatch does not handle wildcards correctly
Bug 55717 - Bad handling of Redirect when URLs are in relative format by HttpClient4 and HttpClient3.1

Other Samplers

Bug 55685 - OS Sampler: timeout option don’t save and restore correctly value and don’t init correctly timeout

Controllers

Bug 55816 - Transaction Controller with “Include duration of timer…” unchecked does not ignore processing time of last child sampler

Listeners

Bug 55826 - Unsynchronised concurrent accesses to list in field RespTimeGraphVisualizer.internalList

Timers, Assertions, Config, Pre- & Post-Processors

Bug 55694 - Assertions and Extractors : Avoid NullPointerException when scope is variable and variable is missing
Bug 55721 - HTTP Cache Manager - no-store directive is wrongly interpreted

Functions

Bug 55871 - Wrong result with intSum() function when a space character is present before/after the number. Contributed by Milamber based on a proposal by James Liang.

I18N

General

Bug 55739 - Remote Test : Total threads in GUI mode shows invalid total number of threads

Improvements

HTTP Samplers and Proxy

Other samplers

Bug 55589 - JMS Publisher/Point to Point : Add ability to set typed values in JMS header properties.

Controllers

Bug 55854 - Transaction Controller:Change default property “Include duration of timer…” for newly created element

Listeners

Bug 55610 - View Results Tree : Add an XPath Tester

Timers, Assertions, Config, Pre- & Post-Processors

Bug 55908 - Response assertion : Change Pattern Matching Rules default to Substring on creation for better performances
Bug 54977 - Ability to choose the client alias for the cert key in JsseSslManager such that Mutual SSL auth testing can be made more flexible. Contributed by UBIK Load Pack (support at ubikloadpack.com)

Functions

I18N

General

Bug 55693 - Add a “Save as Test Fragment” option
Bug 55753 - Improve FilePanel behaviour to start from the value set in Filename field if any. Contributed by UBIK Load Pack (support at ubikloadpack.com)
Bug 55756 - HTTP Mirror Server : Add ability to set Headers
Bug 55852 - Be more lenient in parsing when charset value is surrounded with single quotes
Bug 55857 - Performance : AbstractProperty should test for emptiness to avoid Exception throwing
Bug 55858 - Startup Performance : On Startup, BeanInfoSupport should test for key availability instead of throwing
Bug 55865 - Performance :Disable stale check by default in HttpClient 4 and 3.1
Bug 55512 - Summariser should be enabled by default in Non GUI mode

Non-functional changes

Updated to rsyntaxtextarea-2.5.1.jar (from 2.5.0)
Updated to jodd-core-3.4.9.jar from (3.4.8) and jodd-lagarto-3.4.9.jar (from 3.4.9)
Updated to jsoup-1.7.3.jar (from 1.7.2)
Updated to mail-1.5.0-b01 (from 1.4.4)
Updated to mongo-java-driver-2.11.3 (from 2.11.2)

Thanks

We thank all contributors mentioned in bug and improvement sections above:

James Liang (jliang at andera.com)
UBIK Load Pack (support at ubikloadpack.com)

We also thank bug reporters who helped us improve JMeter.

For this release we want to give special thanks to the following reporters for the clear reports and tests made after our fixes:

John Natsioulas (john_natsioulas at yahoo.com.au)
Antonio Gomes Rodrigues (ra0077 at gmail.com)

Apologies if we have omitted anyone else.

Version 2.10

Summary

[New and Noteworthy](#New and Noteworthy)
[Known bugs](#Known bugs)
[Incompatible changes](#Incompatible changes)
[Bug fixes](#Bug fixes)
Improvements
[Non-functional changes](#Non-functional changes)
Thanks

New and Noteworthy

Core Improvements

New Performance improvements

A Huge performance improvement has been made on High Throughput Tests (no pause), see Bug 54777
An issue with unnecessary SSL Context reset has been fixed which improves performances of pure HTTP tests, see Bug 55023
Important performance improvement in parsing of Embedded resource in HTML pages thanks to a switch to JODD/Lagarto HTML Parser, see Bug 55632

New CSS/JQuery Tester in View Tree Results

A new CSS/JQuery Tester in View Tree Results that makes CSS/JQuery Extractor a first class citizen in JMeter, you can now test your expressions very easily

changes/2.10/01_css_jquery_tester.png

Many improvements in HTTP(S) Recording have been made

changes/2.10/18_https_test_script_recorder.png

Better recording of HTTPS sites, embedded resources using subdomains will more easily be recorded when using JDK 7. See Bug 55507. See updated documentation: HTTP(S) Test Script Recorder
Redirection are now more smartly detected by HTTP Proxy Server, see Bug 55531
Many fixes on edge cases with HTTPS have been made, see Bug 55502, Bug 55504, Bug 55506
Many encoding fixes have been made, see Bug 54482, Bug 54142, Bug 54293

You can now load test MongoDB through new MongoDB Source Config

changes/2.10/02_mongodb_source_config.png

changes/2.10/14_mongodb_jsr223.png

Kerberos authentication has been added to Auth Manager

changes/2.10/15_kerberos.png

Device can now be used in addition to source IP address

changes/2.10/16_device.png

You can now do functional testing of MongoDB scripts through new MongoDB Script

changes/2.10/03_mongodb_script_alpha.png

Timeout has been added to OS Process Sampler

changes/2.10/17_os_process_timeout.png

Query timeout has been added to JDBC Request

changes/2.10/04_jdbc_request_timeout.png

New functions (urlencode and urldecode) are now available to encode/decode URL encoded chars

changes/2.10/05_urlencode_function.png

Continuous Integration is now eased by addition of a new flag that forces NON-GUI JVM to exit after test end

See jmeter property:

jmeterengine.force.system.exit

HttpSampler now allows DELETE Http Method to have a body (works for HC4 and HC31 implementations). This allows for example to test Elastic Search APIs

changes/2.10/06_http_request_delete_method.png

2 implementations of HtmlParser have been added to improve Embedded resources parsing

You can choose the implementation to use for parsing Embedded resources in HTML pages: See jmeter.properties and look at property “htmlParser.className”.

org.apache.jmeter.protocol.http.parser.LagartoBasedHtmlParser for optimal performances
org.apache.jmeter.protocol.http.parser.JSoupBasedHtmlParser for most accurate parsing and functional testing

Distributed testing has been improved

Number of threads on each node are now reported to controller.
Performance improvement on BatchSampleSender(Bug 55423)
Addition of 2 SampleSender modes (StrippedAsynch and StrippedDiskStore), see jmeter.properties

ModuleController has been improved to better handle changes to referenced controllers

Improved class loader configuration, see Bug 55503

New property “plugin_dependency_paths” for plugin dependencies
Properties “search_paths”, “user.classpath” and “plugin_dependency_paths” now automatically add all jars from configured directories

Best-practices section has been improved, ensure you read it to get the most out of JMeter

See Best Practices

GUI and ergonomy Improvements

New Templates feature that allows you to create test plan from existing template or merge

template into your Test Plan

changes/2.10/07_jmeter_templates_icon.png

changes/2.10/08_jmeter_templates_box.png

Workbench can now be saved

changes/2.10/09_save_workbench.png

Syntax color has been added to scripts elements (BeanShell, BSF, and JSR223), MongoDB and JDBC elements making code much more readable and allowing UNDO/REDO through CTRL+Z/CTRL+Y

BSF Sampler with syntax color changes/2.10/10_color_syntax_bsf_sampler.png

JSR223 Pre Processor with syntax color changes/2.10/11_color_syntax_jsr223_preprocessor.png

JMeter GUI can now be fully Internationalized, all remaining issues have been fixed

Currently French has all its labels translated. Other languages are partly translated, feel free to

contribute translations by reading Localisation (Translator’s Guide)

Moving elements in Test plan has been improved in many ways

Drag and drop of elements in Test Plan tree is now much easier and possible on multiple nodes

changes/2.10/12_drap_n-drop_multiple.png

Note that due to this bug in Java, you cannot drop a node after last node. The workaround is to drop it before this last node and then Drag and Drop the last node before the one you just dropped.

New shortcuts have been added to move elements in the tree.

(alt + Arrow Up) and (alt + Arrow Down) move the element within the parent node

(alt + Arrow Left) and (alt + Arrow Right) move the element up and down in the tree depth

Response Time Graph Y axis can now be scaled

changes/2.10/13_response_time_graph_y_scale.png

JUnit Sampler gives now more details on configuration errors

Known bugs

The Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).
Listeners don’t show iteration counts when a If Controller has a condition which is always false from the first iteration (see Bug 52496). A workaround is to add a sampler at the same level as (or superior to) the If Controller. For example a Test Action sampler with 0 wait time (which doesn’t generate a sample), or a Debug Sampler with all fields set to False (to reduce the sample size).
Webservice sampler does not consider the HTTP response status to compute the status of a response, thus a response 500 containing a non empty body will be considered as successful, see Bug 54006. To workaround this issue, ensure you always read the response and add a Response Assertion checking text inside the response.
The numbers that appear to the left of the green box are the number of active threads / total number of threads, these only apply to a locally run test; they do not include any threads started on remote systems when using client-server mode, (see Bug 54152).
Note that there is a bug in Java on some Linux systems that manifests itself as the following error when running the test cases or JMeter itself: [java] WARNING: Couldn't flush user prefs: java.util.prefs.BackingStoreException: java.lang.IllegalArgumentException: Not supported: indent-number This does not affect JMeter operation. This issue is fixed since Java 7b05.
With Java 1.6 and Gnome 3 on Linux systems, the JMeter menu may not work correctly (shift between mouse’s click and the menu). This is a known Java bug (see Bug 54477). A workaround is to use a Java 7 runtime (OpenJDK or Oracle JDK).
With Oracle Java 7 and Mac Book Pro Retina Display, the JMeter GUI may look blurry. This is a known Java bug, see Bug JDK-8000629. A workaround is to use a Java 7 update 40 runtime which fixes this issue.

Incompatible changes

SMTP Sampler now uses eml file subject if subject field is empty
With this version autoFlush has been turned off on PrintWriter in charge of writing test results. This results in improved throughput for intensive tests but can result in more test data loss in case of JMeter crash (extremely rare). To revert to previous behaviour set jmeter.save.saveservice.autoflush property to true.
Shortcut for Function Helper Dialog is now CTRL+SHIFT+F1 (CMD + SHIFT + F1 for Mac OS). The original key sequence (Ctrl+F1) did not work in some locations (it is consumed by the Java Swing ToolTipManager). It was therefore necessary to change the shortcut.
Webservice (SOAP) Request has been removed by default from GUI as Element is deprecated. (Use HTTP Request with Body Data, see also the Template Building a SOAP Webservice Test Plan), if you need to show it, see property not_in_menu in jmeter.properties
Transaction Controller now sets Response Code of Generated Parent Sampler (if Generated Parent Sampler is checked) to response code of first failing child in case of failure of one of the children, in previous versions Response Code was empty.
In previous versions, IncludeController could run Test Elements located inside a Thread Group, this behaviour (which was not documented) could result in weird behaviour, it has been removed in this version (see Bug 55464). The correct way to include Test Elements is to use Test Fragment as stated in documentation of Include Controller.
The retry count for the HttpClient 3.1 and HttpClient 4.x samplers has been changed to 0. Previously the default was 1, which could cause unexpected additional traffic.
Starting with this version, the HTTP(S) Test Script Recorder tries to detect when a sample is the result of a previous redirect. If the current response is a redirect, JMeter will save the redirect URL. When the next request is received, it is compared with the saved redirect URL and if there is a match, JMeter will disable the generated sample. To revert to previous behaviour, set the property proxy.redirect.disabling=false
Starting with this version, in HTTP(S) Test Script Recorder if Grouping is set to Put each group in a new Transaction Controller, the Recorder will create Transaction Controller instances with Include duration of timer and pre-post processors in generated sample set to false. This default value reflect more accurately response time.
__escapeOroRegexpChars function (which escapes ORO reserved characters) no longer trims the value (see Bug 55328)
The commons-lang-2.6.jar has been removed from embedded libraries in jmeter/lib folder as it is not needed by JMeter at run-time (it is only used by Apache Velocity for generating documentation). If you use any plugin or third-party code that depends on it, you need to add it in jmeter/lib folder

Bug fixes

HTTP Samplers and Proxy

Bug 54627 - JMeter Proxy GUI: Type of sampler setting takes the whole screen when there are samplers with long names.
Bug 54629 - HTMLParser does not extract <object> tag urls.
Bug 55023 - SSL Context reuse feature (51380) adversely affects non-ssl request performance/throughput. based on analysis by Brent Cromarty (brent.cromarty at yahoo.ca)
Bug 55092 - Log message “WARN - jmeter.protocol.http.sampler.HTTPSamplerBase: Null URL detected (should not happen)” displayed when embedded resource URL is malformed.
Bug 55161 - Useless processing in SoapSampler.setPostHeaders. Contributed by Adrian Nistor (nistor1 at illinois.edu)
Bug 54482 - HC fails to follow redirects with non-encoded chars.
Bug 54142 - HTTP Proxy Server throws an exception when path contains “|” character.
Bug 55388 - HC3 does not allow IP Source field to override httpclient.localaddress.
Bug 55450 - HEAD redirects should remain as HEAD
Bug 55455 - HTTPS with HTTPClient4 ignores cps setting
Bug 55502 - Proxy generates empty http:/ entries when recording
Bug 55504 - Proxy incorrectly issues CONNECT requests when browser prompts for certificate override
Bug 55506 - Proxy should deliver failed requests to any configured Listeners
Bug 55545 - HTTP Proxy Server GUI should not allow both Follow and Auto redirect to be selected

Other Samplers

Bug 54913 - JMSPublisherGui incorrectly restores its state. Contributed by Benoit Wiart (benoit.wiart at gmail.com)
Bug 55027 - Test Action regression, duration value is not recorded (nightly build).
Bug 55163 - BeanShellTestElement fails to quote string when calling testStarted(String)/testEnded(String).
Bug 55349 - NativeCommand hangs if no input file is specified and the application requests input.
Bug 55462 - System Sampler should not change the sampler label if a sample fails

Controllers

Bug 54467 - Loop Controller: compute loop value only once per parent iteration.
Bug 54985 - Make Transaction Controller set Response Code of Generated Parent Sampler to response code of first failing child in case of failure of one of its children. Contributed by Mikhail Epikhin (epihin-m at yandex.ru)
Bug 54950 - ModuleController : Changes to referenced Module are not taken into account if changes occur after first run and referenced node is disabled.
Bug 55201 - ForEach controller excludes start index and includes end index (clarified documentation).
Bug 55334 - Adding Include Controller to test plan (made of Include Controllers) without saving TestPlan leads to included code not being taken into account until save.
Bug 55375 - StackOverflowError with ModuleController in Non-GUI mode if its name is the same as the target node.
Bug 55464 - Include Controller running included thread group

Listeners

Bug 54589 - View Results Tree have a lot of Garbage characters if html page uses double-byte charset.
Bug 54753 - StringIndexOutOfBoundsException at SampleResult.getSampleLabel() if key_on_threadname=false when using Statistical mode.
Bug 54685 - ArrayIndexOutOfBoundsException if “sample_variable” is set in client but not server.
Bug 55111 - ViewResultsTree: text not refitted if vertical scrollbar is required. Contributed by Milamber

Timers, Assertions, Config, Pre- & Post-Processors

Bug 54540 - “HTML Parameter Mask” are not marked deprecated in the IHM.
Bug 54575 - CSS/JQuery Extractor : Choosing JODD Implementation always uses JSOUP.
Bug 54901 - Response Assertion GUI behaves weirdly.
Bug 54924 - XMLAssertion uses JMeter JVM file.encoding instead of response encoding and does not clean threadlocal variable.
Bug 53679 - Constant Throughput Timer bug with localization. Reported by Ludovic Garcia

Functions

Bug 55328 - __escapeOroRegexpChars trims spaces.

I18N

Bug 55437 - ComboStringEditor does not translate EDIT and UNDEFINED strings on language change
Bug 55501 - Incorrect encoding for French description of __char function. Contributed by Antonio Gomes Rodrigues (ra0077 at gmail.com)

General

Bug 54504 - Resource string not found: [clipboard_node_read_error].
Bug 54538 - GUI: context menu is too big.
Bug 54847 - Cut & Paste is broken with tree multi-selection. Contributed by Benoit Wiart (benoit.wiart at gmail.com)
Bug 54870 - Tree drag and drop may lose leaf nodes (affected nightly build). Contributed by Benoit Wiart (benoit.wiart at gmail.com)
Bug 55056 - wasted work in Data.append(). Contributed by Adrian Nistor (nistor1 at illinois.edu)
Bug 55129 - Change Javadoc generation per CVE-2013-1571, VU#225657.
Bug 55187 - Integer overflow when computing ONE_YEAR_MS in HTTP CacheManager.
Bug 55208 - JSR223 language entries are duplicated; fold to lower case.
Bug 55203 - TestBeanGUI - wrong language settings found.
Bug 55065 - Useless processing in Spline3.converge(). Contributed by Adrian Nistor (nistor1 at illinois.edu)
Bug 55064 - Useless processing in ReportTreeListener.isValidDragAction(). Contributed by Adrian Nistor (nistor1 at illinois.edu)
Bug 55242 - BeanShell Client jar throws exceptions after upgrading to 2.8.
Bug 55288 - JMeter should default to 0 retries for HTTP requests.
Bug 55405 - ant download_jars task fails if lib/api or lib/doc are missing. Contributed by Antonio Gomes Rodrigues.
Bug 55427 - TestBeanHelper should ignore properties not supported by GenericTestBeanCustomizer
Bug 55459 - Elements using ComboStringEditor lose the input value if user selects another Test Element
Bug 54152 - In distributed testing : activeThreads always show 0 in GUI and Summariser
Bug 55509 - Allow Plugins to be notified of remote thread number progression
Bug 55572 - Detail popup of parameter does not show a Scrollbar when content exceeds display
Bug 55580 - Help pane does not scroll to start for <a href=“#”> links
Bug 55600 - JSyntaxTextArea : Strange behaviour on first undo
Bug 55655 - NullPointerException when Remote stopping /shutdown all if one engine did not start correctly. Contributed by UBIK Load Pack (support at ubikloadpack.com)
Bug 55657 - Remote and Local Stop/Shutdown buttons state does not take into account local / remote status

Improvements

HTTP Samplers and Proxy

HTTP Request: Small user interaction improvements in Row parameter Detail Box. Contributed by Milamber
Bug 55255 - Allow Body in HTTP DELETE method to support API that use it (like ElasticSearch).
Bug 53480 - Add Kerberos support to Http Sampler (HttpClient4). Based on patch by Felix Schumacher (felix.schumacher at internetallee.de)
Bug 54874 - Support device in addition to source IP address. Based on patch by Dan Fruehauf (malkodan at gmail.com)
Bug 55488 - Add .ico and .woff file extension to default suggested exclusions in proxy recorder. Contributed by Antonio Gomes Rodrigues
Bug 55525 - Proxy should support alias for keyserver entry
Bug 55531 - Proxy recording and redirects. Added code to disable redirected samples.
Bug 55507 - Proxy SSL recording does not handle external embedded resources well
Bug 55632 - Have a new implementation of htmlParser for embedded resources parsing with better performances
Bug 55653 - HTTP(S) Test Script Recorder should set TransactionController property “Include duration of timer and pre-post processors in generated sample” to false

Other samplers

Bug 54788 - JMS Point-to-Point Sampler - GUI enhancements to increase readability and ease of use. Contributed by Bruno Antunes (b.m.antunes at gmail.com)
Bug 54798 - Using subject from EML-file for SMTP Sampler. Contributed by Mikhail Epikhin (epihin-m at yandex.ru)
Bug 54759 - SSLPeerUnverifiedException using HTTPS , property documented.
Bug 54896 - JUnit sampler gives only “failed to create an instance of the class” message with constructor problems.
Bug 55084 - Add timeout support for JDBC Request. Contributed by Mikhail Epikhin (epihin-m at yandex.ru)
Bug 55403 - Enhancement to OS sampler: Support for timeout
Bug 55518 - Add ability to limit number of cached PreparedStatements per connection when “Prepared Select Statement”, “Prepared Update Statement” or “Callable Statement” query type is selected

Controllers

Bug 54271 - Module Controller breaks if test plan is renamed.

Listeners

Bug 54532 - Improve Response Time Graph Y axis scale with huge values or small values (< 1000ms). Add a new field to define increment scale. Contributed by Milamber based on patch by Luca Maragnani (luca.maragnani at gmail.com)
Bug 54576 - View Results Tree : Add a CSS/JQuery Tester.
Bug 54777 - Improve Performance of default ResultCollector. Based on patch by Mikhail Epikhin (epihin-m at yandex.ru)
Bug 55389 - Show IP source address in request data

Timers, Assertions, Config, Pre- & Post-Processors

Bug 54789 - XPath Assertion - GUI enhancements to increase readability and ease of use.

Functions

Bug 54991 - Add functions to encode/decode URL encoded chars (__urlencode and __urldecode). Contributed by Milamber.

I18N

Bug 55241 - Need GUI Editor to process fields which are based on Enums with localised display strings
Bug 55440 - ComboStringEditor should allow tags to be language dependent
Bug 55432 - CSV Dataset Config loses sharing mode when switching languages

General

Bug 54584 - MongoDB plugin. Based on patch by Jan Paul Ettles (janpaulettles at gmail.com)
Bug 54669 - Add flag forcing non-GUI JVM to exit after test. Contributed by Scott Emmons
Bug 42428 - Workbench not saved with Test Plan. Contributed by Dzmitry Kashlach (dzmitrykashlach at gmail.com)
Bug 54825 - Add shortcuts to move elements in the tree. Contributed by Benoit Wiart (benoit.wiart at gmail.com)
Bug 54834 - Improve Drag & Drop in the jmeter tree. Contributed by Benoit Wiart (benoit.wiart at gmail.com)
Bug 54839 - Set the application name on Mac. Contributed by Benoit Wiart (benoit.wiart at gmail.com)
Bug 54841 - Correctly handle the quit shortcut on Mac Os (CMD-Q). Contributed by Benoit Wiart (benoit.wiart at gmail.com)
Bug 54844 - Set the application icon on Mac Os. Contributed by Benoit Wiart (benoit.wiart at gmail.com)
Bug 54864 - Enable multi selection drag & drop in the tree without having to start dragging before releasing Shift or Control. Contributed by Benoit Wiart (benoit.wiart at gmail.com)
Bug 54945 - Add Shutdown Hook to enable trapping kill or CTRL+C signals.
Bug 54990 - Download large files avoiding outOfMemory.
Bug 55085 - UX Improvement : Ability to create New Test Plan from Templates. Contributed by UBIK Load Pack (support at ubikloadpack.com)
Bug 55172 - Provide plugins a way to add Top Menu and menu items.
Bug 55202 - Add syntax color for scripts elements (BeanShell, BSF, and JSR223) and JDBC elements with RSyntaxTextArea. Contributed by Milamber based on patch by Marko Vlahovic (vlahovic74 at gmail.com)
Bug 55175 - HTTPHC4Impl refactoring to allow better inheritance.
Bug 55236 - Templates - provide button to reload template details.
Bug 55237 - Template system should support relative fileName entries.
Bug 55423 - BatchSampleSender: Reduce locking granularity by moving listener.processBatch outside of synchronized block
Bug 55424 - Add Stripping to existing SampleSenders
Bug 55451 - Test Element GUI with JSyntaxTextArea scroll down when text content is long enough to add a Scrollbar
Bug 55513 - StreamCopier cannot be used with System.err or System.out as it closes the output stream
Bug 55514 - SystemCommand should support arbitrary input and output streams
Bug 55515 - SystemCommand should support chaining of commands
Bug 55606 - Use JSyntaxtTextArea for Http Request, JMS Test Elements
Bug 55651 - Change JMeter application icon to Apache plume icon

Non-functional changes

Updated to jsoup-1.7.2
Bug 54776 - Update the dependency on Bouncy Castle to 1.48. Contributed by Emmanuel Bourg (ebourg at apache.org)
Updated to HttpComponents Client 4.2.6 (from 4.2.3)
Updated to HttpComponents Core 4.2.5 (from 4.2.3)
Updated to commons-codec 1.8 (from 1.6)
Updated to commons-io 2.4 (from 2.2)
Updated to commons-logging 1.1.3 (from 1.1.1)
Updated to commons-net 3.3 (from 3.1)
Updated to jdom-1.1.3 (from 1.1.2)
Updated to jodd-lagarto and jodd-core 3.4.8 (from 3.4.1)
Updated to junit 4.11 (from 4.10)
Updated to slf4j-api 1.7.5 (from 1.7.2)
Updated to tika 1.4 (from 1.3)
Updated to xmlgraphics-commons 1.5 (from 1.3.1)
Updated to xstream 1.4.4 (from 1.4.2)
Updated to BouncyCastle 1.49 (from 1.48)
Bug 54912 - JMeterTreeListener should use constants. Contributed by Benoit Wiart (benoit.wiart at gmail.com)
Bug 54903 - Remove the dependency on the Activation Framework. Contributed by Emmanuel Bourg (ebourg at apache.org)
Moved commons-lang (2.6) to lib/doc as it’s only needed by Velocity.
Re-organised and simplified NOTICE and LICENSE files.
Bug 55411 - NativeCommand could be useful elsewhere. Copied code to o.a.jorphan.exec.
Bug 55435 - ComboStringEditor could be simplified to make most settings final
Bug 55436 - ComboStringEditor should implement ClearGui
Bug 55463 - Component.requestFocus() is discouraged; use requestFocusInWindow() instead
Bug 55486 - New JMeter Logo. Contributed by UBIK Load Pack (support at ubikloadpack.com)
Bug 55548 - Tidy up use of TestElement.ENABLED; use TestElement.isEnabled()/setEnabled() throughout
Bug 55617 - Improvements to jorphan collection. Contributed by Benoit Wiart (benoit.wiart at gmail.com)
Bug 55623 - Invalid/unexpected configuration values should not be silently ignored
Bug 55626 - Rename HTTP Proxy Server as HTTP(S) Test Script Recorder

Thanks

We thank all contributors mentioned in bug and improvement sections above:

Bruno Antunes (b.m.antunes at gmail.com)
Emmanuel Bourg (ebourg at apache.org)
Scott Emmons
Mikhail Epikhin (epihin-m at yandex.ru)
Dzmitry Kashlach (dzmitrykashlach at gmail.com)
Luca Maragnani (luca.maragnani at gmail.com)
Milamber
Adrian Nistor (nistor1 at illinois.edu)
Antonio Gomes Rodrigues (ra0077 at gmail.com)
UBIK Load Pack (support at ubikloadpack.com)
Benoit Wiart (benoit.wiart at gmail.com)

We also thank bug reporters who helped us improve JMeter.

For this release we want to give special thanks to the following reporters for the clear reports and tests made after our fixes:

Immanuel Hayden (immanuel.hayden at gmail.com)
Danny Lade (dlade at web.de)
Brent Cromarty (brent.cromarty at yahoo.ca)
Wolfgang Heider (wolfgang.heider at racon.at)
Shmuel Krakower (shmulikk at gmail.com)

Apologies if we have omitted anyone else.

Version 2.9

New and Noteworthy

Core Improvements:

* A new Extractor that uses CSS or jquery-like selector syntax has been introduced,

it allows using either JODD or JSOUP implementations

changes/2.9/01_css_jquery_extractor.png

Result: the title of the page in a JMeter variable changes/2.9/01_css_jquery_extractor_resul.png

* JMeter can now handle different types of documents (PDF, MsOffice files, Apache OpenOffice’s files, …)

within different elements

Regular Expression Extractor, extract text from documents
Assertion Response, check text in documents
View Results Tree, view as a text the documents

changes/2.9/02_document_render_view_results_tree.png

* A new Regex User Parameters Pre-Processor that enables injecting input parameter names and values

using a reference extracted by Regular Expression Extractor from a previous response

changes/2.9/13_regex_user_params.png

* TCP Sampler: new options

TCP Sampler has been enhanced with new options to allow setting Close Connection, SO_LINGER and End of line(EOL) byte value changes/2.9/03_new_options_tcp_sampler.png

* A new function __escapeOroRegexpChars(,) has been introduced quote ORO regexp meta characters

* ForEach Controller: new fields

ForEach Controller has now 2 new fields to control start and end of loop changes/2.9/04_for_each_new_fields.png

* Result Status Action Handler now has a new option to “Start next thread loop”

changes/2.9/05_result_status_action_handler.png

* JMS Publisher: new option

JMS Publisher can now send Bytes Messages

changes/2.9/11_jms_publisher_bytes.png

* Memory and performance improvements

Significant improvements have been done in this version on memory usage per Thread and CPU when more than one Post Processor is used as child of a Sampler

JSR223 Elements (enable using Groovy, Scala, … as scripting languages) have been improved to enable caching of Compilation results when scripts are passed in Text area

changes/2.9/12_jsr223_sampler.png

Some configuration defaults have changed to improve performances by default(see Bug 54412), see description in New and Noteworthy section.

Distributed testing now uses MODE_STRIPPED_BATCH, which returns samples in batch mode (every 100 samples or every minute by default). Note also that MODE_STRIPPED_BATCH strips response data from SampleResult, so if you need it change to another mode (mode property in jmeter.properties)
Result data are now saved to CSV by default (jmeter.save.saveservice.output_format in jmeter.properties)

* XPath Assertion now enables using a JMeter variable as input

changes/2.9/14_xpath_assertion.png

GUI and ergonomy Improvements:

* Search feature has been improved to search within more internal fields of elements and expand search results

* Copy/paste is now possible between 2 JMeter instances >= 2.9 version

Copy element(s) from one JMeter instance: changes/2.9/06_copy_paste_between_2_jmeter1.png

Paste element(s) into a second JMeter instance: changes/2.9/06_copy_paste_between_2_jmeter2.png

* HTTP Header Manager

Allow copy from clipboard to HeaderPanel, headers are supposed to be separated by new line and have the following form name:value changes/2.9/07_header_panel_add_from_clipboard.png

* Module Controller

Module Controller has been improved to better render referenced controller and expand it by clicking on a new button changes/2.9/08_module_controller_improvements.png

* HTTP Proxy Server

HTTP Proxy Server now has a button to add a set of default exclusions for URL patterns, this list can be configured through property : proxy.excludes.suggested changes/2.9/09_proxy_excludes_suggested.png

* Rendering of target controller has been improved in HTTP Proxy Server

HTTP Proxy Server recording:

HTTP Proxy Server now automatically uses HTTP Request with Raw Post Body mode for samples that only have one unnamed argument (JSON, XML, GWT, …)
HTTP Proxy Server does not force user to select the type of Sampler in HTTP Sampler Settings, this allows easier switch between implementations as Sampler do not have this information set anymore

changes/2.9/10_http_proxy_dont_force_http_type.png

SamplerCreator interface has been enriched to meet new requirements for plug-in providers
It is now possible to create binary sampler for x-www-form-urlencoded POST request by modifying proxy.binary.types property to add application/x-www-form-urlencoded
Improved timestamp format auto-detection when reading CSV files

Known bugs

The Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).

Listeners don’t show iteration counts when a If Controller has a condition which is always false from the first iteration (see Bug 52496). A workaround is to add a sampler at the same level as (or superior to) the If Controller. For example a Test Action sampler with 0 wait time (which doesn’t generate a sample), or a Debug Sampler with all fields set to False (to reduce the sample size).

Webservice sampler does not consider the HTTP response status to compute the status of a response, thus a response 500 containing a non empty body will be considered as successful, see Bug 54006. To workaround this issue, ensure you always read the response and add a Response Assertion checking text inside the response.

Changing language can break part of the configuration of the following elements (see Bug 53679):

CSV Data Set Config (sharing mode will be lost)
Constant Throughput Timer (Calculate throughput based on will be lost)

The numbers that appear to the left of the green box are the number of active threads / total number of threads, these only apply to a locally run test; they do not include any threads started on remote systems when using client-server mode, (see Bug 54152).

Note that there is a bug in Java on some Linux systems that manifests itself as the following error when running the test cases or JMeter itself:

[java] WARNING: Couldn't flush user prefs:
 java.util.prefs.BackingStoreException:
 java.lang.IllegalArgumentException: Not supported: indent-number

This does not affect JMeter operation.

Incompatible changes

JMeter requires now a Java 6 runtime or higher.

Some configuration defaults have changed to improve performances by default (see Bug 54412), see description in New and Noteworthy section.

Webservice sampler now adds to request the headers that are set through Header Manager, these were previously ignored

jdbcsampler.cachesize property has been removed, it previously limited the size of a per connection cache of Map < String, PreparedStatement > , it also limited the size of this map which held the PreparedStatement for SQL queries. This limitation provoked a bug Bug 53995. It has been removed so now size of these 2 maps is not limited anymore. This change changes behaviour as starting from this version no PreparedStatement will be closed during the test.

Starting with this version, there are some important changes on JSR223 Test Elements:

JSR223 Test Elements that have an invalid filename (not existing or unreadable) will make test fail instead of making the element silently work
In JSR223 Test Elements: responseCodeOk, responseMessageOK and successful are set before script is executed, if responseData is set it will not be overridden anymore by a toString() on script return value

View Results Tree now considers response with missing content type as text.

In remote Test mode, JMeter now exits in error if one of the remote engines cannot be configured, previously it started the test with available engines.

Bug fixes

HTTP Samplers and Proxy

Don’t log spurious warning messages when using concurrent pool embedded downloads with Cache Manager or CookieManager
Bug 54057- Proxy option to set user and password at startup (-u and -a) not working with HTTPClient 4
Bug 54187 - Request tab does not show headers if request fails
Bug 53840 - Proxy Recording : Response message: URLDecoder: Illegal hex characters in escape (%) pattern - For input string: “” “
Bug 54351 - HC4 and URI fragments is failing

Other Samplers

Bug 53997 - LDAP Extended Request: Escape ampersand (&), left angle bracket (<) and right angle bracket (>) in search filter tag in XML response data
Bug 53995 - AbstractJDBCTestElement shares PreparedStatement between multi-threads
Bug 54119 - HTTP 307 response is not redirected
Bug 54326 - AjpSampler send file in post throws FileNotFoundException
Bug 54331 - AjpSampler throws null pointer on GET request that are protected

Controllers

Listeners

Bug 54088 - The type video/f4m is text, not binary
Bug 54166 - ViewResultsTree could not render the HTML response: handle failure to parse HTML
Bug 54287 - Incorrect Timestamp in Response Time Graph when using a date with time in Date format field
Bug 54451 - Response Time Graph reports wrong times when the are many samples for same time
Bug 54459 - CSVSaveService does not handle date parsing very well

Timers, Assertions, Config, Pre- & Post-Processors

Bug 54058 - In HTTP Request Defaults, the value of field “Embedded URLs must match: is not saved if the check box “Retrieve All Embedded Resources” is not checked.
Bug 54375 - Regular Expression Extractor : When regex syntax is wrong, post processing is stopped

Functions

I18N

General

Bug 53975 - Variables replacement doesn’t work with option “Delay thread creation until needed”
Bug 54055 - View Results tree: = signs are stripped from parameter values at HTTP tab
Bug 54129 - Search Feature does not find text although existing in elements
Bug 54023 - Unable to start JMeter from a root directory and if the full path of JMeter installation contains one or more spaces (Unix/linux)
Bug 54172 - Duplicate shortcut key not working and CTRL+C / CTRL+V / CTRL+V do not cancel default event
Bug 54057 - Proxy option to set user and password at startup (-u and -a) not working with HTTPClient 4
Bug 54267 - Start Next Thread Loop setting doesn’t work in custom thread groups
Bug 54413 - DataStrippingSampleSender returns 0 for number of bytes of any response

Improvements

HTTP Samplers

Bug 54185 - Allow query strings in paths that start with HTTP or HTTPS

Other samplers

Bug 54004 - Webservice Sampler : Allow adding headers to request with Header Manager
Bug 54106 - JSR223TestElement should check for file existence when a filename is set instead of using Text Area content
Bug 54107 - JSR223TestElement : Enable compilation and caching of Script Text
Bug 54109 - JSR223TestElement : SampleResult properties should be set before entering script to allow user setting different code
Bug 54230 - TCP Sampler, additions of “Close Connection”, “SO_LINGER” and “End of line(EOL) byte value” options
Bug 54182 - Support sending of ByteMessage for JMS Publisher.

Controllers

Bug 54131 - ForEach Controller : Add start and end index for looping over variables
Bug 54132 - Module Controller GUI : Improve rendering of referenced controller
Bug 54155 - ModuleController : Add a shortcut button to unfold the tree up to referenced controller and highlight it

Listeners

Bug 54200 - Add support of several document types (like Apache OpenOffice’s files, MS Office’s files, PDF’s files, etc.) to the elements View Results Tree, Assertion Response and Regular Expression Extractor (using Apache Tika)
Bug 54226 - View Results Tree : Show response even when server does not return ContentType header

Timers, Assertions, Config, Pre- & Post-Processors

Bug 54259 - Introduce a new Extractor that uses CSS or jquery-like selector syntax
Bug 45772 - RegEx User Parameters Post Processor
Bug 54160 - Add support for xpath assertion to apply to a JMeter variable.

Functions

Bug 54189 - Add a function to quote ORO regexp meta characters
Bug 54418 - UUID Function

I18N

General

Bug 54005 - HTTP Mirror Server : Add special headers “X-” to control Response status and response content
Bug 53875 - Include suggested defaults for URL filters on HTTP Proxy
Bug 54031 - Add tooltip to running/total threads indicator
Webservice (SOAP) Request has been deprecated
Bug 54161 - Proxy : be able to create binary sampler for x-www-form-urlencoded POST request
Bug 54154 - HTTP Proxy Server should not force user to select the type of Sampler in HTTP Sampler Settings
Bug 54165 - Proxy Server: Improve rendering of target controller
Bug 46677 - Copying Test Elements between test plans
Bug 54204 - Result Status Action Handler : Add start next thread loop option
Bug 54232 - Search Feature : Add a button to search and expand results
Bug 54251 - Add tristate checkbox implementation
Bug 54257 - Enhance SamplerCreator interface to meet new requirements
Bug 54258 - Proxy : Use Raw Post Body when Sampler has one unnamed argument, useful for Samplers using POST method by of type JSON, XML, GWT body
Bug 54268 - Improve CPU and memory usage
Bug 54376 - ScopePanel : Allow configuring more precisely scopes
Bug 54412 - Changing JMeter defaults to ensure better performances by default
Bug 54414 - Remote Test should not start if one of the engines fails to start correctly

Non-functional changes

Bug 53956 - Add ability to paste (a list of values) from clipboard for Header Manager
Updated to HttpComponents Client 4.2.3 (from 4.2.1)
Updated to HttpComponents Core 4.2.3 (from 4.2.2)
Bug 54110 - BSFTestElement and JSR223TestElement should use shared super-class for common fields
Bug 54199 - Move to Java 6
Upgraded to rhino 1.7R4

Version 2.8

New and Noteworthy

Core Improvements:

Thread Group: New Option Delay thread creation until needed

New Option “Delay thread creation until needed” that will create and start threads when needed instead of creating them on Test startup

This new feature allows running tests with a huge number of short lived threads. changes/2.8/12_delay_thread_creation.png

Add HTTPClient 4 cookie implementation in JMeter.

Cookie Manager has now the default HC3.1 implementation and a new choice HC4 implementation (compliant with IPv6 address) changes/2.8/11_hc4_cookie.png

Memory and performance improvements

Significant improvements have been done in this version on memory usage of JMeterThread

JSR223 Elements (enable using Groovy, scala, … as scripting languages) have been improved to enable:

usage of Compilable interface when available to boost CPU usage
caching of Compilation when scripts are used as Files

See JMeter Performances across versions

OS Process Sampler

Allow defining files for stdout/stderr/stdin. changes/2.8/06_os_sampler_stdout-err-in.png

HTTP Request: PATCH verb

Add PATCH verb to HTTP sampler changes/2.8/01_http_patch_verb.png

HTTP Request: HTTPClient 4 is now the default implementation

HTTPClient 4 is now the default HTTP Request implementation (and for Proxy element when generating HTTP requests).

Previously the default was the HTTP Java implementation (i.e. the implementation provided by the JVM) changes/2.8/02_http_default_hc4.png

HTTP Request

Add Embedded URL Filter to HTTP Request Defaults Control (it was already present for HTTP Requests) changes/2.8/05_http_defaults_url_filter.png

Miscellaneous

CSV Dataset : Embedded new lines are now supported in quoted data
JMX files now contain the version of JMeter that created the file
JMeter Version is now available as property “jmeter.version”

Reporting Improvements:

Response Time Graph

Add a new visualizer Response Time Graph to draw a line graph showing the evolution of response time for a test changes/2.8/09_resp_time_graph.png

Settings for Response Time Graph changes/2.8/08_resp_time_graph_settings.png

View Results in Table

Add latency to View Result in Table listener changes/2.8/10_latency_view_results_table.png

Aggregate Graph

Small improvements: legend at left or right is now on 1 column (instead of 1 large line), … changes/2.8/07_aggregate_graph_legend_left_right.png

GUI and ergonomy Improvements:

HTTP Proxy Server simplifications

HTTPS Spoofing options have been removed from Proxy as HTTPS recording is directly available since JMeter 2.4. changes/2.8/03_remove_https_spoofing1.png

HTTP Proxy Server

Allow URL Filters to be pasted from clipboard changes/2.8/15_add_from_clipboard_filter.png

Find in JMeter

CTRL + F for the new Find feature changes/2.8/14_ctrl_F_shortcut.png

ESC key now closes popups.

User Interface in GNOME 3

Display ‘Apache JMeter’ title in app title bar in Gnome 3 changes/2.8/13_gnome3_title.png

Known bugs

The Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).

Changing language can break part of the configuration of the following elements (see Bug 53679):

CSV Data Set Config (sharing mode will be lost)
Constant Throughput Timer (Calculate throughput based on will be lost)

Note that there is a bug in Java on some Linux systems that manifests itself as the following error when running the test cases or JMeter itself:

[java] WARNING: Couldn't flush user prefs:
 java.util.prefs.BackingStoreException:
 java.lang.IllegalArgumentException: Not supported: indent-number

This does not affect JMeter operation.

Incompatible changes

When using CacheManager, JMeter now caches responses for GET queries provided header Cache-Control is different from “no-cache” as described in specification. Furthermore it doesn’t put anymore in Cache deprecated entries for “no-cache” responses. See Bug 53521 and Bug 53522

A major change has occurred on JSR223 Test Elements, previously variables set up before script execution where stored in ScriptEngineManager which was created once per execution, now ScriptEngineManager is a singleton shared by all JSR223 elements and only ScriptEngine is created once per execution, variables set up before script execution are now stored in Bindings created on each execution, see Bug 53365.

JSR223 Test Elements using Script file are now Compiled if ScriptEngine supports this feature, see Bug 53520.

Shortcut for Function Helper Dialog is now CTRL+F1 (CMD + F1 for Mac OS), CTRL+F (CMD+F1 for Mac OS) now opens Search Dialog.

By default, the TestCompiler now stores details of which pairs it has seen in Controller instances rather than in a static Set. [Bug 53796] This gives much better memory behaviour for delayed start test plans, as memory used is proportional to the number of concurrent threads. With the static Set memory usage was proportional to the total thread count. This change is very unlikely to cause a problem. The original behaviour can be restored by setting the property TestCompiler.useStaticSet=true

HTTPS Spoofing options have been removed from Proxy as HTTPS recording is directly available since JMeter 2.4.

Bug fixes

HTTP Samplers and Proxy

Bug 53521 - Cache Manager should cache content with Cache-control=private
Bug 53522 - Cache Manager should not store at all response with header “no-cache” and store other types of Cache-Control having max-age value
Bug 53838 - Pressing “Stop” does not interrupt the TCP sampler
Bug 53911 - JmeterKeystore does not allow for key down the list of certificate

Other Samplers

Bug 53348 - JMeter JMS Point-to-Point Request-Response sampler doesn’t work when Request-queue and Receive-queue are different
Bug 53357 - JMS Point to Point reports too high response times in Request Response Mode
Bug 53440 - SSL connection leads to ArrayStoreException on JDK 6 with some KeyManagerFactory SPI
Bug 53511 - access log sampler SessionFilter throws NullPointerException - cookie manager not initialized properly
Bug 53715 - JMeter does not load WSDL

Controllers

Listeners

Bug 53742 - When jmeter.save.saveservice.sample_count is set to true, elapsed time read by listener is always equal to 0
Bug 53774 - RequestViewRaw does not show headers unless samplerData is non-null
Bug 53802 - IdleTime values are not saved to CSV log
Bug 53874 - View Results Tree : If some parameter containing special characters like % is not encoded, RequestViewHTTP fails with java.lang.IllegalArgumentException: URLDecoder: Illegal hex characters in escape (%) pattern and Response is not displayed

Timers, Assertions, Config, Pre- & Post-Processors

Bug 51512 - Cookies aren’t inserted into HTTP request with IPv6 Host header

Functions

I18N

General

Bug 53365 - JSR223TestElement should cache ScriptEngineManager
Bug 53520 - JSR223 Elements : Use Compilable interface to improve performances on File scripts
Bug 53501 - Synchronization timer blocks test end.
Bug 53750 - TestCompiler saves unnecessary entries in pairing collection
Bug 52266 - Code:Inconsistent synchronization
Bug 53841 - CSVSaveService reads file using JVM default file encoding instead of using the one configured in saveservice.properties
Bug 53953 New: Typo in monitor test plan documentation

Improvements

HTTP Samplers

Bug 53675 - Add PATCH verb to HTTP sampler
Bug 53931 - Define HTTPClient 4 for the default HTTP Request (and Proxy element to generate the HTTP requests). Before the default, it was the HTTP Java Sampler
Bug 53934 - Removes HTTPS spoofing options in JMeter HTTP Proxy Server. Since JMeter 2.4, the HTTPS protocol is directly supported by the proxy

Other samplers

Bug 55310 - TestAction should implement Interruptible
Bug 53318 - Add Embedded URL Filter to HTTP Request Defaults Control
Bug 53782 - Enhance JavaSampler handling of JavaSamplerClient cleanup to use less memory
Bug 53168 - OS Process - allow specification of stdout/stderr/stdin
Bug 53844 - JDBC related elements should check class of Variable Name supposed to contain JDBC Connection Configuration to avoid ClassCastException

Controllers

Bug 53671 - tearDown thread group to run even if shutdown test happens

Listeners

Bug 53566 - Don’t log partial responses to the jmeter log
Bug 53716 - Small improvements in aggregate graph: legend at left or right is now on 1 column (instead of 1 large line), no border to the reference’s square color, reduce width on some fields
Bug 53718 - Add a new visualizer ‘Response Time Graph’ to draw a line graph showing the evolution of response time for a test
Bug 53738 - Keep track of number of threads started and finished
Bug 53753 - Summariser: no point displaying fractional time in most cases
Bug 53749 - TestListener interface could perhaps be split up. This should reduce per-thread memory requirements and processing, as only test elements that actually use testIterationStart functionality now need to be handled.
Bug 53941 - Add latency to View Result table listener

Timers, Assertions, Config, Pre- & Post-Processors

Bug 53755 - Adding a HttpClient 4 cookie implementation in JMeter. Cookie Manager has now the default HC3.1 implementation and a new choice HC4 implementation (compliant with IPv6 address)

Functions

Bug 51527 - __time() function : add another option to __time() to provide seconds since epoch

I18N

General

Bug 53364 - Sort list of Functions in Function Helper Dialog
Bug 53418 - New Option “Delay thread creation until needed” that will create and start threads when needed instead of creating them on Test startup
Bug 42245 - Show clear passwords in HTTP Authorization Manager
Bug 53616 - Display ‘Apache JMeter’ title in app title bar in Gnome 3
Bug 53759 - ClientJMeterEngine performs unnecessary traverse using SearchByClass(TestListener)
Bug 52601 - CTRL + F for the new Find feature
Bug 53796 - TestCompiler uses static Set which can grow huge
Bug 53673 - Add JMeter version in the jmx file
Add support for HeapDump to the JMeter non-GUI and GUI client
Bug 53862 - Would be nice to have the JMeter Version available as a property
Bug 53806 - FileServer should provide thread-safe parsing
Bug 53807 - CSV Dataset does not handle embedded new lines in quoted data
Bug 53879 - GUI : Allow Popups to be closed with ESC key
Bug 53876 - Allow URL Filters (HTTP Proxy) to be pasted from clipboard

Non-functional changes

Bug 53311 - JMeterUtils#runSafe should not throw Error when interrupted
Updated to commons-net-3.1 (from 3.0.1)
Updated to HttpComponents Core 4.2.2 (from 4.1.4) and HttpComponents Client 4.2.1 (from 4.1.3)
Bug 53765 - Switch to commons-lang3-3.1
Bug 53884 - wrong Maven groupId for commons-lang

Version 2.7

New and Noteworthy

OS Process Sampler

A new System Sampler that can be used to execute commands on the local machine. changes/2.7/01_os_process_sampler.png

OS Process Sampler results example with DNS lookup command ‘dig’ changes/2.7/02_os_process_example_results.png

JMS Samplers improvements

Addition of a “Non Persistent Delivery” option to send “Non-Persistent” (Guaranteed to be delivered at most once. Message loss is not a concern.) JMS messages changes/2.7/11_jms_non_persistent_delivery_mode.png

Support sending of JMS Object Messages to enable sending Objects unmarshalled from XML by XStream changes/2.7/12_jms_sending_objects.png

Enable setting JMS Properties through JMS Publisher sampler changes/2.7/13_jms_properties.png

Test Action sampler

Allow premature exit from a loop changes/2.7/07_test_action_next_iter.png

Webservice Sampler improvements

Add a jmeter property soap.document_cache to control size of Document Cache changes/2.7/14_ws_document_cache.png

Make Maintain HTTP Session configurable changes/2.7/15_ws_maintain_session.png

Aggregate graph: Clustered Bar char with average, median, 90% line, min and max columns

Aggregate graph changes to Clustered Bar chart, add more columns (median, 90% line, min, max) and options, fixed some bugs changes/2.7/03_aggregate_graph_with_new_cols.png

New settings for aggregate graph changes/2.7/04_aggregate_graph_parameters.png

Improvements of HTML report design generated by JMeter Ant task in extras folder

HTML report example changes/2.7/05_jmeter_ant_task_report_success.png

HTML report example with some assertion errors changes/2.7/06_jmeter_ant_task_report_errors.png

Mailer Visualizer

Enable authentication, and connection security with SSL or TLS
Improve GUI design
Add internationalisation (i18n) support

changes/2.7/10_mailer_visualizer_gui.png

New Visual Indicator of number of ERROR/FATAL messages in logs

Indicator shows number of ERROR/FATAL messages in logs, it can be clicked to toggle Log Viewer panel changes/2.7/16_log_errors_counter.png

Dialog box to show detail of a parameter row

Add a detail button on parameters table to show detail of a Row changes/2.7/08_param_button_detail.png

Detail box example changes/2.7/09_detail_box.png

Plugin writers

New interface org.apache.jmeter.engine.util.ConfigMergabilityIndicator has been introduced to tell whether a ConfigTestElement can be merged in Sampler (see Bug 53042):

public boolean applies(ConfigTestElement configElement);

New interface org.apache.jmeter.protocol.http.proxy.SamplerCreator to allow plugging HTTP based samplers that differ from default HTTP Samplers through Proxy during Recording Phase (see Bug 52674):

public String[] getManagedContentTypes();

public HTTPSamplerBase createSampler(HttpRequestHdr request, Map&lt;String, String&gt; pageEncodings, Map&lt;String, String&gt; formEncodings);

public void populateSampler(HTTPSamplerBase sampler, HttpRequestHdr request, Map&lt;String, String&gt; pageEncodings, Map&lt;String, String&gt; formEncodings) throws Exception;

Known bugs

The Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).

Incompatible changes

When doing replacement of User Defined Variables, Proxy will not substitute partial values anymore when “Regexp matching” is used. It will use Perl 5 word matching (“\b”)

In User Defined Variables, Test Plan, HTTP Sampler Arguments Table, Java Request Defaults, JMS Sampler and Publisher, LDAP Request Defaults and LDAP Extended Request Defaults, rows with empty Name and Value are no more saved.

JMeter now expands the Test Plan tree to the testplan level and no further and selects the root of the tree. Furthermore default value of onload.expandtree is false.

Graph Full Results Listener has been removed.

When calling “Clear All” command, if Log Viewer is displayed its content will be cleared.

Bug fixes

HTTP Samplers and Proxy

Bug 52613 - Using Raw Post Body option, text gets encoded
Bug 52781 - Content-Disposition header garbled even if browser compatible headers is checked (HC4)
Bug 52796 - MonitorHandler fails to clear variables when starting a new parse
Bug 52871 - Multiple Certificates not working with HTTP Client 4
Bug 52885 - Proxy : Recording issues with HTTPS, cookies starting with secure are partly truncated
Bug 52886 - Proxy : Recording issues with HTTPS when spoofing is on, secure cookies are not always changed
Bug 52897 - HTTPSampler : Using PUT method with HTTPClient4 and empty Content Encoding and sending files leads to NullPointerException
Bug 53145 - HTTP Sampler - function in path evaluated too early

Other Samplers

Bug 51737 - TCPSampler : Packet gets converted/corrupted
Bug 52868 - BSF language list should be sorted
Bug 52869 - JSR223 language list currently uses BSF list which is wrong
Bug 52932 - JDBC Sampler : Sampler is not marked in error in an Exception which is not of class IOException, SQLException, IOException occurs
Bug 52916 - JDBC Exception if there is an empty user defined variable
Bug 52937 - Webservice Sampler : Clear Soap Documents Cache at end of Test
Bug 53027 - JMeter starts throwing exceptions while using SMTP Sample in a test plan with HTTP Cookie Mngr or HTTP Request Defaults
Bug 53072 - JDBC PREPARED SELECT statements should return results in variables like non prepared SELECT

Controllers

Bug 52968 - Option Start Next Loop in Thread Group does not mark parent Transaction Sampler in error when an error occurs
Bug 50898 - IncludeController : NullPointerException loading script in non-GUI mode if Includers use same element name

Listeners

Bug 43450 - Listeners/Savers assume SampleResult count is always 1; fixed Generate Summary Results

Assertions

Bug 52848 - NullPointer in “XPath Assertion”

Functions

I18N

Bug 52551 - Function Helper Dialog does not switch language correctly
Bug 52552 - Help reference only works in English

General

Bug 52639 - JSplitPane divider for log panel should be hidden if log is not activated
Bug 52672 - Change Controller action deletes all but one child samplers
Bug 52694 - Deadlock in GUI related to non AWT Threads updating GUI
Bug 52678 - Proxy : When doing replacement of UserDefinedVariables, partial values should not be substituted
Bug 52728 - CSV Data Set Config element cannot coexist with BSF Sampler in same Thread Plan
Bug 52762 - Problem with multiples certificates: first index not used until indexes are restarted
Bug 52741 - TestBeanGUI default values do not work at second time or later
Bug 52783 - oro.patterncache.size property never used due to early init
Bug 52789 - Proxy with Regexp Matching can fail with NullPointerException in Value Replacement if value is null
Bug 52645 - Recording with Proxy leads to OutOfMemory
Bug 52679 - User Parameters columns narrow
Bug 52843 - Sample headerSize and bodySize not being accumulated for subsamples
Bug 52967 - The function __P() couldn’t use default value when running with remote server in GUI mode.
Bug 50799 - Having a non-HTTP sampler in a http test plan prevents multiple header managers from working
Bug 52997 - JMeter should not exit without saving Test Plan if saving before exit fails
Bug 53136 - Catching Throwable needs to be carefully handled

Improvements

HTTP Samplers

Other samplers

Bug 52775 - JMS Publisher : Add Non Persistent Delivery option
Bug 52810 - Enable setting JMS Properties through JMS Publisher sampler
Bug 52938 - Webservice Sampler : Add a jmeter property soap.document_cache to control size of Document Cache
Bug 52939 - Webservice Sampler : Make MaintainSession configurable
Bug 53073 - Allow to assign the OUT result of a JDBC CALLABLE to JMeter variables
Bug 53164 - New System Sampler
Bug 53172 - OS Process Sampler - allow specification of Environment Variables
Bug 52936 - JMS Publisher : Support sending of JMS Object Messages

Controllers

Listeners

Bug 52603 - MailerVisualizer : Enable SSL , TLS and Authentication
Bug 52698 - Remove Graph Full Results Listener
Bug 53070 - Change Aggregate graph to Clustered Bar chart, add more columns (median, 90% line, min, max) and options, fixed some bugs
Bug 53246 - Mailer Visualizer: improve GUI design and I18N

Timers, Assertions, Config, Pre- & Post-Processors

Functions

I18N

Mailer Visualizer has been internationalized. French translation added. (see Bug 53246)

General

Bug 45839 - Test Action : Allow premature exit from a loop
Bug 52614 - MailerModel.sendMail has strange way to calculate debug setting
Bug 52782 - Add a detail button on parameters table to show detail of a Row
Bug 52674 - Proxy : Add a Sampler Creator to allow plugging HTTP based samplers using potentially non textual POST Body (AMF, Silverlight, …) and customizing them for others
Bug 52934 - GUI : Open Test plan with the tree expanded to the testplan level and no further and select the root of the tree
Bug 52941 - Improvements of HTML report design generated by JMeter Ant task extra
Bug 53042 - Introduce a new method in Sampler interface to allow Sampler to decide whether a config element applies to Sampler
Bug 52771 - Documentation : Added RSS feed on JMeter Home page under link “Subscribe to What’s New”
Bug 42784 - Show the number of errors logged in the GUI
Bug 53256 - Make Clear All command clean LogViewer content
Bug 53261 - Make “Error/fatal” counter added in Bug 42784 open Log Viewer panel when Warn Indicator is clicked

Non-functional changes

Upgraded to rhino 1.7R3 (was js-1.7R2.jar). Note: the Maven coordinates for the jar were changed from rhino:js to org.mozilla:rhino. This does not affect JMeter directly, but might cause problems if using JMeter in a Maven project with other code that depends on an earlier version of the Rhino Javascript jar.
Bug 52675 - Refactor Proxy and HttpRequestHdr to allow Sampler Creation by Proxy
Bug 52680 - Mention version in which function was introduced
Bug 52788 - HttpRequestHdr : Optimize code to avoid useless work
JMeter Ant (ant-jmeter-1.1.1.jar) task was upgraded from 1.0.9 to 1.1.1
Updated to commons-io 2.2 (from 2.1)
Bug 53129 - Upgrade XStream from 1.3.1 to 1.4.2
Updated to httpcomponents-client 4.1.3 (from 4.1.2)
Updated JMeter distributed testing guide (jmeter_distributed_testing_step_by_step.pdf). Changes source format to OpenOffice odt (from sxw)

Version 2.6

New and Noteworthy

A new toolbar on JMeter’s main window changes/2.6/01_toolbar.png

JMeter start test button

A new menu option and button allow to start a test ignoring the Pause Timers changes/2.6/02_ignore_pause_timers.png

JMeter GUI Look and Feel

Allow System or CrossPlatform LAF to be set from options menu changes/2.6/03_look_and_feel.png

JMeter GUI - duplicate node

Add “duplicate node” in context menu changes/2.6/04_duplicate_context_menu.png

JMeter tree view - search facility

Functionality to search by keyword in Samplers Tree View changes/2.6/05_search_tree.png

HTTP Request - raw request pane

Improve HTTP Request GUI to better show parameters without name (GWT RPC request or SOAP request for example) changes/2.6/06_post_data.png

HTTP Request - other changes

Allow multiple selection in arguments panel
Allow to add (paste) entries from the clipboard to an arguments list
Ability to move variables up or down in HTTP Request

changes/2.6/07_multiple_selection_params.png

HTTP Request - file protocol

Better support for file: protocol in HTTP sampler changes/2.6/08_file_protocol.png

Retrieve embedded resources with file: protocol changes/2.6/09_file_protocol_embedded.png

HTTP Request - Ignore embedded resources failed

Enable “ignore failed” for embedded resources changes/2.6/26_ignore_child_failed.png

Parent success with a embedded resource failed changes/2.6/27_succes_with_child_failed.png

View Results in Table - child sample display

Add option to TableVisualiser to display child samples instead of parent changes/2.6/10_child_sampler.png

Key Store - multiple certificates

Allowing multiple certificates (JKS) changes/2.6/11_jks_keystore.png

Aggregate graph improvements

Some improvements on Aggregate Graph Listener:

new GUI for settings
dynamic graph size
allow to change fonts for title graph and legend
allow to change bar color (background and text values)
allow to draw or not bars outlines
allow to select only some samplers by a regexp filter
allow to define Y axis maximum scale

changes/2.6/12_aggregate_graph_settings.png

Aggregate Graph bar changes/2.6/13_aggregate_graph_bar.png

Counter - new reset option

Add an option to reset counter on each Thread Group iteration changes/2.6/14_reset_counter.png

Functions

Add a new function __RandomString to generate random Strings
Add a new function __TestPlanName returning the name of the current “Test Plan”
Add a new function __machineIP returning IP address
Add a new function __jexl2 to support Jexl2

changes/2.6/15_random_string.png

User Defined Variable improvements

Add a comment field in User Defined Variables
Allow to add (paste) entries from the clipboard to an arguments list
Ability to move up or down variables in User Defined Variables

changes/2.6/16_udv_comments.png

View Results Tree

In View Results Tree rather than showing just a message if the results are to big, show as much of the result as are configured changes/2.6/17_vrt_max_size_display.png

Controllers - change elements

Add ability to Change Controller elements changes/2.6/18_change_ctl_type.png

JDBC pre- and post-processor

Add JDBC pre- and post-processor changes/2.6/19_jdbc_pre_post_proc.png

JDBC transaction isolation option

Allow to set the transaction isolation in the JDBC Connection Configuration changes/2.6/20_jdbc_trans_isolation.png

Poisson Timer

Add a Poisson based timer changes/2.6/21_poisson_timer.png

GUI and OS interaction

Support for file Drag and Drop. changes/2.6/22_drag_and_drop.png

Confirm Remove Dialog box

Add a dialog box to confirm removing the element(s) when Remove action is called changes/2.6/23_confirm_remove.png

The dialogue can be skipped by setting the JMeter property confirm.delete.skip=true

Remote batching support

Use external store to hold samples during distributed testing, Added DiskStore remote sample sender: like Hold, but saves samples to disk until end of test changes/2.6/24_diskstore.png

JMS Subscriber sampler

With JMS Subscriber, ability to use Selectors changes/2.6/25_selector.png

New Logger Panel

A new Log Viewer has been added to the GUI and can be enabled from menu Options → Log Viewer: changes/2.6/28_loggerpanel_option.png

This Log Viewer shows the jmeter.log file, and useful (for example) to debug BeanShell/BSF scripts: changes/2.6/28_loggerpanel.png

The menu item Options / Choose Language now changes all the displayed text to the new language provided all messages are translated. You can help on this by translating into your language.

Legacy JMX and JTL Avalon format support restored

Support for reading/writing the original Avalon XML format of JMX (script) and JTL (sample result) files was dropped in JMeter version 2.4. JMeter can now read the Avalon format files again, however there is no support for saving files in the old format.

JMeter jars available from Maven repository

JMeter jars are now available from Maven repository.

Known bugs

The Include Controller has some problems in non-GUI mode (see Bugs 40671, 41286, 44973, 50898). In particular, it can cause a NullPointerException if there are two include controllers with the same name.

The Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).

Incompatible changes

JMeter versions since 2.1 failed to create a container sample when loading embedded resources. This has been corrected; can still revert to the Bug 51939 behaviour by setting the following property: httpsampler.separate.container=false

Mirror server now uses default port 8081, was 8080 before 2.5.1.

TCP Sampler handles SocketTimeoutException, SocketException and InterruptedIOException differently since 2.6, when these occurs, Sampler is marked as failed.

Sample Sender implementations now resolve their configuration on Client side since 2.6. This behaviour can be changed with property sample_sender_client_configured (set it to false).

The HTTP User Parameter Modifier test element has been removed; it has been deprecated for a long time.

Bug fixes

HTTP Samplers and Proxy

Bug 51932 - CacheManager does not handle cache-control header with any attributes after max-age
Bug 51918 - GZIP compressed traffic produces errors, when multiple connections allowed
Bug 51939 - Should generate new parent sample if necessary when retrieving embedded resources
Bug 51942 - Synchronisation issue on CacheManager when Concurrent Download is used
Bug 51957 - Concurrent get can hang if a task does not complete
Bug 51925 - Calling Stop on Test leaks executor threads when concurrent download of resources is on
Bug 51980 - HtmlParserHTMLParser double-counts images used in links
Bug 52064 - OutOfMemory Risk in CacheManager
Bug 51919 - Random ConcurrentModificationException or NoSuchElementException in CookieManager#removeMatchingCookies when using Concurrent Download
Bug 52126 - HttpClient4 does not clear cookies between iterations
Bug 52129 - Reported Body Size is wrong when using HTTP Client 4 and Keep Alive connection
Bug 52137 - Problems with HTTP Cache Manager
Bug 52221 - Nullpointer Exception with use Retrieve Embedded Resource without HTTP Cache Manager
Bug 52310 - variable in IPSource failed HTTP request if “Concurrent Pool Size” is enabled
Bug 52371 - API Incompatibility - Methods in HTTPSampler2 now require PostMethod instead of HttpMethod[Base]. Reverted to original types.
Bug 49950 - Proxy : IndexOutOfBoundsException when recording with Proxy server
Bug 52409 - HttpSamplerBase#errorResult modifies sampleResult passed as parameter; fix code which assumes that a new instance is created (i.e. when adding a sub-sample)
Bug 52507 - Delete Http User Parameters modifier (deprecated, obsolete)

Other Samplers

Bug 51996 - JMS Initial Context leak newly created Context when Multiple Thread enter InitialContextFactory#lookupContext at the same time
Bug 51691 - Authorization does not work for JMS Publisher and JMS Subscriber
Bug 52036 - Durable Subscription fails with ActiveMQ due to missing clientId field
Bug 52044 - JMS Subscriber used with many threads leads to javax.naming.NamingException: Something already bound with ActiveMQ
Bug 52072 - LengthPrefixedBinaryTcpClientImpl may end a sample prematurely
Bug 52390 - AbstractJDBCTestElement:Memory leak and synchronization issue in perConnCache

Controllers

Bug 51865 - Infinite loop inside thread group does not work properly if “Start next loop after a Sample error” option set
Bug 51868 - A lot of exceptions in jmeter.log while using option “Start next loop” for thread
Bug 51866 - Counter under loop doesn’t work properly if “Start next loop on error” option set for thread group
Bug 52296 - TransactionController + Children ThrouputController or InterleaveController leads to ERROR sampleEnd called twice java.lang.Throwable: Invalid call sequence when TPC does not run sample
Bug 52330 - With next-Loop-On-Error after error samples are not executed in next loop

Listeners

Bug 52357 - View results in Table does not allow for multiple result samples
Bug 52491 - Incorrect parsing of Post data parameters in Tree Listener / Http Request view

Assertions

Bug 52519 - XMLSchemaAssertion uses JMeter JVM file.encoding instead of response encoding

Functions

The CRLF example for the char function was wrong; CRLF=(0xD,0xA), not (0xC,0xA)

I18N

General

Bug 51937 - JMeter does not handle missing TestPlan entry well
Bug 51988 - CSV Data Set Configuration does not resolve default delimiter for header parsing when variables field is empty
Bug 52003 - View Results Tree “Scroll automatically” does not scroll properly in case nodes are expanded
Bug 27112 - User Parameters should use scrollbars
Bug 52029 - Command-line shutdown only gets sent to last engine that was started
Bug 52093 - Toolbar ToolTips don’t switch language
Bug 51733 - SyncTimer is messed up if you a interrupt a test plan
Bug 52118 - New toolbar : shutdown and stop buttons not disabled when no test is running
Bug 52125 - StatCalculator.addAll(StatCalculator calc) joins incorrect if there are more samples with the same response time in one of the TreeMap
Bug 52339 - JMeter Statistical mode in distributed testing shows wrong response time
Bug 52215 - Confusing synchronization in StatVisualizer, SummaryReport ,Summariser and issue in StatGraphVisualizer
Bug 52216 - TableVisualizer : currentData field is badly synchronized
Bug 52217 - ViewResultsFullVisualizer : Synchronization issues on root and treeModel
Bug 43294 - XPath Extractor namespace problems
Bug 52224 - TestBeanHelper does not support NOT_UNDEFINED == Boolean.FALSE
Bug 52279 - Switching to another language loses icons in Tree and logs error Can’t obtain GUI class from …
Bug 52280 - The menu item Options / Choose Language does not change all the displayed text to the new language
Bug 52376 - StatCalculator#addValue(T val, int sampleCount) should use long, not int
Bug 49374 - Encoding of embedded element URLs depend on the file.encoding property
Bug 52399 - URLRewritingModifier uses default file.encoding to match text content
Bug 50438 - code calculates average with integer math, expecting double value
Bug 52469 - Changes in Support of SSH-Tunneling of RMI traffic for Remote Testing
Bug 52466 - Upgrade Test Plan feature : NameUpdater does not upgrade properties
Bug 52503 - Unify File→Close and Window close file saving behaviour
Bug 52537 - Help does not scroll to correct anchor when file is first loaded

Improvements

HTTP Samplers

Bug 51981 - Better support for file: protocol in HTTP sampler
Bug 52033 - Allowing multiple certificates (JKS)
Bug 52352 - Proxy : Support IPv6 URLs capture
Bug 44301 - Enable “ignore failed” for embedded resources

Other samplers

Bug 51419 - JMS Subscriber: ability to use Selectors
Bug 52088 - JMS Sampler : Add a selector when REQUEST / RESPONSE is chosen
Bug 52104 - TCP Sampler handles badly errors
Bug 52087 - TCPClient interface does not allow for partial reads
Bug 52115 - SOAP/XML-RPC should not send a POST request when file to send is not found
Bug 40750 - TCPSampler : Behaviour when sockets are closed by remote host
Bug 52396 - TCP Sampler in “reuse connection mode” reuses previous sampler’s connection even if it’s configured with other host, port, user or password
Bug 52048 - BSFSampler, BSFPreProcessor and BSFPostProcessor should share the same GUI

Controllers

Listeners

Bug 52022 - In View Results Tree rather than showing just a message if the results are to big, show as much of the result as are configured
Bug 52201 - Add option to TableVisualiser to display child samples instead of parent
Bug 52214 - Save Responses to a file - improve naming algorithm
Bug 52340 - Allow remote sampling mode to be changed at run-time
Bug 52452 - Improvements on Aggregate Graph Listener (GUI and settings)
Resurrected OldSaveService to allow reading Avalon format JTL (result) files

Timers, Assertions, Config, Pre- & Post-Processors

Bug 52128 - Add JDBC pre- and post-processor
Bug 52183 - SyncTimer could be improved (performance+reliability)
Bug 52317 - Counter : Add option to reset counter on each Thread Group iteration
Bug 37073 - Add a Poisson based timer
Bug 52497 - Improve DebugSampler and DebugPostProcessor

Functions

Bug 52006 - Create a function RandomString to generate random Strings
Bug 52016 - It would be useful to support Jexl2
__char() function now supports octal values
New function __machineIP returning IP address
Bug 51091 - New function returning the name of the current “Test Plan”

I18N

General

Bug 51892 - Default mirror port should be different from default proxy port
Bug 51817 - Moving variables up and down in User Defined Variables control
Bug 51876 - Functionality to search in Samplers TreeView
Bug 52019 - Add menu option to Start a test ignoring Pause Timers
Bug 52027 - Allow System or CrossPlatform LAF to be set from options menu
Bug 52037 - Remember user-set LaF over restarts.
Bug 51861 - Improve HTTP Request GUI to better show parameters without name (GWT RPC requests for example) (UNDER DEVELOPMENT)
Bug 52040 - Add a toolbar in JMeter main window
Bug 51816 - Comment Field in User Defined Variables control.
Bug 52052 - Using a delimiter to separate result-messages for JMS Subscriber
Bug 52103 - Add automatic scrolling option to table visualizer
Bug 52097 - Save As should point to same folder that was used to open a file if MRU list is used
Bug 52085 - Allow multiple selection in arguments panel
Bug 52099 - Allow to set the transaction isolation in the JDBC Connection Configuration
Bug 52116 - Allow to add (paste) entries from the clipboard to an arguments list
Bug 52160 - Don’t display TestBeanGui items which are flagged as hidden
Bug 51886 - SampleSender configuration resolved partly on client and partly on server
Bug 52161 - Enable plugins to add own translation rules in addition to upgrade.properties. Loads any additional properties found in META-INF/resources/org.apache.jmeter.nameupdater.properties files
Bug 42538 - Add “duplicate node” in context menu
Bug 46921 - Add Ability to Change Controller elements
Bug 52240 - TestBeans should support Boolean, Integer and Long
Bug 52241 - GenericTestBeanCustomizer assumes that the default value is the empty string
Bug 52242 - FileEditor does not allow output to be saved in a File
Bug 51093 - when loading a selection previously stored by “Save Selection As”, show the file name in the blue window bar
Bug 50086 - Password fields not Hidden in JMS Publisher, JMS Subscriber, Mail Reader sampler, SMTP sampler and Database Configuration
Bug 29352 - Use external store to hold samples during distributed testing, Added DiskStore remote sample sender: like Hold, but saves samples to disk until end of test.
Bug 52333 - Reduce overhead in calculating SampleResult#nanoTimeOffset
Bug 52346 - Shutdown detects if there are any non-daemon threads left which prevent JVM exit.
Bug 52281 - Support for file Drag and Drop
Bug 52471 - Improve Mirror Server performance by Using Pool of threads instead of launching a Thread for each request
Resurrected OldSaveService to allow reading Avalon format JMX files (removed in 2.4)
Add a dialog box to confirm removing the element(s) when Remove action is called
Bug 41788 - Log viewer (console window) needed as an option
Add option to change the pause time (default 2000ms) in the daemon thread which checks for successful JVM exit. The thread is not now started unless the pause time is greater than 0.

Non-functional changes

fixes to build.xml: support scripts; localise re-usable property names
Bug 51923 - Counter function bug or documentation issue ? (fixed docs)
Update velocity.jar to 1.7 (from 1.6.2)
Update js.jar to 1.7R3 (from 1.6R5)
Update commons-codec 1.5 ⇒ 1.6
Update commons-io 2.0.1 ⇒ 2.1
Update commons-jexl 2.0.1 ⇒ 2.1.1
Update jdom 1.1 ⇒ 1.1.2
Update junit 4.9 ⇒ 4.10
Bug 51954 - Generated documents include </br> entries which cause extra blank lines
Bug 52075 - JMeterProperty.clone() currently returns Object; it should return JMeterProperty
Updated httpcore to 4.1.4
Bug 49753 - Please publish jMeter artifacts on Maven central repository

Version 2.5.1

Summary of main changes

HttpClient4 sampler now re-uses connections properly (previously it would use one per sample, which could quickly cause resource exhaustion).
Various fixes to JMS samplers
Functions are no longer spuriously invoked when used with a Configuration element
WebService sampler GUI has been re-organized for better design and more user-friendliness. Some improvements on WSDL configuration assistant
Better handling of test shutdown. System.exit now only called if there is no other option; even this can be disabled.

Known bugs

The Include Controller has some problems in non-GUI mode. In particular, it can cause a NullPointerException if there are two include controllers with the same name.

The Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).

The If Controller may cause an infinite loop if the condition is always false from the first iteration. A workaround is to add a sampler at the same level as (or superior to) the If Controller. For example a Test Action sampler with 0 wait time (which doesn’t generate a sample), or a Debug Sampler with all fields set to False (to reduce the sample size).

The menu item Options / Choose Language does not change all the displayed text to the new language. [The behaviour has improved, but language change is still not fully working] To override the default local language fully, set the JMeter property “language” before starting JMeter.

Incompatible changes

The HttpClient4 and Commons HttpClient 3.1 samplers previously used a retry count of 3. This has been changed to default to 1, to be compatible with the Java implementation. The retry count can be overridden by setting the relevant JMeter property, for example:

httpclient4.retrycount=3
httpclient3.retrycount=3

Bug fixes

HTTP Samplers and Proxy

Fix HttpClient 4 sampler so it reuses HttpClient instances and connections where possible.
Temporary fix to HC4 sampler to work round HTTPCLIENT-1120.
Bug 51863 - Lots of ESTABLISHED connections with HttpClient 4 implementation (vs HttpClient 3.1 impl)
Bug 51750 - Retrieve all embedded resources doesn’t follow IFRAME
Bug 51752 - HTTP Cache is broken when using “Retrieve all embedded resources” with concurrent pool
Bug 39219 - HTTP Server: You can’t stop it after File→Open
Bug 51775 - Port number duplicates in Host header when capturing by HttpClient (3.1 and 4.x)
Bug 50617 - Monitor Results legend show “dead” server although values from the server are retrieved

Other Samplers

Bug 50424 - Web Methods drop down list box inconsistent
Bug 43293 - Java Request fields not cleared when creating new sampler
Bug 51830 - Webservice Soap Request triggers too many popups when Webservice WSDL URL is down
WebService(SOAP) request - add a connect timeout to get the wsdl used to populate Web Methods when server doesn’t response
Bug 51841 - JMS : If an error occurs in ReceiveSubscriber constructor or Publisher, then Connections will stay open
Bug 51691 - Authorization does not work for JMS Publisher and JMS Subscriber
Bug 51840 - JMS : Cache of InitialContext has some issues
Bug 47888 - JUnit Sampler re-uses test object

Controllers

If Controller - Fixed two regressions introduced by Bug 50032 (see Bug 50618 too)
If Controller - Catches a StackOverflowError when a condition returns always false (after at least one iteration with return true) See Bug 50618
Bug 51869 - NullPointer Exception when using Include Controller

Listeners

Assertions

Functions

Bug 48943 - Functions are invoked additional times when used in combination with a Config Element

I18N

WebService(SOAP) request - add I18N for some labels

General

Bug 51831 - Cannot disable UDP server or change the maximum UDP port
Bug 51821 - Add short-cut for Enabling / Disabling (sub)tree or branches in test plan.
Bug 47921 - Variables not released for GC after JMeterThread exits.
Bug 51839 - “… end of run” printed prematurely
Bug 51847 - Some JUnit tests are Locale sensitive and fail if Locale is different from US
Bug 51855 - Parent samples may have slightly inaccurate elapsed times
Bug 51880 - The shutdown command is not working if I invoke it before all the thread are started
Remote Shut host menu item was not being enabled.
Bug 51888 - Occasional deadlock when stopping a testplan

Improvements

HTTP Samplers

Bug 51380 - Control reuse of cached SSL Context from iteration to iteration
Bug 51882 - HTTPHC3Client uses a default retry count of 3, make it configurable; default is now 1
Change the default HttpClient 4 sampler retry count to 1

Other samplers

Beanshell Sampler now supports Interruptible interface
Bug 51605 - WebService(SOAP) Request - WebMethod field value changes surreptitiously for all the requests when a value is selected in a request
WebService(SOAP) Request - Reorganized GUI for better design and more user-friendliness

Controllers

Listeners

Bug 42246 - Need for a ‘auto-scroll’ option in “View Results Tree” and “Assertion Results”
View Results Tree: Regexp Tester - little improvements on user interface

Timers, Assertions, Config, Pre- & Post-Processors

Bug 51885 - Allow a JMeter Variable as input to XPathExtractor

Functions

I18N

General

Bug 51822 - (part 1) save 1 invocation of GuiPackage#getCurrentGui
Added AsynchSampleSender which sends samples from server to client asynchronously.
Upgraded to htmlparser 2.1; JavaMail 1.4.4; JUnit 4.9

Non-functional changes

Bug 49976 - FormCharSetFinder visibility is default instead of public.
Bug 50917 - Property CookieManager.save.cookies not honored when set from test plan
Improve error logging when Javascript errors are detected.
Updated documentation footer

Version 2.5

Summary of main changes

The HTTP implementation can now be selected at run-time, and JMeter now also supports Apache HttpComponents HttpClient 4.x. Note that Commons HttpClient 3.1 is no longer actively developed, and support may be removed from JMeter in a future release.
The HTTP sampler now allows concurrent downloads of embedded resources in an HTML page
The HTTP Sampler can now report the size of a request before decompression.
The JMS and Mail samplers have been improved.
The new Test Fragment Test Element makes using Include Controllers easier
There are various improvements to the View Results Tree Listener
Bug 30563 - Thread Group should have a start next loop option on Sample Error
There are two new Thread Group types - setUp and tearDown - which are run before and after the main Thread groups.
Client-Server mode now supports external stop/shutdown via UDP multiple JMeter server instances can be started on the same host without needing to change the port property.
Bug 50516 - “Host” header in HTTP Header Manager is not included in generated HTTP request

Known bugs

The Include Controller has some problems in non-GUI mode. In particular, it can cause a NullPointerException if there are two include controllers with the same name.

Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).

Incompatible changes

Unsupported methods are no longer converted to GET by the Commons HttpClient sampler.

Removed method public static long currentTimeInMs(). This has been replaced by the instance method public long currentTimeInMillis().

ProxyControl.getSamplerTypeName() now returns a String rather than an int. This is internal to the workings of the JMeter Proxy & its GUI, so should not affect any user code.

Bug fixes

HTTP Samplers and Proxy

Bug 50178 - HeaderManager added as child of Thread Group can create concatenated HeaderManager names and OutOfMemoryException
Bug 50392 - value is trimmed when sending the request in Multipart
Bug 50686 - HeaderManager logging too verbose when merging instances
Bug 50963 - AjpSampler throws java.lang.StringIndexOutOfBoundsException
Bug 50516 - “Host” header in HTTP Header Manager is not included in generated HTTP request
Bug 50544 - In Apache Common Log the HEAD requests cause problems.
Bug 51268 - HTTPS request through an invalid proxy causes NullPointerException and does not show in result tree. Rather than delegating to the JMeter thread handler for “unexpected” failures, ensure all Exceptions generate a sample error.
Bug 51275 - Cookie Panel clearGui() sets incorrect default policy in Java 1.6

Other Samplers

Bug 50173 - JDBCSampler discards ResultSet from a PreparedStatement
Ensure JSR223 Sampler has access to the current SampleResult
Bug 50977 - Unable to set TCP Sampler for individual samples

Controllers

Bug 50032 - Last_Sample_Ok along with other controllers doesn’t work correctly when the threadgroup has multiple loops
Bug 50080 - Transaction controller incorrectly creates samples including timer duration
Bug 50134 - TransactionController : Reports bad response time when it contains other TransactionControllers

Listeners

Bug 50367 - Clear / Clear all in View results tree does not clear selected element

Assertions

Bug 51488 - Assertion: Variable name scope is shared among all assertions (and Bug 51255)

Functions

Bug 50568 - Function __FileToString(): Could not read file when encoding option is blank/empty

I18N

Bug 50811 - Incomplete Spanish translation

General

Bug 49734 - Null pointer exception on stop Threads command (Run → Stop)
Bug 49666 - CSV Header read as data after EOF
Bug 45703 - Synchronizing Timer
Bug 50088 - fix getAvgPageBytes in SamplingStatCalculator so it returns what it should
Bug 50203 Cannot set property “jmeter.save.saveservice.default_delimiter=\t”
mirror-server.sh - fix classpath to use : separator (not ;)
Bug 50286 - URL Re-writing Modifier: extracted jsessionid value is incorrect when is between XML tags
System.nanoTime() tends to drift relative to System.currentTimeMillis(). Change SampleResult to recalculate offset each time. Also enable reversion to using System.currentTimeMillis() only.
Bug 50425 - Remove thread groups from Controller add menu
Bug 50675 - CVS Data Set Config incompatible with Remote Start Fixed RMI startup to provide location of JMX file relative to user.dir.
Bug 50221 - Renaming elements in the tree does not resize label
Bug 51002 - Stop Thread if CSV file is not available. JMeter now treats IOError as EOF.
Define sun.net.http.allowRestrictedHeaders=true by default. This fixes Bug 51238.
Bug 51645 - CSVDataSet does not read UTF-8 files when file.encoding is UTF-8

Improvements

HTTP Samplers

AJP Sampler now implements Interruptible
Allow HTTP implementation to be selected at run-time
Bug 50684 - Optionally disable Content-Type and Transfer-Encoding in Multipart POST
Bug 50943 - Allowing concurrent downloads of embedded resources in html page
Bug 50170 - Bytes reported by http sampler is after GUnZip Add optional properties to allow change the method to get response size
Hiding the proxy password on HTTP Sampler (just on GUI, not in JMX file)

Other samplers

Bug 49622 - Allow sending messages without a subject (SMTP Sampler)
Bug 49603 - Allow accepting expired certificates on Mail Reader Sampler
Bug 49775 - Allow sending messages without a body
Bug 49862 - Improve SMTPSampler Request output.
Bug 50268 - Adds static and dynamic destinations to JMS Publisher
JMS Subscriber - Add dynamic destination
Bug 50666 - JMSSubscriber: support for durable subscriptions
Bug 50937 - TCP Sampler does not provide for / honor connect timeout
Bug 50569 - Jdbc Request Sampler to optionally store result set object data
Bug 51011 - Mail Reader: upon authentication failure, tell what you tried

Controllers

Bug 50475 - Introduction of a Test Fragment Test Element for a better Include flow

Listeners

View Results Tree - Add a dialog’s text box on “Sampler result tab → Parsed” to display the long value with a double click on cell
Bug 37156 - Formatted view of Request in Results Tree
Bug 49365 - Allow result set to be written to file in a path relative to the loaded script
Bug 50579 - Error count is long, sample count is int. Changed sample count to long.
View Results Tree - Add new size fields: response headers and response body (in bytes) - derived from Bug 43363

Timers, Assertions, Config, Pre- & Post-Processors

Bug 48015 - Proposal new icons for pre-processor, post-processor and assertion elements
Bug 50962 - SizeAssertionGui validation prevents the use of variables for the size
Size Assertion - Add response size scope (full, headers, body, code, message) - derived from Bug 43363

Functions

Bug 49975 - New function returning the name of the current sampler

I18N

Add French translation for the new labels and reduce size for some labels (by abbreviation) on HTTP Sample

General

Bug 30563 - Thread Group should have a start next loop option on Sample Error
Bug 50347 - Eclipse setup instructions should remind user to download dependent jars
Bug 50490 - Setup and Post Thread Group enhancements for better test flow.
All BeanShell test elements now have the script variables “prev” and “Label” defined.
Bug 50708 - Classpath jar order in NewDriver not alphabetically
Bug 50659 - JMeter server does not support concurrent tests - prevent client from starting another
Added remote shutdown functionality
Client JMeter engine now supports external stop/shutdown via UDP
UDP shutdown can now use a range of ports, from jmeterengine.nongui.port=4445 to jmeterengine.nongui.maxport=4455, allowing multiple JMeter instances on the same host without needing to change the port property.
Updated to httpcore 4.1.3 and httpclient 4.1.2

Non-functional changes

Bug 50008 - Allow BatchSampleSender to be subclassed
Bug 50450 - use System.array copy in jacobi solver as, being native, is more performant.
Bug 50487 - runSerialTest verifies objects that never need persisting
Use Thread.setDefaultUncaughtExceptionHandler() instead of private ThreadGroup
Update to Commons Net 3.0

Version 2.4

Summary of main changes

JMeter now requires at least Java 1.5.
HTTP Proxy can now record HTTPS sessions.
JUnit sampler now supports JUnit4 annotations.
Added JSR223 (javax.script) test elements.
MailReader Sampler can now use any protocol supported by the underlying implementation.
An SMTP Sampler has been added.
JMeter now allows users to provide their own Thread Group implementations.
View Results Tree now supports more display options, including search and Regex Testing.
StatCalculator performance is much improved; Aggregate Report etc. need far less memory.
JMS samplers have been extensively reworked, and should no longer lose messages. Correlation processing is improved. JMS Publisher and Subscriber now support both Topics and Queues.
Many other improvements have been made, please see below and in the manual.

Known bugs

The Include Controller has some problems in non-GUI mode. In particular, it can cause a NullPointerException if there are two include controllers with the same name.

Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).

Incompatible changes

HTTP Redirect now defaults to “Follow Redirects” rather than “Redirect Automatically”. This is to enable JMeter to track cookies that may be sent during redirects. This does not affect existing test plans; it only affects the default for new HTTP Samplers.

The Avalon file format for JMX and JTL files is no longer supported. Any such files will need to be converted by reading them in JMeter 2.3.4 and resaving them.

The XPath Assertion and XPath Extractor elements no longer fetch external DTDs by default; this can be changed in the GUI.

JMSConfigGui has been renamed as JMSSamplerGui. This does not affect existing test plans.

The constructor public SampleResult(SampleResult res) has been changed to become a true “copy constructor”. It no longer calls addSubResult(). This may possibly affect some 3rd party add-ons.

Bug fixes

HTTP Samplers and Proxy

Bug 47445 - Using Proxy with https-spoofing secure cookies need to be unsecured
Bug 47442 - Missing replacement of https by http for certain conditions using https-spoofing
Bug 48451 - Error in: SoapSampler.setPostHeaders(PostMethod post) in the else branch
Bug 48542 - SoapSampler uses wrong response header field to decide if response is gzip encoded
Bug 48568 - CookieManager broken for AjpSampler
Bug 48570 - AjpSampler doesn’t support query parameters (GET/POST)
Bug 46901 - HTTP Sampler does not process var/func refs correctly in first file parameter
Bug 43678 - Handle META tag http-equiv charset?
Bug 49294 - Images not downloaded from redirected-to pages
Bug 49560 - wrong “size in bytes” when following redirections

Other Samplers

Bug 47420 - LDAP extended request not closing connections during add request
Bug 48573 - LDAPExtSampler directory context handling
Bug 47870 - JMSSubscriber fails due to NPE
Bug 47899 - NullPointerExceptions in JMS ReceiveSubscriber constructor
Bug 48144 - NPE in JMS OnMessageSubscriber
Bug 47992 - JMS Point-to-Point Request - Response option doesn’t work
Bug 48579 - Single Bind does not show config information when LdapExt Sampler is accessed
Bug 49111 - “Message With ID Not Found” Error on JMS P2P sampler.
Bug 47949 - JMS Subscriber never receives all the messages
Bug 46142 - JMS Point-to-Point correlation problems
Bug 48747 - TCP Sampler swallows exceptions
Bug 48709 - TCP Sampler Config setting “classname” has no effect

Controllers

Bug 47385 - TransactionController should set AllThreads and GroupThreads
Bug 47940 - Module controller incorrectly creates the replacement Sub Tree
Bug 47592 - Run Thread groups consecutively with “Stop test” on error, JMeter will not mark to finished
Bug 48786 - Run Thread groups consecutively: with “Stop test now” on error or manual stop, JMeter leaves the green box active
Bug 48727 - Cannot stop test if all thread groups are disabled

Listeners

Bug 48603 - Mailer Visualiser sends two emails for a single failed response
Correct calculation of min/max/std.dev for aggregated samples (Summary Report)
Bug 48889 - Wrong response time with mode=Statistical and num_sample_threshold > 1
Bug 47398 - SampleEvents are sent twice over RMI in distributed testing and non gui mode

Assertions

Functions

I18N

General

Bug 47646 - NullPointerException in the “Random Variable” element
Disallow adding any child elements to JDBC Configuration
BeanInfoSupport now caches getBeanDescriptor() - should avoid an NPE on non-Sun JVMs when using CSVDataSet (and some other TestBeans)
Bug 48350 - Deadlock on distributed testing with 2 clients
Bug 48901 - Endless wait by adding Synchronizing Timer
Bug 49149 - usermanual/index.html has typo in link to “Regular Expressions” page
Bug 49394 - Classcast Exception in ActionRouter.postActionPerformed
Bug 48136 - Essential files missing from source tarball. Source archives now contain all source files, including source files previously only provided in the binary archives.
Bug 48331 - XpathExtractor does not return XML string representations for a Nodeset

Improvements

HTTP Samplers

Bug 47622 - enable recording of HTTPS sessions
Allow Proxy Server to be specified on HTTP Sampler GUI and HTTP Config GUI
Bug 47461 - Update Cache Manager to handle Expires HTTP header
Bug 48153 - Support for Cache-Control and Expires headers
Bug 47946 - Proxy should enable Grouping inside a Transaction Controller
Bug 48300 - Allow override of IP source address for HTTP HttpClient requests
Bug 49083 - collapse ‘/pathsegment/..’ in redirect URLs

Other samplers

JUnit sampler now supports JUnit4 tests (using annotations)
Bug 47900 - Allow JMS SubscriberSampler to be interrupted
Added JSR223 Sampler
Bug 47556 - JMS-PointToPoint-Sampler Timeout field should use Strings
Bug 47947 - Mail Reader Sampler should allow port to be overridden
Bug 48155 - Multiple problems / enhancements with JMS protocol classes
Allow MailReader sampler to use arbitrary protocols
Bug 45053 - SMTP-Sampler for JMeter
Bug 49552 - Add Message Headers on SMTPSampler
JMS Publisher and Subscriber now support both Topics and Queues. Added read Timeout to JMS Subscriber. General clean-up of JMS code.

Controllers

Bug 47909 - TransactionController should sum the latency
Bug 41418 - Exclude timer duration from Transaction Controller runtime in report
Bug 48749 - Allowing custom Thread Groups
Bug 43389 - Allow Include files to be found relative to the current JMX file

Listeners

Added DataStrippingSample sender - supports “Stripped” and “StrippedBatch” modes.
Added Comparison Assertion Visualizer
Bug 47907 - Improvements (enhancements and I18N) Comparison Assertion and Comparison Visualizer
Bug 36726 - add search function to Tree View Listener
Bug 47869 - Ability to cleanup fields of SampleResult
Bug 47952 - Added JSR223 Listener
Bug 47474 - View Results Tree support for plugin renderers
Allow Idle Time to be saved to sample log files
Bug 48259 - Improve StatCalculator performance by using TreeMap
Listeners using SamplingStatCalculator have much reduced memory needs as the Sample cache has been moved to the new CachingStatCalculator class. In particular, Aggregate Report can now handle large numbers of samples.
Aggregate Report and Summary Report now allow column headers to be optionally excluded
Bug 49506 - Add .csv File Extension in open dialog box from “read from file” functionality of listeners
Bug 49545 - Formatted (parsed) view of Sample Result in Results Tree

Timers, Assertions, Config, Pre- & Post-Processors

Bug 47338 - XPath Extractor forces retrieval of document DTD
Added Comparison Assertion
Bug 47952 - Added JSR223 PreProcessor and PostProcessor
Added JSR223 Assertion
Added BSF Timer and JSR223 Timer
Bug 48511 - add parent,child,all selection to regex extractor
Add Sampler scope selection to XPathExtractor
Regular Expression Extractor, Response Assertion and Size Assertion can now be applied to a JMeter variable
Bug 46790 - CSV Data Set Config should be able to parse CSV headers

Functions

Bug 47565 - [Function] FileToString

I18N

Bug 47938 - Adding some French translations for new elements
Bug 48714 - add new French messages

General

Bug 47223 - Slow Aggregate Report Performance (StatCalculator)
Bug 47980 - hostname resolves to 127.0.0.1 - specifying IP not possible
Bug 47943 - DisabledComponentRemover is not used in Start class
HeapDumper class for runtime generation of dumps
Basic read-only JavaMail provider implementation for reading raw mail files
Bug 49540 - Sort “Add” menus alphabetically

Non-functional changes

Beanshell, JavaMail and JMS API (Apache Geronimo) jars are now included in the binary archive.
Add TestBean Table Editor support
Removed all external libraries from SVN; added download_jars Ant target
Updated various jar files: - BeanShell - 2.0b4 ⇒ 2.0b5 - Commons Codec - 1.3 ⇒ 1.4 - Commons-Collections - 3.2 ⇒ 3.2.1 - JTidy ⇒ r938 - JUnit - 3.8.2 ⇒ 4.8.1 - Logkit - 1.2 ⇒ 2.0 - Xalan Serializer = 2.7.1 (previously erroneously shown as 2.9.1) - Xerces xml-apis = 1.3.04 (previously erroneously shown as 2.9.1) - Some jar files were renamed.

Version 2.3.4

Summary of main changes

This is a minor bug-fix release, mainly to correct some bugs that were accidentally added in 2.3.3.

Known bugs

The Include Controller has some problems in non-GUI mode. In particular, it can cause a NullPointerException if there are two include controllers with the same name.

Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).

Bug fixes

HTTP Samplers and Proxy

Bug 47321 - HTTPSampler2 response timeout not honored

Other Samplers

Bug 47290 - Infinite loop on connection factory lookup (JMS)
JDBC Sampler should not close Prepared or Callable statements as these are cached

Controllers

Bug 39509 - Once-only controller running twice

Listeners

Change ResultCollector to only warn if the directory was not created
Fix some synchronisation issues in ResultCollector and SampleResult (wrong locks were being used)

I18N

Fixed bug introduced in 2.3.3: JMeter does not start up if there is no messages.properties file for the default Locale.

General

Fix problems with remote clients - bug introduced in 2.3.3
Bug 47377 - Make ClassFinder more robust and close zipfile resources
Fix some errors in generating the documentation (latent bug revealed in 2.3.3 when Velocity was upgraded)

Improvements

Other samplers

Bug 47266 - FTP Request Sampler: allow specifying an FTP port, other than the default

Version 2.3.3

Summary of main changes

The handling of test closedown is much improved. The gradual “Shutdown” command now waits until all threads have stopped, and does not report an error if threads don’t stop within 5 seconds. The immediate “Stop” command can now be used if “Shutdown” takes too long. Also the immediate “Stop” command is able to interrupt samplers which support the new Interruptible interface (e.g. HTTP and SOAP, FTP). This allows immediate completion of pending responses. Non-GUI mode tests can also now be sent a “Shutdown” or “Stop” message. Test Action now supports a “Stop Now” action, as do the Thread Group and Result Status Action Handler Post Processor elements.

HTTP Cookie handling is improved, and HTTP POST can now use variable file names correctly. HTTP, SOAP/XML-RPC and WebService(SOAP) sampler character encodings updated to be more consistent. HTTP Samplers now support connection and response timeouts (requires JVM 1.5 for the HTTP Java sampler). Together with the closedown improvements described above, this should avoid most cases where a test run hangs. Multiple Header Manager elements are now supported for a single HTTP sampler. The Proxy Server is improved, and no longer stores “Host” headers by default.

JDBC Request can optionally save the results of Select statements to variables. JDBC Request now handles quoted strings and UTF-8, and can handle arbitrary variable types.

There are several new functions: __char() function: allows arbitrary Unicode characters to be entered in fields. __unescape() function: allows Java-escaped strings to be used. _unescapeHtml() function: decodes Html-encoded text. __escapeHtml() function: encodes text using Html-encoding. A reference to a missing function - e.g. ${__missing(a)} - is now treated the same as a missing variable. Previously the function name - and leading { - were dropped. This makes it easier to debug test plans.

Some Assertions can now be applied to sub-samples as well as (or instead of) just the parent sample. There is a new Random Variable Configuration element.

JMS samplers are much improved (see details below). The TCP Sampler now supports some additional clients and is a bit more flexible.

Client-server mode has been improved, and the server can optionally use a fixed RMI port, which should help with setting up firewalls.

Various I18N changes have been made; language change works better (though not perfect yet). There are improved French translations as well as new Polish and Brazilian Portuguese translations.

The BeanShell jar is now included with the binary archive; there is no need to download it separately.

Known bugs

The Include Controller has some problems in non-GUI mode. In particular, it can cause a NullPointerException if there are two include controllers with the same name.

Once Only controller behaves correctly under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).

The menu item Options → Choose Language does not change all the displayed text to the new language. [The behaviour has improved, but language change is still not fully working] To override the default local language fully, set the JMeter property “language” before starting JMeter.

Incompatible changes

When loading sample results from a file, previous results are no longer cleared. This allows one to merge multiple files. If the previous behaviour is required, use the menu item Run → Clear → (Ctrl+Shift+E) or Run → Clear All → (Ctrl+E) before loading the file.

The test elements “Save Results to a file” and “Generate Summary Results” are now shown as Listeners. They were previously shown as Post-Processors, even though they are implemented as Listeners.

The Cookie Manager no longer saves incoming cookies as variables by default. To save cookies as variables, define the property “CookieManager.save.cookies=true”. Also, cookies names are prefixed with “COOKIE_” before they are stored (this avoids accidental corruption of local variables) To revert to the original behaviour, define the property “CookieManager.name.prefix= ” (one or more spaces).

The Counter element is now shown as a Configuration element. It was previously shown as a Pre-Processor, even though it is implemented as a Config item.

The above changes only affect the icons that are displayed and the locations in the GUI pop-up menus. They do not affect test plans or test behaviour.

The PreProcessors are now invoked directly by the JMeterThread class, rather than by the TestCompiler#configureSampler() method. (JMeterThread handles the PostProcessors). This does not affect test plans or behaviour, but could perhaps affect 3rd party add-ons (very unlikely).

Moved the Scoping Rules sub-section from Section 3. “Building a Test Plan” to Section 4. “Elements of a test plan”

The While controller now trims leading and trailing spaces from the condition value before it is compared with LAST, blank or false.

The “threadName” variable in the _jexl() and __javaScript() functions was previously misspelt as “theadName”.

The following deprecated methods were removed from JOrphanUtils: booleanToString(boolean) and valueOf(boolean). Java 1.4+ has these methods in the Boolean class.

The TestElement interface has some new methods:

void setProperty(String key, String value, String dflt)
void setProperty(String key, boolean value, boolean dflt)
void setProperty(String key, int value)
void setProperty(String key, int value, int dflt)
int getPropertyAsInt(String key, int defaultValue)

These are implemented in the AbstractTestElement class which all elements should extend so this is unlikely to cause a problem.

Bug fixes

HTTP Samplers and Proxy

Bug 46332 - HTTP Cookie Manager ignores manually defined cookies (bug introduced in r707810)
Cookie Manager was not passing cookie policy to runtime threads so they always used compatibility mode
Add version attribute to JMeter Cookie class (needed for proper cookie support)
Cookie Manager now saves/restores cookie versions
Check validity of cookies before storing them.
HTTPSamplers can now use variables in POSTed file names
Fix processing of first file name in HTTP POST so functions/variables work (bug introduced with multiple file support)
Bug 45831 - WS Sampler reports incorrect throughput if SOAP packet creation fails
HTTP, SOAP/XML-RPC and WebService(SOAP) sampler character encodings updated to be more consistent
Bug 46148 - HTTP sampler fails on SSL requests when logging for jmeter.util is set to DEBUG
Fix Java 1.6 https error: java.net.SocketException: Unconnected sockets not implemented
Bug 46838 - if there was no data, still need to set latency in HTTPSampler
Bug 46993 - Saving from Header Manager generates ClassCastException
Bug 46690 - handling of 302 redirects with invalid relative paths. JMeter now removes extraneous leading “../” segments (as do many browsers)
Bug 44521 - empty variables for a POST in the HTTP Request don’t get ignored
Bug 46977 - JMeter does not handle HTTP headers not delimited by whitespace
Fix bug in HTTP file: handling - read bytes, not characters in the default encoding.
Remove Host from headers saved by the Proxy server, as that will normally be generated by the HTTP stack
Bug 45199 - don’t try to replace blank variables in Proxy recording
Change HTTPS spoofing so https: links are replaced even when URL match fails
Bug 46436 - Improve error reporting in Proxy Gui
Bug 46435 - More verbose error msg for error 501 (Proxy Server)

Other Samplers

The “prev” and “sampler” objects are now defined for BSF test elements
Fix NPE (in DataSourceElement) when using JDBC in client-server mode
Bug 45425 - JDBC Request does not support Unicode (changed sampler to use UTF-8)
Bug 46522 - Incorrect “Response data” in JDBC sample when column names are missing
Bug 46821 - JDBC select request doesn’t store the first column in the variables
Bug 43791 - ensure QueueReceiver is closed in JMS Point to Point sampler
Bug 46016 - avoid possible NPE in JMSSampler
Bug 46142 - JMS Receiver now uses MessageID
Bug 45458 - Point to Point JMS in combination with authentication
Bug 45460 - JMS TestPlan elements depend on resource property
Various ReceiveSubscriber thread-safety fixes
JMSPublisher and Subscriber fixes: thread-safety, support dynamic locale changes, locale independence for JMX attribute values
FTP Sampler now logs out before disconnecting.
TCP sampler now calls setupTest() and teardownTest() methods
Bug 45887 - TCPSampler: timeout property incorrectly set

Controllers

Fix NPE when using nested Transaction Controllers with parent samples
Fix processing of Transaction Controller parent mode so current sampler is set to actual sampler
Bug 44941 - Throughput controllers should not share global counters
Bug 47120 - Throughput Controller: change percent executions to total executions, the value is stored in a String and interpreted as 1 execution
Bug 47150 - ThreadGroup with a loop count of zero causes infinite loop
Bug 47009 - Insert parent caused child controller name to be reset
Bug 47165 - Using duplicate Module Controller names in command line mode causes NPE

Listeners

Mailer Visualizer documentation now agrees with code i.e. failure/success counts need to be exceeded to trigger the mail.
Mailer Visualizer now shows the failure count
Mailer Visualiser - fix parsing of multiple e-mail address when using Test button
Bug 45976 - incomplete result file when using remote testing with more than 1 server
Fix Summariser so it works in client server mode
Bug 34096 - Duplicate samples not eliminated when writing to CSV files
Save “Include group Name in Label” setting in Aggregate and Summary reports
The JMeter variable “sample_variables” is sent to all server instances to ensure the data is available to the client.
CSVSaveService - check for EOF while reading quoted string

Assertions

Bug 45749 - Response Assertion does not work with a substring that happens to be an invalid RE
Bug 45904 - Allow ‘Not’ Response Assertion to succeed with null sample

Functions

Fix regex function - was failing to process $m$mid$n$ correctly
Protect against possible NPE in RegexFunction if called during test shutdown.
Avoid NPE if XPath function does not match any nodes
Correct the variable name “theadName” to “threadName” in the __jexl() and __javaScript() functions
A reference to a missing function - e.g. ${__missing(a)} - is now treated the same as a missing variable. Previously the function name - and leading { - were dropped.

I18N

Fixed language change handling for menus (does not yet work for TestBeans)
Add HeaderAsPropertyRenderer to support header resource names; use this to fix locale changes in various GUI elements
Bug 46424 - corrections to French translation
Bug 46844 - “Library” label in test plan are not I18N
Bug 47064 - fixes for Mac LAF
Bug 47127 - Unable to change language to pl_PL
Bug 47137 - Labels in View Results Tree aren’t I18N
Bug 46423 - I18N of Proxy Recorder
Bug 45928 - AJP/1.3 Sampler doesn’t retrieve its label from messages.properties

General

Prompt to overwrite an existing file when first saving a new test plan
Amend TestBeans to show the correct popup menu for Listeners
Bug 45185 - CSV dataset blank delimiter causes OOM
Fix incorrect GUI classifications: “Save Results to a file” and “Generate Summary Results” are now shown as Listeners. “Counter” is now shown as a Configuration element.
Bug 41608 - misleading warning log message removed
Bug 46359 - BSF JavaScript Preprocessor cannot access sampler variable on first iteration (Implement temporary work-round for BSF-22)
Bug 46407 - BSF elements do not load script files, attempt to interpret filename as script
Better handling of Exceptions during test shutdown
Fix potential thread safety issue in JMeterThread class
Bug 46491 - Incorrect value for the last variable in “CSV Data Set Config” (error in processing quoted strings)

Improvements

HTTP Samplers

Bug 45479 - Support for multiple HTTP Header Manager nodes
HTTP Samplers now support connection and request timeouts (requires Java 1.5 for Java Http sampler)
Apache SOAP 2.3.1 does not give access to HTTP response code/message, so WebService sampler now treats an empty response as an error
Mirror server now supports “X-Sleep” header - if this is set, the responding thread will wait for the specified number of milliseconds
Bug 45694 - Support GZIP compressed logs in Access Log Sampler

Other samplers

JDBC Request can optionally save the results of Select statements to variables.
JDBC Request now handles quoted strings.
JDBC Request now handles arbitrary variable types.
LDAP result data now formatted with line breaks
Bug 45200 - MailReaderSampler: store the whole MIME message in the SamplerResult
Bug 45571 - JMS Sampler correlation enhancement
Bug 46030 - Extend TCP Sampler to Support Length-Prefixed Binary Data
Add classname field to TCP Sampler GUIs

Controllers

Allow If Controller to use variable expressions (not just Javascript)
Trim spaces from While Controller condition before comparing against LAST, blank or false

Listeners

Save Responses to a file can save the generated filename(s) to variables.
Add option to skip suffix generation in Save Responses to a File
Bug 43119 - Save Responses to file: optionally omit the file number
Add BSF Listener element
Bug 47176 - Monitor Results : improve load status graphic
Bug 40045 - Allow Results monitor to select a specific connector
Read XML JTL files more efficiently - pass samples to visualizers as they are read, rather than saving them all and then processing them

Assertions, Config, Pre- & Post-Processors

Bug 45903 - allow Assertions to apply to sub-samples
Add Body (unescaped) source option to Regular Expression Extractor.
Random Variable - new configuration element to create random numeric variables

Functions

Add OUT and log variables to __jexl() function
Use Script to evaluate __jexl() function so can have multiple statements.
Add log variable to the __javaScript() function
Added __char() function: allows arbitrary Unicode characters to be entered in fields.
Added __unescape() function: allows Java-escaped strings to be used.
Added __unescapeHtml() function: decodes Html-encoded text.
Added __escapeHtml() function: encodes text using Html-encoding.

I18N

Bug 45929 - improved French translations
Bug 47132 - Brazilian Portuguese translations
Bug 46900 - Polish translations
Added locales.add property to allow for new Locales

General

Allow spaces in JMeter path names (apply work-round for Java Bug 4496398)
Process JVM_ARGS last in script files so users can override default settings
Bug 46636 - Allow server mode to optionally use a fixed rmi port
Make some samplers interruptible: HTTP (both), SoapSampler, FTPSampler
Test Action now supports “Stop Now” action, as do the Thread Group and Result Status Post Processor elements
The Menu items Stop and Shutdown now behave better. Shutdown will now wait until all threads exit. In GUI mode it can be cancelled and Stop run instead. Stop now reports if some threads will not exit, and exits if running in non-GUI mode
Add UDP server to wait for shutdown message if running in non-GUI mode; add UDP client to send the message.
Bug 41209 - JLabeled* and ToolTips
Include BeanShell 2.0b4 jar in binary download.

Non-functional changes

Introduce AbstractListenerGui class to make it easier to create Listeners with no visual output
Assertions are run after PostProcessors; change order of pop-up menus accordingly
Remove unnecessary clone() methods from function classes
Moved PreProcessor invocation to JMeterThread class
Made HashTree Map field final
Improve performance of calling ResultCollector#isSampleWanted() for multiple samples
Updated to new versions of: xmlgraphics-commons (1.3.1), jdom (1.1), xstream (1.3.1), velocity (1.6.2)

Version 2.3.2

Summary of main changes

Bug fixes

Version 2.3.1 changed the way binary and text content types were determined as far as the View Results Tree Listener was concerned: originally everything except “image/” content types were considered text, but 2.3.1 introduced a check for specific content types. This has caused problems, as several popular types were omitted and these were no longer shown by default in the Response tab. Rather than try to list all the possible text types, JMeter now just checks for the following binary types:

image/*
audio/*
video/*

All other types are now assumed to be text.

JMeter 2.3.1 introduced a bug in the Cookie Manager

if “Clear Cookie each iteration” was selected, all threads would see the same cookies. This bug has been corrected.

Improvements

The Proxy server can now record binary requests. By default the content types application/x-amf and application/x-java-serialized-object will be treated as binary and saved in a file. To change the content types, update the property proxy.binary.types.

The CSV Dataset configuration element has new file sharing options: per thread group, per thread, per identifier. This allows for more flexible file processing, e.g. each thread can process the same data in the same order.

Switch Controller now works properly with functions and variables, and the condition can now be a name instead of a number. Simple Controller now works properly under a While Controller

CSV fields in JTL files can now contain delimiters. CSV and XML files can now contain additional variables (define the JMeter property sample_variables).

Response Assertion can now match on substrings (i.e. not regular expression). Regex extractor can operate on variables.

XPath processing is improved; Tidy errors are handled better.

Save Table Data buttons added to Summary and Aggregate reports to allow easy saving of the calculated data.

HTTP samplers can now save just the MD5 hash of responses, rather than the entire response. As a special case, if the HTTP Sampler path starts with “http://” or “https://” then this is used as the full URL, overriding the host and port fields. The HTTP Samplers can now POST multiple files. Webservice(SOAP) Sampler can now load local WSDL files using the “file:” protocol.

A simple HTTP Cache Manager has been added. This needs further development.

View Results Tree Listener now uses Tidy to display XML. This should allow more content to be displayed successfully. It also avoids the need to download remote DTD files, which can slow the rendering considerably.

MailReader sampler now supports POP3S and IMAPS protocols. Individual mails are now added as sub-samples.

Various improvements to the BSF Sampler: now supports Jexl, and Javascript bug works properly. Added BSF PreProcessor, PostProcessor and Assertion test elements. All now have access to “props” JMeter Properties object.

Number of classes loaded in non-GUI mode is much reduced.

Known bugs

The Include Controller has some problems in non-GUI mode. In particular, it can cause a NullPointerException if there are two include controllers with the same name.

Once Only controller behaves OK under a Thread Group or Loop Controller, but otherwise its behaviour is not consistent (or clearly specified).

The menu item Options / Choose Language does not change all the displayed text to the new language. To override the default local language, set the JMeter property “language” before starting JMeter.

Incompatible changes

To reduce the number of classes loaded in non-GUI mode, Functions will only be found if their classname contains the string ‘.functions.’ and does not contain the string ‘.gui.’. All existing JMeter functions conform to this restriction. To revert to earlier behaviour, comment or change the properties classfinder.functions.* in jmeter.properties.
The reference value parameter for intSum() is now optional. As a consequence, if a variable name is used, it must not be a valid integer.
The supplied TCPClient implementation no longer treats tcp.eolByte=0 as special. To skip EOL checking, set tcp.eolByte=1000 (or some other value which is not a valid byte)
Leading and trailing spaces are trimmed from variable names in function calls. For example, ${__Random(1,63, LOTTERY )} will use the variable ‘LOTTERY’ rather than ’ LOTTERY ’.
Synchronization has been removed from the RunningSample class (it was not fully threadsafe anyway). Developers of 3rd party add-ons that use the class may need to synchronize access.

Bug fixes

Check that the CSV delimiter is reasonable.
Fix Switch Controller to work properly with functions and variables
Bug 44011 - application/soap+xml not treated as a text type
Bug 43427 - Simple Controller is only partly executed in While loop
Bug 33954 - Stack Overflow in If/While controllers (may have been fixed previously)
Bug 44022 - Memory Leak when closing test plan
Bug 44042 - Regression in Cookie Manager (Bug introduced in 2.3.1)
Bug 41028 - JMeter server doesn’t alert the user when the host is defined as a loopback address
Bug 44142 - Function __machineName causes NPE if parameters are omitted.
Bug 44144 - JMS point-to-point: request response test does not work
Bug 44314 - Not possible to add more than one SyncTimer
Capture Tidy console error output and log it
Fix problems using Tidy(tolerant parser) in XPath Assertion and XPath Extractor
Bug 44374 - improve timer calculation
Regular Expression Extractor now deletes all stale variables from previous matches.
Bug 44707 - Running remote test changes internal test plan
Bug 44625 - Cannot have two or more FTP samplers with different “put” and “get” actions
Bug 40850 - BeanShell memory leak
Ensure ResponseCode and ResponseMessage are set for successful JDBC samples
FTPSampler now detects and reports failure to open the remote file
Class directories defined in search_paths and user.classpath no longer need trailing “/”
Bug 44852 SOAP/ XML-RPC Request does not show Request details in View Results Tree
WebService(SOAP) Sampler ResponseData now includes the EOLs sent by server
Bug 44910 - close previous socket (if any) in TCP Sampler
Bug 44912 - Filter not working in Log Parser
The BeanShell and BSF component documentation made some incorrect references to the “SampleResponse” object; this has been corrected to “SampleResult”
BSF Sampler now works properly with Javascript
Test Action “Stop Test” now works
Bug 42833 - Argument class uses LinkedHashMap in getArgumentsAsMap() to preserve ordering
Bug 45093 - SizeAssertion did not call getBytes()
Bug 45007 - Rewrite Location headers when using Proxy HTTPS spoofing
Use CRLF rather than LF in Proxy when returning headers to the client
Bug 45007 - fix content length header if content may have been changed

Improvements

CSV files can now handle fields with embedded delimiters.
longSum() function added
Bug 43382 - configure Tidy output (warnings, errors) for XPath Assertion and Post-Processor
Bug 43984 - trim spaces from port field
Add optional comment to __log() function
Make Random function variable name optional
Reduce class loading in non-GUI mode by only looking for Functions in class names that contain ‘.functions.’ and don’t contain ‘.gui.’
Bug 43379 - Switch Controller now supports selection by name as well as number
Can specify list of variable names to be written to JTL files (CSV and XML format)
Now checks that the remoteStart options -r and -R are only used with non_GUI -n option
Bug 44184 - Allow header to be saved with Aggregate Graph data
Added “Save Table Data” buttons to Aggregate and Summary Reports - save table as CSV format with header
Allow most functions to be used on the Test Plan. Note __evalVar(), __split() and __regex() cannot be used on the Test Plan.
Allow Global properties to be loaded from a file, e.g. -Gglobal.properties
Add “Substring” option to Response Assertion
Bug 44378 - Turkish localisation
Add optional output variable name to Jexl function
Add application/vnd.wap.xhtml+xml as a text type
Add means to override maximum display size in View Results Tree - set the property: view.results.tree.max_size
Use Tidy to display XML in View Results Tree Listener (avoids fetching DTDs)
Bug 44487 - German translation
As a special case, if the HTTP Sampler path starts with “http://” or “https://” then this is used as the full URL.
Bug 44575 - Result Saver can now save only successful results
Bug 44650 - CSV Dataset now handles quoted column values
Bug 44600 - 1-ms resolution timer when running with Java 1.5+
Bug 44632 - Text input enhancement to FTP Sampler
Bug 42204 - add thread group name to Aggregate and Summary reports
FTP Sampler sets latency = time to login
FTP Sampler sets a URL if it can
Bug 41921 - add option for samplers to store MD5 of response; done for HTTP Samplers.
Regex Function can now also be applied to a variable rather than just the previous sample result.
Remove HTML Parameter Mask,HTTP User Parameter Modifier from menus as they are deprecated
Bug 44807 - allow session ids to be terminated by backslash
Bug 44784 - allow for broken server returning additional charset
Added TESTSTART.MS property / variable = test start time in milliseconds
Add POP3S and IMAPS protocols to Mail Reader Sampler.
Mail Reader Sampler now creates a sub-sample for each mail.
The supplied TCPClient implementation no longer treats tcp.eolByte=0 as special. To skip EOL checking, set tcp.eolByte=1000 (or some other value which is not a valid byte)
JUnit sampler GUI now also finds Test classes defined in user.classpath
Leading and trailing spaces are trimmed from variable names in function calls. For example, ${__Random(1,63, LOTTERY )} will use the variable ‘LOTTERY’ rather than ’ LOTTERY ’
Webservice(SOAP) Sampler can now load local WSDL files using the file: protocol
Bug 44872 - Add “All Files” filter to Open File dialogs
Mirror server can now be run independently (mirror-server.cmd and mirror-server.sh)
Bug 19128 - Added multiple file POST support to HTTP Samplers
Allow use of special name LAST to mean the last test run; applies to -t, -l, -j flags
Bug 44418/42178 - CSV Dataset file handling improvements
Give BeanShell, Javascript and Jexl functions access to JMeter properties via the “props” object
Give BSF Sampler access to JMeter Properties via “props” object
Add Jexl as a supported BSF Sampler language
Give Beanshell test elements access to JMeter Properties via “props” object
Added BSF PreProcessor, PostProcessor and Assertion test elements
All BSF elements now have access to System.out via the variable “OUT”
Summariser updated to handle variable names
Synchronisation added to Summary and Aggregate Report to try to prevent occasional lost samples
Bug 44808,Bug 39641 - Proxy support for binary requests
Bug 28502 - HTTP Resource Cache

Non-functional changes

Better handling of MirrorServer startup problems and improved unit test.
Build process now detects missing 3rd party libraries and reports need for both binary and source archives
Skip BeanShell tests if jar is not present
Update to Xerces 2.9.1, Xalan 2.7.1, Commons IO 1.4, Commons Lang 2.4, Commons-Logging 1.1.1, XStream 1.3, XPP3 1.1.4c
Use properties for log/logn function descriptions
Check that all jmx files in the demos directory can be loaded OK
Update copyright to 2008; use copy tag instead of numeric character in HTML output
Methods called from constructors must not be overridable: make GUI init methods private
Make static variables final if possible
Split changes into current and previous

Version 2.3.1

Summary of changes

JMeter Proxy

The Proxy spoof function was broken in 2.3; it has been fixed. Spoof now supports an optional parameter to limit spoofing to particular URLs. This is useful for HTTPS pages that have insecure content - e.g. images/stylesheets may be accessed using HTTP. Spoofed responses now drop the default port (443) from https links to make them work better.

Ignored proxy samples are now visible in Listeners - the label is enclosed in [ and ] as an indication. Proxy documentation has been improved.

GUI changes

The Add menus show element types in the order in which they are processed

see Test Plan Execution Order. It is no longer possible to add test elements to inappropriate parts of the tree
e.g. samplers cannot be added directly under a test plan. This also applies to Paste and drag and drop.

The File menu now supports a “Revert” option, which reloads the current file. Also the last few file names used are remembered for easy reloading.

The Options Menu now supports Collapse All and Expand All items to collapse and expand the test tree.

Remote testing

The JMeter server now starts the RMI server directly (by default). This simplifies testing, and means that the RMI server will be stopped when the server stops.

Functions can now be used in Listener filenames (variables do not work).

Command-line option -G can now be used to define properties for remote servers. Option -X can be used to stop a remote server after a non-GUI run. Server can be set to automatically exit after a single test (set property server.exitaftertest=true).

Other enhancements

JMeter startup no longer loads as many classes; this should reduce memory requirements.

Parameter and file support added to all BeanShell elements. Javascript function now supports access to JMeter objects; Jexl function always did have access, but the documentation has now been included. New functions __eval() and __evalVar() for evaluating variables.

CSV files with the correct header column names are now automatically recognised when loaded. There is no need to configure the properties.

The hostname can now be saved in CSV and XML output files. New “Successes only” option added when saving result files. Errors / Successes only option is now supported when loading XML and CSV files.

General documentation improvements.

HTTP

PUT and DELETE should now work properly. Cookie Manager no longer clears manually entered cookies.

Now handles the META tag http-equiv charset

JDBC

JDBC Sampler now allows INOUT and OUT parameters for Called procedures. JDBC Sampler now allows per-thread connections - set Max Connections = 0 in JDBC Config.

Incompatible changes

JMeter server now creates the RMI registry by default. If the RMI registry has already been started externally, this will generate a warning message, but the server will continue. This should not affect JMeter testing. However, if you are also using the RMI registry for other applications there may be problems. For example, when the JMeter server shuts down it will stop the RMI registry. Also user-written command files may need to be adjusted (the ones supplied with JMeter have been updated). To revert to the earlier behaviour, define the JMeter property: server.rmi.create=false.
The Proxy server removes If-Modified-Since and If-None-Match headers from generated Header Managers. To revert to the previous behaviour, define the property proxy.headers.remove with no value

Bug fixes

Bug 43430 - Count of active threads is incorrect for remote samples
Throughput Controller was not working for “all thread” counts
If a POST body is built from parameter values only, these are now encoded if the checkbox is set.
Bug 43584 - Assertion Failure Message contains a comma that is also used as the delimiter for CSV files
HTTP Mirror Server now always returns the exact same content, it used to return incorrect data if UTF-8 encoding was used for HTTP POST body, for example
Bug 43612 - HTTP PUT does not honor request parameters
Bug 43694 - ForEach Controller (empty collection processing error)
Bug 42012 - Variable Listener filenames do not get processed in remote tests. Filenames can now include function references; variable references do not work.
Ensure Listener nodes get own save configuration when copy-pasted
Correct Proxy Server include and exclude matching description - port and query are included, contrary to previously documented.
Aggregate Graph and Aggregate Report Column Header is KB/Sec; fixed the values to be KB rather than bytes
Fix SamplingStatCalculator so it no longer adds elapsed time to endTime, as this is handled by SampleResult. This corrects discrepancies between Summary Report and Aggregate Report throughput calculation.
Default HTTPSampleResult to ISO-8859-1 encoding
Fix default encoding for blank encoding
Fix Https spoofing (port problem) which was broken in 2.3
Fix HTTP (Java) sampler so http.java.sampler.retries means retries, i.e. does not include initial try
Fix SampleResult dataType checking to better detect TEXT documents

Improvements

Add run_gui Ant target, to package and then start the JMeter GUI from Ant
Add File→Revert to easily drop the current changes and reload the project file currently loaded
Bug 31366 - Remember recently opened file(s)
Bug 43351 - Add support for Parameters and script file to all BeanShell test elements
SaveService no longer needs to instantiate classes
New functions: __eval() and __evalVar()
Menu items now appear in execution order
Test Plan items can now only be dropped/pasted/merged into parts of the tree where they are allowed
Property Display to show the value of System and JMeter properties and allow them to be changed
Bug 43451 - Allow Regex Extractor to operate on Response Code/Message
JDBC Sampler now allows INOUT and OUT parameters for Called procedures
JDBC Sampler now allows per-thread connections
Cookie Manager not longer clears cookies defined in the GUI
HTTP Parameters without names are ignored (except for POST requests with no file)
“Save Selection As” added to main menu; now checks only item is selected
Test Plan now has Paste menu item (paste was already supported via ^V)
If the default delimiter does not work when loading a CSV file, guess the delimiter by analysing the header line.
Add optional “loopback” protocol for HttpClient sampler
HTTP Mirror Server now supports blocking waiting for more data to appear, if content-length header is present in request
HTTP Mirror Server GUI now has the Start and Stop buttons in a more visible place
Server mode now creates the RMI registry; to disable set the JMeter property server.rmi.create=false
HTTP Sampler now supports using MIME Type field to specify content-type request header when body is constructed from parameter values
Enable exit after a single server test - define JMeter property server.exitaftertest=true
Added -G option to set properties in remote servers
Added -X option to stop remote servers after non-GUI run
Bug 43485 - Ability to specify keep-alive on SOAP/XML-RPC request
Bug 43678 - Handle META tag http-equiv charset
Bug 42555 - [I18N] Proposed corrections for the french translation
Bug 43727 - Test Action does not support variables or functions
The Proxy server removes If-Modified-Since and If-None-Match headers from generated Header Managers by default. To change the list of removed headers, define the property proxy.headers.remove as a comma-separated list of headers to remove
The javaScript function now has access to JMeter variables and context etc. See JavaScript function
Use drop-down list for BSF Sampler language field
Add hostname to items that can be saved in CSV and XML output files.
Errors only flag is now supported when loading XML and CSV files
Ensure ResultCollector uses SaveService encoding
Proxy now rejects attempts to use it with https
Proxy spoofing can now use RE matching to determine which urls to spoof (useful if images are not https)
Proxy spoofing now drops the default HTTPS port (443) when converting https: links to http:
Add Successes Only logging and display
The JMeter log file name is formatted as a SimpleDateFormat (applied to the current date) if it contains paired single-quotes, .e.g. ’jmeter_‘yyyyMMddHHmmss’.log’
Added Collapse All and Expand All Option menu items
Allow optional definition of extra content-types that are viewable as text

Non-functional Improvements

Functor code tightened up; Functor can now be used with interfaces, as well as pre-defined targets and parameters.
Save graphics function now prompts before overwriting an existing file
Debug Sampler and Debug PostProcessor added.
Fixed up method names in Calculator and SamplingStatCalculator
Tidied up Listener documentation.

Version 2.3

Fixes since 2.3RC4

Bug fixes

Fix NPE in SampleResultConverter - XStream PrettyPrintWriter cannot handle nulls
If Java HTTP sampler sees null ResponseMessage, replace with HTTP header
Bug 43332 - 2.3RC4 does not clear Guis based on TestBean
Bug 42948 - Problems with Proxy gui table fields in Java 1.6
Fixup broken jmeter-server script
Bug 43364 - option to revert If Controller to pre 2.3RC3 behaviour
Bug 43449 - Statistical Remote mode does not handle Latency
Bug 43450 (partial fix) - Allow SampleCount and ErrorCount to be saved to/restored from files

Improvements

Add nameSpace option to XPath extractor
Add NULL parameter option to JDBC sampler
Add documentation links for Rhino and BeanShell to functions; clarify variables and properties
Ensure uncaught exceptions are logged
Look for user.properties and system.properties in JMeter bin directory if not found locally

Fixes since 2.3RC3

Fixed NPE in Summariser (bug introduced in 2.3RC3)
Fixed setup of proxy port (bug introduced in 2.3RC3)
Fixed errors when running non-GUI on a headless host (bug introduced in 2.3RC3)
Bug 43054 - SSLManager causes stress tests to saturate and crash (bug introduced in 2.3RC3)
Clarified HTTP Request Defaults usage of the port field
Bug 43006 - NPE if icon.properties file not found
Bug 42918 - Size Assertion now treats an empty response as having zero length
Bug 43007 - Test ends before all threadgroups started
Fix possible NPE in HTTPSampler2 if 302 does not have Location header.
Bug 42919 - Failure Message blank in CSV output [now records first non-blank message]
Add link to Extending JMeter PDF
Allow for quoted charset in Content-Type parsing
Bug 39792 - ClientJMeter synchronisation needed
Bug 43122 - GUI changes not always picked up when short-cut keys used (bug introduced in 2.3RC3)
Bug 42947 - TestBeanGUI changes not picked up when short-cut keys used
Added serializer.jar (needed for update to xalan 2.7.0)
Bug 38687 - Module controller does not work in non-GUI mode

Improvements since 2.3RC3

Add stop thread option to CSV Dataset
Updated commons-httpclient to 3.1
Bug 28715 - allow variable cookie values (set CookieManager.allow_variable_cookies=false to disable)
Bug 40873 - add JMS point-to-point non-persistent delivery option
Bug 43283 - Save action adds .jmx if not present; checks for existing file on Save As
Control + A key does not work for Save All As; changed to Control + Shift + S
Bug 40991 - Allow Assertions to check Headers

Version 2.3RC3

Known problems/restrictions:

The JMeter remote server does not support multiple concurrent tests - each remote test should be run in a separate server. Otherwise tests may fail with random Exceptions, e.g. ConcurrentModification Exception in StandardJMeterEngine. See Bug 43168.

The default HTTP Request (not HTTPClient) sampler may not work for HTTPS connections via a proxy. This appears to be due to a Java bug, see Bug 39337. To avoid the problem, try a more recent version of Java, or switch to the HTTPClient version of the HTTP Request sampler.

Transaction Controller parent mode does not support nested Transaction Controllers. Doing so may cause a Null Pointer Exception in TestCompiler.

Thread active counts are always zero in CSV and XML files when running remote tests.

The property file_format.testlog=2.1 is treated the same as 2.2. However JMeter does honour the 3 testplan versions.

Bug 22510 - JMeter always uses the first entry in the keystore.

Remote mode does not work if JMeter is installed in a directory where the path name contains spaces.

BeanShell test elements leak memory. This can be reduced by using a file instead of including the script in the test element.

Variables and functions do not work in Listeners in client-server (remote) mode so they cannot be used to name log files in client-server mode.

CSV Dataset variables are defined after configuration processing is completed, so they cannot be used for other configuration items such as JDBC Config. (see Bug 40394)

Summary of changes (for more details, see below)

Some of the main enhancements are:

Htmlparser 2.0 now used for parsing
HTTP Authorization now supports domain and realm
HttpClient options can be specified via httpclient.parameters file
HttpClient now behaves the same as Java Http for SSL certificates
HTTP Mirror Server to allow local testing of HTTP samplers
HTTP Proxy supports XML-RPC recording, and other proxy improvements
__V() function allows support of nested variable references
LDAP Ext sampler optionally parses result sets and supports secure mode
FTP Sampler supports Ascii/Binary mode and upload
Transaction Controller now optionally generates a Sample with subresults
HTTPS session contexts are now per-thread, rather than shared. This gives better emulation of multiple users
BeanShell elements now support ThreadListener and TestListener interfaces
Coloured icons in Tree View Listener and elsewhere to better differentiate failed samples.

The main bug fixes are:

HTTPS (SSL) handling now much improved
Various Remote mode bugs fixed
Control + C and Control + V now work in the test tree
Latency and Encoding now available in CSV log output
Test elements no longer default to previous contents; test elements no longer cleared when changing language.

Incompatible changes (usage):

N.B. The javax.net.ssl properties have been moved from jmeter.properties to system.properties, and will no longer work if defined in jmeter.properties.

The new arrangement is more flexible, as it allows arbitrary system properties to be defined.

SSL session contexts are now created per-thread, rather than being shared. This generates a more realistic load for HTTPS tests. The change is likely to slow down tests with many SSL threads. The original behaviour can be enabled by setting the JMeter property:

https.sessioncontext.shared=true

The LDAP Extended Sampler now uses the same panel for both Thread Bind and Single-Bind tests. This means that any tests using the Single-bind test will need to be updated to set the username and password.

Bug 41140: JMeterThread behaviour was changed so that PostProcessors are run in forward order (as they appear in the test plan) rather than reverse order as previously. The original behaviour can be restored by setting the following JMeter property:

jmeterthread.reversePostProcessors=true

The HTTP Authorization Manager now has extra columns for domain and realm, so the temporary work-round of using ’' and ‘@’ in the username to delimit the domain and realm has been removed.

Control + Z no longer used for Remote Start All - this now uses Control + Shift + R

HttpClient now uses pre-emptive authentication. This can be changed by setting the following:

jmeter.properties:
httpclient.parameters.file=httpclient.parameters

httpclient.parameters:
http.authentication.preemptive$Boolean=false

The port field in HTTP Request Defaults is no longer ignored for https samplers if it is set to 80.

Incompatible changes (development):

**N.B.**The clear() method was defined in the following interfaces: Clearable, JMeterGUIComponent and TestElement. The methods serve different purposes, so two of them were renamed: the Clearable method is now clearData() and the JMeterGUIComponent method is now clearGui(). 3rd party add-ons may need to be rebuilt.

Calculator and SamplingStatCalculator classes no longer provide any formatting of their data. Formatting should now be done using the jorphan.gui Renderer classes.

Removed deprecated method JMeterUtils.split() - use JOrphanUtils version instead.

Removed method saveUsingJPEGEncoder() from SaveGraphicsService. It was unused so far, and used the only Sun-specific class in JMeter.

New functionality/improvements:

Add Domain and Realm support to HTTP Authorization Manager
HttpClient now behaves the same as the JDK http sampler for invalid certificates etc
Added httpclient.parameters.file to allow HttpClient parameters to be defined
Bug 33964 - Http Requests can send a file as the entire post body if name/type are omitted
Bug 41705 - add content-encoding option to HTTP samplers for POST requests
Bug 40933,Bug 40945 - optional RE matching when retrieving embedded resource URLs
Bug 27780 - (patch 19936) create multipart/form-data HTTP request without uploading file
Bug 42098 - Use specified encoding for parameter values in HTTP GET
Bug 42506 - JMeter threads now use independent SSL sessions
Bug 41707 - HTTP Proxy XML-RPC support
Bug 41880 - Add content-type filtering to HTTP Proxy Server
Bug 41876 - Add more options to control what the HTTP Proxy generates
Bug 42158 - Improve support for multipart/form-data requests in HTTP Proxy server
Bug 42173 - Let HTTP Proxy handle encoding of request, and undecode parameter values
Bug 42674 - default to pre-emptive HTTP authorisation if not specified
Support “file” protocol in HTTP Samplers
Http Autoredirects are now enabled by default when creating new samplers
Bug 40103 - various LDAP enhancements
Bug 40369 - LDAP: Stable search results in sampler
Bug 40381 - LDAP: more descriptive strings
BeanShell Post-Processor no longer ignores samples with zero-length result data
Added beanshell.init.file property to run a BeanShell script at startup
Bug 39864 - BeanShell init files now found from current or bin directory
BeanShell elements now support ThreadListener and TestListener interfaces
BSF Sampler passes additional variables to the script
Added timeout for WebService (SOAP) Sampler
Bug 40825 - Add JDBC prepared statement support
Extend JDBC Sampler: Commit, Rollback, AutoCommit
Bug 41457 - Add TCP Sampler option to not re-use connections
Bug 41522 - Use JUnit sampler name in sample results
Bug 42223 - FTP Sampler can now upload files
Bug 40804 - Change Counter default to max = Long.MAX_VALUE
Use property jmeter.home (if present) to override user.dir when starting JMeter
New -j option to easily change jmeter log file
HTTP Mirror Server Workbench element
Bug 41253 - extend XPathExtractor to work with non-NodeList XPath expressions
Bug 42088 - Add XPath Assertion for booleans
Added __V variable function to resolve nested variable names
Bug 40369 - Equals Response Assertion
Bug 41704 - Allow charset encoding to be specified for CSV DataSet
Bug 41259 - Comment field added to all test elements
Add standard deviation to Summary Report
Bug 41873 - Add name to AssertionResult and display AssertionResult in ViewResultsFullVisualizer
Bug 36755 - Save XML test files with UTF-8 encoding
Use ISO date-time format for Tree View Listener (previously the year was not shown)
Improve loading of CSV files: if possible, use header to determine format; guess timestamp format if not milliseconds
Bug 41913 - TransactionController now creates samples as sub-samples of the transaction
Bug 42582 - JSON pretty printing in Tree View Listener
Bug 40099 - Enable use of object variable in ForEachController
Bug 39693 - View Result Table uses icon instead of check box
Bug 39717 - use icons in the results tree
Bug 42247 - improve HCI
Allow user to cancel out of Close dialogue

Non-functional improvements:

Functor calls can now be unit tested
Replace com.sun.net classes with javax.net
Extract external jar definitions into build.properties file
Use specific jar names in build classpaths so errors are detected sooner
Tidied up ORO calls; now only one cache, size given by oro.patterncache.size, default 1000
Bug 42326 - Order of elements in .jmx files changes

External jar updates:

Htmlparser 2.0-20060923
xstream 1.2.1/xpp3_min-1.1.3.4.O
Batik 1.6
BSF 2.4.0
commons-collections 3.2
commons-httpclient-3.1-rc1
commons-jexl 1.1
commons-lang-2.3 (added)
JUnit 3.8.2
velocity 1.5
commons-io 1.3.1 (added)

Bug fixes:

Bug 39773 - NTLM now needs local host name - fix other call
Bug 40438 - setting “httpclient.localaddress” has no effect
Bug 40419 - Chinese messages translation fix
Bug 39861 - fix typo
Bug 40562 - redirects no longer invoke RE post processors
Bug 40451 - set label if not set by sampler
Fix NPE in CounterConfig.java in Remote mode
Bug 40791 - Calculator used by Summary Report
Bug 40772 - correctly parse missing fields in CSV log files
Bug 40773 - XML log file timestamp not parsed correctly
Bug 41029 - JMeter -t fails to close input JMX file
Bug 40954 - Statistical mode in distributed testing shows wrong results
Fix ClassCast Exception when using sampler that returns null, e..g TestAction
Bug 41140 - Post-processors are run in reverse order
Bug 41277 - add Latency and Encoding to CSV output
Bug 41414 - Mac OS X may add extra item to -jar classpath
Fix NPE when saving thread counts in remote testing
Bug 34261 - NPE in HtmlParser (allow for missing attributes)
Bug 40100 - check FileServer type before calling close
Bug 39887 - jmeter.util.SSLManager: Couldn’t load keystore error message
Bug 41543 - exception when webserver returns “500 Internal Server Error” and content-length is 0
Bug 41416 - don’t use chunked input for text-box input in SOAP-RPC sampler
Bug 39827 - SOAP Sampler content length for files
Fix Class cast exception in Clear.java
Bug 40383 - don’t set content-type if already set
Mailer Visualiser test button now works if test plan has not yet been saved
Bug 36959 - Shortcuts “ctrl c” and “ctrl v” don’t work on the tree elements
Bug 40696 - retrieve embedded resources from STYLE URL() attributes
Bug 41568 - Problem when running tests remotely when using a ‘Counter’
Fixed various classes that assumed timestamps were always end time stamps: - SamplingStatCalculator - JTLData - RunningSample
Bug 40325 - allow specification of proxyuser and proxypassword for WebServiceSampler
Change HttpClient proxy definition to use NTCredentials; added http.proxyDomain property for this
Bug 40371 - response assertion “pattern to test” scrollbar problem
Bug 40589 - Unescape XML entities in embedded URLs
Bug 41902 - NPE in HTTPSampler when responseCode = -1
Bug 41903 - ViewResultsFullVisualizer : status column looks bad when you do copy and paste
Bug 41837 - Parameter value corruption in proxy
Bug 41905 - Can’t cut/paste/select Header Manager fields in Java 1.6
Bug 41928 - Make all request headers sent by HTTP Request sampler appear in sample result
Bug 41944 - Subresults not handled recursively by ResultSaver
Bug 42022 - HTTPSampler does not allow multiple headers of same name
Bug 42019 - Content type not stored in redirected HTTP request with subresults
Bug 42057 - connection can be null if method is null
Bug 41518 - JMeter changes the HTTP header Content Type for POST request
Bug 42156 - HTTPRequest HTTPClient incorrectly urlencodes parameter value in POST
Bug 42184 - Number of bytes for subsamples not added to sample when sub samples are added
Bug 42185 - If a HTTP Sampler follows a redirect, and is set up to download images, then images are downloaded multiple times
Bug 39808 - Invalid redirect causes incorrect sample time
Bug 42267 - Concurrent GUI update failure in Proxy Recording
Bug 30120 - Name of simple controller is resetted if a new simple controller is added as child
Bug 41078 - merge results in name change of test plan
Bug 40077 - Creating new Elements copies values from Existing elements
Bug 42325 - Implement the “clear” method for the LogicControllers
Bug 25441 - TestPlan changes sometimes detected incorrectly (isDirty)
Bug 39734 - Listeners shared after copy/paste operation
Bug 40851 - Loop controller with 0 iterations, stops evaluating the iterations field
Bug 24684 - remote startup problems if spaces in the path of the jmeter
Use Listener configuration when loading CSV data files
Function methods setParameters() need to be synchronized
Fix CLI long optional argument to require “=” (as for short options)
Fix SlowSocket to work properly with Httpclient (both http and https)
Bug 41612 - Loop nested in If Controller behaves erratically
Bug 42232 - changing language clears UDV contents
Jexl function did not allow variables

Version 2.2

Incompatible changes:

The time stamp is now set to the sampler start time (it was the end). To revert to the previous behaviour, change the property sampleresult.timestamp.start to false (or comment it)

The JMX output format has been simplified and files are not backwards compatible

The JMeter.BAT file no longer changes directory to JMeter home, but runs from the current working directory. The jmeter-n.bat and jmeter-t.bat files change to the directory containing the input file.

Listeners are now started slightly later in order to allow variable names to be used. This may cause some problems; if so define the following in jmeter.properties:

jmeterengine.startlistenerslater=false

The GUI now expands the tree by default when loading a test plan. This can be disabled by setting the JMeter property onload.expandtree=false

Known problems:

Post-processors run in reverse order (see Bug 41140)
Module Controller does not work in non-GUI mode
Aggregate Report and some other listeners use increasing amounts of memory as a test progresses
Does not always handle non-default encoding properly
Spaces in the installation path cause problems for client-server mode
Change of Language does not propagate to all test elements
SamplingStatCalculator keeps a List of all samples for calculation purposes; this can cause memory exhaustion in long-running tests
Does not properly handle server certificates if they are expired or not installed locally

New functionality:

Report function
XPath Extractor Post-Processor. Handles single and multiple matches.
Simpler JMX file format (2.2)
BeanshellSampler code can update ResponseData directly
Bug 37490 - Allow UDV as delay in Duration Assertion
Slow connection emulation for HttpClient
Enhanced JUnitSampler so that by default assert errors and exceptions are not appended to the error message. Users must explicitly check append in the sampler
Enhanced the documentation for webservice sampler to explain how it works with CSVDataSet
Enhanced the documentation for javascript function to explain escaping comma
Allow CSV Data Set file names to be absolute
Report Tree compiler errors better
Don’t reset Regex Extractor variable if default is empty
includecontroller.prefix property added
Regular Expression Extractor sets group count
Can now save entire screen as an image, not just the right-hand pane
Bug 38901 - Add optional SOAPAction header to SOAP Sampler
New BeanShell test elements: Timer, PreProcessor, PostProcessor, Listener
__split() function now clears next variable, so it can be used with ForEach Controller
Bug 38682 - add CallableStatement functionality to JDBC Sampler
Make it easier to change the RMI/Server port
Add property jmeter.save.saveservice.xml_pi to provide optional xml processing instruction in JTL files
Add bytes and URL to items that can be saved in sample log files (XML and CSV)
The Post-Processor “Save Responses to a File” now saves the generated file name with the sample, and the file name can be included in the sample log file.
Change jmeter.bat DOS script so it works from any directory
New -N option to define nonProxyHosts from command-line
New -S option to define system properties from input file
Bug 26136 - allow configuration of local address
Expand tree by default when loading a test plan - can be disabled by setting property onload.expandtree=false
Bug 11843 - URL Rewriter can now cache the session id
Counter Pre-Processor now supports formatted numbers
Add support for HEAD PUT OPTIONS TRACE and DELETE methods
Allow default HTTP implementation to be changed
Optionally save active thread counts (group and all) to result files
Variables/functions can now be used in Listener file names
New __time() function; define START.MS/START.YMD/START.HMS properties and variables
Add Thread Name to Tree and Table Views
Add debug functions: What class, debug on, debug off
Non-caching Calculator - used by Table Visualiser to reduce memory footprint
Summary Report - similar to Aggregate Report, but uses less memory
Bug 39580 - recycle option for CSV Dataset
Bug 37652 - support for Ajp Tomcat protocol
Bug 39626 - Loading SOAP/XML-RPC requests from file
Bug 39652 - Allow truncation of labels on AxisGraph
Allow use of htmlparser 1.6
Bug 39656 - always use SOAP action if it is provided
Automatically include properties from user.properties file
Add __jexl() function - evaluates Commons JEXL expressions
Optionally load JMeter properties from user.properties and system properties from system.properties.
Bug 39707 - allow Regex match against URL
Add start time to Table Visualiser
HTTP Samplers can now extract embedded resources for any required media types

Bug fixes:

Fix NPE when no module selected in Module Controller
Fix NPE in XStream when no ResponseData present
Remove ?xml prefix when running with Java 1.5 and no x-jars
Bug 37117 - setProperty() function should return “”; added optional return of original setting
Fix CSV output time format
Bug 37140 - handle encoding better in RegexFunction
Load all cookies, not just the first; fix class cast exception
Fix default Cookie path name (remove page name)
Fixed resultcode attribute name
Bug 36898 - apply encoding to RegexExtractor
Add properties for saving subresults, assertions, latency, samplerData, responseHeaders, requestHeaders & encoding
Bug 37705 - Synch Timer now works OK after run is stopped
Bug 37716 - Proxy request now handles file Post correctly
HttpClient Sampler now saves latency
Fix NPE when using JavaScript function on Test Plan
Fix Base Href parsing in htmlparser
Bug 38256 - handle cookie with no path
Bug 38391 - use long when accumulating timer delays
Bug 38554 - Random function now uses long numbers
Bug 35224 - allow duplicate attributes for LDAP sampler
Bug 38693 - Webservice sampler can now use https protocol
Bug 38646 - Regex Extractor now clears old variables on match failure
Bug 38640 - fix WebService Sampler pooling
Bug 38474 - HTML Link Parser doesn’t follow frame links
Bug 36430 - Counter now uses long rather than int to increase the range
Bug 38302 - fix XPath function
Bug 38748 - JDBC DataSourceElement fails with remote testing
Bug 38902 - sometimes -1 seems to be returned unnecessarily for response code
Bug 38840 - make XML Assertion thread-safe
Bug 38681 - Include controller now works in non-GUI mode
Add write(OS,IS) implementation to TCPClientImpl
Sample Result converter saves response code as “rc”. Previously it saved as “rs” but read with “rc”; it will now also read with “rc”. The XSL stylesheets also now accept either “rc” or “rs”
Fix counter function so each counter instance is independent (previously the per-user counters were shared between instances of the function)
Fix TestBean Examples so that they work
Fix JTidy parser so it does not skip body tags with background images
Fix HtmlParser parser so it catches all background images
Bug 39252 set SoapSampler sample result from XML data
Bug 38694 - WebServiceSampler not setting data encoding correctly
Result Collector now closes input files read by listeners
Bug 25505 - First HTTP sampling fails with “HTTPS hostname wrong: should be ‘localhost’”
Bug 25236 - remove double scrollbar from Assertion Result Listener
Bug 38234 - Graph Listener divide by zero problem
Bug 38824 - clarify behaviour of Ignore Status
Bug 38250 - jmeter.properties “language” now supports country suffix, for zh_CN and zh_TW etc
jmeter.properties file is now closed after it has been read
Bug 39533 - StatCalculator added wrong items
Bug 39599 - ConcurrentModificationException
HTTPSampler2 now handles Auto and Follow redirects correctly
Bug 29481 - fix reloading sample results so subresults not counted twice
Bug 30267 - handle AutoRedirects properly
Bug 39677 - allow for space in JMETER_BIN variable
Use Commons HttpClient cookie parsing and management. Fix various problems with cookie handling.
Bug 39773 - NTCredentials needs host name

Other changes

Updated to HTTPClient 3.0 (from 2.0)
Updated to Commons Collections 3.1
Improved formatting of Request Data in Tree View
Expanded user documentation
Added MANIFEST, NOTICE and LICENSE to all jars
Extract htmlparser interface into separate jarfile to make it possible to replace the parser
Removed SQL Config GUI as no longer needed (or working!)
HTTPSampler no longer logs a warning for Page not found (404)
StringFromFile now callable as __StringFromFile (as well as _StringFromFile)
Updated to Commons Logging 1.1

Version 2.1.1

New functionality:

New Include Controller allows a test plan to reference an external jmx file
New JUnitSampler added for using JUnit Test classes
New Aggregate Graph listener is capable of graphing aggregate statistics
Can provide additional classpath entries using the property user.classpath and on the Test Plan element

Bug fixes:

AccessLog Sampler and JDBC test elements populated correctly from 2.0 test plans
BSF Sampler now populates filename and parameters from saved test plan
Bug 36500 - handle missing data more gracefully in WebServiceSampler
Bug 35546 - add merge to right-click menu
Bug 36642 - Summariser stopped working in 2.1
Bug 36618 - CSV header line did not match saved data
JMeter should now run under JVM 1.3 (but does not build with 1.3)

Version 2.1

New functionality:

New Test Script file format - smaller, more compact, more readable
New Sample Result file format - smaller, more compact
XSchema Assertion
XML Tree display
CSV DataSet Config item
New JDBC Connection Pool Config Element
Synchronisation Timer
setProperty function
Save response data on error
Ant JMeter XSLT now optionally shows failed responses and has internal links
Allow JavaScript variable name to be omitted
Changed following Samplers to set sample label from sampler name
All Test elements can be saved as a graphics image to a file
Bug 35026 - add RE pattern matching to Proxy
Bug 34739 - Enhance constant Throughput timer
Bug 25052 - use response encoding to create comparison string in Response Assertion
New optional icons
Allow icons to be defined via property files
New stylesheets for 2.1 format XML test output
Save samplers, config element and listeners as PNG
Enhanced support for WSDL processing
New JMS sampler for topic and queue messages
How-to for JMS samplers
Bug 35525 - Added Spanish localisation
Bug 30379 - allow server.rmi.port to be overridden
enhanced the monitor listener to save the calculated stats
Functions and variables now work at top level of test plan

Bug fixes:

Bug 34586 - XPath always remained as /
BeanShellInterpreter did not handle null objects properly
Fix Chinese resource bundle names
Save field names if required to CSV files
Ensure XML file is closed
Correct icons now displayed for TestBean components
Allow for missing optional jar(s) in creating menus
Changed Samplers to set sample label from sampler name as was the case for HTTP
Fix various samplers to avoid NPEs when incomplete data is provided
Fix Cookie Manager to use seconds; add debug
Bug 35067 - set up filename when using -t option
Don’t substitute TestElement.* properties by UDVs in Proxy
Bug 35065 - don’t save old extensions in File Saver
Bug 25413 - don’t enable Restart button unnecessarily
Bug 35059 - Runtime Controller stopped working
Clear up any left-over connections created by LDAP Extended Sampler
Bug 23248 - module controller didn’t remember stuff between save and reload
Fix Chinese locales
Bug 29920 - change default locale if necessary to ensure default properties are picked up when English is selected.
Bug fixes for Tomcat monitor captions
Fixed webservice sampler so it works with user defined variables
Fixed screen borders for LDAP config GUI elements
Bug 31184 - make sure encoding is specified in JDBC sampler
TCP sampler - only share sockets with same host:port details; correct the manual
Extract src attribute for embed tags in JTidy and Html Parsers

Version 2.0.3

New functionality:

XPath Assertion and XPath Function
Switch Controller
ForEach Controller can now loop through sets of groups
Allow CSVRead delimiter to be changed (see jmeter.properties)
Bug 33920 - allow additional property files
Bug 33845 - allow direct override of Home dir

Bug fixes:

Regex Extractor nested constant not put in correct place Bug 32395
Start time reset to now if necessary so that delay works OK.
Missing start/end times in scheduler are assumed to be now, not 1970
Bug 28661 - 304 responses not appearing in listeners
DOS scripts now handle different disks better
Bug 32345 - HTTP Rewriter does not work with HTTP Request default
Catch Runtime Exceptions so an error in one Listener does not affect others
Bug 33467 - __threadNum() extracted number wrongly
Bug 29186,33299 - fix CLI parsing of “-” in second argument
Fix CLI parse bug: -D arg1=arg2. Log more startup parameters.
Fix JTidy and HTMLParser parsers to handle form src= and link rel=stylesheet
JMeterThread now logs Errors to jmeter.log which were appearing on console
Ensure WhileController condition is dynamically checked
Bug 32790 ensure If Controller condition is re-evaluated each time
Bug 30266 - document how to display proxy recording responses
Bug 33921 - merge should not change file name
Close file now gives chance to save changes
Bug 33559 - fixes to Runtime Controller

Other changes:

To help with variable evaluation, JMeterThread sets “sampling started” a bit earlier (see jmeter.properties)
Bug 33796 - delete cookies with null/empty values
Better checking of parameter count in JavaScript function
Thread Group now defaults to 1 loop instead of forever
All Beanshell access is now via a single class; only need BSH jar at run-time
Bug 32464 - document Direct Draw settings in jmeter.bat
Bug 33919 - increase Counter field sizes
Bug 32252 - ForEach was not initialising counters

Version 2.0.2

New functionality:

While Controller
BeanShell initialisation scripts
Result Saver can optionally save failed results only
Display as HTML has option not to download frames and images etc
Multiple Tree elements can now be enabled/disabled/copied/pasted at once
__split() function added
Bug 28699 allow Assertion to regard unsuccessful responses - e.g. 404 - as successful
Bug 29075 Regex Extractor can now extract data out of http response header as well as the body
__log() functions can now write to stdout and stderr
URL Modifier can now optionally ignore query parameters

Bug fixes:

If controller now works after the first false condition Bug 31390
Regex GUI was losing track of Header/Body checkbox Bug 29853
Display as HTML now handles frames and relative images
Right-click open replaced by merge
Fix some drag and drop problems
Fixed foreach demo example so it works
Bug 30741 SSL password prompt now works again
StringFromFile now closes files at end of test; start and end now optional as intended
Bug 31342 Fixed text of SOAP Sampler headers
Proxy must now be stopped before it can be removed Bug 25145
Link Parser now supports BASE href Bug 25490
Bug 30917 Classfinder ignores duplicate names
Bug 22820 Allow Counter value to be cleared
Bug 28230 Fix NPE in HTTP Sampler retrieving embedded resources
Improve handling of StopTest; catch and log some more errors
ForEach Controller no longer runs any samples if first variable is not defined
Bug 28663 NPE in remote JDBC execution
Bug 30110 Deadlock in stopTest processing
Bug 31696 Duration not working correctly when using Scheduler
JMeterContext now uses ThreadLocal - should fix some potential NPE errors

Version 2.0.1

Bug fix release. TBA.

Version 2.0

HTML parsing improved; now has choice of 3 parsers, and most embedded elements can now be detected and downloaded.
Redirects can now be delegated to URLConnection by defining the JMeter property HTTPSamper.delegateRedirects=true (default is false)
Stop Thread and Stop Test methods added for Samplers and Assertions etc. Samplers can call setStopThread(true) or setStopTest(true) if they detect an error that needs to stop the thread of the test after the sample has been processed
Thread Group Gui now has an extra pane to specify what happens after a Sampler error: Continue (as now), Stop Thread or Stop Test. This needs to be extended to a lower level at some stage.
Added Shutdown to Run Menu. This is the same as Stop except that it lets the Threads finish normally (i.e. after the next sample has been completed)
Remote samples can be cached until the end of a test by defining the property hold_samples=true when running the server. More work is needed to be able to control this from the GUI
Proxy server has option to skip recording browser headers
Proxy restart works better (stop waits for daemon to finish)
Scheduler ignores start if it has already passed
Scheduler now has delay function
added Summariser test element (mainly for non-GUI) testing. This prints summary statistics to System.out and/or the log file every so often (3 minutes by default). Multiple summarisers can be used; samples are accumulated by summariser name.
Extra Proxy Server options: Create all samplers with keep-alive disabled Add Separator markers between sets of samples Add Response Assertion to first sampler in each set
Test Plan has a comment field
Help Page can now be pushed to background
Separate Function help page
New / amended functions
New / amended Assertions
If Controller (not fully functional yet)
Transaction Controller (aggregates the times of its children)
New Samplers
Optionally start BeanShell server (allows remote access to JMeter variables and methods)

Version 1.9.1

TBA

Version 1.9

Sample result log files can now be in CSV or XML format
New Event model for notification of iteration events during test plan run
New Javascript function for executing arbitrary javascript statements
Many GUI improvements
New Pre-processors and Post-processors replace Modifiers and Response-Based Modifiers.
Compatible with jdk1.3
JMeter functions are now fully recursive and universal (can use functions as parameters to functions)
Integrated help window now supports hypertext links
New Random Function
New XML Assertion
New LDAP Sampler (alpha code)
New Ant Task to run JMeter (in extras folder)
New Java Sampler test implementation (to assist developers)
More efficient use of memory, faster loading of .jmx files
New SOAP Sampler (alpha code)
New Median calculation in Graph Results visualizer
Default config element added for developer benefit
Various performance enhancements during test run
New Simple File recorder for minimal GUI overhead during test run
New Function: StringFromFile - grabs values from a file
New Function: CSVRead - grabs multiple values from a file
Functions now longer need to be encoded - special values should be escaped with “" if they are literal values
New cut/copy/paste functionality
SSL testing should work with less user-fudging, and in non-gui mode
Mailer Model works in non-gui mode
New Throughput Controller
New Module Controller
Tests can now be scheduled to run from a certain time till a certain time
Remote JMeter servers can be started from a non-gui client. Also, in gui mode, all remote servers can be started with a single click
ThreadGroups can now be run either serially or in parallel (default)
New command line options to override properties
New Size Assertion

Version 1.8.1

Bug Fix Release. Many bugs were fixed.
Removed redundant “Root” node from test tree.
Re-introduced Icons in test tree.
Some re-organization of code to improve build process.
View Results Tree has added option to view results as web document (still buggy at this point).
New Total line in Aggregate Listener (still buggy at this point).
Improvements to ability to change JMeter’s Locale settings.
Improvements to SSL Manager.

Version 1.8

Improvement to Aggregate report’s calculations.
Simplified application logging.
New Duration Assertion.
Fixed and improved Mailer Visualizer.
Improvements to HTTP Sampler’s recovery of resources (sockets and file handles).
Improving JMeter’s internal handling of test start/stop.
Fixing and adding options to behavior of Interleave and Random Controllers.
New Counter config element.
New User Parameters config element.
Improved performance of file opener.
Functions and other elements can access global variables.
Help system available within JMeter’s GUI.
Test Elements can be disabled.
Language/Locale can be changed while running JMeter (mostly).
View Results Tree can be configured to record only errors.
Various bug fixes.

Version 1.7.3

New Functions that provide more ability to change requests dynamically during test runs.
New language translations in Japanese and German.
Removed annoying Log4J error messages.
Improved support for loading JMeter 1.7 version test plan files (.jmx files).
JMeter now supports proxy servers that require username/password authentication.
Dialog box indicating test stopping doesn’t hang JMeter on problems with stopping test.
GUI can run multiple remote JMeter servers (fixes GUI bug that prevented this).
Dialog box to help created function calls in GUI.
New Keep-alive switch in HTTP Requests to indicate JMeter should or should not use Keep-Alive for sockets.
HTTP Post requests can have GET style arguments in Path field. Proxy records them correctly now.
New User-defined test-wide static variables.
View Results Tree now displays more information, including name of request (matching the name in the test tree) and full request and POST data.
Removed obsolete View Results Visualizer (use View Results Tree instead).
Performance enhancements.
Memory use enhancements.
Graph visualizer GUI improvements.
Updates and fixes to Mailer Visualizer.

Version 1.7.2

JMeter now notifies user when test has stopped running.
HTTP Proxy server records HTTP Requests with re-direct turned off.
HTTP Requests can be instructed to either follow redirects or ignore them.
Various GUI improvements.
New Random Controller.
New SOAP/XML-RPC Sampler.

Version 1.7.1

JMeter’s architecture revamped for a more complete separation between GUI code and test engine code.
Use of Avalon code to save test plans to XML as Configuration Objects
All listeners can save data to file and load same data at later date.

Version 1.7Beta

Better XML support for special characters (Tushar Bhatia)
Non-GUI functioning & Non-GUI test plan execution (Tushar Bhatia)
Removing Swing dependence from base JMeter classes
Internationalization (Takashi Okamoto)
AllTests bug fix (neth6@atozasia.com)
ClassFinder bug fix (neth6@atozasia.com)
New Loop Controller
Proxy Server records HTTP samples from browser (and documented in the user manual)
Multipart Form support
HTTP Header class for Header customization
Extracting HTTP Header information from responses (Jamie Davidson)
Mailer Visualizer re-added to JMeter
JMeter now url encodes parameter names and values
listeners no longer give exceptions if their gui’s haven’t been initialized
HTTPS and Authorization working together
New Http sampling that automatically parses HTML response for images to download, and includes the downloading of these images in total time for request (Neth neth6@atozasia.com)
HTTP responses from server can be parsed for links and forms, and dynamic data can be extracted and added to test samples at run-time (documented)
New Ramp-up feature (Jonathan O’Keefe)
New visualizers (Neth)
New Assertions for functional testing

Version 1.6.1

Fixed saving and loading of test scripts (no more extra lines)
Can save and load special characters (such as “&” and “<”).
Can save and load timers and listeners.
Minor bug fix for cookies (if you cookie value contained an “=”, then it broke).
URL’s can sample ports other than 80, and can test HTTPS, provided you have the necessary jars (JSSE)

Version 1.6 Alpha

New UI
Separation of GUI and Logic code
New Plug-in framework for new modules
Enhanced performance
Layering of test logic for greater flexibility
Added support for saving of test elements
Added support for distributed testing using a single client

Version 1.5.1

Fixed bug that caused cookies not to be read if header name case not as expected.
Clone entries before sending to sampler - prevents relocations from messing up information across threads
Minor bug fix to convenience dialog for adding parameters to test sample. Bug prevented entries in dialog from appearing in test sample.
Added xerces.jar to distribution
Added junit.jar to distribution and created a few tests.
Started work on new framework. New files in cvs, but do not effect program yet.
Fixed bug that prevent HTTPJMeterThread from delaying according to chosen timer.

Version 1.5

Abstracted out the concept of the Sampler, SamplerController, and TestSample. A Sampler represents code that understands a protocol (such as HTTP, or FTP, RMI, SMTP, etc..). It is the code that actually makes the connection to whatever is being tested. A SamplerController represents code that understands how to organize and run a group of test samples. It is what binds together a Sampler and its test samples and runs them. A TestSample represents code that understands how to gather information from the user about a particular test. For a website, it would represent a URL and any information to be sent with the URL.
The UI has been updated to make entering test samples more convenient.
Thread groups have been added, allowing a user to setup multiple test to run concurrently, and to allow sharing of test samples between those tests.
It is now possible to save and load test samples.
… and many more minor changes/improvements …

Apache JMeter 1.4.1-dev

Cleaned up URLSampler code after tons of patches for better readability. (SM)
Made JMeter send a special “user-agent” identifier. (SM)
Fixed problems with redirection not sending cookies and authentication info and removed a warning with jikes compilation. Thanks to Wesley Tanaka for the patches (SM)
Fixed a bug in the URLSampler that caused to skip one URL when testing lists of URLs and a problem with Cookie handling. Thanks to Graham Johnson for the patches (SM)
Fixed a problem with POST actions. Thanks to Stephen Schaub for the patch (SM)

Apache JMeter 1.4 - Jul 11 1999

Fixed a problem with POST actions. Thanks to Brendan Burns for the patch (SM)
Added close button to the About box for those window managers who don’t provide it. Thanks to Jan-Henrik Haukeland for pointing it out. (SM)
Added the simple Spline sample visualizer (JPN)

Apache JMeter 1.3 - Apr 16 1999
Run the Garbage Collector and run finalization before starting to sampling to ensure same state every time (SM)
Fixed some NullPointerExceptions here and there (SM)
Added HTTP authentication capabilities (RL)
Added windowed sample visualizer (SM)
Fixed stupid bug for command line arguments. Thanks to Jorge Bracer for pointing this out (SM)

Apache JMeter 1.2 - Mar 17 1999
Integrated cookie capabilities with JMeter (SM)
Added the Cookie manager and Netscape file parser (SD)
Fixed compilation error for JDK 1.1 (SD)

Apache JMeter 1.1 - Feb 24 1999

Created the opportunity to create URL aliasing from the properties file as well as the ability to associate aliases to URL sequences instead of single URLs (SM) Thanks to Simon Chatfield for the very nice suggestions and code examples.
Removed the TextVisualizer and replaced it with the much more useful FileVisualizer (SM)
Added the known bug list (SM)
Removed the Java Apache logo (SM)
Fixed a couple of typos (SM)
Added UNIX makefile (SD)

Apache JMeter 1.0.1 - Jan 25 1999

Removed pending issues doc issues (SM)
Fixed the unix script (SM)
Added the possibility of running the JAR directly using “java -jar ApacheJMeter.jar” with Java 2 (SM)
Some small updates: fixed Swing location after Java 2(tm) release, license update and small cleanups (SM)

Apache JMeter 1.0 - Dec 15 1998

Initial version. (SM)