This International Standard defines how user oriented performance of computer-based software systems (CBSS)<\/p>\n
may be measured and rated. A CBSS is a data processing system as it is seen by its users, e.g. by users at various<\/p>\n
terminals, or as it is seen by operational users and business users at the data processing center.<\/p>\n
A CBSS includes hardware and all its software (system software and application software) which is needed to<\/p>\n
realize the data processing functions required by the users or what may influence to the CBSS's time behaviour.<\/p>\n
This International Standard is applicable for tests of all time constrained systems or system parts. Also a network<\/p>\n
may be part of a system or may be the main subject of a test. The method defined in this International Standard is<\/p>\n
not limited to special cases like classic batch or terminal-host systems, e.g. also included are client server systems<\/p>\n
or, with a broader comprehension of the definition of ?task', real time systems. But the practicability of tests may be<\/p>\n
limited by the expenditure required to test large environments.<\/p>\n
This International Standard specifies the key figures of user oriented performance terms and specifies a method of<\/p>\n
measuring and rating these performance values. The specified performance values are those which describe the<\/p>\n
execution speed of user orders (tasks), namely the triple of:<\/p>\n
– execution time,<\/p>\n
– throughput,<\/p>\n
– timeliness.<\/p>\n
The user orders, subsequently called tasks, may be of simple or complex internal structure. A task may be a job,<\/p>\n
transaction, process or a more complex structure, but with a defined start and end depending on the needs of the<\/p>\n
evaluator. When evaluating the performance it is possible to use this International Standard for measuring the time<\/p>\n
behaviour with reference to business transaction completion times in addition to other individual response times.<\/p>\n
The rating is done with respect to users requirements or by comparing two or more measured systems (types or<\/p>\n
versions).<\/p>\n
Intentionally no proposals for measuring internal values, such as:<\/p>\n
– utilisation values,<\/p>\n
– mean instruction rates,<\/p>\n
– path lengths,<\/p>\n
– cache hit rates,<\/p>\n
– queuing times,<\/p>\n
– service times,<\/p>\n
<\/b><\/p>\n
are given, because the definition of internal values depends on the architecture of the hardware and the software of<\/p>\n
the system under test. Contrary to this the user oriented performance values which are defined in this International<\/p>\n
Standard are independent of architecture. The definition of internal performance values can be done independently<\/p>\n
from the definition of user oriented performance values. They may be used and can be measured in addition to the<\/p>\n
user oriented performance values. Also the definition of terms for the efficiency with which the user oriented values<\/p>\n
are produced can be done freely. In addition this International Standard gives guidance on how to establish at a<\/p>\n
data processing system a stable and reproducible state of operation. This reproducible state may be used to<\/p>\n
measure other performance values such as the above mentioned internal values.<\/p>\n
This International Standard focuses on:<\/p>\n
– application software;<\/p>\n
– system software;<\/p>\n
– turn-key systems (i.e. systems consisting of an application software, the system software and the<\/p>\n
hardware for which it was designed);<\/p>\n
– general data processing systems.<\/p>\n
This International Standard specifies the requirements for an emulation (by a technical system – the so-called<\/p>\n
remote terminal emulator (RTE) – of user interactions with a data processing system. It is the guideline for precisely<\/p>\n
measuring and rating the user oriented performance values. It provides the guideline for estimating these values<\/p>\n
with the required accuracy and repeatability of CBSSs with deterministic as well as random behaviour of users. It is<\/p>\n
also a guidance for implementing a RTE or proving whether it works according to this International Standard.<\/p>\n
This International Standard provides the guideline to measure and rate the performance of CBSS with random user<\/p>\n
behaviour when the accuracy and repeatability is required. It specifies in detail how to prepare and carry out the<\/p>\n
measurement procedure. Along with a description of the analysis of the measured values, the formulas for<\/p>\n
computing the performance value and the rating value, are provided.<\/p>\n
This International Standard also gives guidance on:<\/p>\n
– how to design a user oriented benchmark test using a:<\/p>\n
* transaction oriented workload,<\/p>\n
* batch oriented workload,<\/p>\n
* or transaction and batch mixed workload.<\/p>\n
It specifies:<\/p>\n
– how to describe such a workload,<\/p>\n
– how to perform the measurement procedure,<\/p>\n
– how to rate the measured results.<\/p>\n
This International Standard is of interest to:<\/p>\n
– evaluators,<\/p>\n
– developers,<\/p>\n
– buyers (including users of a data processing system),<\/p>\n
– system integrators<\/p>\n
of CBSSs.<\/p>\n
NOTE 1 The field of application of this International Standard may be extended to include the following aspects.<\/p>\n
Workloads fulfilling the specifications of this standard and having a sufficiently general structure may be used as standard<\/p>\n
workloads. They may be used to measure and rate performance of data processing systems used in specific fields. E.g. a<\/p>\n
standard workload for word-processing may be used to compare the time efficiency of different software products or<\/p>\n
different versions of the same product running on the same hardware system. Such a standard workload may also be<\/p>\n
used if always applying the same application software version and the same hardware to compare the efficiency of the<\/p>\n
system software. When applying the same application software and workload to different systems, consisting of hardware<\/p>\n
and system software, as normally sold by system vendors, the efficiency of the data processing systems may be<\/p>\n
compared with respect to the application and workload used.<\/p>\n","protected":false},"excerpt":{"rendered":"
Information technology \u2014 Measurement and rating of performance of computer-based software systems<\/b><\/p>\n\n\n
\n Published By<\/td>\n Publication Date<\/td>\n Number of Pages<\/td>\n<\/tr>\n \n ISO<\/b><\/a><\/td>\n 1999-11<\/td>\n 56<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n","protected":false},"featured_media":632850,"template":"","meta":{"rank_math_lock_modified_date":false,"ep_exclude_from_search":false},"product_cat":[665,2634],"product_tag":[],"class_list":{"0":"post-632837","1":"product","2":"type-product","3":"status-publish","4":"has-post-thumbnail","6":"product_cat-35-080","7":"product_cat-iso","9":"first","10":"instock","11":"sold-individually","12":"shipping-taxable","13":"purchasable","14":"product-type-simple"},"_links":{"self":[{"href":"https:\/\/pdfstandards.shop\/wp-json\/wp\/v2\/product\/632837","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/pdfstandards.shop\/wp-json\/wp\/v2\/product"}],"about":[{"href":"https:\/\/pdfstandards.shop\/wp-json\/wp\/v2\/types\/product"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/pdfstandards.shop\/wp-json\/wp\/v2\/media\/632850"}],"wp:attachment":[{"href":"https:\/\/pdfstandards.shop\/wp-json\/wp\/v2\/media?parent=632837"}],"wp:term":[{"taxonomy":"product_cat","embeddable":true,"href":"https:\/\/pdfstandards.shop\/wp-json\/wp\/v2\/product_cat?post=632837"},{"taxonomy":"product_tag","embeddable":true,"href":"https:\/\/pdfstandards.shop\/wp-json\/wp\/v2\/product_tag?post=632837"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}