Best Practice for Using Assessment Hierarchies in Operational Analysis

  • PDF / 508,409 Bytes
  • 12 Pages / 589.56 x 841.92 pts Page_size
  • 88 Downloads / 194 Views

DOWNLOAD

REPORT


In1h(

/ Il Ivw 2 ltii/ 'j,,,,' 2(1(1!

Best Practice for using Assessment Hierarchies in Operational Analysis princzples and' practical experiences

Graham Mathieson measures of system ls('I'torinchIlce into measures (il fbrcc cfh'ctivcncss. 'Ihn increasing challenge fbi Oí\ has been to study the clinctiveness of investments in

I7ie bedrock of liiiIital}' operational research for nianv 'ear.i of coudai mode/s to convert meas ores of

¡ccv been the use

yPu11 Pe?fance

¡lito

niemurro

of ¡die

eJfectivenesv.

Quantij5ing effectiveness ¡n i/ic context of oprrcutwns oilier 111(111

the context of operations othei' than war (OOI\\H,

War, (i/id takimn,' account of tile human (1/1(1 olgaflLvational

especially

has proved difficult ivvinç' corn u/jo/ial modelling techniques. 77ie need fer multiple measuo.v of merit and inn/tip/c dcciv ion cflterla mnakes the use of m'sessmnent

operation! inhumation system investments, taking account of the human and organisational elements of investment. 'I'his challenge has emphasised the

leerarclnes very attractive to iiard-pwvssd executives.

difficulty, if effectiveness

aspects,

There

Lv

a/so a trend, in these cost conscious tienes, to zvarit cheaper and decision-making,

from

requirements

capture,

in all of these application areas assessment hierarchies appear to of/er a relatively simple. highly visible and low cost means of through design

to

integrated operational and non-

not in

impossibility, o! quantifying these circumstances using

conventional modelling technic1ues. Consequently, the use of static scoring systems such as multi-criteria assessment hierarchies has blossomed.

more common GA too/s and mnelhodv across the fù/l range of investment

for

investment appraisal.

Command and Control (C2( prolslems, in l)rticlilvr,

thus

frequently require rich, in ulti -cli ru e n sional assessment, covering Isoth functional and nonfunctional aspects of systems. Decisions about

The relatively uncontrolled and unrigorous use of assevement combined with the seíf-reirfercing features of' fàcilitated judgensental inc/h ods, can lead to questionable advice to decision-,uakecv. Viant previous treatments of this subject have focussed on the details ofjudgemeni elicitation or mathematical manipulations, without fully addressing the

information technology investment need to be taken in the context of consequential organisational change. This introduces social and political issues,

assessing the value of comp/ex investments. However, appearance is dangerously deceptive.

hierarchies,

which have to be synthesised with the technical aspects of the problem to achieve an adec1uately balanced assessment. The need fbi' multiple measures of merit and multiple (often

lager issues of appropriateness and vaiidi/s. This paper wi/l discuss the principles and practice of the application of assessment hierarchies more rigorously. Drawing on recent stuqy experiences in the areas of Intelligence and Information stems, it wil/ distinguish between estimating effectiveness and valuing perfà