1
.. , .. , .. , ..
, . , , , , , . : , , . -, , , .
: , , ,

() : , , , (), (PBS/Torque, Cleo, .
. , , . (, , -, ), ( ), (, , ) .
, . , , . , ,
1 - 2014»
, - , , .
, . , Ganglia . - Nagios Zabbix , .
LAPTA [1], , . . , , , . , LAPTA . , , .
, , : - , , .
[2] , :
- ;
- ;
- , , ;
- (Ganglia, Nagios .);
- , (, Perl, Bash .);
- () ;
- , ;
- , ;
- ;
- , , ;
- .
1.
- () :
=< N , , , R, S > ,
:
- N - ;
- - () ;
- - ;
- - ;
- - ;
- 5 - .
:
- NM N - , , ;
- NT N - , ;
- NA N - ,
;
- - , , ;
- 5 5 - , , -
. . N - . - ( ). () = (()} - - , = 1, 2, .
[,] ,
:
1 (*) - (0) |< , V* [0, *1 ], V [1, ,],
- , .
() (), - .
[, ] , , , 5.
5 , . :
- ;
- , ni;
- , ni;
- ni ( , );
- ni ( , ).

, .
(Bi) , .
2.
( . 1):
- , , ;
- , ;
- , ;
- , ;
- , ;
- , .
, , . , , . , .
, , , [3], , , , .
Web-
(API) (CLI) (MS IE, Firefox, Safari)






-






REST

REST -

HTTP
- "\
+ REST-

I

I -
-
1
Apache -
I
I

PHP
XML-RPC
SQL/RRD. Y



~



7J

XML-RPC




RRD-



~


t ft
]

- -XML-RPC------------------------------------XML-RPC -

~





Sensors Ganglia GPU

» ~
I ~|

RRD-

f '

APC

Emerson

Humidity

. 1.
:
- , , , ;
- , ;
- , , , ;
- , .
, , , .
. , , . , , (, ) . ( ). , , . Ganglia (gmond) , ( 30 .), 37% . , Ganglia. , .
(, , .) SIGAR [4]. , ECMA Script [5] , , , .
, , ( , ), . - .

, . , , . , , . , , . , , .
. CLIPS [6], : , , ; , .
, : , , , .
, . , , , - . , , : ; ; , .
(Round Robin Database) - , . , .
, (MRTG, RRDtools .) , , , / .
SQLite RRDtools MRTG. , , XML. / , , -
, , . (RRDtools, MRTG).
, , , SQLite. SQLite , , .
, . , , .
- ( - ). , -, . -, -. -, -.
- : PHP - -, ( HTML5, JavaScript, Ajax, ExtJS, jQuery) -. ExtJS . 2.
. 2. () ()
. 3 [7] .. » () () . . 4 .
. 3.

Conditioners
UPS


12.0 tW 10.7 tW 13.3 tw 9.4 tW
. 12.0 tW 10.7 tW 13.3 tw 9.4 tW
21.3 20.9 21.3 22.2
, 20.1 ° 1. ° 20.0 ° 20.1 °
, 30.3 30.9 30.3 29.8
829 L/s 834 L/s 834 L/s 834 L/s
53.4% 53.9 % 53.9 % 53.9 %
Open Open Open Open
Closed Closed Closed Closed

0 5 17 15
54% 54% 56 % 57 %
0.85 L/s 0.81 L/s 0.88 L/s 0.76 L/s
6.2 6.2 5.9 6.7
. ' 9.6 ' .8 9.9 °
, . 22.2 22.2 22.2 22.2 °
20.0 ° 20.0 ° 20.0 ° 20.0 °

# Rating Current Power
1 16 16 16 1.1 0.0 1.2 0.21 tW 0.00 tw 0.22 tW
2 16 16 16 1.1 0.0 1.1 0.19 tW 0.00 tw 0.21 tW
3 32 32 32 15.8 9.4 13.7 8.38 tW
4 32 32 32 16.4 18.9 11.9 10.47 tW
5 32 32 32 15.8 16.6 15.7 10.65 tW
6 32 32 32 15.3 9.8 13.3 8.39 tW

. 4.
3.
[8] , , .
- :
- 2 Nvidia Tesla C1060 1920;
- 10 AMD Opteron 6276 320;
- 20 Intel Xeon 5345 160.

- , :
- (warning node node-4.blackford.icc.ru loadavg 43);
- (critical node node-13.blackford.icc.ru cpu-sys-p 77);
- (critical node node011.matrosov.icc.ru filesystem /store wtime 583816);
- (error node node-4.blackford.icc.ru available down).
- (warning node node-15.blackford.icc.ru memory-used-ten 81);
- (critical node node2.tesla.icc.ru memory-used-ten 92);
- (error node node-7.blackford.icc.ru filesystem /store du-free 0).
- , , , .
, Synedra acus MAKER [9] / . , , 30%.

, , , , . , -, , , -, . , , , , .
(-5007.2014.9).

1. , .. , / .. , .. , .. // : XI -. . - , 2011. - . 10-14.
2. , .. / .. , .. // : . XVIII . . - . III. - : - , 2013. - . 177-184.
3. Wooldridge, M. Intelligent Agents: Theory and Practice / M. Wooldridge, N. Jennings / / The Knowledge Engineering Review. - 1995. - Vol. 10, No 2. - P. 115-152.
4. System Information Gatherer and Reporter API. URL: http://www.hyperic.com/products/sigar ( : 08.04.2014).
5. Standard ECMA-262: ECMAScript Language Specification. URL: http://www.ecma-international.org/publications/standards/Ecma-262.htm ( : 08.04.2014)
6. , .. . CLIPS / . . , . . , . . . - -: -, 2003. - 393 c.
7. .. / .. , .. , .. / / : . - : - ,
2013. - C. 53.
8. . URL: http://hpc.icc.ru ( : 08.04.2014)
9. MAKER - genome annotation pipeline. URL: http://gmod.org/wiki/MAKER (
: 08.04.2014)
, ..., .., (, ), ivan.sidorov@icc.ru
, ..., . ., (, ), apn@icc.ru
, ..., ., . , (, ), oparin@icc.ru
, , (, ), skorov@icc.ru
10 2014 .
Bulletin of the South Ural State University Series Computational Mathematics and Software Engineering
2014, vol. 3, no. 2, pp. 30-42
METHODS AND TOOLS OF DISTRIBUTED COMPUTING SYSTEMS METAMONITORING
I.A. Sidorov, Institute for System Dynamics and Control Theory of the Siberian
Branch of the RAS (Irkutsk, Russian Federation)
A.P. Novopashin, Institute for System Dynamics and Control Theory of the Siberian Branch of the RAS (Irkutsk, Russian Federation)
G.A. Oparin, Institute for System Dynamics and Control Theory of the Siberian
Branch of the RAS (Irkutsk, Russian Federation)
V. V. Skorov, Institute for System Dynamics and Control Theory of the Siberian
Branch of the RAS (Irkutsk, Russian Federation)
This paper discusses the problems of monitoring a distributed computing environment that includes a lot of loosely-coupled heterogeneous computing resources. The principal distinctive feature and novelty aspect of the developed metamonitoring system first of all consists in creation of the universal software agents, capable to collect data about state of different environment components from local monitoring systems, to unify and analyze these data, and if necessary to generate and execute automatic control actions directed on changing equipment working mode, including the shutdown in case of emergencies. The approach is based on web-technologies and multi-agent technologies usage, methods of expert systems creation, methods of decentralized processing and the distributed storage of data.
Keywords: distributed computing systems, monitoring, multiagent technologies, expert systems
References
1. Adinets, A.V., Bryzgalov P.A., Voevodin V.V. Monitoring, analiz i visualizaciya potoka zadanii na klasternoi sisteme [Monitoring, analyze and visualization of tasks flow on cluster system]. Visokoproizvoditelnye parallelnye vichisleniya na klasternih sistemah [High-performance parallel computation on cluster systems].Nizhny Novgorod, 2011. P. 10-14.
2. Sidorov I.A., Skorov V.V. Odin iz podhodov k realizacii sredstv monitoringa visokopro-izvoditelnih vichislitelnih system [Approach to the monitoring system implementation for HPC clusters] Informacionnye I matematicheskie technologii v nauke I upravlenii [Informational and mathematical technologies in science and control]. Irkutsk, Publishing of MESI SB RAS, 2013. P. 177-184.
3. Wooldridge M., Jennings N. Intelligent Agents: Theory and Practice // The Knowledge Engineering Review, 1995. Vol. 10, No 2. P. 115-152.
4. System Information Gatherer and Reporter API. URL: http://www.hyperic.com/products/sigar (accessed: 08.04.2014).
5. Standard ECMA-262: ECMAScript Language Specification. URL: http://www.ecma-international.org/publications/standards/Ecma-262.htm ( : 08.04.2014)
6. Chastikov A.P, Belov D.L, Gavrilova T.A. Razrabotka ekspertnyh sistem. Sreda CLIPS [Developing of expert systems. CLIPS Toolkit]. Saint-Petersburg, 2003. 393 P.
7. Skorov V.V., Sidorov I.A., Novopashin A.P Redaktor graficheskogo predstavleniya ob-jectov injenernoi infrastructury vichislitelnogo tsentra [Editor of graphical representation of engineering infrastructure objects of HPC-center] / / Lyapunovskie chteniya [Lyapunov reading]. Irkutsk, Publishing at ISDCT SB RAS, 2013. P. 53.
8. Irkutsk supercomputer center URL: http://hpc.icc.ru (accessed: 08.04.2014)
9. MAKER - genome annotation pipeline. URL: http://gmod.org/wiki/MAKER (ac-
cessed: 08.04.2014)
Received 10 April 20-