starting mon.ldhfmi02 rank 0 at 10.97.4.84:6789/0 mon_data /var/lib/ceph/mon/nonfood-ldhfmi02 fsid d6e91ff1-9b43-4972-b7a7-a22d84497d78 2012-11-21 16:15:21.395394 7f7077b2d780 0 ceph version 0.54 (commit:60b84b095b1009a305d4d6a5b16f88571cbd3150), process ceph-mon, pid 13425 2012-11-21 16:15:21.395402 7f7077b2d780 1 store(/var/lib/ceph/mon/nonfood-ldhfmi02) mount 2012-11-21 16:15:21.398263 7f7077b2d780 1 mon.ldhfmi02@-1(probing) e3 init fsid d6e91ff1-9b43-4972-b7a7-a22d84497d78 2012-11-21 16:15:21.400109 7f7077b2d780 0 mon.ldhfmi02@-1(probing) e3 my rank is now 0 (was -1) 2012-11-21 16:15:21.402804 7f7071ed6700 0 log [INF] : mon.ldhfmi02 calling new monitor election 2012-11-21 16:15:26.400244 7f70716d5700 1 mon.ldhfmi02@0(electing) e3 discarding message auth(proto 0 26 bytes epoch 3) v1 and sending client elsewhere; we are not in quorum 2012-11-21 16:15:26.400339 7f70716d5700 1 mon.ldhfmi02@0(electing) e3 discarding message auth(proto 0 36 bytes epoch 3) v1 and sending client elsewhere; we are not in quorum 2012-11-21 16:15:26.618920 7f70716d5700 0 log [INF] : mon.ldhfmi02@0 won leader election with quorum 0,2 2012-11-21 16:15:26.864867 7f7071ed6700 0 log [INF] : pgmap v1708: 192 pgs: 50 active+clean, 140 active+remapped, 2 active+clean+scrubbing; 1000 MB data, 5177 MB used, 457 GB / 464 GB avail 2012-11-21 16:15:26.864900 7f7071ed6700 0 log [INF] : mdsmap e32: 1/1/1 up {0=hotcpc12533=up:active} 2012-11-21 16:15:26.865303 7f7071ed6700 0 log [INF] : osdmap e776: 3 osds: 3 up, 3 in 2012-11-21 16:15:26.865355 7f7071ed6700 0 log [INF] : monmap e3: 3 mons at {hotcpc12533=10.252.24.88:6789/0,hotcpc9039=10.252.24.25:6789/0,ldhfmi02=10.97.4.84:6789/0} 2012-11-21 16:15:27.033043 7f7071ed6700 0 cephx server mds.hotcpc12533: unexpected key: req.key=5f9c533cec61ba21 expected_key=e910546ae293f5a1 2012-11-21 16:15:28.564041 7f70706cc700 0 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2b2ed80 sd=20 :6789 pgs=0 cs=0 l=0).accept connect_seq 0 vs existing 0 state connecting 2012-11-21 16:15:28.716500 7f7071ed6700 0 log [INF] : mon.ldhfmi02 calling new monitor election 2012-11-21 16:15:30.726061 7f7071ed6700 0 log [INF] : mon.ldhfmi02@0 won leader election with quorum 0,1,2 2012-11-21 16:15:30.922263 7f7071ed6700 0 log [INF] : pgmap v1708: 192 pgs: 50 active+clean, 140 active+remapped, 2 active+clean+scrubbing; 1000 MB data, 5177 MB used, 457 GB / 464 GB avail 2012-11-21 16:15:30.922374 7f7071ed6700 0 log [INF] : mdsmap e32: 1/1/1 up {0=hotcpc12533=up:active} 2012-11-21 16:15:30.922919 7f7071ed6700 0 log [INF] : osdmap e776: 3 osds: 3 up, 3 in 2012-11-21 16:15:30.922973 7f7071ed6700 0 log [INF] : monmap e3: 3 mons at {hotcpc12533=10.252.24.88:6789/0,hotcpc9039=10.252.24.25:6789/0,ldhfmi02=10.97.4.84:6789/0} 2012-11-21 16:15:32.282821 7f70706cc700 0 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :50720 pgs=6 cs=1 l=0).fault with nothing to send, going to standby 2012-11-21 16:15:32.530250 7f7070bd1700 0 -- 10.97.4.84:6789/0 >> 10.252.24.88:6789/0 pipe(0x2a67900 sd=16 :43974 pgs=60779 cs=1 l=0).fault with nothing to send, going to standby ./osd/OSDMap.h: In function 'pg_t OSDMap::raw_pg_to_pg(pg_t) const' thread 7f7071ed6700 time 2012-11-21 16:15:32.533453 ./osd/OSDMap.h: 486: FAILED assert(pools.count(pg.pool())) ceph version 0.54 (commit:60b84b095b1009a305d4d6a5b16f88571cbd3150) 1: (PGMonitor::preprocess_command(MMonCommand*)+0xd60) [0x4eeba0] 2: (PGMonitor::preprocess_query(PaxosServiceMessage*)+0x2aa) [0x4ef85a] 3: (PaxosService::dispatch(PaxosServiceMessage*)+0x12d) [0x49e35d] 4: (Monitor::handle_command(MMonCommand*)+0x6f2) [0x47af22] 5: (Monitor::_ms_dispatch(Message*)+0x10ab) [0x48044b] 6: (Monitor::ms_dispatch(Message*)+0x7e) [0x491aee] 7: (DispatchQueue::entry()+0x6a9) [0x6267f9] 8: (DispatchQueue::DispatchThread::entry()+0xd) [0x62198d] 9: (()+0x68ca) [0x7f70771cd8ca] 10: (clone()+0x6d) [0x7f707611586d] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2012-11-21 16:15:32.533413 7f7071ed6700 0 mon.ldhfmi02@0(leader) e3 handle_command mon_command(pg map 10000000005.00000000 v 0) v1 2012-11-21 16:15:32.533949 7f7071ed6700 -1 ./osd/OSDMap.h: In function 'pg_t OSDMap::raw_pg_to_pg(pg_t) const' thread 7f7071ed6700 time 2012-11-21 16:15:32.533453 ./osd/OSDMap.h: 486: FAILED assert(pools.count(pg.pool())) ceph version 0.54 (commit:60b84b095b1009a305d4d6a5b16f88571cbd3150) 1: (PGMonitor::preprocess_command(MMonCommand*)+0xd60) [0x4eeba0] 2: (PGMonitor::preprocess_query(PaxosServiceMessage*)+0x2aa) [0x4ef85a] 3: (PaxosService::dispatch(PaxosServiceMessage*)+0x12d) [0x49e35d] 4: (Monitor::handle_command(MMonCommand*)+0x6f2) [0x47af22] 5: (Monitor::_ms_dispatch(Message*)+0x10ab) [0x48044b] 6: (Monitor::ms_dispatch(Message*)+0x7e) [0x491aee] 7: (DispatchQueue::entry()+0x6a9) [0x6267f9] 8: (DispatchQueue::DispatchThread::entry()+0xd) [0x62198d] 9: (()+0x68ca) [0x7f70771cd8ca] 10: (clone()+0x6d) [0x7f707611586d] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- begin dump of recent events --- -1383> 2012-11-21 16:15:21.394509 7f7077b2d780 5 asok(0x2a68000) register_command perfcounters_dump hook 0x2a5c010 -1382> 2012-11-21 16:15:21.394533 7f7077b2d780 5 asok(0x2a68000) register_command 1 hook 0x2a5c010 -1381> 2012-11-21 16:15:21.394535 7f7077b2d780 5 asok(0x2a68000) register_command perf dump hook 0x2a5c010 -1380> 2012-11-21 16:15:21.394540 7f7077b2d780 5 asok(0x2a68000) register_command perfcounters_schema hook 0x2a5c010 -1379> 2012-11-21 16:15:21.394542 7f7077b2d780 5 asok(0x2a68000) register_command 2 hook 0x2a5c010 -1378> 2012-11-21 16:15:21.394544 7f7077b2d780 5 asok(0x2a68000) register_command perf schema hook 0x2a5c010 -1377> 2012-11-21 16:15:21.394545 7f7077b2d780 5 asok(0x2a68000) register_command config show hook 0x2a5c010 -1376> 2012-11-21 16:15:21.394547 7f7077b2d780 5 asok(0x2a68000) register_command config set hook 0x2a5c010 -1375> 2012-11-21 16:15:21.394548 7f7077b2d780 5 asok(0x2a68000) register_command log flush hook 0x2a5c010 -1374> 2012-11-21 16:15:21.394550 7f7077b2d780 5 asok(0x2a68000) register_command log dump hook 0x2a5c010 -1373> 2012-11-21 16:15:21.394551 7f7077b2d780 5 asok(0x2a68000) register_command log reopen hook 0x2a5c010 -1372> 2012-11-21 16:15:21.395394 7f7077b2d780 0 ceph version 0.54 (commit:60b84b095b1009a305d4d6a5b16f88571cbd3150), process ceph-mon, pid 13425 -1371> 2012-11-21 16:15:21.395402 7f7077b2d780 1 store(/var/lib/ceph/mon/nonfood-ldhfmi02) mount -1370> 2012-11-21 16:15:21.395660 7f7077b2d780 1 -- 10.97.4.84:6789/0 learned my addr 10.97.4.84:6789/0 -1369> 2012-11-21 16:15:21.395668 7f7077b2d780 1 accepter.accepter.bind my_inst.addr is 10.97.4.84:6789/0 need_addr=0 -1368> 2012-11-21 16:15:21.397974 7f7077b2d780 5 asok(0x2a68000) init /var/run/ceph/ceph-mon.ldhfmi02.asok -1367> 2012-11-21 16:15:21.397985 7f7077b2d780 5 asok(0x2a68000) bind_and_listen /var/run/ceph/ceph-mon.ldhfmi02.asok -1366> 2012-11-21 16:15:21.398042 7f7077b2d780 5 asok(0x2a68000) register_command 0 hook 0x2a5b0b8 -1365> 2012-11-21 16:15:21.398055 7f7077b2d780 5 asok(0x2a68000) register_command version hook 0x2a5b0b8 -1364> 2012-11-21 16:15:21.398057 7f7077b2d780 5 asok(0x2a68000) register_command git_version hook 0x2a5b0b8 -1363> 2012-11-21 16:15:21.398059 7f7077b2d780 5 asok(0x2a68000) register_command help hook 0x2a5c0c0 -1362> 2012-11-21 16:15:21.398086 7f7077b2d780 1 -- 10.97.4.84:6789/0 messenger.start -1361> 2012-11-21 16:15:21.398094 7f7077b2d780 1 accepter.accepter.start -1360> 2012-11-21 16:15:21.398263 7f7077b2d780 1 mon.ldhfmi02@-1(probing) e3 init fsid d6e91ff1-9b43-4972-b7a7-a22d84497d78 -1359> 2012-11-21 16:15:21.399352 7f7077b2d780 4 mon.ldhfmi02@-1(probing).mds e32 new map -1358> 2012-11-21 16:15:21.399369 7f7073eda700 5 asok(0x2a68000) entry start -1357> 2012-11-21 16:15:21.400024 7f7077b2d780 2 auth: KeyRing::load: loaded key file /var/lib/ceph/mon/nonfood-ldhfmi02/keyring -1356> 2012-11-21 16:15:21.400037 7f7077b2d780 5 asok(0x2a68000) register_command mon_status hook 0x2a5c280 -1355> 2012-11-21 16:15:21.400043 7f7077b2d780 5 asok(0x2a68000) register_command quorum_status hook 0x2a5c280 -1354> 2012-11-21 16:15:21.400049 7f7077b2d780 5 asok(0x2a68000) register_command add_bootstrap_peer_hint hook 0x2a5c280 -1353> 2012-11-21 16:15:21.400109 7f7077b2d780 0 mon.ldhfmi02@-1(probing) e3 my rank is now 0 (was -1) -1352> 2012-11-21 16:15:21.400136 7f7077b2d780 1 -- 10.97.4.84:6789/0 mark_down_all -1351> 2012-11-21 16:15:21.400155 7f7077b2d780 1 -- 10.97.4.84:6789/0 --> mon.1 10.252.24.25:6789/0 -- mon_probe(probe d6e91ff1-9b43-4972-b7a7-a22d84497d78 name ldhfmi02) v3 -- ?+0 0x2adb000 -1350> 2012-11-21 16:15:21.400195 7f7077b2d780 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- mon_probe(probe d6e91ff1-9b43-4972-b7a7-a22d84497d78 name ldhfmi02) v3 -- ?+0 0x2adb680 -1349> 2012-11-21 16:15:21.400410 7f7070dd3700 1 -- 10.97.4.84:6789/0 >> :/0 pipe(0x2add000 sd=18 :6789 pgs=0 cs=0 l=0).accept sd=18 -1348> 2012-11-21 16:15:21.400534 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1347> 2012-11-21 16:15:21.400862 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1346> 2012-11-21 16:15:21.401197 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1345> 2012-11-21 16:15:21.401263 7f7070dd3700 5 throttle(mon_daemon_bytes 0x7fff76f54250) get 56 (0 -> 56) -1344> 2012-11-21 16:15:21.401275 7f7070dd3700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 56 (0 -> 56) -1343> 2012-11-21 16:15:21.401301 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== osd.0 10.252.24.88:6801/10082 1 ==== auth(proto 0 26 bytes epoch 3) v1 ==== 56+0+0 (2133482938 0 0) 0x2a6c800 con 0x2ad9780 -1342> 2012-11-21 16:15:21.401317 7f7071ed6700 5 mon.ldhfmi02@0(probing) e3 waitlisting message auth(proto 0 26 bytes epoch 3) v1 until we get in quorum -1341> 2012-11-21 16:15:21.401322 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 56 (0x8b8988 -> 0) -1340> 2012-11-21 16:15:21.401431 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1339> 2012-11-21 16:15:21.401797 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1338> 2012-11-21 16:15:21.402095 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1337> 2012-11-21 16:15:21.402164 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -1336> 2012-11-21 16:15:21.402206 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 1 ==== mon_probe(probe d6e91ff1-9b43-4972-b7a7-a22d84497d78 name hotcpc12533) v3 ==== 88+0+0 (512776726 0 0) 0x2adb9c0 con 0x2ad93c0 -1335> 2012-11-21 16:15:21.402223 7f7071ed6700 5 mon.ldhfmi02@0(probing) e3 setting monitor caps on this connection -1334> 2012-11-21 16:15:21.402245 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.252.24.88:6789/0 -- mon_probe(reply d6e91ff1-9b43-4972-b7a7-a22d84497d78 name ldhfmi02 versions {auth=200,logm=2443,mdsmap=32,monmap=3,osdmap=776,pgmap=1708}) v3 -- ?+0 0x2adbd00 con 0x2ad93c0 -1333> 2012-11-21 16:15:21.402269 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -1332> 2012-11-21 16:15:21.402293 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -1331> 2012-11-21 16:15:21.402323 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 2 ==== mon_probe(probe d6e91ff1-9b43-4972-b7a7-a22d84497d78 name hotcpc12533) v3 ==== 88+0+0 (512776726 0 0) 0x2adc380 con 0x2ad93c0 -1330> 2012-11-21 16:15:21.402366 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.252.24.88:6789/0 -- mon_probe(reply d6e91ff1-9b43-4972-b7a7-a22d84497d78 name ldhfmi02 versions {auth=200,logm=2443,mdsmap=32,monmap=3,osdmap=776,pgmap=1708}) v3 -- ?+0 0x2adb9c0 con 0x2ad93c0 -1329> 2012-11-21 16:15:21.402390 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -1328> 2012-11-21 16:15:21.402420 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -1327> 2012-11-21 16:15:21.402441 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 3 ==== mon_probe(probe d6e91ff1-9b43-4972-b7a7-a22d84497d78 name hotcpc12533) v3 ==== 88+0+0 (512776726 0 0) 0x2adc040 con 0x2ad93c0 -1326> 2012-11-21 16:15:21.402458 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.252.24.88:6789/0 -- mon_probe(reply d6e91ff1-9b43-4972-b7a7-a22d84497d78 name ldhfmi02 versions {auth=200,logm=2443,mdsmap=32,monmap=3,osdmap=776,pgmap=1708}) v3 -- ?+0 0x2adc380 con 0x2ad93c0 -1325> 2012-11-21 16:15:21.402534 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1324> 2012-11-21 16:15:21.402571 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -1323> 2012-11-21 16:15:21.402596 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -1322> 2012-11-21 16:15:21.402617 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 4 ==== mon_probe(probe d6e91ff1-9b43-4972-b7a7-a22d84497d78 name hotcpc12533) v3 ==== 88+0+0 (512776726 0 0) 0x2adca00 con 0x2ad93c0 -1321> 2012-11-21 16:15:21.402635 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.252.24.88:6789/0 -- mon_probe(reply d6e91ff1-9b43-4972-b7a7-a22d84497d78 name ldhfmi02 versions {auth=200,logm=2443,mdsmap=32,monmap=3,osdmap=776,pgmap=1708}) v3 -- ?+0 0x2adc040 con 0x2ad93c0 -1320> 2012-11-21 16:15:21.402651 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -1319> 2012-11-21 16:15:21.402672 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -1318> 2012-11-21 16:15:21.402690 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 5 ==== mon_probe(probe d6e91ff1-9b43-4972-b7a7-a22d84497d78 name hotcpc12533) v3 ==== 88+0+0 (512776726 0 0) 0x2adc6c0 con 0x2ad93c0 -1317> 2012-11-21 16:15:21.402706 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.252.24.88:6789/0 -- mon_probe(reply d6e91ff1-9b43-4972-b7a7-a22d84497d78 name ldhfmi02 versions {auth=200,logm=2443,mdsmap=32,monmap=3,osdmap=776,pgmap=1708}) v3 -- ?+0 0x2adca00 con 0x2ad93c0 -1316> 2012-11-21 16:15:21.402722 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -1315> 2012-11-21 16:15:21.402746 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 686 (0 -> 686) -1314> 2012-11-21 16:15:21.402767 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 6 ==== mon_probe(reply d6e91ff1-9b43-4972-b7a7-a22d84497d78 name hotcpc12533 versions {auth=200,logm=2443,mdsmap=32,monmap=3,osdmap=776,pgmap=1708}) v3 ==== 686+0+0 (4111979512 0 0) 0x2adb680 con 0x2ad93c0 -1313> 2012-11-21 16:15:21.402804 7f7071ed6700 0 log [INF] : mon.ldhfmi02 calling new monitor election -1312> 2012-11-21 16:15:21.402808 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.0 10.97.4.84:6789/0 -- log(1 entries) v1 -- ?+0 0x2a6ce00 -1311> 2012-11-21 16:15:21.402819 7f7071ed6700 5 mon.ldhfmi02@0(electing).elector(0) start -- can i be leader? -1310> 2012-11-21 16:15:21.403146 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1309> 2012-11-21 16:15:21.403412 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1308> 2012-11-21 16:15:21.403690 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1307> 2012-11-21 16:15:21.403989 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1306> 2012-11-21 16:15:21.404247 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1305> 2012-11-21 16:15:21.404499 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1304> 2012-11-21 16:15:21.404757 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1303> 2012-11-21 16:15:21.405045 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1302> 2012-11-21 16:15:21.405316 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1301> 2012-11-21 16:15:21.405565 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1300> 2012-11-21 16:15:21.405838 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1299> 2012-11-21 16:15:21.406123 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1298> 2012-11-21 16:15:21.406423 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1297> 2012-11-21 16:15:21.406700 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1296> 2012-11-21 16:15:21.406985 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1295> 2012-11-21 16:15:21.407258 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1294> 2012-11-21 16:15:21.407543 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1293> 2012-11-21 16:15:21.407826 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1292> 2012-11-21 16:15:21.408135 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1291> 2012-11-21 16:15:21.408403 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1290> 2012-11-21 16:15:21.408670 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1289> 2012-11-21 16:15:21.408959 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1288> 2012-11-21 16:15:21.409226 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1287> 2012-11-21 16:15:21.409488 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1286> 2012-11-21 16:15:21.409763 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1285> 2012-11-21 16:15:21.410037 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1284> 2012-11-21 16:15:21.410306 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1283> 2012-11-21 16:15:21.410576 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1282> 2012-11-21 16:15:21.410849 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1281> 2012-11-21 16:15:21.411112 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1280> 2012-11-21 16:15:21.411401 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1279> 2012-11-21 16:15:21.411658 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1278> 2012-11-21 16:15:21.411911 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1277> 2012-11-21 16:15:21.412194 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1276> 2012-11-21 16:15:21.412473 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1275> 2012-11-21 16:15:21.412889 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1274> 2012-11-21 16:15:21.413237 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1273> 2012-11-21 16:15:21.413490 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1272> 2012-11-21 16:15:21.413798 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1271> 2012-11-21 16:15:21.414189 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1270> 2012-11-21 16:15:21.414489 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1269> 2012-11-21 16:15:21.414797 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1268> 2012-11-21 16:15:21.415088 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1267> 2012-11-21 16:15:21.415359 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1266> 2012-11-21 16:15:21.415653 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1265> 2012-11-21 16:15:21.415921 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1264> 2012-11-21 16:15:21.416382 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1263> 2012-11-21 16:15:21.416995 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1262> 2012-11-21 16:15:21.417411 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1261> 2012-11-21 16:15:21.417853 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1260> 2012-11-21 16:15:21.418542 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1259> 2012-11-21 16:15:21.419341 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1258> 2012-11-21 16:15:21.419935 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1257> 2012-11-21 16:15:21.420487 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1256> 2012-11-21 16:15:21.420934 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1255> 2012-11-21 16:15:21.421414 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1254> 2012-11-21 16:15:21.421876 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1253> 2012-11-21 16:15:21.422190 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1252> 2012-11-21 16:15:21.422468 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1251> 2012-11-21 16:15:21.422721 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1250> 2012-11-21 16:15:21.422986 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1249> 2012-11-21 16:15:21.423296 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1248> 2012-11-21 16:15:21.423588 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1247> 2012-11-21 16:15:21.423869 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1246> 2012-11-21 16:15:21.424538 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1245> 2012-11-21 16:15:21.424819 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1244> 2012-11-21 16:15:21.425121 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1243> 2012-11-21 16:15:21.425465 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1242> 2012-11-21 16:15:21.425767 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1241> 2012-11-21 16:15:21.426063 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1240> 2012-11-21 16:15:21.426342 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1239> 2012-11-21 16:15:21.426627 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1238> 2012-11-21 16:15:21.426923 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1237> 2012-11-21 16:15:21.427211 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1236> 2012-11-21 16:15:21.427499 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1235> 2012-11-21 16:15:21.427810 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1234> 2012-11-21 16:15:21.428123 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1233> 2012-11-21 16:15:21.428415 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1232> 2012-11-21 16:15:21.428727 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1231> 2012-11-21 16:15:21.429014 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1230> 2012-11-21 16:15:21.429297 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1229> 2012-11-21 16:15:21.429594 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1228> 2012-11-21 16:15:21.429874 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1227> 2012-11-21 16:15:21.430199 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1226> 2012-11-21 16:15:21.430479 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1225> 2012-11-21 16:15:21.430751 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1224> 2012-11-21 16:15:21.431016 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1223> 2012-11-21 16:15:21.431310 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1222> 2012-11-21 16:15:21.431600 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1221> 2012-11-21 16:15:21.431880 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1220> 2012-11-21 16:15:21.432166 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1219> 2012-11-21 16:15:21.432426 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1218> 2012-11-21 16:15:21.432726 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1217> 2012-11-21 16:15:21.433003 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1216> 2012-11-21 16:15:21.433289 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1215> 2012-11-21 16:15:21.433594 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1214> 2012-11-21 16:15:21.433885 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1213> 2012-11-21 16:15:21.434194 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1212> 2012-11-21 16:15:21.434493 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1211> 2012-11-21 16:15:21.434789 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1210> 2012-11-21 16:15:21.435061 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1209> 2012-11-21 16:15:21.435325 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1208> 2012-11-21 16:15:21.435588 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1207> 2012-11-21 16:15:21.435861 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1206> 2012-11-21 16:15:21.436165 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1205> 2012-11-21 16:15:21.436477 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1204> 2012-11-21 16:15:21.436778 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1203> 2012-11-21 16:15:21.437071 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1202> 2012-11-21 16:15:21.437355 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1201> 2012-11-21 16:15:21.437604 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1200> 2012-11-21 16:15:21.437856 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1199> 2012-11-21 16:15:21.438124 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1198> 2012-11-21 16:15:21.438416 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1197> 2012-11-21 16:15:21.438659 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1196> 2012-11-21 16:15:21.438920 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1195> 2012-11-21 16:15:21.439175 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1194> 2012-11-21 16:15:21.439435 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1193> 2012-11-21 16:15:21.439715 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1192> 2012-11-21 16:15:21.439963 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1191> 2012-11-21 16:15:21.440216 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1190> 2012-11-21 16:15:21.440478 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1189> 2012-11-21 16:15:21.440716 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1188> 2012-11-21 16:15:21.440998 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1187> 2012-11-21 16:15:21.441283 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1186> 2012-11-21 16:15:21.441547 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1185> 2012-11-21 16:15:21.441822 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1184> 2012-11-21 16:15:21.442106 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1183> 2012-11-21 16:15:21.442569 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1182> 2012-11-21 16:15:21.442882 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1181> 2012-11-21 16:15:21.443201 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1180> 2012-11-21 16:15:21.443496 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1179> 2012-11-21 16:15:21.443801 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1178> 2012-11-21 16:15:21.444087 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1177> 2012-11-21 16:15:21.444365 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1176> 2012-11-21 16:15:21.444641 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1175> 2012-11-21 16:15:21.444921 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1174> 2012-11-21 16:15:21.445206 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1173> 2012-11-21 16:15:21.445487 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1172> 2012-11-21 16:15:21.445766 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1171> 2012-11-21 16:15:21.446034 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1170> 2012-11-21 16:15:21.446318 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1169> 2012-11-21 16:15:21.446598 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1168> 2012-11-21 16:15:21.446898 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1167> 2012-11-21 16:15:21.447207 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1166> 2012-11-21 16:15:21.447515 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1165> 2012-11-21 16:15:21.447815 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1164> 2012-11-21 16:15:21.448110 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1163> 2012-11-21 16:15:21.448411 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1162> 2012-11-21 16:15:21.448712 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1161> 2012-11-21 16:15:21.449007 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1160> 2012-11-21 16:15:21.449290 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1159> 2012-11-21 16:15:21.449727 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1158> 2012-11-21 16:15:21.450160 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1157> 2012-11-21 16:15:21.450849 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1156> 2012-11-21 16:15:21.451519 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1155> 2012-11-21 16:15:21.452128 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1154> 2012-11-21 16:15:21.452724 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1153> 2012-11-21 16:15:21.453403 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1152> 2012-11-21 16:15:21.454120 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1151> 2012-11-21 16:15:21.454432 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1150> 2012-11-21 16:15:21.454722 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1149> 2012-11-21 16:15:21.455007 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1148> 2012-11-21 16:15:21.455332 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1147> 2012-11-21 16:15:21.455659 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1146> 2012-11-21 16:15:21.455961 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1145> 2012-11-21 16:15:21.456325 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1144> 2012-11-21 16:15:21.456650 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1143> 2012-11-21 16:15:21.457042 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1142> 2012-11-21 16:15:21.457423 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1141> 2012-11-21 16:15:21.457816 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1140> 2012-11-21 16:15:21.458112 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1139> 2012-11-21 16:15:21.458652 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1138> 2012-11-21 16:15:21.458962 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1137> 2012-11-21 16:15:21.459251 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1136> 2012-11-21 16:15:21.459541 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1135> 2012-11-21 16:15:21.459837 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1134> 2012-11-21 16:15:21.460119 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1133> 2012-11-21 16:15:21.460420 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1132> 2012-11-21 16:15:21.460704 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1131> 2012-11-21 16:15:21.461002 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1130> 2012-11-21 16:15:21.461304 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1129> 2012-11-21 16:15:21.461598 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1128> 2012-11-21 16:15:21.461879 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1127> 2012-11-21 16:15:21.462194 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1126> 2012-11-21 16:15:21.462477 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1125> 2012-11-21 16:15:21.462763 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1124> 2012-11-21 16:15:21.463038 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1123> 2012-11-21 16:15:21.463324 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1122> 2012-11-21 16:15:21.463636 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1121> 2012-11-21 16:15:21.463924 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1120> 2012-11-21 16:15:21.464227 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1119> 2012-11-21 16:15:21.464515 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1118> 2012-11-21 16:15:21.464793 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1117> 2012-11-21 16:15:21.465059 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1116> 2012-11-21 16:15:21.465339 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1115> 2012-11-21 16:15:21.465619 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1114> 2012-11-21 16:15:21.465900 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1113> 2012-11-21 16:15:21.466182 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1112> 2012-11-21 16:15:21.466460 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1111> 2012-11-21 16:15:21.466738 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1110> 2012-11-21 16:15:21.467017 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1109> 2012-11-21 16:15:21.467299 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1108> 2012-11-21 16:15:21.467590 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1107> 2012-11-21 16:15:21.467878 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1106> 2012-11-21 16:15:21.468162 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1105> 2012-11-21 16:15:21.468441 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1104> 2012-11-21 16:15:21.468719 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1103> 2012-11-21 16:15:21.469001 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1102> 2012-11-21 16:15:21.469280 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1101> 2012-11-21 16:15:21.469569 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1100> 2012-11-21 16:15:21.470057 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1099> 2012-11-21 16:15:21.470353 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1098> 2012-11-21 16:15:21.470707 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1097> 2012-11-21 16:15:21.471058 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1096> 2012-11-21 16:15:21.471440 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1095> 2012-11-21 16:15:21.471728 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1094> 2012-11-21 16:15:21.472176 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1093> 2012-11-21 16:15:21.472477 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1092> 2012-11-21 16:15:21.472776 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1091> 2012-11-21 16:15:21.473087 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1090> 2012-11-21 16:15:21.473385 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1089> 2012-11-21 16:15:21.473667 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1088> 2012-11-21 16:15:21.473927 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1087> 2012-11-21 16:15:21.474202 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1086> 2012-11-21 16:15:21.474482 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1085> 2012-11-21 16:15:21.474759 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1084> 2012-11-21 16:15:21.475036 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1083> 2012-11-21 16:15:21.475311 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1082> 2012-11-21 16:15:21.475583 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1081> 2012-11-21 16:15:21.475871 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1080> 2012-11-21 16:15:21.476160 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1079> 2012-11-21 16:15:21.476260 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 535 (686 -> 1221) -1078> 2012-11-21 16:15:21.476470 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1077> 2012-11-21 16:15:21.476786 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1076> 2012-11-21 16:15:21.477068 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1075> 2012-11-21 16:15:21.477486 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1074> 2012-11-21 16:15:21.477778 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1073> 2012-11-21 16:15:21.478073 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1072> 2012-11-21 16:15:21.478363 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1071> 2012-11-21 16:15:21.478652 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1070> 2012-11-21 16:15:21.478931 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1069> 2012-11-21 16:15:21.479207 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1068> 2012-11-21 16:15:21.479485 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1067> 2012-11-21 16:15:21.479763 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1066> 2012-11-21 16:15:21.480042 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1065> 2012-11-21 16:15:21.480320 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1064> 2012-11-21 16:15:21.480596 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1063> 2012-11-21 16:15:21.480873 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1062> 2012-11-21 16:15:21.481171 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1061> 2012-11-21 16:15:21.481464 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1060> 2012-11-21 16:15:21.481768 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1059> 2012-11-21 16:15:21.482065 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1058> 2012-11-21 16:15:21.482363 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1057> 2012-11-21 16:15:21.482666 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1056> 2012-11-21 16:15:21.482966 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1055> 2012-11-21 16:15:21.483248 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1054> 2012-11-21 16:15:21.483533 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1053> 2012-11-21 16:15:21.483836 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1052> 2012-11-21 16:15:21.484118 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1051> 2012-11-21 16:15:21.484397 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1050> 2012-11-21 16:15:21.484684 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1049> 2012-11-21 16:15:21.484974 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1048> 2012-11-21 16:15:21.485257 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1047> 2012-11-21 16:15:21.485530 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1046> 2012-11-21 16:15:21.485830 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1045> 2012-11-21 16:15:21.486156 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1044> 2012-11-21 16:15:21.486443 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1043> 2012-11-21 16:15:21.486769 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1042> 2012-11-21 16:15:21.487077 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1041> 2012-11-21 16:15:21.487399 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1040> 2012-11-21 16:15:21.487709 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1039> 2012-11-21 16:15:21.488135 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1038> 2012-11-21 16:15:21.488443 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1037> 2012-11-21 16:15:21.488771 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1036> 2012-11-21 16:15:21.489068 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1035> 2012-11-21 16:15:21.489349 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1034> 2012-11-21 16:15:21.489650 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1033> 2012-11-21 16:15:21.489967 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1032> 2012-11-21 16:15:21.490255 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1031> 2012-11-21 16:15:21.490556 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1030> 2012-11-21 16:15:21.490875 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1029> 2012-11-21 16:15:21.491221 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1028> 2012-11-21 16:15:21.491513 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1027> 2012-11-21 16:15:21.491805 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1026> 2012-11-21 16:15:21.492085 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1025> 2012-11-21 16:15:21.492402 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1024> 2012-11-21 16:15:21.492689 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1023> 2012-11-21 16:15:21.492967 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1022> 2012-11-21 16:15:21.493250 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1021> 2012-11-21 16:15:21.493535 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1020> 2012-11-21 16:15:21.493840 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1019> 2012-11-21 16:15:21.494159 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1018> 2012-11-21 16:15:21.494446 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1017> 2012-11-21 16:15:21.494735 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1016> 2012-11-21 16:15:21.495024 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1015> 2012-11-21 16:15:21.495312 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1014> 2012-11-21 16:15:21.495599 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1013> 2012-11-21 16:15:21.495873 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1012> 2012-11-21 16:15:21.496148 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1011> 2012-11-21 16:15:21.496451 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1010> 2012-11-21 16:15:21.496753 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1009> 2012-11-21 16:15:21.497059 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1008> 2012-11-21 16:15:21.497349 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1007> 2012-11-21 16:15:21.497643 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1006> 2012-11-21 16:15:21.497964 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1005> 2012-11-21 16:15:21.498251 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1004> 2012-11-21 16:15:21.498527 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1003> 2012-11-21 16:15:21.498811 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1002> 2012-11-21 16:15:21.499095 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1001> 2012-11-21 16:15:21.499380 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -1000> 2012-11-21 16:15:21.499648 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -999> 2012-11-21 16:15:21.499931 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -998> 2012-11-21 16:15:21.500212 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -997> 2012-11-21 16:15:21.500502 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -996> 2012-11-21 16:15:21.500790 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -995> 2012-11-21 16:15:21.501080 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -994> 2012-11-21 16:15:21.501375 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -993> 2012-11-21 16:15:21.501677 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -992> 2012-11-21 16:15:21.501973 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -991> 2012-11-21 16:15:21.502267 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -990> 2012-11-21 16:15:21.502555 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -989> 2012-11-21 16:15:21.502830 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -988> 2012-11-21 16:15:21.503103 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -987> 2012-11-21 16:15:21.503402 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -986> 2012-11-21 16:15:21.503686 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -985> 2012-11-21 16:15:21.503972 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -984> 2012-11-21 16:15:21.504266 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -983> 2012-11-21 16:15:21.504551 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -982> 2012-11-21 16:15:21.504848 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -981> 2012-11-21 16:15:21.505157 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -980> 2012-11-21 16:15:21.505447 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -979> 2012-11-21 16:15:21.505727 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -978> 2012-11-21 16:15:21.506012 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -977> 2012-11-21 16:15:21.506302 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -976> 2012-11-21 16:15:21.506586 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -975> 2012-11-21 16:15:21.506857 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -974> 2012-11-21 16:15:21.507494 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.1 10.252.24.25:6789/0 -- election(d6e91ff1-9b43-4972-b7a7-a22d84497d78 propose 1) v3 -- ?+0 0x2add480 -973> 2012-11-21 16:15:21.507542 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- election(d6e91ff1-9b43-4972-b7a7-a22d84497d78 propose 1) v3 -- ?+0 0x2addd80 -972> 2012-11-21 16:15:21.507573 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 686 (0x8b8988 -> 535) -971> 2012-11-21 16:15:21.507579 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.0 10.97.4.84:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x2a6ce00 con 0x2a6e280 -970> 2012-11-21 16:15:21.507592 7f7071ed6700 5 mon.ldhfmi02@0(electing) e3 setting monitor caps on this connection -969> 2012-11-21 16:15:21.507596 7f7071ed6700 1 mon.ldhfmi02@0(electing).paxos(logm recovering c 1943..2443) is_readable now=2012-11-21 16:15:21.507597 lease_expire=0.000000 has v0 lc 2443 -968> 2012-11-21 16:15:21.507616 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 7 ==== election(d6e91ff1-9b43-4972-b7a7-a22d84497d78 propose 1) v3 ==== 535+0+0 (3793525197 0 0) 0x2addb40 con 0x2ad93c0 -967> 2012-11-21 16:15:21.507642 7f7071ed6700 5 mon.ldhfmi02@0(electing).elector(1) handle_propose from mon.2 -966> 2012-11-21 16:15:21.507646 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 535 (0x8b8988 -> 0) -965> 2012-11-21 16:15:21.507333 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -964> 2012-11-21 16:15:21.508297 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -963> 2012-11-21 16:15:21.508593 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 535 (0 -> 535) -962> 2012-11-21 16:15:21.508632 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 8 ==== election(d6e91ff1-9b43-4972-b7a7-a22d84497d78 ack 1) v3 ==== 535+0+0 (3571109439 0 0) 0x2add900 con 0x2ad93c0 -961> 2012-11-21 16:15:21.508657 7f7071ed6700 5 mon.ldhfmi02@0(electing).elector(1) handle_ack from mon.2 -960> 2012-11-21 16:15:21.508660 7f7071ed6700 5 mon.ldhfmi02@0(electing).elector(1) so far i have {0=8388607,2=8388607} -959> 2012-11-21 16:15:21.508666 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 535 (0x8b8988 -> 0) -958> 2012-11-21 16:15:21.508886 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -957> 2012-11-21 16:15:21.509308 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -956> 2012-11-21 16:15:21.509749 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -955> 2012-11-21 16:15:21.510254 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -954> 2012-11-21 16:15:21.510552 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -953> 2012-11-21 16:15:21.510859 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -952> 2012-11-21 16:15:21.511167 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -951> 2012-11-21 16:15:21.511459 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -950> 2012-11-21 16:15:21.511759 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -949> 2012-11-21 16:15:21.512081 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -948> 2012-11-21 16:15:21.512404 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -947> 2012-11-21 16:15:21.512697 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -946> 2012-11-21 16:15:21.512994 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -945> 2012-11-21 16:15:21.513295 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -944> 2012-11-21 16:15:21.513693 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -943> 2012-11-21 16:15:21.514163 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -942> 2012-11-21 16:15:21.514504 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -941> 2012-11-21 16:15:21.514867 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -940> 2012-11-21 16:15:21.515169 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -939> 2012-11-21 16:15:21.515475 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -938> 2012-11-21 16:15:21.515777 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -937> 2012-11-21 16:15:21.516079 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -936> 2012-11-21 16:15:21.516379 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -935> 2012-11-21 16:15:21.516676 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -934> 2012-11-21 16:15:21.516962 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -933> 2012-11-21 16:15:21.517266 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -932> 2012-11-21 16:15:21.517557 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -931> 2012-11-21 16:15:21.517855 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -930> 2012-11-21 16:15:21.518200 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -929> 2012-11-21 16:15:21.518511 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -928> 2012-11-21 16:15:21.518806 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -927> 2012-11-21 16:15:21.519103 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -926> 2012-11-21 16:15:21.519404 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -925> 2012-11-21 16:15:21.519704 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -924> 2012-11-21 16:15:21.520007 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -923> 2012-11-21 16:15:21.520302 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -922> 2012-11-21 16:15:21.520606 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -921> 2012-11-21 16:15:21.520906 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -920> 2012-11-21 16:15:21.521233 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -919> 2012-11-21 16:15:21.521522 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -918> 2012-11-21 16:15:21.521815 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -917> 2012-11-21 16:15:21.522107 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -916> 2012-11-21 16:15:21.522456 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -915> 2012-11-21 16:15:21.522739 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -914> 2012-11-21 16:15:21.523042 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -913> 2012-11-21 16:15:21.523329 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -912> 2012-11-21 16:15:21.523637 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -911> 2012-11-21 16:15:21.523947 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -910> 2012-11-21 16:15:21.524324 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -909> 2012-11-21 16:15:21.524663 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -908> 2012-11-21 16:15:21.525000 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -907> 2012-11-21 16:15:21.525357 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -906> 2012-11-21 16:15:21.525677 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -905> 2012-11-21 16:15:21.525968 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -904> 2012-11-21 16:15:21.526279 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -903> 2012-11-21 16:15:21.526591 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -902> 2012-11-21 16:15:21.526890 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -901> 2012-11-21 16:15:21.527189 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -900> 2012-11-21 16:15:21.527470 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -899> 2012-11-21 16:15:21.527771 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -898> 2012-11-21 16:15:21.528059 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -897> 2012-11-21 16:15:21.528373 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -896> 2012-11-21 16:15:21.528671 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -895> 2012-11-21 16:15:21.529010 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -894> 2012-11-21 16:15:21.529317 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -893> 2012-11-21 16:15:21.529621 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -892> 2012-11-21 16:15:21.529895 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -891> 2012-11-21 16:15:21.530184 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -890> 2012-11-21 16:15:21.530478 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -889> 2012-11-21 16:15:21.530762 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -888> 2012-11-21 16:15:21.531041 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -887> 2012-11-21 16:15:21.531328 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -886> 2012-11-21 16:15:21.531614 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -885> 2012-11-21 16:15:21.531921 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -884> 2012-11-21 16:15:21.532214 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -883> 2012-11-21 16:15:21.532588 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -882> 2012-11-21 16:15:21.532899 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -881> 2012-11-21 16:15:21.534182 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -880> 2012-11-21 16:15:21.534480 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -879> 2012-11-21 16:15:21.534765 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -878> 2012-11-21 16:15:21.535042 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -877> 2012-11-21 16:15:21.535321 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -876> 2012-11-21 16:15:21.535621 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -875> 2012-11-21 16:15:21.535901 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -874> 2012-11-21 16:15:21.536185 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -873> 2012-11-21 16:15:21.536478 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -872> 2012-11-21 16:15:21.536774 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -871> 2012-11-21 16:15:21.537059 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -870> 2012-11-21 16:15:21.537335 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -869> 2012-11-21 16:15:21.537619 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -868> 2012-11-21 16:15:21.537905 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -867> 2012-11-21 16:15:21.538190 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -866> 2012-11-21 16:15:21.538479 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -865> 2012-11-21 16:15:21.538763 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -864> 2012-11-21 16:15:21.539040 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -863> 2012-11-21 16:15:21.539316 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -862> 2012-11-21 16:15:21.539599 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -861> 2012-11-21 16:15:21.539891 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -860> 2012-11-21 16:15:21.540170 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -859> 2012-11-21 16:15:21.540437 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -858> 2012-11-21 16:15:21.540712 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -857> 2012-11-21 16:15:21.541003 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -856> 2012-11-21 16:15:21.541283 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -855> 2012-11-21 16:15:21.541568 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -854> 2012-11-21 16:15:21.541856 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -853> 2012-11-21 16:15:21.542151 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -852> 2012-11-21 16:15:21.542439 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -851> 2012-11-21 16:15:21.542723 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -850> 2012-11-21 16:15:21.542996 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -849> 2012-11-21 16:15:21.543421 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -848> 2012-11-21 16:15:21.543718 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -847> 2012-11-21 16:15:21.544016 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -846> 2012-11-21 16:15:21.544325 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -845> 2012-11-21 16:15:21.544624 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -844> 2012-11-21 16:15:21.544914 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -843> 2012-11-21 16:15:21.545214 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -842> 2012-11-21 16:15:21.545509 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -841> 2012-11-21 16:15:21.545804 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -840> 2012-11-21 16:15:21.546103 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -839> 2012-11-21 16:15:21.546426 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -838> 2012-11-21 16:15:21.546731 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -837> 2012-11-21 16:15:21.547016 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -836> 2012-11-21 16:15:21.547273 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -835> 2012-11-21 16:15:21.547554 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -834> 2012-11-21 16:15:21.547832 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -833> 2012-11-21 16:15:21.548112 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -832> 2012-11-21 16:15:21.548397 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -831> 2012-11-21 16:15:21.548684 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -830> 2012-11-21 16:15:21.548967 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -829> 2012-11-21 16:15:21.549272 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -828> 2012-11-21 16:15:21.549595 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -827> 2012-11-21 16:15:21.549890 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -826> 2012-11-21 16:15:21.550178 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -825> 2012-11-21 16:15:21.550461 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -824> 2012-11-21 16:15:21.550735 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -823> 2012-11-21 16:15:21.551008 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -822> 2012-11-21 16:15:21.551287 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -821> 2012-11-21 16:15:21.551573 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -820> 2012-11-21 16:15:21.551880 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -819> 2012-11-21 16:15:21.552180 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -818> 2012-11-21 16:15:21.552477 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -817> 2012-11-21 16:15:21.552770 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -816> 2012-11-21 16:15:21.553068 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -815> 2012-11-21 16:15:21.553369 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -814> 2012-11-21 16:15:21.553717 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -813> 2012-11-21 16:15:21.554016 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -812> 2012-11-21 16:15:21.554321 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -811> 2012-11-21 16:15:21.554629 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -810> 2012-11-21 16:15:21.554936 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -809> 2012-11-21 16:15:21.555227 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -808> 2012-11-21 16:15:21.555617 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -807> 2012-11-21 16:15:21.555933 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -806> 2012-11-21 16:15:21.556241 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -805> 2012-11-21 16:15:21.556541 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -804> 2012-11-21 16:15:21.556883 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -803> 2012-11-21 16:15:21.557197 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -802> 2012-11-21 16:15:21.557498 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -801> 2012-11-21 16:15:21.557850 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -800> 2012-11-21 16:15:21.558413 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -799> 2012-11-21 16:15:21.559005 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -798> 2012-11-21 16:15:21.559775 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -797> 2012-11-21 16:15:21.560786 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -796> 2012-11-21 16:15:21.561720 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -795> 2012-11-21 16:15:21.562416 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -794> 2012-11-21 16:15:21.563171 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -793> 2012-11-21 16:15:21.564041 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -792> 2012-11-21 16:15:21.564872 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -791> 2012-11-21 16:15:21.565549 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -790> 2012-11-21 16:15:21.566034 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -789> 2012-11-21 16:15:21.566363 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -788> 2012-11-21 16:15:21.566714 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -787> 2012-11-21 16:15:21.567020 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -786> 2012-11-21 16:15:21.567301 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -785> 2012-11-21 16:15:21.567588 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -784> 2012-11-21 16:15:21.567894 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -783> 2012-11-21 16:15:21.568214 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -782> 2012-11-21 16:15:21.568535 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -781> 2012-11-21 16:15:21.568863 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -780> 2012-11-21 16:15:21.569182 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -779> 2012-11-21 16:15:21.569475 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -778> 2012-11-21 16:15:21.569830 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -777> 2012-11-21 16:15:21.570183 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -776> 2012-11-21 16:15:21.570652 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -775> 2012-11-21 16:15:21.571342 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -774> 2012-11-21 16:15:21.572186 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -773> 2012-11-21 16:15:21.573034 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -772> 2012-11-21 16:15:21.574490 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -771> 2012-11-21 16:15:21.575009 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -770> 2012-11-21 16:15:21.575867 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -769> 2012-11-21 16:15:21.576451 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -768> 2012-11-21 16:15:21.577256 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -767> 2012-11-21 16:15:21.578087 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -766> 2012-11-21 16:15:21.578813 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -765> 2012-11-21 16:15:21.579680 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -764> 2012-11-21 16:15:21.580459 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -763> 2012-11-21 16:15:21.581143 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -762> 2012-11-21 16:15:21.581834 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -761> 2012-11-21 16:15:21.582367 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -760> 2012-11-21 16:15:21.582889 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -759> 2012-11-21 16:15:21.583323 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -758> 2012-11-21 16:15:21.583986 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -757> 2012-11-21 16:15:21.584567 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -756> 2012-11-21 16:15:21.585079 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -755> 2012-11-21 16:15:21.585614 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -754> 2012-11-21 16:15:21.586438 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -753> 2012-11-21 16:15:21.587441 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -752> 2012-11-21 16:15:21.631682 7f7070ad0700 1 -- 10.97.4.84:6789/0 >> :/0 pipe(0x2addb40 sd=19 :6789 pgs=0 cs=0 l=0).accept sd=19 -751> 2012-11-21 16:15:21.633591 7f7070ad0700 5 throttle(mon_daemon_bytes 0x7fff76f54250) get 66 (56 -> 122) -750> 2012-11-21 16:15:21.633604 7f7070ad0700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 66 (0 -> 66) -749> 2012-11-21 16:15:21.633634 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mds.? 10.252.24.88:6803/14568 1 ==== auth(proto 0 36 bytes epoch 3) v1 ==== 66+0+0 (1406463741 0 0) 0x2adf600 con 0x2ad98c0 -748> 2012-11-21 16:15:21.633652 7f7071ed6700 5 mon.ldhfmi02@0(electing) e3 waitlisting message auth(proto 0 36 bytes epoch 3) v1 until we get in quorum -747> 2012-11-21 16:15:21.633659 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 66 (0x8b8988 -> 0) -746> 2012-11-21 16:15:21.640476 7f7070dd3700 2 -- 10.97.4.84:6789/0 >> 10.252.24.88:6801/10082 pipe(0x2add000 sd=18 :6789 pgs=10824478 cs=1 l=1).reader couldn't read tag, Success -745> 2012-11-21 16:15:21.640512 7f7070dd3700 2 -- 10.97.4.84:6789/0 >> 10.252.24.88:6801/10082 pipe(0x2add000 sd=18 :6789 pgs=10824478 cs=1 l=1).fault 0: Success -744> 2012-11-21 16:15:23.265889 7f7070dd3700 1 -- 10.97.4.84:6789/0 >> :/0 pipe(0x2add6c0 sd=18 :6789 pgs=0 cs=0 l=0).accept sd=18 -743> 2012-11-21 16:15:24.029879 7f7070ad0700 2 -- 10.97.4.84:6789/0 >> 10.252.24.88:6803/14568 pipe(0x2addb40 sd=19 :6789 pgs=2317 cs=1 l=1).reader couldn't read tag, Success -742> 2012-11-21 16:15:24.029942 7f7070ad0700 2 -- 10.97.4.84:6789/0 >> 10.252.24.88:6803/14568 pipe(0x2addb40 sd=19 :6789 pgs=2317 cs=1 l=1).fault 0: Success -741> 2012-11-21 16:15:24.587034 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -740> 2012-11-21 16:15:24.588089 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -739> 2012-11-21 16:15:24.588803 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -738> 2012-11-21 16:15:24.589501 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -737> 2012-11-21 16:15:24.590230 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -736> 2012-11-21 16:15:24.591144 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -735> 2012-11-21 16:15:24.592118 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -734> 2012-11-21 16:15:24.592975 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -733> 2012-11-21 16:15:24.593853 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -732> 2012-11-21 16:15:24.594797 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -731> 2012-11-21 16:15:24.595519 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -730> 2012-11-21 16:15:24.596136 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -729> 2012-11-21 16:15:24.596641 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -728> 2012-11-21 16:15:24.597260 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -727> 2012-11-21 16:15:24.597961 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -726> 2012-11-21 16:15:24.598738 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -725> 2012-11-21 16:15:24.599543 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -724> 2012-11-21 16:15:24.600325 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -723> 2012-11-21 16:15:24.601275 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -722> 2012-11-21 16:15:24.602160 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -721> 2012-11-21 16:15:24.603122 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -720> 2012-11-21 16:15:24.604011 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -719> 2012-11-21 16:15:24.604757 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -718> 2012-11-21 16:15:24.605565 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -717> 2012-11-21 16:15:24.606385 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -716> 2012-11-21 16:15:24.607337 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -715> 2012-11-21 16:15:24.608305 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -714> 2012-11-21 16:15:24.608911 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -713> 2012-11-21 16:15:24.609349 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -712> 2012-11-21 16:15:24.609895 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -711> 2012-11-21 16:15:24.610498 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -710> 2012-11-21 16:15:24.611103 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -709> 2012-11-21 16:15:24.611775 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -708> 2012-11-21 16:15:24.612574 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -707> 2012-11-21 16:15:24.613452 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -706> 2012-11-21 16:15:24.614260 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -705> 2012-11-21 16:15:24.615125 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -704> 2012-11-21 16:15:24.615995 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -703> 2012-11-21 16:15:24.616482 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -702> 2012-11-21 16:15:24.617097 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -701> 2012-11-21 16:15:24.617816 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -700> 2012-11-21 16:15:24.618671 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -699> 2012-11-21 16:15:24.619602 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -698> 2012-11-21 16:15:24.620518 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -697> 2012-11-21 16:15:24.621100 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -696> 2012-11-21 16:15:24.621363 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -695> 2012-11-21 16:15:24.621636 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -694> 2012-11-21 16:15:24.621976 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -693> 2012-11-21 16:15:24.622356 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -692> 2012-11-21 16:15:24.622846 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -691> 2012-11-21 16:15:24.623378 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -690> 2012-11-21 16:15:24.624010 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -689> 2012-11-21 16:15:24.624810 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -688> 2012-11-21 16:15:24.625768 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -687> 2012-11-21 16:15:24.626726 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -686> 2012-11-21 16:15:24.627534 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -685> 2012-11-21 16:15:24.628143 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -684> 2012-11-21 16:15:24.628474 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -683> 2012-11-21 16:15:24.628823 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -682> 2012-11-21 16:15:24.629121 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -681> 2012-11-21 16:15:24.629412 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -680> 2012-11-21 16:15:24.629724 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -679> 2012-11-21 16:15:24.630148 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -678> 2012-11-21 16:15:24.630739 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -677> 2012-11-21 16:15:24.631346 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -676> 2012-11-21 16:15:24.632034 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -675> 2012-11-21 16:15:24.632914 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -674> 2012-11-21 16:15:24.633663 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -673> 2012-11-21 16:15:24.634533 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -672> 2012-11-21 16:15:24.635496 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -671> 2012-11-21 16:15:24.636779 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -670> 2012-11-21 16:15:24.637364 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -669> 2012-11-21 16:15:24.637678 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -668> 2012-11-21 16:15:24.638001 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -667> 2012-11-21 16:15:24.638296 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -666> 2012-11-21 16:15:24.638664 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -665> 2012-11-21 16:15:24.639087 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -664> 2012-11-21 16:15:24.639656 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -663> 2012-11-21 16:15:24.640328 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -662> 2012-11-21 16:15:24.640885 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -661> 2012-11-21 16:15:24.641350 7f7070ad0700 1 -- 10.97.4.84:6789/0 >> :/0 pipe(0x2add000 sd=18 :6789 pgs=0 cs=0 l=0).accept sd=18 -660> 2012-11-21 16:15:24.641598 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -659> 2012-11-21 16:15:24.642466 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -658> 2012-11-21 16:15:24.643158 7f7070ad0700 5 throttle(mon_daemon_bytes 0x7fff76f54250) get 56 (122 -> 178) -657> 2012-11-21 16:15:24.643165 7f7070ad0700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 56 (0 -> 56) -656> 2012-11-21 16:15:24.643183 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== osd.0 10.252.24.88:6801/10082 1 ==== auth(proto 0 26 bytes epoch 3) v1 ==== 56+0+0 (2133482938 0 0) 0x2adf800 con 0x2b1e3c0 -655> 2012-11-21 16:15:24.643195 7f7071ed6700 5 mon.ldhfmi02@0(electing) e3 waitlisting message auth(proto 0 26 bytes epoch 3) v1 until we get in quorum -654> 2012-11-21 16:15:24.643200 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 56 (0x8b8988 -> 0) -653> 2012-11-21 16:15:24.643343 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -652> 2012-11-21 16:15:24.644242 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -651> 2012-11-21 16:15:24.645170 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -650> 2012-11-21 16:15:24.646045 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -649> 2012-11-21 16:15:24.646825 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -648> 2012-11-21 16:15:24.647759 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -647> 2012-11-21 16:15:25.384091 7f7070dd3700 1 -- 10.97.4.84:6789/0 >> :/0 pipe(0x2add6c0 sd=19 :6789 pgs=0 cs=0 l=0).accept sd=19 -646> 2012-11-21 16:15:25.385979 7f7070dd3700 5 throttle(mon_daemon_bytes 0x7fff76f54250) get 66 (178 -> 244) -645> 2012-11-21 16:15:25.385993 7f7070dd3700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 66 (0 -> 66) -644> 2012-11-21 16:15:25.386023 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mds.0 10.252.24.88:6804/9861 1 ==== auth(proto 0 36 bytes epoch 3) v1 ==== 66+0+0 (4110800675 0 0) 0x2adfa00 con 0x2b1e280 -643> 2012-11-21 16:15:25.386043 7f7071ed6700 5 mon.ldhfmi02@0(electing) e3 waitlisting message auth(proto 0 36 bytes epoch 3) v1 until we get in quorum -642> 2012-11-21 16:15:25.386050 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 66 (0x8b8988 -> 0) -641> 2012-11-21 16:15:26.400244 7f70716d5700 1 mon.ldhfmi02@0(electing) e3 discarding message auth(proto 0 26 bytes epoch 3) v1 and sending client elsewhere; we are not in quorum -640> 2012-11-21 16:15:26.400297 7f70716d5700 1 -- 10.97.4.84:6789/0 mark_down 0x2ad9780 -- pipe dne -639> 2012-11-21 16:15:26.400326 7f70716d5700 5 throttle(mon_daemon_bytes 0x7fff76f54250) put 56 (0x8b8988 -> 188) -638> 2012-11-21 16:15:26.400339 7f70716d5700 1 mon.ldhfmi02@0(electing) e3 discarding message auth(proto 0 36 bytes epoch 3) v1 and sending client elsewhere; we are not in quorum -637> 2012-11-21 16:15:26.400346 7f70716d5700 1 -- 10.97.4.84:6789/0 mark_down 0x2ad98c0 -- pipe dne -636> 2012-11-21 16:15:26.400352 7f70716d5700 5 throttle(mon_daemon_bytes 0x7fff76f54250) put 66 (0x8b8988 -> 122) -635> 2012-11-21 16:15:26.400357 7f70716d5700 5 mon.ldhfmi02@0(electing) e3 waitlisting message auth(proto 0 26 bytes epoch 3) v1 until we get in quorum -634> 2012-11-21 16:15:26.400361 7f70716d5700 5 mon.ldhfmi02@0(electing) e3 waitlisting message auth(proto 0 36 bytes epoch 3) v1 until we get in quorum -633> 2012-11-21 16:15:26.507684 7f70716d5700 5 mon.ldhfmi02@0(electing).elector(1) election timer expired -632> 2012-11-21 16:15:26.618850 7f70716d5700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- election(d6e91ff1-9b43-4972-b7a7-a22d84497d78 victory 2) v3 -- ?+0 0x2addd80 -631> 2012-11-21 16:15:26.618920 7f70716d5700 0 log [INF] : mon.ldhfmi02@0 won leader election with quorum 0,2 -630> 2012-11-21 16:15:26.618927 7f70716d5700 1 -- 10.97.4.84:6789/0 --> mon.0 10.97.4.84:6789/0 -- log(1 entries) v1 -- ?+0 0x2adf600 -629> 2012-11-21 16:15:26.619199 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.0 10.97.4.84:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x2adf600 con 0x2a6e280 -628> 2012-11-21 16:15:26.627375 7f70716d5700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(pgmap collect lc 1708 fc 1208 pn 2700 opn 0 gv {}) v2 -- ?+0 0x2b2a000 -627> 2012-11-21 16:15:26.629636 7f70716d5700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(mdsmap collect lc 32 fc 1 pn 2700 opn 0 gv {}) v2 -- ?+0 0x2b2a500 -626> 2012-11-21 16:15:26.633107 7f70716d5700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(osdmap collect lc 776 fc 276 pn 2700 opn 0 gv {}) v2 -- ?+0 0x2b2a280 -625> 2012-11-21 16:15:26.640423 7f70716d5700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(logm collect lc 2443 fc 1943 pn 2700 opn 0 gv {}) v2 -- ?+0 0x2b2ac80 -624> 2012-11-21 16:15:26.642736 7f70716d5700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(monmap collect lc 3 fc 1 pn 2700 opn 0 gv {}) v2 -- ?+0 0x2b2aa00 -623> 2012-11-21 16:15:26.644762 7f70716d5700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(auth collect lc 200 fc 180 pn 2700 opn 0 gv {}) v2 -- ?+0 0x2b2a780 -622> 2012-11-21 16:15:26.644845 7f70716d5700 1 mon.ldhfmi02@0(leader).paxos(auth recovering c 180..200) is_readable now=2012-11-21 16:15:26.644847 lease_expire=0.000000 has v0 lc 200 -621> 2012-11-21 16:15:26.644869 7f70716d5700 1 mon.ldhfmi02@0(leader).paxos(auth recovering c 180..200) is_readable now=2012-11-21 16:15:26.644870 lease_expire=0.000000 has v0 lc 200 -620> 2012-11-21 16:15:26.644894 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(logm recovering c 1943..2443) is_readable now=2012-11-21 16:15:26.644895 lease_expire=0.000000 has v0 lc 2443 -619> 2012-11-21 16:15:26.737982 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -618> 2012-11-21 16:15:26.738038 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 9 ==== paxos(pgmap last lc 1708 fc 1208 pn 2700 opn 0 gv {}) v2 ==== 88+0+0 (2985547229 0 0) 0x2b2a780 con 0x2ad93c0 -617> 2012-11-21 16:15:26.738074 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(pgmap lease lc 1708 fc 1208 pn 0 opn 0 gv {}) v2 -- ?+0 0x2b2a280 -616> 2012-11-21 16:15:26.738104 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -615> 2012-11-21 16:15:26.763217 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -614> 2012-11-21 16:15:26.763273 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 10 ==== paxos(mdsmap last lc 32 fc 1 pn 2700 opn 0 gv {}) v2 ==== 88+0+0 (87146422 0 0) 0x2b2a280 con 0x2ad93c0 -613> 2012-11-21 16:15:26.763300 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(mdsmap lease lc 32 fc 1 pn 0 opn 0 gv {}) v2 -- ?+0 0x2b2a780 -612> 2012-11-21 16:15:26.763316 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -611> 2012-11-21 16:15:26.788597 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -610> 2012-11-21 16:15:26.788652 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 11 ==== paxos(osdmap last lc 776 fc 276 pn 2700 opn 0 gv {}) v2 ==== 88+0+0 (876397181 0 0) 0x2b2a780 con 0x2ad93c0 -609> 2012-11-21 16:15:26.788679 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(osdmap lease lc 776 fc 276 pn 0 opn 0 gv {}) v2 -- ?+0 0x2b2a280 -608> 2012-11-21 16:15:26.788694 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -607> 2012-11-21 16:15:26.813881 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -606> 2012-11-21 16:15:26.813934 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 12 ==== paxos(logm last lc 2443 fc 1943 pn 2700 opn 0 gv {}) v2 ==== 88+0+0 (3803185434 0 0) 0x2b2a280 con 0x2ad93c0 -605> 2012-11-21 16:15:26.813962 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(logm lease lc 2443 fc 1943 pn 0 opn 0 gv {}) v2 -- ?+0 0x2b2a780 -604> 2012-11-21 16:15:26.813978 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -603> 2012-11-21 16:15:26.839268 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -602> 2012-11-21 16:15:26.839326 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 13 ==== paxos(monmap last lc 3 fc 1 pn 2700 opn 0 gv {}) v2 ==== 88+0+0 (3074068559 0 0) 0x2b2a780 con 0x2ad93c0 -601> 2012-11-21 16:15:26.839356 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(monmap lease lc 3 fc 1 pn 0 opn 0 gv {}) v2 -- ?+0 0x2b2a280 -600> 2012-11-21 16:15:26.839370 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -599> 2012-11-21 16:15:26.864631 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -598> 2012-11-21 16:15:26.864690 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (88 -> 176) -597> 2012-11-21 16:15:26.864699 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (176 -> 264) -596> 2012-11-21 16:15:26.864706 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (264 -> 352) -595> 2012-11-21 16:15:26.864711 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (352 -> 440) -594> 2012-11-21 16:15:26.864720 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 525 (440 -> 965) -593> 2012-11-21 16:15:26.864751 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (965 -> 1053) -592> 2012-11-21 16:15:26.864781 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 14 ==== paxos(auth last lc 200 fc 179 pn 2700 opn 0 gv {}) v2 ==== 88+0+0 (2838491178 0 0) 0x2b2a280 con 0x2ad93c0 -591> 2012-11-21 16:15:26.864808 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(auth lease lc 200 fc 180 pn 0 opn 0 gv {}) v2 -- ?+0 0x2b2a780 -590> 2012-11-21 16:15:26.864867 7f7071ed6700 0 log [INF] : pgmap v1708: 192 pgs: 50 active+clean, 140 active+remapped, 2 active+clean+scrubbing; 1000 MB data, 5177 MB used, 457 GB / 464 GB avail -589> 2012-11-21 16:15:26.864873 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.0 10.97.4.84:6789/0 -- log(2 entries) v1 -- ?+0 0x2adf200 -588> 2012-11-21 16:15:26.864900 7f7071ed6700 0 log [INF] : mdsmap e32: 1/1/1 up {0=hotcpc12533=up:active} -587> 2012-11-21 16:15:26.864901 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.0 10.97.4.84:6789/0 -- log(2 entries) v1 -- ?+0 0x2adf000 -586> 2012-11-21 16:15:26.865303 7f7071ed6700 0 log [INF] : osdmap e776: 3 osds: 3 up, 3 in -585> 2012-11-21 16:15:26.865306 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.0 10.97.4.84:6789/0 -- log(2 entries) v1 -- ?+0 0x2b2b800 -584> 2012-11-21 16:15:26.865355 7f7071ed6700 0 log [INF] : monmap e3: 3 mons at {hotcpc12533=10.252.24.88:6789/0,hotcpc9039=10.252.24.25:6789/0,ldhfmi02=10.97.4.84:6789/0} -583> 2012-11-21 16:15:26.865359 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.0 10.97.4.84:6789/0 -- log(2 entries) v1 -- ?+0 0x2b2b600 -582> 2012-11-21 16:15:26.865375 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(logm active c 1943..2443) is_readable now=2012-11-21 16:15:26.865376 lease_expire=2012-11-21 16:15:31.813960 has v0 lc 2443 -581> 2012-11-21 16:15:26.865485 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(logm active c 1943..2443) is_readable now=2012-11-21 16:15:26.865486 lease_expire=2012-11-21 16:15:31.813960 has v0 lc 2443 -580> 2012-11-21 16:15:26.865500 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(auth active c 180..200) is_readable now=2012-11-21 16:15:26.865501 lease_expire=2012-11-21 16:15:31.864806 has v0 lc 200 -579> 2012-11-21 16:15:26.865542 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.252.24.88:6801/10082 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0x2adf600 con 0x2b1e3c0 -578> 2012-11-21 16:15:26.865558 7f7071ed6700 5 throttle(mon_daemon_bytes 0x7fff76f54250) put 56 (0x8b8988 -> 66) -577> 2012-11-21 16:15:26.865562 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(auth active c 180..200) is_readable now=2012-11-21 16:15:26.865562 lease_expire=2012-11-21 16:15:31.864806 has v0 lc 200 -576> 2012-11-21 16:15:26.865582 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.252.24.88:6804/9861 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0x2adf800 con 0x2b1e280 -575> 2012-11-21 16:15:26.865631 7f7071ed6700 5 throttle(mon_daemon_bytes 0x7fff76f54250) put 66 (0x8b8988 -> 0) -574> 2012-11-21 16:15:26.865643 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 965) -573> 2012-11-21 16:15:26.865646 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 15 ==== paxos(pgmap lease_ack lc 1708 fc 1208 pn 0 opn 0 gv {}) v2 ==== 88+0+0 (4224772149 0 0) 0x2b2a000 con 0x2ad93c0 -572> 2012-11-21 16:15:26.865657 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 877) -571> 2012-11-21 16:15:26.865659 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.0 10.97.4.84:6789/0 0 ==== log(2 entries) v1 ==== 0+0+0 (0 0 0) 0x2adf200 con 0x2a6e280 -570> 2012-11-21 16:15:26.865663 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(logm active c 1943..2443) is_readable now=2012-11-21 16:15:26.865663 lease_expire=2012-11-21 16:15:31.813960 has v0 lc 2443 -569> 2012-11-21 16:15:26.865689 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 16 ==== paxos(mdsmap lease_ack lc 32 fc 1 pn 0 opn 0 gv {}) v2 ==== 88+0+0 (3733686681 0 0) 0x2b2aa00 con 0x2ad93c0 -568> 2012-11-21 16:15:26.865696 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 789) -567> 2012-11-21 16:15:26.865697 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.0 10.97.4.84:6789/0 0 ==== log(2 entries) v1 ==== 0+0+0 (0 0 0) 0x2adf000 con 0x2a6e280 -566> 2012-11-21 16:15:26.865701 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(logm active c 1943..2443) is_readable now=2012-11-21 16:15:26.865701 lease_expire=2012-11-21 16:15:31.813960 has v0 lc 2443 -565> 2012-11-21 16:15:26.865725 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 17 ==== paxos(osdmap lease_ack lc 776 fc 276 pn 0 opn 0 gv {}) v2 ==== 88+0+0 (1081025264 0 0) 0x2b2ac80 con 0x2ad93c0 -564> 2012-11-21 16:15:26.865732 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 701) -563> 2012-11-21 16:15:26.865733 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.0 10.97.4.84:6789/0 0 ==== log(2 entries) v1 ==== 0+0+0 (0 0 0) 0x2b2b800 con 0x2a6e280 -562> 2012-11-21 16:15:26.865737 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(logm active c 1943..2443) is_readable now=2012-11-21 16:15:26.865737 lease_expire=2012-11-21 16:15:31.813960 has v0 lc 2443 -561> 2012-11-21 16:15:26.865761 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 18 ==== paxos(logm lease_ack lc 2443 fc 1943 pn 0 opn 0 gv {}) v2 ==== 88+0+0 (2736230982 0 0) 0x2b2a500 con 0x2ad93c0 -560> 2012-11-21 16:15:26.865766 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 613) -559> 2012-11-21 16:15:26.865768 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.0 10.97.4.84:6789/0 0 ==== log(2 entries) v1 ==== 0+0+0 (0 0 0) 0x2b2b600 con 0x2a6e280 -558> 2012-11-21 16:15:26.865772 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(logm active c 1943..2443) is_readable now=2012-11-21 16:15:26.865772 lease_expire=2012-11-21 16:15:31.813960 has v0 lc 2443 -557> 2012-11-21 16:15:26.865796 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 19 ==== forward(log(1 entries) v1) to leader v1 ==== 525+0+0 (1740994845 0 0) 0x2a8ddc0 con 0x2ad93c0 -556> 2012-11-21 16:15:26.865802 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(logm active c 1943..2443) is_readable now=2012-11-21 16:15:26.865802 lease_expire=2012-11-21 16:15:31.813960 has v0 lc 2443 -555> 2012-11-21 16:15:26.865809 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 525 (0x8b8988 -> 88) -554> 2012-11-21 16:15:26.865811 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 20 ==== paxos(monmap lease_ack lc 3 fc 1 pn 0 opn 0 gv {}) v2 ==== 88+0+0 (2413959786 0 0) 0x2b2da00 con 0x2ad93c0 -553> 2012-11-21 16:15:26.865816 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -552> 2012-11-21 16:15:26.866748 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -551> 2012-11-21 16:15:26.866789 7f7070ad0700 5 throttle(mon_daemon_bytes 0x7fff76f54250) get 158 (0 -> 158) -550> 2012-11-21 16:15:26.866793 7f7070ad0700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 158 (88 -> 246) -549> 2012-11-21 16:15:26.866808 7f7070dd3700 5 throttle(mon_daemon_bytes 0x7fff76f54250) get 174 (158 -> 332) -548> 2012-11-21 16:15:26.866810 7f7070dd3700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 174 (246 -> 420) -547> 2012-11-21 16:15:26.866829 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 21 ==== paxos(auth lease_ack lc 200 fc 179 pn 0 opn 0 gv {}) v2 ==== 88+0+0 (903880718 0 0) 0x2b2a780 con 0x2ad93c0 -546> 2012-11-21 16:15:26.866851 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 332) -545> 2012-11-21 16:15:26.866857 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== osd.0 10.252.24.88:6801/10082 2 ==== auth(proto 2 128 bytes epoch 0) v1 ==== 158+0+0 (3441231263 0 0) 0x2b2bc00 con 0x2b1e3c0 -544> 2012-11-21 16:15:26.866866 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(auth active c 180..200) is_readable now=2012-11-21 16:15:26.866867 lease_expire=2012-11-21 16:15:31.864806 has v0 lc 200 -543> 2012-11-21 16:15:26.867062 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.252.24.88:6801/10082 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0x2b2b400 con 0x2b1e3c0 -542> 2012-11-21 16:15:26.867098 7f7071ed6700 5 throttle(mon_daemon_bytes 0x7fff76f54250) put 158 (0x8b8988 -> 174) -541> 2012-11-21 16:15:26.867107 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 158 (0x8b8988 -> 174) -540> 2012-11-21 16:15:26.867112 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mds.0 10.252.24.88:6804/9861 2 ==== auth(proto 2 144 bytes epoch 0) v1 ==== 174+0+0 (3677256538 0 0) 0x2b2be00 con 0x2b1e280 -539> 2012-11-21 16:15:26.867122 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(auth active c 180..200) is_readable now=2012-11-21 16:15:26.867122 lease_expire=2012-11-21 16:15:31.864806 has v0 lc 200 -538> 2012-11-21 16:15:26.867232 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.252.24.88:6804/9861 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0x2b2bc00 con 0x2b1e280 -537> 2012-11-21 16:15:26.867292 7f7071ed6700 5 throttle(mon_daemon_bytes 0x7fff76f54250) put 174 (0x8b8988 -> 0) -536> 2012-11-21 16:15:26.867303 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 174 (0x8b8988 -> 0) -535> 2012-11-21 16:15:26.868297 7f7070ad0700 5 throttle(mon_daemon_bytes 0x7fff76f54250) get 69 (0 -> 69) -534> 2012-11-21 16:15:26.868304 7f7070ad0700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 69 (0 -> 69) -533> 2012-11-21 16:15:26.868323 7f7070ad0700 5 throttle(mon_daemon_bytes 0x7fff76f54250) get 69 (69 -> 138) -532> 2012-11-21 16:15:26.868325 7f7070ad0700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 69 (69 -> 138) -531> 2012-11-21 16:15:26.868341 7f7070dd3700 5 throttle(mon_daemon_bytes 0x7fff76f54250) get 61 (138 -> 199) -530> 2012-11-21 16:15:26.868343 7f7070dd3700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 61 (138 -> 199) -529> 2012-11-21 16:15:26.868360 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== osd.0 10.252.24.88:6801/10082 3 ==== mon_subscribe({monmap=4+,osd_pg_creates=0,osdmap=769}) v2 ==== 69+0+0 (841924443 0 0) 0x2abac40 con 0x2b1e3c0 -528> 2012-11-21 16:15:26.868403 7f7071ed6700 5 mon.ldhfmi02@0(leader).osd e776 send_incremental [769..776] to osd.0 10.252.24.88:6801/10082 -527> 2012-11-21 16:15:26.868596 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> osd.0 10.252.24.88:6801/10082 -- osd_map(769..776 src has 276..776) v3 -- ?+0 0x2b2be00 -526> 2012-11-21 16:15:26.868649 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> osd.0 10.252.24.88:6801/10082 -- mon_subscribe_ack(300s) v1 -- ?+0 0x2aba1c0 -525> 2012-11-21 16:15:26.868670 7f7071ed6700 5 throttle(mon_daemon_bytes 0x7fff76f54250) put 69 (0x8b8988 -> 130) -524> 2012-11-21 16:15:26.868677 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 69 (0x8b8988 -> 130) -523> 2012-11-21 16:15:26.868682 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mds.0 10.252.24.88:6804/9861 3 ==== mon_subscribe({mdsmap=33+,monmap=4+,osdmap=777}) v2 ==== 61+0+0 (2230330311 0 0) 0x2aba700 con 0x2b1e280 -522> 2012-11-21 16:15:26.868696 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mds.0 10.252.24.88:6804/9861 -- mon_subscribe_ack(300s) v1 -- ?+0 0x2abac40 -521> 2012-11-21 16:15:26.868717 7f7071ed6700 5 throttle(mon_daemon_bytes 0x7fff76f54250) put 61 (0x8b8988 -> 69) -520> 2012-11-21 16:15:26.868723 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 61 (0x8b8988 -> 69) -519> 2012-11-21 16:15:26.868728 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== osd.0 10.252.24.88:6801/10082 4 ==== mon_subscribe({monmap=4+,osd_pg_creates=0,osdmap=769}) v2 ==== 69+0+0 (841924443 0 0) 0x2aba540 con 0x2b1e3c0 -518> 2012-11-21 16:15:26.868740 7f7071ed6700 5 mon.ldhfmi02@0(leader).osd e776 send_incremental [769..776] to osd.0 10.252.24.88:6801/10082 -517> 2012-11-21 16:15:26.868787 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> osd.0 10.252.24.88:6801/10082 -- osd_map(769..776 src has 276..776) v3 -- ?+0 0x2b2b200 -516> 2012-11-21 16:15:26.868821 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> osd.0 10.252.24.88:6801/10082 -- mon_subscribe_ack(300s) v1 -- ?+0 0x2aba700 -515> 2012-11-21 16:15:26.868838 7f7071ed6700 5 throttle(mon_daemon_bytes 0x7fff76f54250) put 69 (0x8b8988 -> 0) -514> 2012-11-21 16:15:26.868844 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 69 (0x8b8988 -> 0) -513> 2012-11-21 16:15:26.915536 7f70716d5700 5 mon.ldhfmi02@0(leader).paxos(logm active c 1943..2443) propose_new_value 2444 1386 bytes, gv 5163 -512> 2012-11-21 16:15:27.030657 7f70708ce700 1 -- 10.97.4.84:6789/0 >> :/0 pipe(0x2addb40 sd=21 :6789 pgs=0 cs=0 l=0).accept sd=21 -511> 2012-11-21 16:15:27.031872 7f70716d5700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(logm begin lc 2443 fc 0 pn 2700 opn 0 gv {2444=5163}) v2 -- ?+0 0x2b2dc80 -510> 2012-11-21 16:15:27.032191 7f70708ce700 5 throttle(mon_daemon_bytes 0x7fff76f54250) get 66 (0 -> 66) -509> 2012-11-21 16:15:27.032204 7f70708ce700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 66 (0 -> 66) -508> 2012-11-21 16:15:27.032230 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mds.? 10.252.24.88:6803/14568 1 ==== auth(proto 0 36 bytes epoch 3) v1 ==== 66+0+0 (1406463741 0 0) 0x2adf800 con 0x2b1e140 -507> 2012-11-21 16:15:27.032250 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(auth active c 180..200) is_readable now=2012-11-21 16:15:27.032251 lease_expire=2012-11-21 16:15:31.864806 has v0 lc 200 -506> 2012-11-21 16:15:27.032301 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.252.24.88:6803/14568 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0x2b2bc00 con 0x2b1e140 -505> 2012-11-21 16:15:27.032318 7f7071ed6700 5 throttle(mon_daemon_bytes 0x7fff76f54250) put 66 (0x8b8988 -> 0) -504> 2012-11-21 16:15:27.032324 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 66 (0x8b8988 -> 0) -503> 2012-11-21 16:15:27.032900 7f70708ce700 5 throttle(mon_daemon_bytes 0x7fff76f54250) get 62 (0 -> 62) -502> 2012-11-21 16:15:27.032912 7f70708ce700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 62 (0 -> 62) -501> 2012-11-21 16:15:27.032939 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mds.? 10.252.24.88:6803/14568 2 ==== auth(proto 2 32 bytes epoch 0) v1 ==== 62+0+0 (2257355744 0 0) 0x2b51200 con 0x2b1e140 -500> 2012-11-21 16:15:27.032956 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(auth active c 180..200) is_readable now=2012-11-21 16:15:27.032957 lease_expire=2012-11-21 16:15:31.864806 has v0 lc 200 -499> 2012-11-21 16:15:27.033043 7f7071ed6700 0 cephx server mds.hotcpc12533: unexpected key: req.key=5f9c533cec61ba21 expected_key=e910546ae293f5a1 -498> 2012-11-21 16:15:27.033057 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.252.24.88:6803/14568 -- auth_reply(proto 2 -1 Operation not permitted) v1 -- ?+0 0x2adf800 con 0x2b1e140 -497> 2012-11-21 16:15:27.033069 7f7071ed6700 5 throttle(mon_daemon_bytes 0x7fff76f54250) put 62 (0x8b8988 -> 0) -496> 2012-11-21 16:15:27.033073 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 62 (0x8b8988 -> 0) -495> 2012-11-21 16:15:27.082155 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -494> 2012-11-21 16:15:27.082256 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 22 ==== paxos(logm accept lc 2443 fc 0 pn 2700 opn 0 gv {}) v2 ==== 88+0+0 (3670173582 0 0) 0x2b2dc80 con 0x2ad93c0 -493> 2012-11-21 16:15:27.085158 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(logm commit lc 2444 fc 0 pn 2700 opn 0 gv {2444=5163}) v2 -- ?+0 0x2b52780 -492> 2012-11-21 16:15:27.085235 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(logm lease lc 2444 fc 1943 pn 0 opn 0 gv {}) v2 -- ?+0 0x2b52500 -491> 2012-11-21 16:15:27.091707 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.97.4.84:6789/0 -- log(last 1) v1 -- ?+0 0x2aba540 con 0x2a6e280 -490> 2012-11-21 16:15:27.091747 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.97.4.84:6789/0 -- log(last 2) v1 -- ?+0 0x2aba000 con 0x2a6e280 -489> 2012-11-21 16:15:27.091764 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.97.4.84:6789/0 -- log(last 3) v1 -- ?+0 0x2abbe00 con 0x2a6e280 -488> 2012-11-21 16:15:27.091782 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.97.4.84:6789/0 -- log(last 4) v1 -- ?+0 0x2aba700 con 0x2a6e280 -487> 2012-11-21 16:15:27.091797 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.97.4.84:6789/0 -- log(last 5) v1 -- ?+0 0x2aba1c0 con 0x2a6e280 -486> 2012-11-21 16:15:27.091821 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.252.24.88:6789/0 -- route(log(last 1) v1 tid 1) v2 -- ?+0 0x2b2e6c0 con 0x2ad93c0 -485> 2012-11-21 16:15:27.091846 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -484> 2012-11-21 16:15:27.091890 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.0 10.97.4.84:6789/0 0 ==== log(last 1) v1 ==== 0+0+0 (0 0 0) 0x2aba540 con 0x2a6e280 -483> 2012-11-21 16:15:27.091914 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.0 10.97.4.84:6789/0 0 ==== log(last 2) v1 ==== 0+0+0 (0 0 0) 0x2aba000 con 0x2a6e280 -482> 2012-11-21 16:15:27.091929 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.0 10.97.4.84:6789/0 0 ==== log(last 3) v1 ==== 0+0+0 (0 0 0) 0x2abbe00 con 0x2a6e280 -481> 2012-11-21 16:15:27.091945 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.0 10.97.4.84:6789/0 0 ==== log(last 4) v1 ==== 0+0+0 (0 0 0) 0x2aba700 con 0x2a6e280 -480> 2012-11-21 16:15:27.091961 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.0 10.97.4.84:6789/0 0 ==== log(last 5) v1 ==== 0+0+0 (0 0 0) 0x2aba1c0 con 0x2a6e280 -479> 2012-11-21 16:15:27.240414 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -478> 2012-11-21 16:15:27.240488 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 23 ==== paxos(logm lease_ack lc 2444 fc 1943 pn 0 opn 0 gv {}) v2 ==== 88+0+0 (3748140879 0 0) 0x2b52500 con 0x2ad93c0 -477> 2012-11-21 16:15:27.240532 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -476> 2012-11-21 16:15:27.640882 7f7070ad0700 5 throttle(mon_daemon_bytes 0x7fff76f54250) get 69 (0 -> 69) -475> 2012-11-21 16:15:27.640911 7f7070ad0700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 69 (0 -> 69) -474> 2012-11-21 16:15:27.640977 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== osd.0 10.252.24.88:6801/10082 5 ==== mon_subscribe({monmap=4+,osd_pg_creates=0,osdmap=769}) v2 ==== 69+0+0 (841924443 0 0) 0x2aba380 con 0x2b1e3c0 -473> 2012-11-21 16:15:27.641024 7f7071ed6700 5 mon.ldhfmi02@0(leader).osd e776 send_incremental [769..776] to osd.0 10.252.24.88:6801/10082 -472> 2012-11-21 16:15:27.641143 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> osd.0 10.252.24.88:6801/10082 -- osd_map(769..776 src has 276..776) v3 -- ?+0 0x2b2b000 -471> 2012-11-21 16:15:27.641232 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> osd.0 10.252.24.88:6801/10082 -- mon_subscribe_ack(300s) v1 -- ?+0 0x2aba1c0 -470> 2012-11-21 16:15:27.641269 7f7071ed6700 5 throttle(mon_daemon_bytes 0x7fff76f54250) put 69 (0x8b8988 -> 0) -469> 2012-11-21 16:15:27.641282 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 69 (0x8b8988 -> 0) -468> 2012-11-21 16:15:27.647026 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -467> 2012-11-21 16:15:27.647922 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -466> 2012-11-21 16:15:27.648730 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -465> 2012-11-21 16:15:27.649572 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -464> 2012-11-21 16:15:27.650361 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -463> 2012-11-21 16:15:27.651195 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -462> 2012-11-21 16:15:27.651862 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -461> 2012-11-21 16:15:27.652191 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -460> 2012-11-21 16:15:27.652548 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -459> 2012-11-21 16:15:27.652887 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -458> 2012-11-21 16:15:27.653383 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -457> 2012-11-21 16:15:27.653884 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -456> 2012-11-21 16:15:27.654359 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -455> 2012-11-21 16:15:27.655041 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -454> 2012-11-21 16:15:27.655623 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -453> 2012-11-21 16:15:27.656382 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -452> 2012-11-21 16:15:27.657206 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -451> 2012-11-21 16:15:27.657988 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -450> 2012-11-21 16:15:27.658793 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -449> 2012-11-21 16:15:27.659582 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -448> 2012-11-21 16:15:27.660357 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -447> 2012-11-21 16:15:27.661187 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -446> 2012-11-21 16:15:27.661977 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -445> 2012-11-21 16:15:27.662881 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -444> 2012-11-21 16:15:27.663747 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -443> 2012-11-21 16:15:27.664277 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -442> 2012-11-21 16:15:27.664588 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -441> 2012-11-21 16:15:27.664897 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -440> 2012-11-21 16:15:27.665271 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -439> 2012-11-21 16:15:27.666184 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -438> 2012-11-21 16:15:27.666671 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -437> 2012-11-21 16:15:27.666985 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -436> 2012-11-21 16:15:27.667320 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -435> 2012-11-21 16:15:27.667684 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -434> 2012-11-21 16:15:27.667992 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -433> 2012-11-21 16:15:27.668303 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -432> 2012-11-21 16:15:27.668603 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -431> 2012-11-21 16:15:27.668909 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -430> 2012-11-21 16:15:27.669208 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -429> 2012-11-21 16:15:27.669500 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -428> 2012-11-21 16:15:27.669807 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -427> 2012-11-21 16:15:27.670112 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -426> 2012-11-21 16:15:27.670453 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -425> 2012-11-21 16:15:27.670751 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -424> 2012-11-21 16:15:27.671056 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -423> 2012-11-21 16:15:27.671355 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -422> 2012-11-21 16:15:27.671661 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -421> 2012-11-21 16:15:27.671979 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -420> 2012-11-21 16:15:27.672282 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -419> 2012-11-21 16:15:27.672585 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -418> 2012-11-21 16:15:27.672892 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -417> 2012-11-21 16:15:27.673195 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -416> 2012-11-21 16:15:27.673493 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -415> 2012-11-21 16:15:27.673785 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -414> 2012-11-21 16:15:27.674896 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -413> 2012-11-21 16:15:27.675919 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -412> 2012-11-21 16:15:27.683146 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -411> 2012-11-21 16:15:27.683741 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -410> 2012-11-21 16:15:27.684144 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -409> 2012-11-21 16:15:27.684463 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -408> 2012-11-21 16:15:27.685161 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -407> 2012-11-21 16:15:27.685634 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -406> 2012-11-21 16:15:27.686426 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -405> 2012-11-21 16:15:27.687868 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -404> 2012-11-21 16:15:27.688600 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -403> 2012-11-21 16:15:27.690862 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -402> 2012-11-21 16:15:27.693103 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -401> 2012-11-21 16:15:27.694874 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -400> 2012-11-21 16:15:27.695595 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -399> 2012-11-21 16:15:27.696098 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -398> 2012-11-21 16:15:27.696637 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -397> 2012-11-21 16:15:27.697130 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -396> 2012-11-21 16:15:27.697704 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -395> 2012-11-21 16:15:27.698398 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -394> 2012-11-21 16:15:27.699212 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -393> 2012-11-21 16:15:27.699871 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -392> 2012-11-21 16:15:27.700204 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -391> 2012-11-21 16:15:27.700691 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -390> 2012-11-21 16:15:27.701490 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -389> 2012-11-21 16:15:27.702220 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -388> 2012-11-21 16:15:27.702511 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -387> 2012-11-21 16:15:27.703004 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -386> 2012-11-21 16:15:27.703622 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -385> 2012-11-21 16:15:27.704416 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -384> 2012-11-21 16:15:27.705097 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -383> 2012-11-21 16:15:27.705543 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -382> 2012-11-21 16:15:27.706186 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -381> 2012-11-21 16:15:27.707039 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -380> 2012-11-21 16:15:27.707921 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -379> 2012-11-21 16:15:27.708920 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -378> 2012-11-21 16:15:27.709744 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -377> 2012-11-21 16:15:27.710594 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -376> 2012-11-21 16:15:27.711341 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -375> 2012-11-21 16:15:27.712166 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -374> 2012-11-21 16:15:27.713150 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -373> 2012-11-21 16:15:27.714076 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -372> 2012-11-21 16:15:27.714644 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -371> 2012-11-21 16:15:27.715220 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -370> 2012-11-21 16:15:27.715657 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -369> 2012-11-21 16:15:27.716083 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -368> 2012-11-21 16:15:27.716524 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -367> 2012-11-21 16:15:27.716994 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -366> 2012-11-21 16:15:27.717701 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -365> 2012-11-21 16:15:27.718500 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -364> 2012-11-21 16:15:27.718909 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -363> 2012-11-21 16:15:27.719323 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -362> 2012-11-21 16:15:27.720121 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -361> 2012-11-21 16:15:27.720902 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -360> 2012-11-21 16:15:27.721890 7f7077b2c700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :0 pgs=0 cs=0 l=0).connect error 10.252.24.25:6789/0, 111: Connection refused -359> 2012-11-21 16:15:27.736643 7f7070dd3700 5 throttle(mon_daemon_bytes 0x7fff76f54250) get 61 (0 -> 61) -358> 2012-11-21 16:15:27.736660 7f7070dd3700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 61 (0 -> 61) -357> 2012-11-21 16:15:27.736720 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mds.0 10.252.24.88:6804/9861 4 ==== mon_subscribe({mdsmap=33+,monmap=4+,osdmap=777}) v2 ==== 61+0+0 (2230330311 0 0) 0x2aba000 con 0x2b1e280 -356> 2012-11-21 16:15:27.736753 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mds.0 10.252.24.88:6804/9861 -- mon_subscribe_ack(300s) v1 -- ?+0 0x2aba380 -355> 2012-11-21 16:15:27.736765 7f7071ed6700 5 throttle(mon_daemon_bytes 0x7fff76f54250) put 61 (0x8b8988 -> 0) -354> 2012-11-21 16:15:27.736771 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 61 (0x8b8988 -> 0) -353> 2012-11-21 16:15:28.366511 7f7070dd3700 5 throttle(mon_daemon_bytes 0x7fff76f54250) get 250 (0 -> 250) -352> 2012-11-21 16:15:28.366541 7f7070dd3700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 250 (0 -> 250) -351> 2012-11-21 16:15:28.366612 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mds.0 10.252.24.88:6804/9861 5 ==== mdsbeacon(5600/hotcpc12533 up:active seq 1219 v32) v2 ==== 250+0+0 (2617823255 0 0) 0x2b52a00 con 0x2b1e280 -350> 2012-11-21 16:15:28.366641 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(mdsmap active c 1..32) is_readable now=2012-11-21 16:15:28.366643 lease_expire=2012-11-21 16:15:31.763297 has v32 lc 32 -349> 2012-11-21 16:15:28.366674 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.252.24.88:6804/9861 -- mdsbeacon(5600/hotcpc12533 up:active seq 1219 v32) v2 -- ?+0 0x2b52500 con 0x2b1e280 -348> 2012-11-21 16:15:28.366691 7f7071ed6700 5 throttle(mon_daemon_bytes 0x7fff76f54250) put 250 (0x8b8988 -> 0) -347> 2012-11-21 16:15:28.366698 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 250 (0x8b8988 -> 0) -346> 2012-11-21 16:15:28.563265 7f70706cc700 1 -- 10.97.4.84:6789/0 >> :/0 pipe(0x2b2ed80 sd=20 :6789 pgs=0 cs=0 l=0).accept sd=20 -345> 2012-11-21 16:15:28.564041 7f70706cc700 0 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2b2ed80 sd=20 :6789 pgs=0 cs=0 l=0).accept connect_seq 0 vs existing 0 state connecting -344> 2012-11-21 16:15:28.598281 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 535 (0 -> 535) -343> 2012-11-21 16:15:28.598342 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 24 ==== election(d6e91ff1-9b43-4972-b7a7-a22d84497d78 propose 3) v3 ==== 535+0+0 (2258607269 0 0) 0x2de46c0 con 0x2ad93c0 -342> 2012-11-21 16:15:28.598374 7f7071ed6700 5 mon.ldhfmi02@0(leader).elector(2) handle_propose from mon.2 -341> 2012-11-21 16:15:28.706707 7f70705cb700 1 -- 10.97.4.84:6789/0 >> :/0 pipe(0x2b2eb40 sd=23 :6789 pgs=0 cs=0 l=0).accept sd=23 -340> 2012-11-21 16:15:28.707458 7f70705cb700 5 throttle(mon_daemon_bytes 0x7fff76f54250) get 56 (0 -> 56) -339> 2012-11-21 16:15:28.707472 7f70705cb700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 56 (535 -> 591) -338> 2012-11-21 16:15:28.716500 7f7071ed6700 0 log [INF] : mon.ldhfmi02 calling new monitor election -337> 2012-11-21 16:15:28.716514 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.0 10.97.4.84:6789/0 -- log(2 entries) v1 -- ?+0 0x2adfa00 -336> 2012-11-21 16:15:28.716533 7f7071ed6700 5 mon.ldhfmi02@0(electing).elector(3) start -- can i be leader? -335> 2012-11-21 16:15:28.716546 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.1 10.252.24.25:6789/0 -- election(d6e91ff1-9b43-4972-b7a7-a22d84497d78 propose 3) v3 -- ?+0 0x2addd80 -334> 2012-11-21 16:15:28.716569 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- election(d6e91ff1-9b43-4972-b7a7-a22d84497d78 propose 3) v3 -- ?+0 0x2b2e480 -333> 2012-11-21 16:15:28.716590 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 535 (0x8b8988 -> 56) -332> 2012-11-21 16:15:28.716597 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.0 10.97.4.84:6789/0 0 ==== log(2 entries) v1 ==== 0+0+0 (0 0 0) 0x2adfa00 con 0x2a6e280 -331> 2012-11-21 16:15:28.716608 7f7071ed6700 1 mon.ldhfmi02@0(electing).paxos(logm active c 1944..2444) is_readable now=2012-11-21 16:15:28.716609 lease_expire=2012-11-21 16:15:32.085233 has v0 lc 2444 -330> 2012-11-21 16:15:28.716621 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== osd.2 10.252.58.31:6800/18530 1 ==== auth(proto 0 26 bytes epoch 3) v1 ==== 56+0+0 (3992736148 0 0) 0x2a6ce00 con 0x2b1e640 -329> 2012-11-21 16:15:28.716632 7f7071ed6700 5 mon.ldhfmi02@0(electing) e3 waitlisting message auth(proto 0 26 bytes epoch 3) v1 until we get in quorum -328> 2012-11-21 16:15:28.716642 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 56 (0x8b8988 -> 0) -327> 2012-11-21 16:15:28.717907 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 535 (0 -> 535) -326> 2012-11-21 16:15:28.717951 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 25 ==== election(d6e91ff1-9b43-4972-b7a7-a22d84497d78 ack 3) v3 ==== 535+0+0 (2958674775 0 0) 0x2de4480 con 0x2ad93c0 -325> 2012-11-21 16:15:28.717983 7f7071ed6700 5 mon.ldhfmi02@0(electing).elector(3) handle_ack from mon.2 -324> 2012-11-21 16:15:28.717986 7f7071ed6700 5 mon.ldhfmi02@0(electing).elector(3) so far i have {0=8388607,2=8388607} -323> 2012-11-21 16:15:28.717992 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 535 (0x8b8988 -> 0) -322> 2012-11-21 16:15:30.721557 7f70706cc700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2b2ed80 sd=20 :6789 pgs=0 cs=0 l=0).fault 0: Success -321> 2012-11-21 16:15:30.722684 7f70706cc700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 87 (0 -> 87) -320> 2012-11-21 16:15:30.722719 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.1 10.252.24.25:6789/0 1 ==== mon_probe(probe d6e91ff1-9b43-4972-b7a7-a22d84497d78 name hotcpc9039) v3 ==== 87+0+0 (2914156390 0 0) 0x2adbd00 con 0x2ad9640 -319> 2012-11-21 16:15:30.722753 7f7071ed6700 5 mon.ldhfmi02@0(electing) e3 setting monitor caps on this connection -318> 2012-11-21 16:15:30.722765 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.252.24.25:6789/0 -- mon_probe(reply d6e91ff1-9b43-4972-b7a7-a22d84497d78 name ldhfmi02 versions {auth=200,logm=2444,mdsmap=32,monmap=3,osdmap=776,pgmap=1708}) v3 -- ?+0 0x2adb680 con 0x2ad9640 -317> 2012-11-21 16:15:30.722816 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 87 (0x8b8988 -> 0) -316> 2012-11-21 16:15:30.722837 7f70706cc700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 535 (0 -> 535) -315> 2012-11-21 16:15:30.722893 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.1 10.252.24.25:6789/0 2 ==== election(d6e91ff1-9b43-4972-b7a7-a22d84497d78 propose 1) v3 ==== 535+0+0 (3793525197 0 0) 0x2b2e6c0 con 0x2ad9640 -314> 2012-11-21 16:15:30.722935 7f7071ed6700 5 mon.ldhfmi02@0(electing).elector(3) handle_propose from mon.1 -313> 2012-11-21 16:15:30.722938 7f7071ed6700 5 mon.ldhfmi02@0(electing).elector(3) ignoring old propose -312> 2012-11-21 16:15:30.722942 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 535 (0x8b8988 -> 0) -311> 2012-11-21 16:15:30.722956 7f70706cc700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 535 (0 -> 535) -310> 2012-11-21 16:15:30.722975 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.1 10.252.24.25:6789/0 3 ==== election(d6e91ff1-9b43-4972-b7a7-a22d84497d78 propose 3) v3 ==== 535+0+0 (2258607269 0 0) 0x2de46c0 con 0x2ad9640 -309> 2012-11-21 16:15:30.722988 7f7071ed6700 5 mon.ldhfmi02@0(electing).elector(3) handle_propose from mon.1 -308> 2012-11-21 16:15:30.722990 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 535 (0x8b8988 -> 0) -307> 2012-11-21 16:15:30.723006 7f70706cc700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 685 (0 -> 685) -306> 2012-11-21 16:15:30.723028 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.1 10.252.24.25:6789/0 4 ==== mon_probe(reply d6e91ff1-9b43-4972-b7a7-a22d84497d78 name hotcpc9039 versions {auth=200,logm=2443,mdsmap=32,monmap=3,osdmap=776,pgmap=1708}) v3 ==== 685+0+0 (3298921512 0 0) 0x2adb000 con 0x2ad9640 -305> 2012-11-21 16:15:30.723040 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 685 (0x8b8988 -> 0) -304> 2012-11-21 16:15:30.723049 7f70706cc700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 535 (0 -> 535) -303> 2012-11-21 16:15:30.723069 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.1 10.252.24.25:6789/0 5 ==== election(d6e91ff1-9b43-4972-b7a7-a22d84497d78 ack 3) v3 ==== 535+0+0 (2958674775 0 0) 0x2add480 con 0x2ad9640 -302> 2012-11-21 16:15:30.723089 7f7071ed6700 5 mon.ldhfmi02@0(electing).elector(3) handle_ack from mon.1 -301> 2012-11-21 16:15:30.723093 7f7071ed6700 5 mon.ldhfmi02@0(electing).elector(3) so far i have {0=8388607,1=8388607,2=8388607} -300> 2012-11-21 16:15:30.726030 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.1 10.252.24.25:6789/0 -- election(d6e91ff1-9b43-4972-b7a7-a22d84497d78 victory 4) v3 -- ?+0 0x2de46c0 -299> 2012-11-21 16:15:30.726047 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- election(d6e91ff1-9b43-4972-b7a7-a22d84497d78 victory 4) v3 -- ?+0 0x2b2e240 -298> 2012-11-21 16:15:30.726061 7f7071ed6700 0 log [INF] : mon.ldhfmi02@0 won leader election with quorum 0,1,2 -297> 2012-11-21 16:15:30.726064 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.0 10.97.4.84:6789/0 -- log(1 entries) v1 -- ?+0 0x2b2bc00 -296> 2012-11-21 16:15:30.727935 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.1 10.252.24.25:6789/0 -- paxos(pgmap collect lc 1708 fc 1208 pn 2800 opn 0 gv {}) v2 -- ?+0 0x2b52a00 -295> 2012-11-21 16:15:30.727952 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(pgmap collect lc 1708 fc 1208 pn 2800 opn 0 gv {}) v2 -- ?+0 0x2b2dc80 -294> 2012-11-21 16:15:30.729774 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.1 10.252.24.25:6789/0 -- paxos(mdsmap collect lc 32 fc 1 pn 2800 opn 0 gv {}) v2 -- ?+0 0x2b52280 -293> 2012-11-21 16:15:30.729789 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(mdsmap collect lc 32 fc 1 pn 2800 opn 0 gv {}) v2 -- ?+0 0x2b52000 -292> 2012-11-21 16:15:30.730351 7f70706cc700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (535 -> 623) -291> 2012-11-21 16:15:30.731885 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.1 10.252.24.25:6789/0 -- paxos(osdmap collect lc 776 fc 276 pn 2800 opn 0 gv {}) v2 -- ?+0 0x2b52c80 -290> 2012-11-21 16:15:30.731904 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(osdmap collect lc 776 fc 276 pn 2800 opn 0 gv {}) v2 -- ?+0 0x2df7c80 -289> 2012-11-21 16:15:30.732304 7f70706cc700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (623 -> 711) -288> 2012-11-21 16:15:30.733747 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.1 10.252.24.25:6789/0 -- paxos(logm collect lc 2444 fc 1944 pn 2800 opn 0 gv {}) v2 -- ?+0 0x2df7a00 -287> 2012-11-21 16:15:30.733763 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(logm collect lc 2444 fc 1944 pn 2800 opn 0 gv {}) v2 -- ?+0 0x2df7780 -286> 2012-11-21 16:15:30.734116 7f70706cc700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (711 -> 799) -285> 2012-11-21 16:15:30.735529 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.1 10.252.24.25:6789/0 -- paxos(monmap collect lc 3 fc 1 pn 2800 opn 0 gv {}) v2 -- ?+0 0x2df7500 -284> 2012-11-21 16:15:30.735544 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(monmap collect lc 3 fc 1 pn 2800 opn 0 gv {}) v2 -- ?+0 0x2df7280 -283> 2012-11-21 16:15:30.735660 7f70706cc700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (799 -> 887) -282> 2012-11-21 16:15:30.737227 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.1 10.252.24.25:6789/0 -- paxos(auth collect lc 200 fc 180 pn 2800 opn 0 gv {}) v2 -- ?+0 0x2df7000 -281> 2012-11-21 16:15:30.737267 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(auth collect lc 200 fc 180 pn 2800 opn 0 gv {}) v2 -- ?+0 0x2dfdc80 -280> 2012-11-21 16:15:30.737301 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(auth recovering c 180..200) is_readable now=2012-11-21 16:15:30.737302 lease_expire=0.000000 has v0 lc 200 -279> 2012-11-21 16:15:30.737343 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 535 (0x8b8988 -> 352) -278> 2012-11-21 16:15:30.737351 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.0 10.97.4.84:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x2b2bc00 con 0x2a6e280 -277> 2012-11-21 16:15:30.737362 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(logm recovering c 1944..2444) is_readable now=2012-11-21 16:15:30.737362 lease_expire=0.000000 has v0 lc 2444 -276> 2012-11-21 16:15:30.737369 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.1 10.252.24.25:6789/0 6 ==== paxos(pgmap last lc 1708 fc 1208 pn 2800 opn 0 gv {}) v2 ==== 88+0+0 (401348621 0 0) 0x2b52a00 con 0x2ad9640 -275> 2012-11-21 16:15:30.737380 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 264) -274> 2012-11-21 16:15:30.737385 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.1 10.252.24.25:6789/0 7 ==== paxos(mdsmap last lc 32 fc 1 pn 2800 opn 0 gv {}) v2 ==== 88+0+0 (1596078401 0 0) 0x2b52280 con 0x2ad9640 -273> 2012-11-21 16:15:30.737394 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 176) -272> 2012-11-21 16:15:30.737398 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.1 10.252.24.25:6789/0 8 ==== paxos(osdmap last lc 776 fc 276 pn 2800 opn 0 gv {}) v2 ==== 88+0+0 (301288311 0 0) 0x2b52c80 con 0x2ad9640 -271> 2012-11-21 16:15:30.737413 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 88) -270> 2012-11-21 16:15:30.737418 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.1 10.252.24.25:6789/0 9 ==== paxos(logm last lc 2443 fc 1943 pn 2800 opn 0 gv {}) v2 ==== 88+0+0 (2504904113 0 0) 0x2df7a00 con 0x2ad9640 -269> 2012-11-21 16:15:30.737429 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -268> 2012-11-21 16:15:30.737441 7f70706cc700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -267> 2012-11-21 16:15:30.737459 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.1 10.252.24.25:6789/0 10 ==== paxos(monmap last lc 3 fc 1 pn 2800 opn 0 gv {}) v2 ==== 88+0+0 (92626348 0 0) 0x2df7500 con 0x2ad9640 -266> 2012-11-21 16:15:30.737470 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -265> 2012-11-21 16:15:30.738907 7f70706cc700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -264> 2012-11-21 16:15:30.738931 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.1 10.252.24.25:6789/0 11 ==== paxos(auth last lc 200 fc 179 pn 2800 opn 0 gv {}) v2 ==== 88+0+0 (128290639 0 0) 0x2df7000 con 0x2ad9640 -263> 2012-11-21 16:15:30.738945 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -262> 2012-11-21 16:15:30.796821 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -261> 2012-11-21 16:15:30.796878 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 26 ==== paxos(pgmap last lc 1708 fc 1208 pn 2800 opn 0 gv {}) v2 ==== 88+0+0 (888266124 0 0) 0x2dfdc80 con 0x2ad93c0 -260> 2012-11-21 16:15:30.796909 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.1 10.252.24.25:6789/0 -- paxos(pgmap lease lc 1708 fc 1208 pn 0 opn 0 gv {}) v2 -- ?+0 0x2df7000 -259> 2012-11-21 16:15:30.796945 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(pgmap lease lc 1708 fc 1208 pn 0 opn 0 gv {}) v2 -- ?+0 0x2df7500 -258> 2012-11-21 16:15:30.796972 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -257> 2012-11-21 16:15:30.797895 7f70706cc700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -256> 2012-11-21 16:15:30.797920 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.1 10.252.24.25:6789/0 12 ==== paxos(pgmap lease_ack lc 1708 fc 1208 pn 0 opn 0 gv {}) v2 ==== 88+0+0 (2376454763 0 0) 0x2df7000 con 0x2ad9640 -255> 2012-11-21 16:15:30.797936 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -254> 2012-11-21 16:15:30.820752 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -253> 2012-11-21 16:15:30.820782 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 27 ==== paxos(mdsmap last lc 32 fc 1 pn 2800 opn 0 gv {}) v2 ==== 88+0+0 (114251843 0 0) 0x2df7500 con 0x2ad93c0 -252> 2012-11-21 16:15:30.820801 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.1 10.252.24.25:6789/0 -- paxos(mdsmap lease lc 32 fc 1 pn 0 opn 0 gv {}) v2 -- ?+0 0x2df7000 -251> 2012-11-21 16:15:30.820831 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(mdsmap lease lc 32 fc 1 pn 0 opn 0 gv {}) v2 -- ?+0 0x2dfdc80 -250> 2012-11-21 16:15:30.820857 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -249> 2012-11-21 16:15:30.821886 7f70706cc700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -248> 2012-11-21 16:15:30.821911 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.1 10.252.24.25:6789/0 13 ==== paxos(mdsmap lease_ack lc 32 fc 1 pn 0 opn 0 gv {}) v2 ==== 88+0+0 (2947858679 0 0) 0x2df7000 con 0x2ad9640 -247> 2012-11-21 16:15:30.821927 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -246> 2012-11-21 16:15:30.846103 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -245> 2012-11-21 16:15:30.846137 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 28 ==== paxos(osdmap last lc 776 fc 276 pn 2800 opn 0 gv {}) v2 ==== 88+0+0 (1288350641 0 0) 0x2dfdc80 con 0x2ad93c0 -244> 2012-11-21 16:15:30.846160 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.1 10.252.24.25:6789/0 -- paxos(osdmap lease lc 776 fc 276 pn 0 opn 0 gv {}) v2 -- ?+0 0x2df7000 -243> 2012-11-21 16:15:30.846188 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(osdmap lease lc 776 fc 276 pn 0 opn 0 gv {}) v2 -- ?+0 0x2df7500 -242> 2012-11-21 16:15:30.846213 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -241> 2012-11-21 16:15:30.847188 7f70706cc700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -240> 2012-11-21 16:15:30.847221 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.1 10.252.24.25:6789/0 14 ==== paxos(osdmap lease_ack lc 776 fc 276 pn 0 opn 0 gv {}) v2 ==== 88+0+0 (466192171 0 0) 0x2df7000 con 0x2ad9640 -239> 2012-11-21 16:15:30.847242 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -238> 2012-11-21 16:15:30.871401 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -237> 2012-11-21 16:15:30.871427 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 29 ==== paxos(logm last lc 2444 fc 1943 pn 2800 opn 0 gv {}) v2 ==== 88+0+0 (869935783 0 0) 0x2df7500 con 0x2ad93c0 -236> 2012-11-21 16:15:30.871511 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.1 10.252.24.25:6789/0 -- paxos(logm commit lc 2444 fc 0 pn 0 opn 0 gv {2444=5163}) v2 -- ?+0 0x2df7000 -235> 2012-11-21 16:15:30.871551 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.1 10.252.24.25:6789/0 -- paxos(logm lease lc 2444 fc 1944 pn 0 opn 0 gv {}) v2 -- ?+0 0x2dfdc80 -234> 2012-11-21 16:15:30.871576 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(logm lease lc 2444 fc 1944 pn 0 opn 0 gv {}) v2 -- ?+0 0x2dfd780 -233> 2012-11-21 16:15:30.871601 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -232> 2012-11-21 16:15:30.876364 7f70706cc700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -231> 2012-11-21 16:15:30.876402 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.1 10.252.24.25:6789/0 15 ==== paxos(logm lease_ack lc 2444 fc 1943 pn 0 opn 0 gv {}) v2 ==== 88+0+0 (2432482327 0 0) 0x2dfda00 con 0x2ad9640 -230> 2012-11-21 16:15:30.876420 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -229> 2012-11-21 16:15:30.878404 7f70706cc700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 524 (0 -> 524) -228> 2012-11-21 16:15:30.878441 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.1 10.252.24.25:6789/0 16 ==== forward(log(1 entries) v1) to leader v1 ==== 524+0+0 (3459506518 0 0) 0x2a8e080 con 0x2ad9640 -227> 2012-11-21 16:15:30.878457 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(logm active c 1944..2444) is_readable now=2012-11-21 16:15:30.878458 lease_expire=2012-11-21 16:15:35.871549 has v0 lc 2444 -226> 2012-11-21 16:15:30.878484 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 524 (0x8b8988 -> 0) -225> 2012-11-21 16:15:30.878502 7f70706cc700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 524 (0 -> 524) -224> 2012-11-21 16:15:30.878526 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.1 10.252.24.25:6789/0 17 ==== forward(log(1 entries) v1) to leader v1 ==== 524+0+0 (2631418196 0 0) 0x2a8ddc0 con 0x2ad9640 -223> 2012-11-21 16:15:30.878540 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(logm active c 1944..2444) is_readable now=2012-11-21 16:15:30.878541 lease_expire=2012-11-21 16:15:35.871549 has v0 lc 2444 -222> 2012-11-21 16:15:30.878552 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 524 (0x8b8988 -> 0) -221> 2012-11-21 16:15:30.896845 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -220> 2012-11-21 16:15:30.896885 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 30 ==== paxos(monmap last lc 3 fc 1 pn 2800 opn 0 gv {}) v2 ==== 88+0+0 (3007726736 0 0) 0x2dfd780 con 0x2ad93c0 -219> 2012-11-21 16:15:30.896910 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.1 10.252.24.25:6789/0 -- paxos(monmap lease lc 3 fc 1 pn 0 opn 0 gv {}) v2 -- ?+0 0x2dfda00 -218> 2012-11-21 16:15:30.896940 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(monmap lease lc 3 fc 1 pn 0 opn 0 gv {}) v2 -- ?+0 0x2df7500 -217> 2012-11-21 16:15:30.896970 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -216> 2012-11-21 16:15:30.897763 7f70706cc700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -215> 2012-11-21 16:15:30.897805 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.1 10.252.24.25:6789/0 18 ==== paxos(monmap lease_ack lc 3 fc 1 pn 0 opn 0 gv {}) v2 ==== 88+0+0 (978178080 0 0) 0x2dfda00 con 0x2ad9640 -214> 2012-11-21 16:15:30.897829 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -213> 2012-11-21 16:15:30.922102 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -212> 2012-11-21 16:15:30.922121 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (88 -> 176) -211> 2012-11-21 16:15:30.922128 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (176 -> 264) -210> 2012-11-21 16:15:30.922136 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (264 -> 352) -209> 2012-11-21 16:15:30.922142 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (352 -> 440) -208> 2012-11-21 16:15:30.922158 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 31 ==== paxos(auth last lc 200 fc 180 pn 2800 opn 0 gv {}) v2 ==== 88+0+0 (1741245297 0 0) 0x2df7500 con 0x2ad93c0 -207> 2012-11-21 16:15:30.922182 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.1 10.252.24.25:6789/0 -- paxos(auth lease lc 200 fc 180 pn 0 opn 0 gv {}) v2 -- ?+0 0x2dfda00 -206> 2012-11-21 16:15:30.922213 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(auth lease lc 200 fc 180 pn 0 opn 0 gv {}) v2 -- ?+0 0x2dfd780 -205> 2012-11-21 16:15:30.922263 7f7071ed6700 0 log [INF] : pgmap v1708: 192 pgs: 50 active+clean, 140 active+remapped, 2 active+clean+scrubbing; 1000 MB data, 5177 MB used, 457 GB / 464 GB avail -204> 2012-11-21 16:15:30.922344 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.0 10.97.4.84:6789/0 -- log(2 entries) v1 -- ?+0 0x2b2b200 -203> 2012-11-21 16:15:30.922374 7f7071ed6700 0 log [INF] : mdsmap e32: 1/1/1 up {0=hotcpc12533=up:active} -202> 2012-11-21 16:15:30.922394 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.0 10.97.4.84:6789/0 -- log(2 entries) v1 -- ?+0 0x2b2be00 -201> 2012-11-21 16:15:30.922919 7f7071ed6700 0 log [INF] : osdmap e776: 3 osds: 3 up, 3 in -200> 2012-11-21 16:15:30.922947 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.0 10.97.4.84:6789/0 -- log(2 entries) v1 -- ?+0 0x2b51e00 -199> 2012-11-21 16:15:30.922973 7f7071ed6700 0 log [INF] : monmap e3: 3 mons at {hotcpc12533=10.252.24.88:6789/0,hotcpc9039=10.252.24.25:6789/0,ldhfmi02=10.97.4.84:6789/0} -198> 2012-11-21 16:15:30.922993 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.0 10.97.4.84:6789/0 -- log(2 entries) v1 -- ?+0 0x2b51c00 -197> 2012-11-21 16:15:30.923008 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(logm active c 1944..2444) is_readable now=2012-11-21 16:15:30.923009 lease_expire=2012-11-21 16:15:35.871549 has v0 lc 2444 -196> 2012-11-21 16:15:30.923049 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(logm active c 1944..2444) is_readable now=2012-11-21 16:15:30.923050 lease_expire=2012-11-21 16:15:35.871549 has v0 lc 2444 -195> 2012-11-21 16:15:30.923063 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(auth active c 180..200) is_readable now=2012-11-21 16:15:30.923064 lease_expire=2012-11-21 16:15:35.922181 has v0 lc 200 -194> 2012-11-21 16:15:30.923097 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.252.58.31:6800/18530 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0x2b2bc00 con 0x2b1e640 -193> 2012-11-21 16:15:30.923151 7f7071ed6700 5 throttle(mon_daemon_bytes 0x7fff76f54250) put 56 (0x8b8988 -> 0) -192> 2012-11-21 16:15:30.923160 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(logm active c 1944..2444) is_readable now=2012-11-21 16:15:30.923162 lease_expire=2012-11-21 16:15:35.871549 has v0 lc 2444 -191> 2012-11-21 16:15:30.923175 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(logm active c 1944..2444) is_readable now=2012-11-21 16:15:30.923176 lease_expire=2012-11-21 16:15:35.871549 has v0 lc 2444 -190> 2012-11-21 16:15:30.923192 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 352) -189> 2012-11-21 16:15:30.923197 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 32 ==== paxos(pgmap lease_ack lc 1708 fc 1208 pn 0 opn 0 gv {}) v2 ==== 88+0+0 (15101005 0 0) 0x2df7280 con 0x2ad93c0 -188> 2012-11-21 16:15:30.923211 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 264) -187> 2012-11-21 16:15:30.923216 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.0 10.97.4.84:6789/0 0 ==== log(2 entries) v1 ==== 0+0+0 (0 0 0) 0x2b2b200 con 0x2a6e280 -186> 2012-11-21 16:15:30.923225 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(logm active c 1944..2444) is_readable now=2012-11-21 16:15:30.923225 lease_expire=2012-11-21 16:15:35.871549 has v0 lc 2444 -185> 2012-11-21 16:15:30.923255 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 33 ==== paxos(mdsmap lease_ack lc 32 fc 1 pn 0 opn 0 gv {}) v2 ==== 88+0+0 (3027133626 0 0) 0x2df7780 con 0x2ad93c0 -184> 2012-11-21 16:15:30.923268 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 176) -183> 2012-11-21 16:15:30.923273 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.0 10.97.4.84:6789/0 0 ==== log(2 entries) v1 ==== 0+0+0 (0 0 0) 0x2b2be00 con 0x2a6e280 -182> 2012-11-21 16:15:30.923281 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(logm active c 1944..2444) is_readable now=2012-11-21 16:15:30.923282 lease_expire=2012-11-21 16:15:35.871549 has v0 lc 2444 -181> 2012-11-21 16:15:30.923312 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 34 ==== paxos(osdmap lease_ack lc 776 fc 276 pn 0 opn 0 gv {}) v2 ==== 88+0+0 (1934020318 0 0) 0x2df7c80 con 0x2ad93c0 -180> 2012-11-21 16:15:30.923323 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 88) -179> 2012-11-21 16:15:30.923329 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.0 10.97.4.84:6789/0 0 ==== log(2 entries) v1 ==== 0+0+0 (0 0 0) 0x2b51e00 con 0x2a6e280 -178> 2012-11-21 16:15:30.923338 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(logm active c 1944..2444) is_readable now=2012-11-21 16:15:30.923338 lease_expire=2012-11-21 16:15:35.871549 has v0 lc 2444 -177> 2012-11-21 16:15:30.923368 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 35 ==== paxos(logm lease_ack lc 2444 fc 1943 pn 0 opn 0 gv {}) v2 ==== 88+0+0 (912214905 0 0) 0x2df7a00 con 0x2ad93c0 -176> 2012-11-21 16:15:30.923379 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -175> 2012-11-21 16:15:30.923384 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.0 10.97.4.84:6789/0 0 ==== log(2 entries) v1 ==== 0+0+0 (0 0 0) 0x2b51c00 con 0x2a6e280 -174> 2012-11-21 16:15:30.923392 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(logm active c 1944..2444) is_readable now=2012-11-21 16:15:30.923393 lease_expire=2012-11-21 16:15:35.871549 has v0 lc 2444 -173> 2012-11-21 16:15:30.923432 7f70706cc700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -172> 2012-11-21 16:15:30.923455 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.1 10.252.24.25:6789/0 19 ==== paxos(auth lease_ack lc 200 fc 179 pn 0 opn 0 gv {}) v2 ==== 88+0+0 (3451220669 0 0) 0x2dfda00 con 0x2ad9640 -171> 2012-11-21 16:15:30.923469 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -170> 2012-11-21 16:15:30.924339 7f70705cb700 5 throttle(mon_daemon_bytes 0x7fff76f54250) get 158 (0 -> 158) -169> 2012-11-21 16:15:30.924348 7f70705cb700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 158 (0 -> 158) -168> 2012-11-21 16:15:30.924381 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== osd.2 10.252.58.31:6800/18530 2 ==== auth(proto 2 128 bytes epoch 0) v1 ==== 158+0+0 (1761291510 0 0) 0x2e01200 con 0x2b1e640 -167> 2012-11-21 16:15:30.924396 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(auth active c 180..200) is_readable now=2012-11-21 16:15:30.924397 lease_expire=2012-11-21 16:15:35.922181 has v0 lc 200 -166> 2012-11-21 16:15:30.924576 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.252.58.31:6800/18530 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0x2adf800 con 0x2b1e640 -165> 2012-11-21 16:15:30.924612 7f7071ed6700 5 throttle(mon_daemon_bytes 0x7fff76f54250) put 158 (0x8b8988 -> 0) -164> 2012-11-21 16:15:30.924622 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 158 (0x8b8988 -> 0) -163> 2012-11-21 16:15:30.925302 7f70705cb700 5 throttle(mon_daemon_bytes 0x7fff76f54250) get 42 (0 -> 42) -162> 2012-11-21 16:15:30.925310 7f70705cb700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 42 (0 -> 42) -161> 2012-11-21 16:15:30.925331 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== osd.2 10.252.58.31:6800/18530 3 ==== mon_subscribe({monmap=4+,osdmap=773}) v2 ==== 42+0+0 (1219124097 0 0) 0x2abac40 con 0x2b1e640 -160> 2012-11-21 16:15:30.925351 7f7071ed6700 5 mon.ldhfmi02@0(leader).osd e776 send_incremental [773..776] to osd.2 10.252.58.31:6800/18530 -159> 2012-11-21 16:15:30.925392 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> osd.2 10.252.58.31:6800/18530 -- osd_map(773..776 src has 276..776) v3 -- ?+0 0x2e01200 -158> 2012-11-21 16:15:30.925432 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> osd.2 10.252.58.31:6800/18530 -- mon_subscribe_ack(300s) v1 -- ?+0 0x2aba000 -157> 2012-11-21 16:15:30.925456 7f7071ed6700 5 throttle(mon_daemon_bytes 0x7fff76f54250) put 42 (0x8b8988 -> 0) -156> 2012-11-21 16:15:30.925463 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 42 (0x8b8988 -> 0) -155> 2012-11-21 16:15:30.947504 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 525 (0 -> 525) -154> 2012-11-21 16:15:30.947547 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (525 -> 613) -153> 2012-11-21 16:15:30.947560 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (613 -> 701) -152> 2012-11-21 16:15:30.948227 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 36 ==== forward(log(1 entries) v1) to leader v1 ==== 525+0+0 (363961065 0 0) 0x2a8db00 con 0x2ad93c0 -151> 2012-11-21 16:15:30.948260 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(logm active c 1944..2444) is_readable now=2012-11-21 16:15:30.948261 lease_expire=2012-11-21 16:15:35.871549 has v0 lc 2444 -150> 2012-11-21 16:15:30.948288 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 525 (0x8b8988 -> 176) -149> 2012-11-21 16:15:30.948297 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 37 ==== paxos(monmap lease_ack lc 3 fc 1 pn 0 opn 0 gv {}) v2 ==== 88+0+0 (3117456758 0 0) 0x2dfd780 con 0x2ad93c0 -148> 2012-11-21 16:15:30.948320 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 88) -147> 2012-11-21 16:15:30.948330 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 38 ==== paxos(auth lease_ack lc 200 fc 180 pn 0 opn 0 gv {}) v2 ==== 88+0+0 (2497131613 0 0) 0x2e06000 con 0x2ad93c0 -146> 2012-11-21 16:15:30.948353 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -145> 2012-11-21 16:15:30.973233 7f70716d5700 5 mon.ldhfmi02@0(leader).paxos(logm active c 1944..2444) propose_new_value 2445 1889 bytes, gv 5164 -144> 2012-11-21 16:15:31.092496 7f70716d5700 1 -- 10.97.4.84:6789/0 --> mon.1 10.252.24.25:6789/0 -- paxos(logm begin lc 2444 fc 0 pn 2800 opn 0 gv {2445=5164}) v2 -- ?+0 0x2b2da00 -143> 2012-11-21 16:15:31.092546 7f70716d5700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(logm begin lc 2444 fc 0 pn 2800 opn 0 gv {2445=5164}) v2 -- ?+0 0x2b2dc80 -142> 2012-11-21 16:15:31.095573 7f70706cc700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -141> 2012-11-21 16:15:31.095633 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.1 10.252.24.25:6789/0 20 ==== paxos(logm accept lc 2444 fc 0 pn 2800 opn 0 gv {}) v2 ==== 88+0+0 (1182492761 0 0) 0x2b2da00 con 0x2ad9640 -140> 2012-11-21 16:15:31.100927 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.1 10.252.24.25:6789/0 -- paxos(logm commit lc 2445 fc 0 pn 2800 opn 0 gv {2445=5164}) v2 -- ?+0 0x2dfd780 -139> 2012-11-21 16:15:31.101012 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(logm commit lc 2445 fc 0 pn 2800 opn 0 gv {2445=5164}) v2 -- ?+0 0x2dfda00 -138> 2012-11-21 16:15:31.101080 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -137> 2012-11-21 16:15:31.147967 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -136> 2012-11-21 16:15:31.148021 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 39 ==== paxos(logm accept lc 2444 fc 0 pn 2800 opn 0 gv {}) v2 ==== 88+0+0 (1659706812 0 0) 0x2dfda00 con 0x2ad93c0 -135> 2012-11-21 16:15:31.148057 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.1 10.252.24.25:6789/0 -- paxos(logm lease lc 2445 fc 1944 pn 0 opn 0 gv {}) v2 -- ?+0 0x2b2da00 -134> 2012-11-21 16:15:31.148107 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(logm lease lc 2445 fc 1944 pn 0 opn 0 gv {}) v2 -- ?+0 0x2df7a00 -133> 2012-11-21 16:15:31.148849 7f70706cc700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (88 -> 176) -132> 2012-11-21 16:15:31.156025 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.97.4.84:6789/0 -- log(last 7) v1 -- ?+0 0x2abac40 con 0x2a6e280 -131> 2012-11-21 16:15:31.156061 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.252.24.25:6789/0 -- route(log(last 1) v1 tid 1) v2 -- ?+0 0x2de4000 con 0x2ad9640 -130> 2012-11-21 16:15:31.156114 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.97.4.84:6789/0 -- log(last 8) v1 -- ?+0 0x2abb540 con 0x2a6e280 -129> 2012-11-21 16:15:31.156137 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.97.4.84:6789/0 -- log(last 9) v1 -- ?+0 0x2abbe00 con 0x2a6e280 -128> 2012-11-21 16:15:31.156152 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.97.4.84:6789/0 -- log(last 10) v1 -- ?+0 0x2abbc40 con 0x2a6e280 -127> 2012-11-21 16:15:31.156171 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.97.4.84:6789/0 -- log(last 11) v1 -- ?+0 0x2abba80 con 0x2a6e280 -126> 2012-11-21 16:15:31.156186 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.252.24.88:6789/0 -- route(log(last 2) v1 tid 2) v2 -- ?+0 0x2de46c0 con 0x2ad93c0 -125> 2012-11-21 16:15:31.156232 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 88) -124> 2012-11-21 16:15:31.156244 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.1 10.252.24.25:6789/0 21 ==== paxos(logm lease_ack lc 2445 fc 1944 pn 0 opn 0 gv {}) v2 ==== 88+0+0 (3113459373 0 0) 0x2b2da00 con 0x2ad9640 -123> 2012-11-21 16:15:31.156268 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -122> 2012-11-21 16:15:31.156277 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.0 10.97.4.84:6789/0 0 ==== log(last 7) v1 ==== 0+0+0 (0 0 0) 0x2abac40 con 0x2a6e280 -121> 2012-11-21 16:15:31.156294 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.0 10.97.4.84:6789/0 0 ==== log(last 8) v1 ==== 0+0+0 (0 0 0) 0x2abb540 con 0x2a6e280 -120> 2012-11-21 16:15:31.156310 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.0 10.97.4.84:6789/0 0 ==== log(last 9) v1 ==== 0+0+0 (0 0 0) 0x2abbe00 con 0x2a6e280 -119> 2012-11-21 16:15:31.156325 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.0 10.97.4.84:6789/0 0 ==== log(last 10) v1 ==== 0+0+0 (0 0 0) 0x2abbc40 con 0x2a6e280 -118> 2012-11-21 16:15:31.156341 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.0 10.97.4.84:6789/0 0 ==== log(last 11) v1 ==== 0+0+0 (0 0 0) 0x2abba80 con 0x2a6e280 -117> 2012-11-21 16:15:31.248014 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -116> 2012-11-21 16:15:31.248093 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 40 ==== paxos(logm lease_ack lc 2445 fc 1944 pn 0 opn 0 gv {}) v2 ==== 88+0+0 (1600040501 0 0) 0x2df7a00 con 0x2ad93c0 -115> 2012-11-21 16:15:31.248153 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -114> 2012-11-21 16:15:31.400509 7f70716d5700 1 mon.ldhfmi02@0(leader).paxos(pgmap active c 1208..1708) is_readable now=2012-11-21 16:15:31.400522 lease_expire=2012-11-21 16:15:35.796906 has v0 lc 1708 -113> 2012-11-21 16:15:31.400549 7f70716d5700 1 mon.ldhfmi02@0(leader).paxos(pgmap active c 1208..1708) is_readable now=2012-11-21 16:15:31.400550 lease_expire=2012-11-21 16:15:35.796906 has v0 lc 1708 -112> 2012-11-21 16:15:31.400602 7f70716d5700 5 mon.ldhfmi02@0(leader).paxos(auth active c 180..200) propose_new_value 201 649 bytes, gv 5165 -111> 2012-11-21 16:15:31.510455 7f70716d5700 1 -- 10.97.4.84:6789/0 --> mon.1 10.252.24.25:6789/0 -- paxos(auth begin lc 200 fc 0 pn 2800 opn 0 gv {201=5165}) v2 -- ?+0 0x2b2d780 -110> 2012-11-21 16:15:31.510512 7f70716d5700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(auth begin lc 200 fc 0 pn 2800 opn 0 gv {201=5165}) v2 -- ?+0 0x2b2d500 -109> 2012-11-21 16:15:31.513723 7f70706cc700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -108> 2012-11-21 16:15:31.513777 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.1 10.252.24.25:6789/0 22 ==== paxos(auth accept lc 200 fc 0 pn 2800 opn 0 gv {}) v2 ==== 88+0+0 (2828698670 0 0) 0x2b2d780 con 0x2ad9640 -107> 2012-11-21 16:15:31.520641 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.1 10.252.24.25:6789/0 -- paxos(auth commit lc 201 fc 0 pn 2800 opn 0 gv {201=5165}) v2 -- ?+0 0x2df7a00 -106> 2012-11-21 16:15:31.520849 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(auth commit lc 201 fc 0 pn 2800 opn 0 gv {201=5165}) v2 -- ?+0 0x2b2da00 -105> 2012-11-21 16:15:31.520945 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -104> 2012-11-21 16:15:31.566359 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -103> 2012-11-21 16:15:31.566424 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 41 ==== paxos(auth accept lc 200 fc 0 pn 2800 opn 0 gv {}) v2 ==== 88+0+0 (3031326636 0 0) 0x2dfd000 con 0x2ad93c0 -102> 2012-11-21 16:15:31.566464 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.1 10.252.24.25:6789/0 -- paxos(auth lease lc 201 fc 180 pn 0 opn 0 gv {}) v2 -- ?+0 0x2b2d780 -101> 2012-11-21 16:15:31.566512 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(auth lease lc 201 fc 180 pn 0 opn 0 gv {}) v2 -- ?+0 0x2dfda00 -100> 2012-11-21 16:15:31.567899 7f70706cc700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (88 -> 176) -99> 2012-11-21 16:15:31.570583 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 88) -98> 2012-11-21 16:15:31.570607 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.1 10.252.24.25:6789/0 23 ==== paxos(auth lease_ack lc 201 fc 180 pn 0 opn 0 gv {}) v2 ==== 88+0+0 (2968445949 0 0) 0x2dfd280 con 0x2ad9640 -97> 2012-11-21 16:15:31.570636 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -96> 2012-11-21 16:15:31.664152 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -95> 2012-11-21 16:15:31.664235 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 42 ==== paxos(auth lease_ack lc 201 fc 180 pn 0 opn 0 gv {}) v2 ==== 88+0+0 (3060304900 0 0) 0x2dfda00 con 0x2ad93c0 -94> 2012-11-21 16:15:31.664283 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -93> 2012-11-21 16:15:32.105858 7f70706cc700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 26 (0 -> 26) -92> 2012-11-21 16:15:32.105925 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.1 10.252.24.25:6789/0 24 ==== global_id (6496) v1 ==== 26+0+0 (84759178 0 0) 0x2aba700 con 0x2ad9640 -91> 2012-11-21 16:15:32.105946 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(auth active c 181..201) is_readable now=2012-11-21 16:15:32.105947 lease_expire=2012-11-21 16:15:36.566462 has v0 lc 201 -90> 2012-11-21 16:15:32.105965 7f7071ed6700 5 mon.ldhfmi02@0(leader).paxos(auth active c 181..201) propose_new_value 202 19 bytes, gv 5166 -89> 2012-11-21 16:15:32.219408 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.1 10.252.24.25:6789/0 -- paxos(auth begin lc 201 fc 0 pn 2800 opn 0 gv {202=5166}) v2 -- ?+0 0x2dfda00 -88> 2012-11-21 16:15:32.219460 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(auth begin lc 201 fc 0 pn 2800 opn 0 gv {202=5166}) v2 -- ?+0 0x2dfd280 -87> 2012-11-21 16:15:32.219476 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 26 (0x8b8988 -> 0) -86> 2012-11-21 16:15:32.221827 7f70706cc700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -85> 2012-11-21 16:15:32.221865 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.1 10.252.24.25:6789/0 25 ==== paxos(auth accept lc 201 fc 0 pn 2800 opn 0 gv {}) v2 ==== 88+0+0 (369760030 0 0) 0x2dfda00 con 0x2ad9640 -84> 2012-11-21 16:15:32.228817 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.1 10.252.24.25:6789/0 -- paxos(auth commit lc 202 fc 0 pn 2800 opn 0 gv {202=5166}) v2 -- ?+0 0x2dfd000 -83> 2012-11-21 16:15:32.228849 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(auth commit lc 202 fc 0 pn 2800 opn 0 gv {202=5166}) v2 -- ?+0 0x2df7c80 -82> 2012-11-21 16:15:32.228864 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -81> 2012-11-21 16:15:32.271285 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -80> 2012-11-21 16:15:32.271352 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 43 ==== paxos(auth accept lc 201 fc 0 pn 2800 opn 0 gv {}) v2 ==== 88+0+0 (950127759 0 0) 0x2df7c80 con 0x2ad93c0 -79> 2012-11-21 16:15:32.271398 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.1 10.252.24.25:6789/0 -- paxos(auth lease lc 202 fc 181 pn 0 opn 0 gv {}) v2 -- ?+0 0x2dfda00 -78> 2012-11-21 16:15:32.271415 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> mon.2 10.252.24.88:6789/0 -- paxos(auth lease lc 202 fc 181 pn 0 opn 0 gv {}) v2 -- ?+0 0x2df7780 -77> 2012-11-21 16:15:32.273088 7f70706cc700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (88 -> 176) -76> 2012-11-21 16:15:32.277781 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 88) -75> 2012-11-21 16:15:32.277808 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.1 10.252.24.25:6789/0 26 ==== paxos(auth lease_ack lc 202 fc 180 pn 0 opn 0 gv {}) v2 ==== 88+0+0 (1608341968 0 0) 0x2dfda00 con 0x2ad9640 -74> 2012-11-21 16:15:32.277838 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -73> 2012-11-21 16:15:32.282748 7f70706cc700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :50720 pgs=6 cs=1 l=0).reader couldn't read tag, Success -72> 2012-11-21 16:15:32.282782 7f70706cc700 2 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :50720 pgs=6 cs=1 l=0).fault 0: Success -71> 2012-11-21 16:15:32.282821 7f70706cc700 0 -- 10.97.4.84:6789/0 >> 10.252.24.25:6789/0 pipe(0x2a67b40 sd=17 :50720 pgs=6 cs=1 l=0).fault with nothing to send, going to standby -70> 2012-11-21 16:15:32.283187 7f70703c9700 1 -- 10.97.4.84:6789/0 >> :/0 pipe(0x2b2e900 sd=20 :6789 pgs=0 cs=0 l=0).accept sd=20 -69> 2012-11-21 16:15:32.283959 7f70703c9700 5 throttle(mon_daemon_bytes 0x7fff76f54250) get 56 (0 -> 56) -68> 2012-11-21 16:15:32.283971 7f70703c9700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 56 (0 -> 56) -67> 2012-11-21 16:15:32.284004 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== osd.1 10.252.24.25:6801/20153 1 ==== auth(proto 0 26 bytes epoch 3) v1 ==== 56+0+0 (3652012367 0 0) 0x2b51600 con 0x2e0b640 -66> 2012-11-21 16:15:32.284023 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(auth active c 182..202) is_readable now=2012-11-21 16:15:32.284024 lease_expire=2012-11-21 16:15:37.271396 has v0 lc 202 -65> 2012-11-21 16:15:32.284061 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.252.24.25:6801/20153 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0x2b2b000 con 0x2e0b640 -64> 2012-11-21 16:15:32.284072 7f7071ed6700 5 throttle(mon_daemon_bytes 0x7fff76f54250) put 56 (0x8b8988 -> 0) -63> 2012-11-21 16:15:32.284076 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 56 (0x8b8988 -> 0) -62> 2012-11-21 16:15:32.284539 7f70703c9700 5 throttle(mon_daemon_bytes 0x7fff76f54250) get 158 (0 -> 158) -61> 2012-11-21 16:15:32.284548 7f70703c9700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 158 (0 -> 158) -60> 2012-11-21 16:15:32.284569 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== osd.1 10.252.24.25:6801/20153 2 ==== auth(proto 2 128 bytes epoch 0) v1 ==== 158+0+0 (835346508 0 0) 0x2b51a00 con 0x2e0b640 -59> 2012-11-21 16:15:32.284582 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(auth active c 182..202) is_readable now=2012-11-21 16:15:32.284582 lease_expire=2012-11-21 16:15:37.271396 has v0 lc 202 -58> 2012-11-21 16:15:32.286178 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.252.24.25:6801/20153 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0x2b51600 con 0x2e0b640 -57> 2012-11-21 16:15:32.286194 7f7071ed6700 5 throttle(mon_daemon_bytes 0x7fff76f54250) put 158 (0x8b8988 -> 0) -56> 2012-11-21 16:15:32.286199 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 158 (0x8b8988 -> 0) -55> 2012-11-21 16:15:32.286748 7f70703c9700 5 throttle(mon_daemon_bytes 0x7fff76f54250) get 69 (0 -> 69) -54> 2012-11-21 16:15:32.286758 7f70703c9700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 69 (0 -> 69) -53> 2012-11-21 16:15:32.286809 7f70703c9700 5 throttle(mon_daemon_bytes 0x7fff76f54250) get 69 (69 -> 138) -52> 2012-11-21 16:15:32.286813 7f70703c9700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 69 (69 -> 138) -51> 2012-11-21 16:15:32.286836 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== osd.1 10.252.24.25:6801/20153 3 ==== mon_subscribe({monmap=4+,osd_pg_creates=0,osdmap=770}) v2 ==== 69+0+0 (729920370 0 0) 0x2abb380 con 0x2e0b640 -50> 2012-11-21 16:15:32.286868 7f7071ed6700 5 mon.ldhfmi02@0(leader).osd e776 send_incremental [770..776] to osd.1 10.252.24.25:6801/20153 -49> 2012-11-21 16:15:32.286937 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> osd.1 10.252.24.25:6801/20153 -- osd_map(770..776 src has 276..776) v3 -- ?+0 0x2b51a00 -48> 2012-11-21 16:15:32.286955 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> osd.1 10.252.24.25:6801/20153 -- mon_subscribe_ack(300s) v1 -- ?+0 0x2aba700 -47> 2012-11-21 16:15:32.286967 7f7071ed6700 5 throttle(mon_daemon_bytes 0x7fff76f54250) put 69 (0x8b8988 -> 69) -46> 2012-11-21 16:15:32.286974 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 69 (0x8b8988 -> 69) -45> 2012-11-21 16:15:32.286981 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== osd.1 10.252.24.25:6801/20153 4 ==== mon_subscribe({monmap=4+,osd_pg_creates=0,osdmap=770}) v2 ==== 69+0+0 (729920370 0 0) 0x2abb700 con 0x2e0b640 -44> 2012-11-21 16:15:32.286999 7f7071ed6700 5 mon.ldhfmi02@0(leader).osd e776 send_incremental [770..776] to osd.1 10.252.24.25:6801/20153 -43> 2012-11-21 16:15:32.287045 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> osd.1 10.252.24.25:6801/20153 -- osd_map(770..776 src has 276..776) v3 -- ?+0 0x2b51c00 -42> 2012-11-21 16:15:32.287060 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> osd.1 10.252.24.25:6801/20153 -- mon_subscribe_ack(300s) v1 -- ?+0 0x2abb380 -41> 2012-11-21 16:15:32.287070 7f7071ed6700 5 throttle(mon_daemon_bytes 0x7fff76f54250) put 69 (0x8b8988 -> 0) -40> 2012-11-21 16:15:32.287077 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 69 (0x8b8988 -> 0) -39> 2012-11-21 16:15:32.366618 7f7070dd3700 5 throttle(mon_daemon_bytes 0x7fff76f54250) get 250 (0 -> 250) -38> 2012-11-21 16:15:32.366655 7f7070dd3700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 250 (0 -> 250) -37> 2012-11-21 16:15:32.366719 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mds.0 10.252.24.88:6804/9861 6 ==== mdsbeacon(5600/hotcpc12533 up:active seq 1220 v32) v2 ==== 250+0+0 (1022797320 0 0) 0x2e14280 con 0x2b1e280 -36> 2012-11-21 16:15:32.366752 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(mdsmap active c 1..32) is_readable now=2012-11-21 16:15:32.366754 lease_expire=2012-11-21 16:15:35.820800 has v32 lc 32 -35> 2012-11-21 16:15:32.366777 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.252.24.88:6804/9861 -- mdsbeacon(5600/hotcpc12533 up:active seq 1220 v32) v2 -- ?+0 0x2dfda00 con 0x2b1e280 -34> 2012-11-21 16:15:32.366826 7f7071ed6700 5 throttle(mon_daemon_bytes 0x7fff76f54250) put 250 (0x8b8988 -> 0) -33> 2012-11-21 16:15:32.366840 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 250 (0x8b8988 -> 0) -32> 2012-11-21 16:15:32.368982 7f7070bd1700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 88 (0 -> 88) -31> 2012-11-21 16:15:32.369023 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== mon.2 10.252.24.88:6789/0 44 ==== paxos(auth lease_ack lc 202 fc 180 pn 0 opn 0 gv {}) v2 ==== 88+0+0 (558302973 0 0) 0x2df7780 con 0x2ad93c0 -30> 2012-11-21 16:15:32.369053 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 88 (0x8b8988 -> 0) -29> 2012-11-21 16:15:32.530189 7f7070bd1700 2 -- 10.97.4.84:6789/0 >> 10.252.24.88:6789/0 pipe(0x2a67900 sd=16 :43974 pgs=60779 cs=1 l=0).reader couldn't read tag, Success -28> 2012-11-21 16:15:32.530238 7f7070bd1700 2 -- 10.97.4.84:6789/0 >> 10.252.24.88:6789/0 pipe(0x2a67900 sd=16 :43974 pgs=60779 cs=1 l=0).fault 0: Success -27> 2012-11-21 16:15:32.530250 7f7070bd1700 0 -- 10.97.4.84:6789/0 >> 10.252.24.88:6789/0 pipe(0x2a67900 sd=16 :43974 pgs=60779 cs=1 l=0).fault with nothing to send, going to standby -26> 2012-11-21 16:15:32.530797 7f70701c7700 1 -- 10.97.4.84:6789/0 >> :/0 pipe(0x2de4d80 sd=22 :6789 pgs=0 cs=0 l=0).accept sd=22 -25> 2012-11-21 16:15:32.531649 7f70701c7700 5 throttle(mon_client_bytes 0x7fff76f542d0) get 60 (0 -> 60) -24> 2012-11-21 16:15:32.531662 7f70701c7700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 60 (0 -> 60) -23> 2012-11-21 16:15:32.531691 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== client.? 10.252.24.88:0/17185 1 ==== auth(proto 0 30 bytes epoch 3) v1 ==== 60+0+0 (700203682 0 0) 0x2b51600 con 0x2e0b3c0 -22> 2012-11-21 16:15:32.531706 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(auth active c 182..202) is_readable now=2012-11-21 16:15:32.531707 lease_expire=2012-11-21 16:15:37.271396 has v0 lc 202 -21> 2012-11-21 16:15:32.531739 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.252.24.88:0/17185 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0x2b2be00 con 0x2e0b3c0 -20> 2012-11-21 16:15:32.531748 7f7071ed6700 5 throttle(mon_client_bytes 0x7fff76f542d0) put 60 (0x8b8988 -> 0) -19> 2012-11-21 16:15:32.531751 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 60 (0x8b8988 -> 0) -18> 2012-11-21 16:15:32.532391 7f70701c7700 5 throttle(mon_client_bytes 0x7fff76f542d0) get 158 (0 -> 158) -17> 2012-11-21 16:15:32.532402 7f70701c7700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 158 (0 -> 158) -16> 2012-11-21 16:15:32.532429 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== client.? 10.252.24.88:0/17185 2 ==== auth(proto 2 128 bytes epoch 0) v1 ==== 158+0+0 (1688906841 0 0) 0x2adfa00 con 0x2e0b3c0 -15> 2012-11-21 16:15:32.532446 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(auth active c 182..202) is_readable now=2012-11-21 16:15:32.532447 lease_expire=2012-11-21 16:15:37.271396 has v0 lc 202 -14> 2012-11-21 16:15:32.532644 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> 10.252.24.88:0/17185 -- auth_reply(proto 2 0 Success) v1 -- ?+0 0x2b51600 con 0x2e0b3c0 -13> 2012-11-21 16:15:32.532655 7f7071ed6700 5 throttle(mon_client_bytes 0x7fff76f542d0) put 158 (0x8b8988 -> 0) -12> 2012-11-21 16:15:32.532657 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 158 (0x8b8988 -> 0) -11> 2012-11-21 16:15:32.533345 7f70701c7700 5 throttle(mon_client_bytes 0x7fff76f542d0) get 23 (0 -> 23) -10> 2012-11-21 16:15:32.533351 7f70701c7700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 23 (0 -> 23) -9> 2012-11-21 16:15:32.533365 7f70701c7700 5 throttle(mon_client_bytes 0x7fff76f542d0) get 75 (23 -> 98) -8> 2012-11-21 16:15:32.533366 7f70701c7700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) get 75 (23 -> 98) -7> 2012-11-21 16:15:32.533382 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== client.? 10.252.24.88:0/17185 3 ==== mon_subscribe({monmap=4+}) v2 ==== 23+0+0 (3193407737 0 0) 0x2aba700 con 0x2e0b3c0 -6> 2012-11-21 16:15:32.533398 7f7071ed6700 1 -- 10.97.4.84:6789/0 --> client.? 10.252.24.88:0/17185 -- mon_subscribe_ack(300s) v1 -- ?+0 0x2abb700 -5> 2012-11-21 16:15:32.533404 7f7071ed6700 5 throttle(mon_client_bytes 0x7fff76f542d0) put 23 (0x8b8988 -> 75) -4> 2012-11-21 16:15:32.533406 7f7071ed6700 5 throttle(msgr_dispatch_throttler-mon 0x2a76488) put 23 (0x8b8988 -> 75) -3> 2012-11-21 16:15:32.533407 7f7071ed6700 1 -- 10.97.4.84:6789/0 <== client.? 10.252.24.88:0/17185 4 ==== mon_command(pg map 10000000005.00000000 v 0) v1 ==== 75+0+0 (3885788949 0 0) 0x2abce00 con 0x2e0b3c0 -2> 2012-11-21 16:15:32.533413 7f7071ed6700 0 mon.ldhfmi02@0(leader) e3 handle_command mon_command(pg map 10000000005.00000000 v 0) v1 -1> 2012-11-21 16:15:32.533416 7f7071ed6700 1 mon.ldhfmi02@0(leader).paxos(pgmap active c 1208..1708) is_readable now=2012-11-21 16:15:32.533417 lease_expire=2012-11-21 16:15:35.796906 has v0 lc 1708 0> 2012-11-21 16:15:32.533949 7f7071ed6700 -1 ./osd/OSDMap.h: In function 'pg_t OSDMap::raw_pg_to_pg(pg_t) const' thread 7f7071ed6700 time 2012-11-21 16:15:32.533453 ./osd/OSDMap.h: 486: FAILED assert(pools.count(pg.pool())) ceph version 0.54 (commit:60b84b095b1009a305d4d6a5b16f88571cbd3150) 1: (PGMonitor::preprocess_command(MMonCommand*)+0xd60) [0x4eeba0] 2: (PGMonitor::preprocess_query(PaxosServiceMessage*)+0x2aa) [0x4ef85a] 3: (PaxosService::dispatch(PaxosServiceMessage*)+0x12d) [0x49e35d] 4: (Monitor::handle_command(MMonCommand*)+0x6f2) [0x47af22] 5: (Monitor::_ms_dispatch(Message*)+0x10ab) [0x48044b] 6: (Monitor::ms_dispatch(Message*)+0x7e) [0x491aee] 7: (DispatchQueue::entry()+0x6a9) [0x6267f9] 8: (DispatchQueue::DispatchThread::entry()+0xd) [0x62198d] 9: (()+0x68ca) [0x7f70771cd8ca] 10: (clone()+0x6d) [0x7f707611586d] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 5 lockdep 0/ 5 context 1/ 5 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 0 buffer 0/ 5 timer 0/ 5 filer 0/ 0 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 journaler 0/ 5 objectcacher 0/ 5 client 0/ 5 osd 0/ 5 optracker 0/ 5 objclass 1/ 5 filestore 1/ 5 journal 0/ 5 ms 1/ 5 mon 0/ 5 monc 0/ 5 paxos 0/ 5 tp 1/ 5 auth 1/ 5 finisher 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/ 5 hadoop 1/ 5 asok 1/ 5 throttle -2/-2 (syslog threshold) 99/99 (stderr threshold) max_recent 10000 max_new 1000000 log_file --- end dump of recent events --- terminate called after throwing an instance of 'ceph::FailedAssertion' *** Caught signal (Aborted) ** in thread 7f7071ed6700 ceph version 0.54 (commit:60b84b095b1009a305d4d6a5b16f88571cbd3150) 1: /usr/bin/ceph-mon() [0x5310b9] 2: (()+0xeff0) [0x7f70771d5ff0] 3: (gsignal()+0x35) [0x7f70760781b5] 4: (abort()+0x180) [0x7f707607afc0] 5: (__gnu_cxx::__verbose_terminate_handler()+0x115) [0x7f707690cdc5] 6: (()+0xcb166) [0x7f707690b166] 7: (()+0xcb193) [0x7f707690b193] 8: (()+0xcb28e) [0x7f707690b28e] 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x7c9) [0x554119] 10: (PGMonitor::preprocess_command(MMonCommand*)+0xd60) [0x4eeba0] 11: (PGMonitor::preprocess_query(PaxosServiceMessage*)+0x2aa) [0x4ef85a] 12: (PaxosService::dispatch(PaxosServiceMessage*)+0x12d) [0x49e35d] 13: (Monitor::handle_command(MMonCommand*)+0x6f2) [0x47af22] 14: (Monitor::_ms_dispatch(Message*)+0x10ab) [0x48044b] 15: (Monitor::ms_dispatch(Message*)+0x7e) [0x491aee] 16: (DispatchQueue::entry()+0x6a9) [0x6267f9] 17: (DispatchQueue::DispatchThread::entry()+0xd) [0x62198d] 18: (()+0x68ca) [0x7f70771cd8ca] 19: (clone()+0x6d) [0x7f707611586d] 2012-11-21 16:15:32.544163 7f7071ed6700 -1 *** Caught signal (Aborted) ** in thread 7f7071ed6700 ceph version 0.54 (commit:60b84b095b1009a305d4d6a5b16f88571cbd3150) 1: /usr/bin/ceph-mon() [0x5310b9] 2: (()+0xeff0) [0x7f70771d5ff0] 3: (gsignal()+0x35) [0x7f70760781b5] 4: (abort()+0x180) [0x7f707607afc0] 5: (__gnu_cxx::__verbose_terminate_handler()+0x115) [0x7f707690cdc5] 6: (()+0xcb166) [0x7f707690b166] 7: (()+0xcb193) [0x7f707690b193] 8: (()+0xcb28e) [0x7f707690b28e] 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x7c9) [0x554119] 10: (PGMonitor::preprocess_command(MMonCommand*)+0xd60) [0x4eeba0] 11: (PGMonitor::preprocess_query(PaxosServiceMessage*)+0x2aa) [0x4ef85a] 12: (PaxosService::dispatch(PaxosServiceMessage*)+0x12d) [0x49e35d] 13: (Monitor::handle_command(MMonCommand*)+0x6f2) [0x47af22] 14: (Monitor::_ms_dispatch(Message*)+0x10ab) [0x48044b] 15: (Monitor::ms_dispatch(Message*)+0x7e) [0x491aee] 16: (DispatchQueue::entry()+0x6a9) [0x6267f9] 17: (DispatchQueue::DispatchThread::entry()+0xd) [0x62198d] 18: (()+0x68ca) [0x7f70771cd8ca] 19: (clone()+0x6d) [0x7f707611586d] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- begin dump of recent events --- 0> 2012-11-21 16:15:32.544163 7f7071ed6700 -1 *** Caught signal (Aborted) ** in thread 7f7071ed6700 ceph version 0.54 (commit:60b84b095b1009a305d4d6a5b16f88571cbd3150) 1: /usr/bin/ceph-mon() [0x5310b9] 2: (()+0xeff0) [0x7f70771d5ff0] 3: (gsignal()+0x35) [0x7f70760781b5] 4: (abort()+0x180) [0x7f707607afc0] 5: (__gnu_cxx::__verbose_terminate_handler()+0x115) [0x7f707690cdc5] 6: (()+0xcb166) [0x7f707690b166] 7: (()+0xcb193) [0x7f707690b193] 8: (()+0xcb28e) [0x7f707690b28e] 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x7c9) [0x554119] 10: (PGMonitor::preprocess_command(MMonCommand*)+0xd60) [0x4eeba0] 11: (PGMonitor::preprocess_query(PaxosServiceMessage*)+0x2aa) [0x4ef85a] 12: (PaxosService::dispatch(PaxosServiceMessage*)+0x12d) [0x49e35d] 13: (Monitor::handle_command(MMonCommand*)+0x6f2) [0x47af22] 14: (Monitor::_ms_dispatch(Message*)+0x10ab) [0x48044b] 15: (Monitor::ms_dispatch(Message*)+0x7e) [0x491aee] 16: (DispatchQueue::entry()+0x6a9) [0x6267f9] 17: (DispatchQueue::DispatchThread::entry()+0xd) [0x62198d] 18: (()+0x68ca) [0x7f70771cd8ca] 19: (clone()+0x6d) [0x7f707611586d] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 5 lockdep 0/ 5 context 1/ 5 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 0 buffer 0/ 5 timer 0/ 5 filer 0/ 0 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 journaler 0/ 5 objectcacher 0/ 5 client 0/ 5 osd 0/ 5 optracker 0/ 5 objclass 1/ 5 filestore 1/ 5 journal 0/ 5 ms 1/ 5 mon 0/ 5 monc 0/ 5 paxos 0/ 5 tp 1/ 5 auth 1/ 5 finisher 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/ 5 hadoop 1/ 5 asok 1/ 5 throttle -2/-2 (syslog threshold) 99/99 (stderr threshold) max_recent 10000 max_new 1000000 log_file --- end dump of recent events ---