Topic: Bridgewater-Brunel game no. 3

[Matthew]

A quick note for those not on Discord: today's update has a bug in the logging. So I guess it's best to run the client without logging (don't use the - log parameter) and expect frequent server crashes. But if you're reading this you probably know more than me about it. 

[freddyhayward]

A quick note for those not on Discord: today's update has a bug in the logging. So I guess it's best to run the client without logging (don't use the - log parameter) and expect frequent server crashes. But if you're reading this you probably know more than me about it. 

'fortunately', the server will tend to crash before the client. But again, apologies for causing the issue...

[jamespetts]

I have now restarted the server with Freddy's patch applied.

[Matthew]

Bridgewater-Brunel crashes every time it tries to enter 1916 (crash confirmed by checking the server log). If you join and the date is December 1915, it might be best to wait and observe before changing anything.

Here are things I have noticed about the crash from the client log file (most of which are probably irrelevant):
(1) It was the start of the year.
(2) This new_month() message about industry appears every time:

(3) The other messages in that particular log do not appear every time. (7325,28,1) is a cattle farm field in Caledonia. According to the Towns chat, the farm was upgraded at that month start, but on other attempts at starting the new month, other industries are closed/upgraded/connected.
(4) That industry message always seems to be followed by many

Code: [Select]

uint32 haltestelle_t::get_service_frequency(halthandle_t destination, uint8 category) const:    Unknown frequency messages. For example, the first time there were 142,496(!) lines of such messages.
(5) Then there were a mere 377 lines of Unknown arrival time messages.
(6) One time when I unpaused the client, I got a crash in private_car_t::~private_car_t.
(7) The total size of the Simutrans-Extended process now exceeds 10GiB.

All these logs were gathered using the Windows 10 64-bit executable from Bridgewater-Brunel.
I observed this on two different VMs (one with 10GiB and one with 16GiB of RAM).

[freddyhayward]

I believe I have fixed the issue here: https://github.com/jamespetts/simutrans-extended/pull/293

[Matthew]

I believe I have fixed the issue here: https://github.com/jamespetts/simutrans-extended/pull/293

Thank you, Freddy!

I tested Freddy's branch on Windows. In single-player mode, a Bridgewater-Brunel savegame passed into 1916 without difficulty and continued running smoothly for 1 hour 45 mins of in-game time.

[jamespetts]

Thank you very much for the fix - now incorporated.

[Matthew]

Just now the game reached the beginning of October or November 1942. As usual, the game became unresponsive as it processed the new month. After 9 minutes, it was still unchanged. I believe this was a server problem as there was nothing untoward in the client logs and the client was not using CPU or memory.

The last entries in the server log were these:

Code: [Select]

Warning: karte_t::interactive: server lagging by 140304
Message: network_command_t::rdwr: write packet_id=9, client_id=0
Message: packet_t::send: sent 201 bytes to socket[6]; id=9, size=201
Warning: karte_t::interactive: server lagging by 140260
Message: network_command_t::rdwr: write packet_id=9, client_id=0
Message: packet_t::send: sent 201 bytes to socket[6]; id=9, size=201
Warning: karte_t::interactive: server lagging by 140218
Message: network_command_t::rdwr: write packet_id=9, client_id=0
Message: packet_t::send: sent 201 bytes to socket[6]; id=9, size=201
Warning: obj_t::~obj_t(): couldn't remove 0x15a492870 from 6130,1982,6
Warning: obj_t::~obj_t(): removed 0x15a492870 from 6130,1982,5, but it should have been on 6130,1982,6
Warning: obj_t::~obj_t(): couldn't remove 0x15a492840 from 6130,1980,6
Warning: obj_t::~obj_t(): removed 0x15a492840 from 6130,1980,5, but it should have been on 6130,1980,6
Warning: obj_t::~obj_t(): couldn't remove 0x15a4927b0 from 6130,1981,6
Warning: obj_t::~obj_t(): removed 0x15a4927b0 from 6130,1981,5, but it should have been on 6130,1981,6
Warning: obj_t::~obj_t(): couldn't remove 0x15a4d51c0 from 6668,588,4
Warning: obj_t::~obj_t(): removed 0x15a4d51c0 from 6668,588,3, but it should have been on 6668,588,4
Warning: obj_t::~obj_t(): couldn't remove 0x120198e00 from 6158,2100,4
Warning: obj_t::~obj_t(): removed 0x120198e00 from 6158,2100,3, but it should have been on 6158,2100,4
Warning: obj_t::~obj_t(): couldn't remove 0x120198920 from 6159,2100,4
Warning: obj_t::~obj_t(): removed 0x120198920 from 6159,2100,3, but it should have been on 6159,2100,4
Warning: obj_t::~obj_t(): couldn't remove 0x120197b40 from 6161,2099,5
Warning: obj_t::~obj_t(): removed 0x120197b40 from 6161,2099,3, but it should have been on 6161,2099,5
Warning: obj_t::~obj_t(): couldn't remove 0x1201d8570 from 617,990,5
Warning: obj_t::~obj_t(): removed 0x1201d8570 from 617,990,4, but it should have been on 617,990,5
Warning: obj_t::~obj_t(): couldn't remove 0x1201d8210 from 617,991,5
Warning: obj_t::~obj_t(): removed 0x1201d8210 from 617,991,4, but it should have been on 617,991,5
Warning: obj_t::~obj_t(): couldn't remove 0x1201dae40 from 493,1059,7
Warning: obj_t::~obj_t(): removed 0x1201dae40 from 493,1059,6, but it should have been on 493,1059,7
Warning: obj_t::~obj_t(): couldn't remove 0x1201f7130 from 433,740,6
Warning: obj_t::~obj_t(): removed 0x1201f7130 from 433,740,5, but it should have been on 433,740,6
Warning: obj_t::~obj_t(): couldn't remove 0x1571b3d60 from 2047,2511,7
Warning: obj_t::~obj_t(): removed 0x1571b3d60 from 2047,2511,6, but it should have been on 2047,2511,7
Warning: obj_t::~obj_t(): couldn't remove 0x1571b3d00 from 2047,2512,7
Warning: obj_t::~obj_t(): removed 0x1571b3d00 from 2047,2512,6, but it should have been on 2047,2512,7
Warning: obj_t::~obj_t(): couldn't remove 0x1571b3cd0 from 2048,2511,7
Warning: obj_t::~obj_t(): removed 0x1571b3cd0 from 2048,2511,6, but it should have been on 2048,2511,7
Warning: obj_t::~obj_t(): couldn't remove 0x1571b6eb0 from 1910,2473,7
Warning: obj_t::~obj_t(): removed 0x1571b6eb0 from 1910,2473,6, but it should have been on 1910,2473,7
Warning: obj_t::~obj_t(): couldn't remove 0x1571b6e50 from 1911,2472,7
Warning: obj_t::~obj_t(): removed 0x1571b6e50 from 1911,2472,6, but it should have been on 1911,2472,7
Warning: obj_t::~obj_t(): couldn't remove 0x1571b6e20 from 1910,2472,7
Warning: obj_t::~obj_t(): removed 0x1571b6e20 from 1910,2472,6, but it should have been on 1910,2472,7
Warning: obj_t::~obj_t(): couldn't remove 0x1571f01a0 from 813,2231,4
Warning: obj_t::~obj_t(): removed 0x1571f01a0 from 813,2231,3, but it should have been on 813,2231,4
Warning: obj_t::~obj_t(): couldn't remove 0x1571f0140 from 813,2232,4
Warning: obj_t::~obj_t(): removed 0x1571f0140 from 813,2232,3, but it should have been on 813,2232,4
Warning: obj_t::~obj_t(): couldn't remove 0x3bcbe5e0 from 7321,1687,2
Warning: obj_t::~obj_t(): removed 0x3bcbe5e0 from 7321,1687,1, but it should have been on 7321,1687,2
Warning: obj_t::~obj_t(): couldn't remove 0x3bcdb8d0 from 205,2483,3
Warning: obj_t::~obj_t(): removed 0x3bcdb8d0 from 205,2483,2, but it should have been on 205,2483,3
Warning: obj_t::~obj_t(): couldn't remove 0x3bcdb480 from 203,2468,3
Warning: obj_t::~obj_t(): removed 0x3bcdb480 from 203,2468,2, but it should have been on 203,2468,3
Warning: obj_t::~obj_t(): couldn't remove 0x3bcdb180 from 200,2492,3
Warning: obj_t::~obj_t(): removed 0x3bcdb180 from 200,2492,2, but it should have been on 200,2492,3
Warning: obj_t::~obj_t(): couldn't remove 0x3bcdadf0 from 199,2492,3
Warning: obj_t::~obj_t(): removed 0x3bcdadf0 from 199,2492,2, but it should have been on 199,2492,3
Warning: obj_t::~obj_t(): couldn't remove 0x3bcda760 from 199,2471,2
Warning: obj_t::~obj_t(): removed 0x3bcda760 from 199,2471,0, but it should have been on 199,2471,2
Warning: obj_t::~obj_t(): couldn't remove 0x3bcda6d0 from 199,2474,2
Warning: obj_t::~obj_t(): removed 0x3bcda6d0 from 199,2474,1, but it should have been on 199,2474,2
Warning: obj_t::~obj_t(): couldn't remove 0x3bcda640 from 199,2473,2
Warning: obj_t::~obj_t(): removed 0x3bcda640 from 199,2473,1, but it should have been on 199,2473,2
Warning: obj_t::~obj_t(): couldn't remove 0x3bcda490 from 199,2476,2
Warning: obj_t::~obj_t(): removed 0x3bcda490 from 199,2476,1, but it should have been on 199,2476,2
Warning: obj_t::~obj_t(): couldn't remove 0x3bcda460 from 199,2475,2
Warning: obj_t::~obj_t(): removed 0x3bcda460 from 199,2475,1, but it should have been on 199,2475,2
Warning: obj_t::~obj_t(): couldn't remove 0x15ccce830 from 6562,2436,8
Warning: obj_t::~obj_t(): removed 0x15ccce830 from 6562,2436,7, but it should have been on 6562,2436,8
Warning: obj_t::~obj_t(): couldn't remove 0xe4428170 from 1655,2144,4
Warning: obj_t::~obj_t(): removed 0xe4428170 from 1655,2144,3, but it should have been on 1655,2144,4
Warning: obj_t::~obj_t(): couldn't remove 0xe4428110 from 1643,2150,5
Warning: obj_t::~obj_t(): removed 0xe4428110 from 1643,2150,4, but it should have been on 1643,2150,5
Warning: obj_t::~obj_t(): couldn't remove 0xe44280b0 from 1644,2150,5
Warning: obj_t::~obj_t(): removed 0xe44280b0 from 1644,2150,4, but it should have been on 1644,2150,5
Warning: obj_t::~obj_t(): couldn't remove 0xe4428080 from 1645,2150,5
Warning: obj_t::~obj_t(): removed 0xe4428080 from 1645,2150,4, but it should have been on 1645,2150,5
Warning: obj_t::~obj_t(): couldn't remove 0xe4428050 from 1646,2150,5
Warning: obj_t::~obj_t(): removed 0xe4428050 from 1646,2150,4, but it should have been on 1646,2150,5
Warning: obj_t::~obj_t(): couldn't remove 0x14cc1f400 from 6209,42,6
Warning: obj_t::~obj_t(): removed 0x14cc1f400 from 6209,42,5, but it should have been on 6209,42,6
Warning: obj_t::~obj_t(): couldn't remove 0x14cc1f1f0 from 6207,42,6
Warning: obj_t::~obj_t(): removed 0x14cc1f1f0 from 6207,42,5, but it should have been on 6207,42,6
Warning: obj_t::~obj_t(): couldn't remove 0x14cc1f160 from 6205,42,6
Warning: obj_t::~obj_t(): removed 0x14cc1f160 from 6205,42,5, but it should have been on 6205,42,6
Warning: obj_t::~obj_t(): couldn't remove 0x14cc1f130 from 6204,42,6
Warning: obj_t::~obj_t(): removed 0x14cc1f130 from 6204,42,5, but it should have been on 6204,42,6
Warning: obj_t::~obj_t(): couldn't remove 0x14cc1f100 from 6206,42,6
Warning: obj_t::~obj_t(): removed 0x14cc1f100 from 6206,42,5, but it should have been on 6206,42,6
Warning: obj_t::~obj_t(): couldn't remove 0x14cc23650 from 6297,86,5
Warning: obj_t::~obj_t(): removed 0x14cc23650 from 6297,86,4, but it should have been on 6297,86,5
Warning: obj_t::~obj_t(): couldn't remove 0x14cc37510 from 6021,2061,3
Warning: obj_t::~obj_t(): removed 0x14cc37510 from 6021,2061,2, but it should have been on 6021,2061,3
Warning: obj_t::~obj_t(): couldn't remove 0x14cc69490 from 6875,1942,3
Warning: obj_t::~obj_t(): removed 0x14cc69490 from 6875,1942,2, but it should have been on 6875,1942,3
Warning: obj_t::~obj_t(): couldn't remove 0x14cc69280 from 6878,1977,5
Warning: obj_t::~obj_t(): removed 0x14cc69280 from 6878,1977,4, but it should have been on 6878,1977,5
Warning: obj_t::~obj_t(): couldn't remove 0x14cc691f0 from 6878,1967,5
Warning: obj_t::~obj_t(): removed 0x14cc691f0 from 6878,1967,4, but it should have been on 6878,1967,5
Warning: obj_t::~obj_t(): couldn't remove 0x14cc69100 from 6878,1962,4
Warning: obj_t::~obj_t(): removed 0x14cc69100 from 6878,1962,3, but it should have been on 6878,1962,4
Warning: obj_t::~obj_t(): couldn't remove 0x14cc690a0 from 6878,1972,5
Warning: obj_t::~obj_t(): removed 0x14cc690a0 from 6878,1972,4, but it should have been on 6878,1972,5
Warning: obj_t::~obj_t(): couldn't remove 0x14cc684d0 from 6871,1972,4
Warning: obj_t::~obj_t(): removed 0x14cc684d0 from 6871,1972,3, but it should have been on 6871,1972,4
Warning: obj_t::~obj_t(): couldn't remove 0x14cc67810 from 6853,1981,4
Warning: obj_t::~obj_t(): removed 0x14cc67810 from 6853,1981,3, but it should have been on 6853,1981,4
Warning: obj_t::~obj_t(): couldn't remove 0x15a8a1dd0 from 7059,1402,4
Warning: obj_t::~obj_t(): removed 0x15a8a1dd0 from 7059,1402,3, but it should have been on 7059,1402,4
Warning: obj_t::~obj_t(): couldn't remove 0x15a8a1da0 from 7058,1403,4
Warning: obj_t::~obj_t(): removed 0x15a8a1da0 from 7058,1403,3, but it should have been on 7058,1403,4
Warning: obj_t::~obj_t(): couldn't remove 0x15a8a1d70 from 7058,1402,4
Warning: obj_t::~obj_t(): removed 0x15a8a1d70 from 7058,1402,3, but it should have been on 7058,1402,4
Warning: obj_t::~obj_t(): couldn't remove 0x15a9064c0 from 7119,1293,5
Warning: obj_t::~obj_t(): removed 0x15a9064c0 from 7119,1293,4, but it should have been on 7119,1293,5
Warning: obj_t::~obj_t(): couldn't remove 0x15a906490 from 7119,1294,5
Warning: obj_t::~obj_t(): removed 0x15a906490 from 7119,1294,4, but it should have been on 7119,1294,5
Warning: obj_t::~obj_t(): couldn't remove 0x15a9103b0 from 7330,1288,2
Warning: obj_t::~obj_t(): removed 0x15a9103b0 from 7330,1288,1, but it should have been on 7330,1288,2
Warning: obj_t::~obj_t(): couldn't remove 0x119c2d7d0 from 6894,1797,6
Warning: obj_t::~obj_t(): removed 0x119c2d7d0 from 6894,1797,5, but it should have been on 6894,1797,6
Warning: obj_t::~obj_t(): couldn't remove 0x119c2cc60 from 6894,1798,6
Warning: obj_t::~obj_t(): removed 0x119c2cc60 from 6894,1798,5, but it should have been on 6894,1798,6
Warning: obj_t::~obj_t(): couldn't remove 0x119c2beb0 from 6894,1799,6
Warning: obj_t::~obj_t(): removed 0x119c2beb0 from 6894,1799,5, but it should have been on 6894,1799,6
Warning: obj_t::~obj_t(): couldn't remove 0x119c2b790 from 6894,1800,6
Warning: obj_t::~obj_t(): removed 0x119c2b790 from 6894,1800,5, but it should have been on 6894,1800,6
Warning: obj_t::~obj_t(): couldn't remove 0x119c2aef0 from 6894,1801,6
Warning: obj_t::~obj_t(): removed 0x119c2aef0 from 6894,1801,5, but it should have been on 6894,1801,6
Warning: obj_t::~obj_t(): couldn't remove 0x119c2ac20 from 6894,1802,6
Warning: obj_t::~obj_t(): removed 0x119c2ac20 from 6894,1802,5, but it should have been on 6894,1802,6
Warning: obj_t::~obj_t(): couldn't remove 0x119c3eef0 from 6812,1984,5
Warning: obj_t::~obj_t(): removed 0x119c3eef0 from 6812,1984,4, but it should have been on 6812,1984,5
Warning: obj_t::~obj_t(): couldn't remove 0x119c4a1d0 from 1058,1021,4
Warning: obj_t::~obj_t(): removed 0x119c4a1d0 from 1058,1021,3, but it should have been on 1058,1021,4
Warning: obj_t::~obj_t(): couldn't remove 0x119c4a170 from 1058,1020,4
Warning: obj_t::~obj_t(): removed 0x119c4a170 from 1058,1020,3, but it should have been on 1058,1020,4
Warning: obj_t::~obj_t(): couldn't remove 0x119c4a110 from 1059,1020,4
Warning: obj_t::~obj_t(): removed 0x119c4a110 from 1059,1020,3, but it should have been on 1059,1020,4
Warning: obj_t::~obj_t(): couldn't remove 0x119c9f750 from 6988,2193,5
Warning: obj_t::~obj_t(): removed 0x119c9f750 from 6988,2193,4, but it should have been on 6988,2193,5
Warning: obj_t::~obj_t(): couldn't remove 0x119753890 from 7340,2534,2
Warning: obj_t::~obj_t(): removed 0x119753890 from 7340,2534,1, but it should have been on 7340,2534,2
Warning: obj_t::~obj_t(): couldn't remove 0x119753860 from 7341,2532,2
Warning: obj_t::~obj_t(): removed 0x119753860 from 7341,2532,1, but it should have been on 7341,2532,2
Warning: obj_t::~obj_t(): couldn't remove 0x119753830 from 7340,2532,2
Warning: obj_t::~obj_t(): removed 0x119753830 from 7340,2532,1, but it should have been on 7340,2532,2
Warning: obj_t::~obj_t(): couldn't remove 0x119753800 from 7340,2533,2
Warning: obj_t::~obj_t(): removed 0x119753800 from 7340,2533,1, but it should have been on 7340,2533,2
Warning: obj_t::~obj_t(): couldn't remove 0x1197582f0 from 7292,2372,4
Warning: obj_t::~obj_t(): removed 0x1197582f0 from 7292,2372,3, but it should have been on 7292,2372,4
Warning: obj_t::~obj_t(): couldn't remove 0x119778d90 from 6416,594,4
Warning: obj_t::~obj_t(): removed 0x119778d90 from 6416,594,3, but it should have been on 6416,594,4
Warning: obj_t::~obj_t(): couldn't remove 0x119777500 from 6430,588,4
Warning: obj_t::~obj_t(): removed 0x119777500 from 6430,588,3, but it should have been on 6430,588,4
Warning: obj_t::~obj_t(): couldn't remove 0x119777410 from 6427,588,3
Warning: obj_t::~obj_t(): removed 0x119777410 from 6427,588,2, but it should have been on 6427,588,3
Warning: obj_t::~obj_t(): couldn't remove 0x119789300 from 6338,553,3
Warning: obj_t::~obj_t(): removed 0x119789300 from 6338,553,2, but it should have been on 6338,553,3
Warning: obj_t::~obj_t(): couldn't remove 0xe7fe5e90 from 7867,1920,5
Warning: obj_t::~obj_t(): removed 0xe7fe5e90 from 7867,1920,4, but it should have been on 7867,1920,5
Warning: obj_t::~obj_t(): couldn't remove 0xe7fe5e60 from 7867,1921,5
Warning: obj_t::~obj_t(): removed 0xe7fe5e60 from 7867,1921,4, but it should have been on 7867,1921,5
Warning: obj_t::~obj_t(): couldn't remove 0xe803a7a0 from 5584,1538,2
Warning: obj_t::~obj_t(): removed 0xe803a7a0 from 5584,1538,1, but it should have been on 5584,1538,2
Warning: obj_t::~obj_t(): couldn't remove 0xe80415b0 from 5878,1663,2
Warning: obj_t::~obj_t(): removed 0xe80415b0 from 5878,1663,1, but it should have been on 5878,1663,2
Warning: obj_t::~obj_t(): couldn't remove 0xe8041490 from 5805,1763,2
Warning: obj_t::~obj_t(): removed 0xe8041490 from 5805,1763,1, but it should have been on 5805,1763,2
Warning: obj_t::~obj_t(): couldn't remove 0xe80411c0 from 5805,1762,2
Warning: obj_t::~obj_t(): removed 0xe80411c0 from 5805,1762,1, but it should have been on 5805,1762,2
Warning: obj_t::~obj_t(): couldn't remove 0xe8041040 from 5805,1761,2
Warning: obj_t::~obj_t(): removed 0xe8041040 from 5805,1761,1, but it should have been on 5805,1761,2
Warning: obj_t::~obj_t(): couldn't remove 0xe8040fb0 from 5806,1761,2
Warning: obj_t::~obj_t(): removed 0xe8040fb0 from 5806,1761,1, but it should have been on 5806,1761,2
Warning: obj_t::~obj_t(): couldn't remove 0xe803f960 from 5770,1654,2
Warning: obj_t::~obj_t(): removed 0xe803f960 from 5770,1654,1, but it should have been on 5770,1654,2
Warning: obj_t::~obj_t(): couldn't remove 0xe803f000 from 5780,1656,2
Warning: obj_t::~obj_t(): removed 0xe803f000 from 5780,1656,1, but it should have been on 5780,1656,2
Warning: obj_t::~obj_t(): couldn't remove 0x9f6c5220 from 5661,1602,2
Warning: obj_t::~obj_t(): removed 0x9f6c5220 from 5661,1602,1, but it should have been on 5661,1602,2
Warning: obj_t::~obj_t(): couldn't remove 0x9f6c5160 from 5660,1603,2
Warning: obj_t::~obj_t(): removed 0x9f6c5160 from 5660,1603,1, but it should have been on 5660,1603,2
Warning: obj_t::~obj_t(): couldn't remove 0x9f6c0f60 from 5646,1623,2
Warning: obj_t::~obj_t(): removed 0x9f6c0f60 from 5646,1623,1, but it should have been on 5646,1623,2
Warning: obj_t::~obj_t(): couldn't remove 0x9f6f51b0 from 7026,2101,4
Warning: obj_t::~obj_t(): removed 0x9f6f51b0 from 7026,2101,3, but it should have been on 7026,2101,4
Warning: obj_t::~obj_t(): couldn't remove 0x9f6f5180 from 7026,2100,4
Warning: obj_t::~obj_t(): removed 0x9f6f5180 from 7026,2100,3, but it should have been on 7026,2100,4
Warning: obj_t::~obj_t(): couldn't remove 0x9f710b90 from 7073,1513,2
Warning: obj_t::~obj_t(): removed 0x9f710b90 from 7073,1513,1, but it should have been on 7073,1513,2
Warning: obj_t::~obj_t(): couldn't remove 0x9f7108f0 from 7073,1514,2
Warning: obj_t::~obj_t(): removed 0x9f7108f0 from 7073,1514,1, but it should have been on 7073,1514,2
Warning: obj_t::~obj_t(): couldn't remove 0x9f70f0f0 from 7068,1533,2
Warning: obj_t::~obj_t(): removed 0x9f70f0f0 from 7068,1533,1, but it should have been on 7068,1533,2
Warning: obj_t::~obj_t(): couldn't remove 0x9f70f0c0 from 7068,1532,2
Warning: obj_t::~obj_t(): removed 0x9f70f0c0 from 7068,1532,1, but it should have been on 7068,1532,2
Warning: obj_t::~obj_t(): couldn't remove 0x9f732900 from 282,2069,6
Warning: obj_t::~obj_t(): removed 0x9f732900 from 282,2069,5, but it should have been on 282,2069,6
Warning: obj_t::~obj_t(): couldn't remove 0x9f7328d0 from 283,2069,6
Warning: obj_t::~obj_t(): removed 0x9f7328d0 from 283,2069,5, but it should have been on 283,2069,6
Warning: obj_t::~obj_t(): couldn't remove 0x9f732870 from 282,2070,6
Warning: obj_t::~obj_t(): removed 0x9f732870 from 282,2070,5, but it should have been on 282,2070,6
Warning: obj_t::~obj_t(): couldn't remove 0x9f732840 from 284,2069,6
Warning: obj_t::~obj_t(): removed 0x9f732840 from 284,2069,5, but it should have been on 284,2069,6
Warning: obj_t::~obj_t(): couldn't remove 0x14b147f90 from 2544,1910,2
Warning: obj_t::~obj_t(): removed 0x14b147f90 from 2544,1910,1, but it should have been on 2544,1910,2
Warning: obj_t::~obj_t(): couldn't remove 0x14b165dd0 from 8026,2376,3
Warning: obj_t::~obj_t(): removed 0x14b165dd0 from 8026,2376,2, but it should have been on 8026,2376,3
Warning: obj_t::~obj_t(): couldn't remove 0x14b165d70 from 8026,2383,3
Warning: obj_t::~obj_t(): removed 0x14b165d70 from 8026,2383,2, but it should have been on 8026,2383,3
Warning: obj_t::~obj_t(): couldn't remove 0x14b165ce0 from 8026,2373,3
Warning: obj_t::~obj_t(): removed 0x14b165ce0 from 8026,2373,2, but it should have been on 8026,2373,3
Warning: obj_t::~obj_t(): couldn't remove 0x14b165c50 from 8026,2375,3
Warning: obj_t::~obj_t(): removed 0x14b165c50 from 8026,2375,2, but it should have been on 8026,2375,3
Warning: obj_t::~obj_t(): couldn't remove 0x14b165980 from 8026,2374,3
Warning: obj_t::~obj_t(): removed 0x14b165980 from 8026,2374,2, but it should have been on 8026,2374,3
Warning: obj_t::~obj_t(): couldn't remove 0x14b16f890 from 8022,2357,2
Warning: obj_t::~obj_t(): removed 0x14b16f890 from 8022,2357,1, but it should have been on 8022,2357,2
Warning: obj_t::~obj_t(): couldn't remove 0x14b16f740 from 8023,2356,2
Warning: obj_t::~obj_t(): removed 0x14b16f740 from 8023,2356,1, but it should have been on 8023,2356,2
Warning: obj_t::~obj_t(): couldn't remove 0x14b16f6b0 from 8023,2355,2
Warning: obj_t::~obj_t(): removed 0x14b16f6b0 from 8023,2355,1, but it should have been on 8023,2355,2
Warning: obj_t::~obj_t(): couldn't remove 0x14b16f080 from 8027,2348,4
Warning: obj_t::~obj_t(): removed 0x14b16f080 from 8027,2348,3, but it should have been on 8027,2348,4
Warning: obj_t::~obj_t(): couldn't remove 0x14b16a7c0 from 8050,2375,3
Warning: obj_t::~obj_t(): removed 0x14b16a7c0 from 8050,2375,2, but it should have been on 8050,2375,3
Warning: obj_t::~obj_t(): couldn't remove 0x14b16a730 from 8051,2375,3
Warning: obj_t::~obj_t(): removed 0x14b16a730 from 8051,2375,2, but it should have been on 8051,2375,3
Warning: obj_t::~obj_t(): couldn't remove 0x1425a7ca0 from 7378,2187,4
Warning: obj_t::~obj_t(): removed 0x1425a7ca0 from 7378,2187,2, but it should have been on 7378,2187,4
Warning: obj_t::~obj_t(): couldn't remove 0x1425a7ac0 from 7378,2188,4
Warning: obj_t::~obj_t(): removed 0x1425a7ac0 from 7378,2188,2, but it should have been on 7378,2188,4
Warning: obj_t::~obj_t(): couldn't remove 0x1425a7820 from 7378,2189,4
Warning: obj_t::~obj_t(): removed 0x1425a7820 from 7378,2189,2, but it should have been on 7378,2189,4
Warning: obj_t::~obj_t(): couldn't remove 0x14cf58e90 from 7373,2193,3
Warning: obj_t::~obj_t(): removed 0x14cf58e90 from 7373,2193,2, but it should have been on 7373,2193,3
Warning: obj_t::~obj_t(): couldn't remove 0x1425b3d40 from 7327,2250,2
Warning: obj_t::~obj_t(): removed 0x1425b3d40 from 7327,2250,1, but it should have been on 7327,2250,2
Warning: obj_t::~obj_t(): couldn't remove 0x1425ae9d0 from 7328,2254,3
Warning: obj_t::~obj_t(): removed 0x1425ae9d0 from 7328,2254,2, but it should have been on 7328,2254,3
Warning: obj_t::~obj_t(): couldn't remove 0x1425ae760 from 7329,2254,3
Warning: obj_t::~obj_t(): removed 0x1425ae760 from 7329,2254,2, but it should have been on 7329,2254,3
Warning: obj_t::~obj_t(): couldn't remove 0x1a41c410 from 7365,1667,2
Warning: obj_t::~obj_t(): removed 0x1a41c410 from 7365,1667,1, but it should have been on 7365,1667,2
Warning: obj_t::~obj_t(): couldn't remove 0x1a41bb40 from 7340,1701,2
Warning: obj_t::~obj_t(): removed 0x1a41bb40 from 7340,1701,1, but it should have been on 7340,1701,2
Warning: obj_t::~obj_t(): couldn't remove 0x1a41b9f0 from 7340,1700,2
Warning: obj_t::~obj_t(): removed 0x1a41b9f0 from 7340,1700,1, but it should have been on 7340,1700,2
Warning: obj_t::~obj_t(): couldn't remove 0x1a41ac70 from 7374,1670,2
Warning: obj_t::~obj_t(): removed 0x1a41ac70 from 7374,1670,1, but it should have been on 7374,1670,2
Warning: obj_t::~obj_t(): couldn't remove 0x1a41ac40 from 7370,1671,1
Warning: obj_t::~obj_t(): removed 0x1a41ac40 from 7370,1671,0, but it should have been on 7370,1671,1
Warning: obj_t::~obj_t(): couldn't remove 0x1a41aa90 from 7380,1674,2
Warning: obj_t::~obj_t(): removed 0x1a41aa90 from 7380,1674,1, but it should have been on 7380,1674,2
Warning: obj_t::~obj_t(): couldn't remove 0x142644920 from 7390,1698,3
Warning: obj_t::~obj_t(): removed 0x142644920 from 7390,1698,2, but it should have been on 7390,1698,3
Warning: obj_t::~obj_t(): couldn't remove 0x1a466ba0 from 2368,2535,5
Warning: obj_t::~obj_t(): removed 0x1a466ba0 from 2368,2535,4, but it should have been on 2368,2535,5
Warning: obj_t::~obj_t(): couldn't remove 0x1a466b40 from 2369,2535,5
Warning: obj_t::~obj_t(): removed 0x1a466b40 from 2369,2535,4, but it should have been on 2369,2535,5
Warning: obj_t::~obj_t(): couldn't remove 0x1a466b10 from 2367,2534,5
Warning: obj_t::~obj_t(): removed 0x1a466b10 from 2367,2534,4, but it should have been on 2367,2534,5
Warning: obj_t::~obj_t(): couldn't remove 0x1a466a20 from 2366,2533,5
Warning: obj_t::~obj_t(): removed 0x1a466a20 from 2366,2533,4, but it should have been on 2366,2533,5
Warning: obj_t::~obj_t(): couldn't remove 0x1a488bf0 from 6056,1336,6
Warning: obj_t::~obj_t(): removed 0x1a488bf0 from 6056,1336,5, but it should have been on 6056,1336,6
Warning: obj_t::~obj_t(): couldn't remove 0x1a4b3c50 from 7173,1853,7
Warning: obj_t::~obj_t(): removed 0x1a4b3c50 from 7173,1853,6, but it should have been on 7173,1853,7
Warning: obj_t::~obj_t(): couldn't remove 0x10eeef230 from 7482,2408,8
Warning: obj_t::~obj_t(): removed 0x10eeef230 from 7482,2408,7, but it should have been on 7482,2408,8
Warning: obj_t::~obj_t(): couldn't remove 0x10eefda90 from 6378,295,5
Warning: obj_t::~obj_t(): removed 0x10eefda90 from 6378,295,4, but it should have been on 6378,295,5
Warning: obj_t::~obj_t(): couldn't remove 0x10eefbed0 from 6377,291,4
Warning: obj_t::~obj_t(): removed 0x10eefbed0 from 6377,291,3, but it should have been on 6377,291,4
Warning: obj_t::~obj_t(): couldn't remove 0x10eefbdb0 from 6379,291,4
Warning: obj_t::~obj_t(): removed 0x10eefbdb0 from 6379,291,3, but it should have been on 6379,291,4
Warning: obj_t::~obj_t(): couldn't remove 0x10eefbb70 from 6378,291,4
Warning: obj_t::~obj_t(): removed 0x10eefbb70 from 6378,291,3, but it should have been on 6378,291,4
Warning: obj_t::~obj_t(): couldn't remove 0x10eef8180 from 6368,272,3
Warning: obj_t::~obj_t(): removed 0x10eef8180 from 6368,272,2, but it should have been on 6368,272,3
Warning: obj_t::~obj_t(): couldn't remove 0x10eef8150 from 6368,271,3
Warning: obj_t::~obj_t(): removed 0x10eef8150 from 6368,271,2, but it should have been on 6368,271,3
Warning: obj_t::~obj_t(): couldn't remove 0x10ef1a6a0 from 587,759,3
Warning: obj_t::~obj_t(): removed 0x10ef1a6a0 from 587,759,2, but it should have been on 587,759,3
Warning: obj_t::~obj_t(): couldn't remove 0x10ef1a1c0 from 587,758,3
Warning: obj_t::~obj_t(): removed 0x10ef1a1c0 from 587,758,2, but it should have been on 587,758,3
Warning: obj_t::~obj_t(): couldn't remove 0x10ef18e40 from 585,699,1
Warning: obj_t::~obj_t(): removed 0x10ef18e40 from 585,699,0, but it should have been on 585,699,1
Warning: obj_t::~obj_t(): couldn't remove 0x10ef17c70 from 607,706,1
Warning: obj_t::~obj_t(): removed 0x10ef17c70 from 607,706,0, but it should have been on 607,706,1
Warning: obj_t::~obj_t(): couldn't remove 0x10ef177c0 from 601,718,2
Warning: obj_t::~obj_t(): removed 0x10ef177c0 from 601,718,1, but it should have been on 601,718,2
Warning: obj_t::~obj_t(): couldn't remove 0x10ef16dd0 from 597,724,3
Warning: obj_t::~obj_t(): removed 0x10ef16dd0 from 597,724,2, but it should have been on 597,724,3
Warning: obj_t::~obj_t(): couldn't remove 0x159c030a0 from 7170,1957,7
Warning: obj_t::~obj_t(): removed 0x159c030a0 from 7170,1957,6, but it should have been on 7170,1957,7
Warning: obj_t::~obj_t(): couldn't remove 0x159c1ded0 from 5613,1761,4
Warning: obj_t::~obj_t(): removed 0x159c1ded0 from 5613,1761,3, but it should have been on 5613,1761,4
Warning: obj_t::~obj_t(): couldn't remove 0x159c27fd0 from 5621,1607,2
Warning: obj_t::~obj_t(): removed 0x159c27fd0 from 5621,1607,1, but it should have been on 5621,1607,2
Warning: obj_t::~obj_t(): couldn't remove 0x159c27e20 from 5620,1607,2
Warning: obj_t::~obj_t(): removed 0x159c27e20 from 5620,1607,1, but it should have been on 5620,1607,2
Warning: obj_t::~obj_t(): couldn't remove 0x159c27dc0 from 5617,1608,2
Warning: obj_t::~obj_t(): removed 0x159c27dc0 from 5617,1608,1, but it should have been on 5617,1608,2
Warning: obj_t::~obj_t(): couldn't remove 0x159c3a570 from 5639,1602,2
Warning: obj_t::~obj_t(): removed 0x159c3a570 from 5639,1602,1, but it should have been on 5639,1602,2
Warning: obj_t::~obj_t(): couldn't remove 0x159c3a480 from 5638,1602,2
Warning: obj_t::~obj_t(): removed 0x159c3a480 from 5638,1602,1, but it should have been on 5638,1602,2
Warning: obj_t::~obj_t(): couldn't remove 0x159c3a210 from 5637,1603,2
Warning: obj_t::~obj_t(): removed 0x159c3a210 from 5637,1603,1, but it should have been on 5637,1603,2
Warning: obj_t::~obj_t(): couldn't remove 0x159c3a150 from 5637,1602,2
Warning: obj_t::~obj_t(): removed 0x159c3a150 from 5637,1602,1, but it should have been on 5637,1602,2
Warning: obj_t::~obj_t(): couldn't remove 0x159c7d600 from 7163,2341,3
Warning: obj_t::~obj_t(): removed 0x159c7d600 from 7163,2341,1, but it should have been on 7163,2341,3
Warning: obj_t::~obj_t(): couldn't remove 0x159c7d5d0 from 7175,2349,3
Warning: obj_t::~obj_t(): removed 0x159c7d5d0 from 7175,2349,2, but it should have been on 7175,2349,3
Warning: obj_t::~obj_t(): couldn't remove 0x159c7d5a0 from 7174,2349,3
Warning: obj_t::~obj_t(): removed 0x159c7d5a0 from 7174,2349,2, but it should have been on 7174,2349,3
Warning: obj_t::~obj_t(): couldn't remove 0x159c7d1e0 from 7270,2313,3
Warning: obj_t::~obj_t(): removed 0x159c7d1e0 from 7270,2313,2, but it should have been on 7270,2313,3
Warning: obj_t::~obj_t(): couldn't remove 0x159c7c580 from 7268,2321,3
Warning: obj_t::~obj_t(): removed 0x159c7c580 from 7268,2321,2, but it should have been on 7268,2321,3
Warning: obj_t::~obj_t(): couldn't remove 0x159c7b6e0 from 7264,2319,2
Warning: obj_t::~obj_t(): removed 0x159c7b6e0 from 7264,2319,1, but it should have been on 7264,2319,2
Warning: obj_t::~obj_t(): couldn't remove 0x159c7a810 from 7251,2335,1
Warning: obj_t::~obj_t(): removed 0x159c7a810 from 7251,2335,0, but it should have been on 7251,2335,1
Warning: obj_t::~obj_t(): couldn't remove 0xdefad480 from 7628,2541,7
Warning: obj_t::~obj_t(): removed 0xdefad480 from 7628,2541,6, but it should have been on 7628,2541,7
Warning: obj_t::~obj_t(): couldn't remove 0xdefad390 from 7628,2542,7
Warning: obj_t::~obj_t(): removed 0xdefad390 from 7628,2542,6, but it should have been on 7628,2542,7
Warning: obj_t::~obj_t(): couldn't remove 0xdefad2a0 from 7628,2540,7
Warning: obj_t::~obj_t(): removed 0xdefad2a0 from 7628,2540,6, but it should have been on 7628,2540,7
Warning: obj_t::~obj_t(): couldn't remove 0x156ae71b0 from 7574,2494,8
Warning: obj_t::~obj_t(): removed 0x156ae71b0 from 7574,2494,7, but it should have been on 7574,2494,8
Warning: obj_t::~obj_t(): couldn't remove 0x156ae70c0 from 7575,2494,8
Warning: obj_t::~obj_t(): removed 0x156ae70c0 from 7575,2494,7, but it should have been on 7575,2494,8
Warning: obj_t::~obj_t(): couldn't remove 0x156b11720 from 5950,2197,4
Warning: obj_t::~obj_t(): removed 0x156b11720 from 5950,2197,3, but it should have been on 5950,2197,4
Warning: obj_t::~obj_t(): couldn't remove 0x156b11120 from 5951,2200,5
Warning: obj_t::~obj_t(): removed 0x156b11120 from 5951,2200,4, but it should have been on 5951,2200,5
Warning: obj_t::~obj_t(): couldn't remove 0x156b10e20 from 5951,2197,4
Warning: obj_t::~obj_t(): removed 0x156b10e20 from 5951,2197,3, but it should have been on 5951,2197,4
Warning: obj_t::~obj_t(): couldn't remove 0x156b10bb0 from 5952,2200,5
Warning: obj_t::~obj_t(): removed 0x156b10bb0 from 5952,2200,4, but it should have been on 5952,2200,5
Warning: obj_t::~obj_t(): couldn't remove 0x156b10af0 from 5952,2197,4
Warning: obj_t::~obj_t(): removed 0x156b10af0 from 5952,2197,3, but it should have been on 5952,2197,4
Warning: obj_t::~obj_t(): couldn't remove 0x156b10820 from 5953,2213,4
Warning: obj_t::~obj_t(): removed 0x156b10820 from 5953,2213,3, but it should have been on 5953,2213,4
Warning: obj_t::~obj_t(): couldn't remove 0x156b106d0 from 5953,2200,5
Warning: obj_t::~obj_t(): removed 0x156b106d0 from 5953,2200,4, but it should have been on 5953,2200,5
Warning: obj_t::~obj_t(): couldn't remove 0x14a4e4410 from 5616,1511,3
Warning: obj_t::~obj_t(): removed 0x14a4e4410 from 5616,1511,2, but it should have been on 5616,1511,3
Warning: obj_t::~obj_t(): couldn't remove 0x14a4e3960 from 5618,1502,3
Warning: obj_t::~obj_t(): removed 0x14a4e3960 from 5618,1502,2, but it should have been on 5618,1502,3
Warning: obj_t::~obj_t(): couldn't remove 0x14a4e3720 from 5618,1501,3
Warning: obj_t::~obj_t(): removed 0x14a4e3720 from 5618,1501,2, but it should have been on 5618,1501,3
Warning: obj_t::~obj_t(): couldn't remove 0x14a4e35d0 from 5619,1500,3
Warning: obj_t::~obj_t(): removed 0x14a4e35d0 from 5619,1500,2, but it should have been on 5619,1500,3
Warning: obj_t::~obj_t(): couldn't remove 0xd43c1e10 from 5800,1919,6
Warning: obj_t::~obj_t(): removed 0xd43c1e10 from 5800,1919,5, but it should have been on 5800,1919,6
Warning: obj_t::~obj_t(): couldn't remove 0xd43c0be0 from 5756,1897,8
Warning: obj_t::~obj_t(): removed 0xd43c0be0 from 5756,1897,6, but it should have been on 5756,1897,8
Warning: obj_t::~obj_t(): couldn't remove 0xd43c03d0 from 5761,1885,7
Warning: obj_t::~obj_t(): removed 0xd43c03d0 from 5761,1885,6, but it should have been on 5761,1885,7
Warning: obj_t::~obj_t(): couldn't remove 0xd43c0310 from 5763,1885,7
Warning: obj_t::~obj_t(): removed 0xd43c0310 from 5763,1885,6, but it should have been on 5763,1885,7
Warning: obj_t::~obj_t(): couldn't remove 0xd43c02e0 from 5760,1885,7
Warning: obj_t::~obj_t(): removed 0xd43c02e0 from 5760,1885,6, but it should have been on 5760,1885,7
Warning: obj_t::~obj_t(): couldn't remove 0xd43c0250 from 5762,1885,7
Warning: obj_t::~obj_t(): removed 0xd43c0250 from 5762,1885,6, but it should have been on 5762,1885,7
Warning: obj_t::~obj_t(): couldn't remove 0xd43fc290 from 7461,1965,7
Warning: obj_t::~obj_t(): removed 0xd43fc290 from 7461,1965,6, but it should have been on 7461,1965,7
Warning: obj_t::~obj_t(): couldn't remove 0xd43f66b0 from 7466,1964,7
Warning: obj_t::~obj_t(): removed 0xd43f66b0 from 7466,1964,6, but it should have been on 7466,1964,7
Warning: obj_t::~obj_t(): couldn't remove 0x14c6d9610 from 933,1090,7
Warning: obj_t::~obj_t(): removed 0x14c6d9610 from 933,1090,6, but it should have been on 933,1090,7
Warning: obj_t::~obj_t(): couldn't remove 0x14c6d3460 from 986,1063,6
Warning: obj_t::~obj_t(): removed 0x14c6d3460 from 986,1063,5, but it should have been on 986,1063,6
Warning: obj_t::~obj_t(): couldn't remove 0x14c6d3340 from 985,1063,6
Warning: obj_t::~obj_t(): removed 0x14c6d3340 from 985,1063,5, but it should have been on 985,1063,6
Warning: obj_t::~obj_t(): couldn't remove 0x14c6d3070 from 985,1064,6
Warning: obj_t::~obj_t(): removed 0x14c6d3070 from 985,1064,5, but it should have been on 985,1064,6
Warning: obj_t::~obj_t(): couldn't remove 0x14c6d2fe0 from 984,1068,7
Warning: obj_t::~obj_t(): removed 0x14c6d2fe0 from 984,1068,6, but it should have been on 984,1068,7
Warning: obj_t::~obj_t(): couldn't remove 0x318ae410 from 6171,1607,3
Warning: obj_t::~obj_t(): removed 0x318ae410 from 6171,1607,2, but it should have been on 6171,1607,3
Warning: obj_t::~obj_t(): couldn't remove 0x318ae320 from 6170,1607,3
Warning: obj_t::~obj_t(): removed 0x318ae320 from 6170,1607,2, but it should have been on 6170,1607,3
Warning: obj_t::~obj_t(): couldn't remove 0x318ad4e0 from 6136,1594,3
Warning: obj_t::~obj_t(): removed 0x318ad4e0 from 6136,1594,2, but it should have been on 6136,1594,3
Warning: obj_t::~obj_t(): couldn't remove 0x318ab9b0 from 6130,1614,3
Warning: obj_t::~obj_t(): removed 0x318ab9b0 from 6130,1614,2, but it should have been on 6130,1614,3
Warning: obj_t::~obj_t(): couldn't remove 0x318b2100 from 6120,1784,6
Warning: obj_t::~obj_t(): removed 0x318b2100 from 6120,1784,5, but it should have been on 6120,1784,6
Warning: obj_t::~obj_t(): couldn't remove 0x318c3380 from 6130,1364,7
Warning: obj_t::~obj_t(): removed 0x318c3380 from 6130,1364,6, but it should have been on 6130,1364,7
Warning: obj_t::~obj_t(): couldn't remove 0x318c3350 from 6130,1365,7
Warning: obj_t::~obj_t(): removed 0x318c3350 from 6130,1365,6, but it should have been on 6130,1365,7
Warning: obj_t::~obj_t(): couldn't remove 0x318e2dd0 from 6580,53,5
Warning: obj_t::~obj_t(): removed 0x318e2dd0 from 6580,53,4, but it should have been on 6580,53,5
Warning: obj_t::~obj_t(): couldn't remove 0x1357f02b0 from 1477,1602,5
Warning: obj_t::~obj_t(): removed 0x1357f02b0 from 1477,1602,4, but it should have been on 1477,1602,5
Warning: obj_t::~obj_t(): couldn't remove 0x15188e660 from 2125,1523,2
Warning: obj_t::~obj_t(): removed 0x15188e660 from 2125,1523,1, but it should have been on 2125,1523,2
Warning: obj_t::~obj_t(): couldn't remove 0x1518c2c40 from 9,995,7
Warning: obj_t::~obj_t(): removed 0x1518c2c40 from 9,995,6, but it should have been on 9,995,7
Warning: obj_t::~obj_t(): couldn't remove 0x1518c2c10 from 9,996,7
Warning: obj_t::~obj_t(): removed 0x1518c2c10 from 9,996,6, but it should have been on 9,996,7
Warning: obj_t::~obj_t(): couldn't remove 0x8b8bd9a0 from 31,1860,4
Warning: obj_t::~obj_t(): removed 0x8b8bd9a0 from 31,1860,3, but it should have been on 31,1860,4
Warning: obj_t::~obj_t(): couldn't remove 0x8b8bb9f0 from 42,1865,6
Warning: obj_t::~obj_t(): removed 0x8b8bb9f0 from 42,1865,5, but it should have been on 42,1865,6
Warning: obj_t::~obj_t(): couldn't remove 0x39b5c6d0 from 6378,1405,4
Warning: obj_t::~obj_t(): removed 0x39b5c6d0 from 6378,1405,3, but it should have been on 6378,1405,4
Warning: obj_t::~obj_t(): couldn't remove 0x39b5c400 from 6380,1404,4
Warning: obj_t::~obj_t(): removed 0x39b5c400 from 6380,1404,2, but it should have been on 6380,1404,4
Warning: obj_t::~obj_t(): couldn't remove 0x39b5bdd0 from 6379,1403,4
Warning: obj_t::~obj_t(): removed 0x39b5bdd0 from 6379,1403,2, but it should have been on 6379,1403,4

I haven't been able to study these tiles yet, as my VM timed out. I was in the process of lowering land when the month change happened.

EDIT: The next message in the server log after the above was:

Code: [Select]

Message: karte_t::new_month(): Industry density proportion of 10000 being overriden with a value of 10000
So maybe the pause could have been related to planting a factory too.

[freddyhayward]

From offline testing, this was caused by hundreds of industries closing between October - November 1942.

[freddyhayward]

An error in the most recent patch has caused about half the companies on the server to go into administration. The server will have to be rolled back to an earlier save and this patch (https://github.com/jamespetts/simutrans-extended/pull/304) will have to be applied. I have a save from earlier today, and I believe Matthew has even more recent saves.

[jamespetts]

Thank you for finding and fixing this problem. Now restarting the server with your patch applied and rolled back to March 1944, before any players were in administration.

[Matthew]

Recent saves are here.

Times in the filenames are in EST (GMT-5)

[jamespetts]

I believe that the server has now been restarted with a reverted saved game version - please let me know if this process has not been effective.

[Matthew]

It appears that the Bridgewater-Brunel game server has not updated to the latest nightly build (#1b3a304).

If you use Nightly Updater, you may want to hold off updating and/or save your old executable (#8afbbce).

EDIT: I have tried to build yesterday's version (#8afbbce) for Windows and it is available here. It has been been tested online and appears to work, but YMMV. Also, it's a GDI build (so it won't have that annoying mouse cursor offset, but it also won't be able to play more than one sound at a time or handle non-Latin characters)

[jamespetts]

I am not sure quite why there was a delay in restarting, but it has now restarted with the correct version.

[jamespetts]

The server is currently undergoing an upgrade - although the game may appear to be available, the server may restart at any time and consequently changes will not be saved until further notice later to-day.

[jamespetts]

The upgrade has now been completed and the server is running again: apologies for the inconvenience.

[freddyhayward]

The upgrade has now been completed and the server is running again: apologies for the inconvenience.

May I ask what the upgrade involved?

[jamespetts]

May I ask what the upgrade involved?

It was an upgrade of the Linux distribution version on the server, which was out of date. One of the motivations was to allow installation of the latest libzstd-dev package for moving towards integrating this improved compression algorithm, once I have managed to get this to compile properly on the server and for cross-compile builds.

[Matthew]

The upgrade has now been completed and the server is running again: apologies for the inconvenience.

Thank you for the upgrade. Also thank you to Isaac, Vladki, and others who maintain the Extended infrastructure.

[Vladki]

What distro & version are you running?

[freddyhayward]

The server and its clients have been frequently crashing because of my signal routing patch. Could you please revert it?
edit: pull request that reverts it here: https://github.com/jamespetts/simutrans-extended/pull/309

[jamespetts]

I have now merged Freddy's pull request - thank you for that.

I am in the process of running a further upgrade on the server, from Ubuntu 18.04 to Ubuntu 20.04 to get easy access to the latest development libraries for compiling.

After the next save, changes may be lost until further notice.

[jamespetts]

The server has now been upgraded to 20.04 and is running normally again.

[freddyhayward]

The server game has not properly updated to the latest version again, could you please update it manually?

[jamespetts]

The server game has not properly updated to the latest version again, could you please update it manually?

What appears to be happening is that the Simutrans-Extended instance on the server is failing to shut down when commanded to do so, so, while the new code is compiled, the old code is still running. I do not understand why this has now started to happen. I will try to restart manually, but, given the need to ensure that the game be saved, this is extremely time consuming.

[Matthew]

What appears to be happening is that the Simutrans-Extended instance on the server is failing to shut down when commanded to do so, so, while the new code is compiled, the old code is still running. I do not understand why this has now started to happen. I will try to restart manually, but, given the need to ensure that the game be saved, this is extremely time consuming.

The server instance has not restarted for three days now. Full marks for stability, Bridgewater-Brunel! And thank you to Freddy, James, Prissi, Turfit, and everyone who has made the server so stable. This is a nice problem to have, but it is a problem. The Nightly Updater has become useless, because the paksets and binaries at bridgewater-brunel.me.uk/downloads/ are not necessarily what the server is running. And the server log is now 1.8GB, which is effectively unusable.

I speculate that this is related to general 'server lag'. This is not a concept I totally understand (since it seems that clients and server can both lag at the same time), but I take to mean the server has unimplemented actions waiting in a queue.  Last week I noticed that the 'Minister of Transport' message, which should run at 0559 London time, did not appear until after 0600 (0601 IIRC). That suggests the server has unfinished business when the restart script runs at 0600.

Looking at the restart script, it appears that it uses simple kill, which I believe tells Simutrans-Extended to exit gracefully (in contrast to kill -9). As of August 2020, it also had startstopgracetime=5, so the server only had five seconds to stop and start. The server should stop and start faster than the clients, because it doesn't have to (un)load graphical objects, but it would not be surprising if (un)load times were longer than five seconds, especially if it's got to complete a backlog of queued actions beforehand. So as a first step, perhaps it would be sensible to increase startstopgracetime dramatically, to 120, 180 or 300 seconds?

[jamespetts]

Thank you for the suggestions. At this stage, the strategy is to move towards implementing the improved compression algorithm as soon as reasonably possible, which may well reduce the lag enough to eliminate this problem. If it does not do so, more significant consideration can be given to other means of dealing with it then.

Thank you for analysing this carefully, however.

[freddyhayward]

The server has now been offline for over two hours.

[freddyhayward]

The server has now been offline for over two hours.

This happened for 5:30 hours before working again. Now, the exact same problem has occurred after today's restart. In both cases, the log shows that the server freezes just before entering karte_t::load.

[jamespetts]

That is very odd. Yesterday, what appeared to be happening was that the server was failing to load the saved game. I made some slight changes to the code with the intention of diagnosing the problem, and the problem went away after I ran the nightly script and refreshed the build. I am not sure what the problem was to-day: I was too busy to deal with this before now, and I see that the server is back online again.

The problem yesterday appeared to be related to the following part of the code:

Code: [Select]

if(!file.rd_open(name)) {

if(  file.get_version_int()==0  ||  file.get_version_int()>loadsave_t::int_version(SAVEGAME_VER_NR, NULL).version  ) {
dbg->warning("karte_t::load()", translator::translate("WRONGSAVE") );
dbg->warning("karte_t::load()", "Version is %u (Ex %u)", loadsave_t::int_version(SAVEGAME_VER_NR, NULL).version, loadsave_t::int_version(SAVEGAME_VER_NR, NULL).extended_version);
create_win( new news_img("WRONGSAVE"), w_info, magic_none );
}

I was getting the translated error message from WRONGSAVE in the command line on the server. I added debugging information to try to get it to be more specific, but, as noted above, the problem went away after recompiling. I do not know whether or not to-day's problem was related.

[freddyhayward]

The same exact problem is happening again today - the log always ends just before entering karte_t::load. Can you please manually restart the server again?

[Ranran]

As previously reported, there is an issue where the save version cannot be read correctly. The version will be blank. (It is saved correctly just because it cannot be read. If you use an old client, you can check that the version information is recorded in the save data created by the current client)
I think that is the cause.
One of the possible problems seems to be the incorrect version. (Or the part related to this is incorrect)

Code: [Select]

#define SIM_SAVE_MINOR      7
#define SIM_SERVER_MINOR    7
But I have no idea what this version should be.
For example, current nightly build can't recognize the saved game version recorded by itself, but the it will read recorded version if you change it. But I couldn't find the number to read its own saved game.

[jamespetts]

The server is currently not running. I have very limited time to-day, but the problem with the server starting appears to be not quite the same as it has been previously. A backtrace output gives the following:

Code: [Select]


Warning: sound_desc_t::get_sound_id():  sound "konakaboom-black-five.wav" not found
Warning: sound_desc_t::get_sound_id():  sound "felix-blume-old-factory.wav" not found
Warning: obj_reader_t::resolve_xrefs(): cannot resolve 'GOOD-bulk'
Warning: obj_reader_t::resolve_xrefs(): cannot resolve 'VHCL-LBSCR-4Wheel-composite-sub-fitted'
Warning: obj_reader_t::resolve_xrefs(): cannot resolve 'VHCL-gwr-4100'
Warning: obj_reader_t::resolve_xrefs(): cannot resolve 'VHCL-GWR-517Tank-AutoFitted'
Warning: obj_reader_t::resolve_xrefs(): cannot resolve 'VHCL-LBSCR-4Wheel-Brake-front-sub-fitted'
Warning: obj_reader_t::resolve_xrefs(): cannot resolve 'VHCL-LBSCR-4Wheel-Brake-rear-sub-fitted'
Warning: obj_reader_t::resolve_xrefs(): cannot resolve 'VHCL-LBSCR-4Wheel-Second-sub-fitted'
Warning: obj_reader_t::resolve_xrefs(): cannot resolve 'VHCL-LBSCR-4Wheel-First-sub-fitted'
Message: warn_missing_objects:  Object MonorailGround not found, feature disabled
Message: simu_main():   Reading menu configuration ...
Warning: tool_t::read_menu():   toolbar[11][5]: replaced way-builder(id=14) with default param=cityroad by cityroad builder(id=36)
Message: simu_main():   Reading private car ownership configuration ...
Message: register_desc():       Notice: obj Button already defined
Message: register_desc():       Notice: obj Roundbutton already defined
Message: register_desc():       Notice: obj Editfield already defined
Message: register_desc():       Notice: obj Listbox already defined
Message: register_desc():       Notice: obj Back already defined
Message: skinverwaltung_t::register_desc():     Extra object Titlebar added.
Message: skinverwaltung_t::register_desc():     Extra object GadgetBack added.
Message: register_desc():       Notice: obj Checkbutton already defined
Message: register_desc():       Notice: obj Posbutton already defined
Message: register_desc():       Notice: obj Scrollbar already defined
Message: register_desc():       Notice: obj Gadget already defined
Message: register_desc():       Notice: obj Divider already defined
[New Thread 0x7ffff762e700 (LWP 647892)]

Thread 2 "simutrans-exten" received signal SIGSEGV, Segmentation fault.
[Switching to Thread 0x7ffff762e700 (LWP 647892)]
__memmove_sse2_unaligned_erms () at ../sysdeps/x86_64/multiarch/memmove-vec-unaligned-erms.S:383
383     ../sysdeps/x86_64/multiarch/memmove-vec-unaligned-erms.S: No such file or directory.
(gdb) backtrace
#0  __memmove_sse2_unaligned_erms () at ../sysdeps/x86_64/multiarch/memmove-vec-unaligned-erms.S:383
#1  0x00007ffff7f6a754 in ZSTD_decompressStream () from /usr/lib/x86_64-linux-gnu/libzstd.so.1
#2  0x00005555556cf6b1 in ?? ()
#3  0x0000000100000000 in ?? ()
#4  0x4a1833deb9388600 in ?? ()
#5  0x0000000000100000 in ?? ()
#6  0x0000555555c19020 in ?? ()
#7  0x0000000000100000 in ?? ()
#8  0x0000000000000000 in ?? ()


[jamespetts]

Oddly, the problem now appears to have changed:

Code: [Select]

Incompatible saved game.

Cannot load file.

Warning: karte_t::load():       Version is 120007 (Ex 0)
ERROR: loadsave_t():    failed reading with error 1
For help with this error or to file a bug report please see the Simutrans forum:
http://forum.simutrans.com
Warning: nwc_routesearch_t::reset:      all static variables are reset
Message: nwc_auth_player_t::init_player_lock_server:    new = 32767
Message: karte_t::create_rivers():      There aren't any water tiles!

Message: simmain():     Creating cities ...
Message: karte_t::init():       Creating factories ...
Distributing 1 tourist attractions ...
Message: karte_t::init():       Preparing startup ...
Message: network_command_t::rdwr:       write packet_id=8, client_id=0
Warning: nwc_tool_t::rdwr:      rdwr id=8 client=0 plnr=255 pos=koord3d invalid tool_id=8224 defpar=16384,Now 0 clients connected. init=1 flags=0
Message: simu_main():   modal_dialogue( new welt_gui_t(&env_t::default_settings), magic_welt_gui_t, welt, never_quit );
ERROR: modal_dialogue:  called without a display driver => nothing will be shown!
For help with this error or to file a bug report please see the Simutrans forum:
http://forum.simutrans.com