jdev - 2020-06-29


  1. Жокир has left

  2. Жокир has joined

  3. Жокир has left

  4. Жокир has joined

  5. test2 has joined

  6. test2 has left

  7. test2 has joined

  8. test2 has left

  9. test2 has joined

  10. test2 has left

  11. test2 has joined

  12. Vaulor has left

  13. Жокир has left

  14. Жокир has joined

  15. lksjdflksjdf has left

  16. Жокир has left

  17. Жокир has joined

  18. Жокир has left

  19. Жокир has joined

  20. test2 has left

  21. test2 has joined

  22. Жокир has left

  23. Жокир has joined

  24. Жокир has left

  25. Жокир has joined

  26. drops has left

  27. drops has joined

  28. larma has left

  29. larma has joined

  30. test2 has left

  31. test2 has joined

  32. Жокир has left

  33. Жокир has joined

  34. adiaholic_ has left

  35. adiaholic_ has joined

  36. Yagizа has joined

  37. Жокир has left

  38. Жокир has joined

  39. test2 has left

  40. paul has joined

  41. martin has joined

  42. drops has left

  43. drops has joined

  44. drops has left

  45. drops has joined

  46. Vaulor has joined

  47. test2 has joined

  48. test2 has left

  49. test2 has joined

  50. martin has left

  51. Martin has left

  52. drops has left

  53. Martin has joined

  54. martin has joined

  55. martin has left

  56. Жокир has left

  57. Жокир has joined

  58. martin has joined

  59. jonas’

    lovetox, I don’t see any issue here, so unlikely: https://github.com/horazont/muchopper/issues

  60. Жокир has left

  61. Жокир has joined

  62. Жокир has left

  63. Жокир has joined

  64. Жокир has left

  65. Жокир has joined

  66. Жокир has left

  67. Жокир has joined

  68. pulkomandy has left

  69. pulkomandy has joined

  70. goffi has joined

  71. Жокир has left

  72. Жокир has joined

  73. Жокир has left

  74. Жокир has joined

  75. pulkomandy has left

  76. pulkomandy has joined

  77. test2 has left

  78. Жокир has left

  79. Жокир has joined

  80. moparisthebest has left

  81. asterix has joined

  82. Жокир

    Do any popular servers actually implement XEP-0368? If yes, could anyone give point to any such servers?

  83. jonas’

    Жокир, https://compliance.conversations.im/ any suggested as "compliant" servers should do, at least for c2s

  84. Жокир has left

  85. Жокир has joined

  86. jonas’

    I don’t know of any s2s implementation except maybe https://github.com/surevine/Metre , which isn’t quite a server.

  87. edhelas has left

  88. edhelas has joined

  89. debacle has joined

  90. xecks has joined

  91. Guus

    Looking at my server log, I'm noticing that I'm getting a lot of connection timeouts on s2s in bursts - presumably x minutes after a user that caused the federation to be set up sent its last presence update.

  92. Guus

    I wonder if it'd be good to introduce a small factor of randomness to the timeout interval, to avoid staggered behavior.

  93. flow

    Guus, maybe controversal counter-question: that does sounds like an timeout enforced on the application layer. if so, then why would you have an application layer timeout for s2s connections and not simply let the tcp connection timeout

  94. jonas’

    flow, save resources.

  95. jonas’

    the tcp connection will also not time out ever

  96. flow

    is it worth it?

  97. jonas’

    because both peers can see each other (in this scenario)

  98. jonas’

    file descriptors are limited and when you notice you’re running out of them, it’s too late

  99. jonas’

    being a bit proactive about preserving them is generally a good idea

  100. flow

    ok so kill idle connections based on the amount of available file descriptions, but not based on time

  101. jonas’

    you don’t know the amount of available file descriptors

  102. flow

    (or, to be precise, only as second criteria based on time)

  103. jonas’

    you know the limit, but you don’t know how many are open in your process

  104. jonas’

    you can estimate, but you can be wrong in the bad direction.

  105. jonas’

    (or in both directions, depending on how you estimate)

  106. flow

    ls /proc/$pid/fd/ | wc -l

  107. flow

    ?

  108. jonas’

    that’s at least a rather expensive way to do it

  109. jonas’

    but true, that works, on systems where procfs has that feature

  110. flow

    why is it expensive?

  111. Guus

    flow I don't mind much either way - I'm just noticing that I get a lot of disconnects. I'm thinking Prosody does this? Openfire probably does so as well, though.

  112. jonas’

    flow, that’s many syscalls

  113. Guus

    (at the very least, it's configurable)

  114. jonas’

    I can’t see immediately in man 5 procfs whether /proc/$pid/fd is a linux or a posix thing

  115. flow

    jonas’, I wouldn't be surpised if there is a more efficient way to get that number

  116. jonas’

    I would

  117. Guus

    I don't mind much closing idle connections (although it does feel like premature optimization a bit.)

  118. flow

    especially on linux

  119. jonas’

    I think I looked into that already and found that it’s not possible

  120. jonas’

    there’s surely a reason why sudo does a for i in 0..MAXFD do close($i); done

  121. Guus

    as Openfire is a multi-platform solution, depending on any platform specific thingy is going to be a pain.

  122. Guus

    unless Java exposes things, which I doubt.

  123. flow

    Guus, UnixOperationSystemMXBean.getOpenFileDescriptorCount()

  124. flow

    not sure if something like that also exist for other OS'es

  125. Guus

    *Unix*OperationSystemMXBean is likely going to fail on Windows? 🙂

  126. Guus

    but also: not worth the complexity, maybe?

  127. flow

    so you may have to implement a fallback strategy for sure (like disconnection based on a timeout)

  128. jonas’

    I don’t see any problem with a timeout here, to be honest

  129. flow

    Guus, potentially, depends on your goals I'd say

  130. jonas’

    everything else seems slightly overengineered

  131. jonas’

    file descriptors may also just be one reason why you want to keep the number of open connections low

  132. jonas’

    other reasons may include running behind a stateful firewall and wanting to conserve resources there

  133. Жокир has left

  134. Жокир has joined

  135. Guus

    I was just suggesting to add a small random factor in the timeout delay, nothing more 😉

  136. flow

    Guus, which is always a good idea

  137. Guus

    also, given how I see batches of s2s tear down only to be brought up again, I'm suspecting that the default timeout of (Prosody?) might be on the low end.

  138. jonas’

    prosody doesn’t have a default timeout

  139. Guus

    oh, that's interesting

  140. Guus

    note that I didn't actually check what server software is used on those. I just assumed.

  141. Guus

    having had a closer look: might be ejabberd 🙂

  142. jonas’

    https://sotecware.net/files/noindex/connections.png

  143. jonas’

    :-)

  144. adrien has left

  145. adrien has joined

  146. flow

    looks like a 30 minute timeout

  147. flow

    combined with an hourly cron job maybe?

  148. jonas’

    I think there are two timeouts, one ~15min (the linear curve down) and one ~30min (which also looks randomized, because of the slight exp-y behaviour at the end)

  149. jonas’

    and yes, this is the connection stats of search.jabber.network, and the spikes you see is the hourly scan :)

  150. Guus

    (maybe randomize your scan!)

  151. flow

    now we only need to identify the implementations with the 15m and 30m (randomized) timeout

  152. jonas’

    Guus, it’s already shuffled :)

  153. flow

    and what is keeping the baseline of 1.5k connections

  154. Guus

    moar shuffling!

  155. jonas’

    flow, compare the ratios with https://search.jabber.network/stats#software :)

  156. jonas’

    assuming that many "unknowns" are in fact prosody MUCs, because prosody doesn’t report version on MUC by default IIRC

  157. flow

    ahh, so it is probably prosody which keeps the connections

  158. jonas’

    flow, very likely

  159. flow

    but the amount of 15m and 30m timeout connections appears to be nearly equal

  160. jonas’

    I experimented with loading mod_s2s_idle_timeout or whatsitcalled on s.j.n, but then I disabled it to reduce the codebase to the minimum for some unrelated testing

  161. jonas’

    flow, I’ll have to dig deeper into it, it’s also possible that the different behaviours there are an artifact of how the scanner works

  162. jonas’

    flow, I’ll have to dig deeper into it, it’s also possible that the two different falloff behaviours there are an artifact of how the scanner works

  163. flow

    i see

  164. jonas’

    since there are two scanning components, and one finishes much quicker than the other; it’s possible that the quicker one is causing the additional tip of the initial spike, while the slower one is what causes the slow fall off at the end

  165. jonas’

    since the quicker one also tends to touch more domains

  166. jonas’

    oh yeah, that’s very plausible

  167. jonas’

    that may also explain the exp falloff due to shuffling

  168. jonas’

    if there’s really just a 15m or something timeout involved

  169. flow

    jonas’, are you aware that 'German' appears twice in the room languages table?

  170. jonas’

    yes

  171. jonas’

    de-de vs. de

  172. jonas’

    I need to normalize that

  173. jonas’

    https://sotecware.net/files/noindex/connections-1h.png

  174. jonas’

    https://sotecware.net/files/noindex/ingestion-1h.png

  175. jonas’

    that seems to fit very well

  176. jonas’

    (the "filled" part in the second graph is the fast component, the "line" part in the second graph is the slow component)

  177. jonas’

    the fast component ends at 07:24, which is exactly when the initial spike drops in the first graph

  178. kikuchiyo has left

  179. kikuchiyo has joined

  180. adiaholic_ has left

  181. adiaholic_ has joined

  182. drops has joined

  183. kikuchiyo has left

  184. kikuchiyo has joined

  185. drops has left

  186. drops has joined

  187. test2 has joined

  188. debacle has left

  189. eta has left

  190. eta has joined

  191. Kev has joined

  192. adrien has left

  193. sonny has joined

  194. adrien has joined

  195. debacle has joined

  196. adiaholic_ has left

  197. adiaholic_ has joined

  198. pulkomandy has left

  199. pulkomandy has joined

  200. pulkomandy has left

  201. pulkomandy has joined

  202. jonnj has left

  203. test2 has left

  204. kikuchiyo has left

  205. martin has left

  206. martin has joined

  207. pulkomandy has left

  208. pulkomandy has joined

  209. kikuchiyo has joined

  210. kikuchiyo has left

  211. Жокир has left

  212. Жокир has joined

  213. pulkomandy has left

  214. pulkomandy has joined

  215. kikuchiyo has joined

  216. kikuchiyo has left

  217. kikuchiyo has joined

  218. martin has left

  219. Martin has left

  220. Martin has joined

  221. martin has joined

  222. jonnj has joined

  223. test2 has joined

  224. test2 has left

  225. test2 has joined

  226. adrien has left

  227. Жокир has left

  228. Жокир has joined

  229. Жокир has left

  230. Жокир has joined

  231. adrien has joined

  232. pulkomandy has left

  233. pulkomandy has joined

  234. adiaholic_ has left

  235. adiaholic_ has joined

  236. test2 has left

  237. test2 has joined

  238. alexis has left

  239. alexis has joined

  240. moparisthebest has joined

  241. adiaholic_ has left

  242. adiaholic_ has joined

  243. kikuchiyo has left

  244. kikuchiyo has joined

  245. kikuchiyo has left

  246. kikuchiyo has joined

  247. lksjdflksjdf has joined

  248. test2 has left

  249. test2 has joined

  250. Wojtek has joined

  251. kikuchiyo has left

  252. waqas has joined

  253. waqas has left

  254. kikuchiyo has joined

  255. kikuchiyo has left

  256. kikuchiyo has joined

  257. kikuchiyo has left

  258. kikuchiyo has joined

  259. kikuchiyo has left

  260. kikuchiyo has joined

  261. kikuchiyo has left

  262. kikuchiyo has joined

  263. kikuchiyo has left

  264. kikuchiyo has joined

  265. kikuchiyo has left

  266. kikuchiyo has joined

  267. kikuchiyo has left

  268. kikuchiyo has joined

  269. kikuchiyo has left

  270. kikuchiyo has joined

  271. kikuchiyo has left

  272. kikuchiyo has joined

  273. kikuchiyo has left

  274. kikuchiyo has joined

  275. kikuchiyo has left

  276. kikuchiyo has joined

  277. kikuchiyo has left

  278. kikuchiyo has joined

  279. kikuchiyo has left

  280. kikuchiyo has joined

  281. kikuchiyo has left

  282. kikuchiyo has joined

  283. kikuchiyo has left

  284. kikuchiyo has joined

  285. kikuchiyo has left

  286. kikuchiyo has joined

  287. kikuchiyo has left

  288. kikuchiyo has joined

  289. kikuchiyo has left

  290. kikuchiyo has joined

  291. kikuchiyo has left

  292. kikuchiyo has joined

  293. kikuchiyo has left

  294. kikuchiyo has joined

  295. kikuchiyo has left

  296. kikuchiyo has joined

  297. kikuchiyo has left

  298. kikuchiyo has joined

  299. kikuchiyo has left

  300. kikuchiyo has joined

  301. kikuchiyo has left

  302. kikuchiyo has joined

  303. kikuchiyo has left

  304. kikuchiyo has joined

  305. kikuchiyo has left

  306. test2 has left

  307. kikuchiyo has joined

  308. kikuchiyo has left

  309. kikuchiyo has joined

  310. kikuchiyo has left

  311. kikuchiyo has joined

  312. kikuchiyo has left

  313. kikuchiyo has joined

  314. kikuchiyo has left

  315. kikuchiyo has joined

  316. kikuchiyo has left

  317. kikuchiyo has joined

  318. kikuchiyo has left

  319. kikuchiyo has joined

  320. kikuchiyo has left

  321. kikuchiyo has joined

  322. kikuchiyo has left

  323. kikuchiyo has joined

  324. kikuchiyo has left

  325. kikuchiyo has joined

  326. kikuchiyo has left

  327. kikuchiyo has joined

  328. kikuchiyo has left

  329. kikuchiyo has joined

  330. kikuchiyo has left

  331. kikuchiyo has joined

  332. kikuchiyo has left

  333. kikuchiyo has joined

  334. kikuchiyo has left

  335. kikuchiyo has joined

  336. kikuchiyo has left

  337. kikuchiyo has joined

  338. kikuchiyo has left

  339. sonny has left

  340. kikuchiyo has joined

  341. sonny has joined

  342. kikuchiyo has left

  343. kikuchiyo has joined

  344. kikuchiyo has left

  345. kikuchiyo has joined

  346. kikuchiyo has left

  347. kikuchiyo has joined

  348. kikuchiyo has left

  349. kikuchiyo has joined

  350. kikuchiyo has left

  351. test2 has joined

  352. kikuchiyo has joined

  353. kikuchiyo has left

  354. kikuchiyo has joined

  355. alexis has left

  356. kikuchiyo has left

  357. kikuchiyo has joined

  358. kikuchiyo has left

  359. kikuchiyo has joined

  360. kikuchiyo has left

  361. kikuchiyo has joined

  362. kikuchiyo has left

  363. kikuchiyo has joined

  364. kikuchiyo has left

  365. kikuchiyo has joined

  366. kikuchiyo has left

  367. kikuchiyo has joined

  368. kikuchiyo has left

  369. kikuchiyo has joined

  370. kikuchiyo has left

  371. kikuchiyo has joined

  372. kikuchiyo has left

  373. lksjdflksjdf has left

  374. kikuchiyo has joined

  375. kikuchiyo has left

  376. daidoji has left

  377. kikuchiyo has joined

  378. kikuchiyo has left

  379. kikuchiyo has joined

  380. kikuchiyo has left

  381. kikuchiyo has joined

  382. kikuchiyo has left

  383. kikuchiyo has joined

  384. kikuchiyo has left

  385. kikuchiyo has joined

  386. kikuchiyo has left

  387. kikuchiyo has joined

  388. kikuchiyo has left

  389. kikuchiyo has joined

  390. kikuchiyo has left

  391. kikuchiyo has joined

  392. kikuchiyo has left

  393. kikuchiyo has joined

  394. kikuchiyo has left

  395. kikuchiyo has joined

  396. kikuchiyo has left

  397. alexis has joined

  398. kikuchiyo has joined

  399. kikuchiyo has left

  400. kikuchiyo has joined

  401. kikuchiyo has left

  402. kikuchiyo has joined

  403. kikuchiyo has left

  404. kikuchiyo has joined

  405. kikuchiyo has left

  406. test2 has left

  407. test2 has joined

  408. kikuchiyo has joined

  409. lksjdflksjdf has joined

  410. Жокир has left

  411. Жокир has joined

  412. test2 has left

  413. test2 has joined

  414. Neustradamus has left

  415. lovetox has joined

  416. pulkomandy has left

  417. pulkomandy has joined

  418. Жокир has left

  419. adiaholic_ has left

  420. adiaholic_ has joined

  421. pulkomandy has left

  422. pulkomandy has joined

  423. Neustradamus has joined

  424. Neustradamus has left

  425. Neustradamus has joined

  426. Neustradamus has left

  427. Neustradamus has joined

  428. Neustradamus has left

  429. Neustradamus has joined

  430. martin has left

  431. martin has joined

  432. lovetox has left

  433. test2 has left

  434. test2 has joined

  435. adiaholic_ has left

  436. adiaholic_ has joined

  437. test2 has left

  438. test2 has joined

  439. Beherit has left

  440. Beherit has joined

  441. lovetox has joined

  442. test2 has left

  443. adiaholic_ has left

  444. adiaholic_ has joined

  445. adiaholic_ has left

  446. adiaholic_ has joined

  447. lksjdflksjdf has left

  448. martin has left

  449. martin has joined

  450. lksjdflksjdf has joined

  451. lksjdflksjdf has left

  452. debacle has left

  453. paul has left

  454. adiaholic_ has left

  455. Beherit has left

  456. adiaholic_ has joined

  457. Beherit has joined

  458. Yagizа has left

  459. test2 has joined

  460. test2 has left

  461. test2 has joined

  462. debacle has joined

  463. debacle has left

  464. debacle has joined

  465. xecks has left

  466. xecks has joined

  467. paul has joined

  468. test2 has left

  469. test2 has joined

  470. test2 has left

  471. test2 has joined

  472. test2 has left

  473. lksjdflksjdf has joined

  474. waqas has joined

  475. sonny has left

  476. sonny has joined

  477. goffi has left

  478. Neustradamus has left

  479. Neustradamus has joined

  480. Beherit has left

  481. Beherit has joined

  482. lksjdflksjdf has left

  483. lksjdflksjdf has joined

  484. lovetox has left

  485. lovetox has joined

  486. adiaholic_ has left

  487. adiaholic_ has joined

  488. lksjdflksjdf has left

  489. lovetox has left

  490. lovetox has joined

  491. adrien has left

  492. adrien has joined

  493. sonny has left

  494. sonny has joined

  495. wurstsalat has left

  496. lovetox has left

  497. test2 has joined

  498. martin has left

  499. asterix has left

  500. Жокир has joined

  501. paul has left

  502. test2 has left

  503. test2 has joined

  504. test2 has left

  505. test2 has joined

  506. test2 has left

  507. test2 has joined

  508. test2 has left

  509. test2 has joined

  510. test2 has left

  511. test2 has joined