XMPP Service Operators - 2020-05-01


  1. Neustradamus has joined

  2. Neustradamus has left

  3. stpeter has joined

  4. stpeter has left

  5. Neustradamus has joined

  6. Neustradamus has left

  7. sol has left

  8. sol has joined

  9. Huxx has left

  10. lorddavidiii has left

  11. lorddavidiii has joined

  12. sol has left

  13. sol has joined

  14. sol has left

  15. sol has joined

  16. rintinfinn has left

  17. SouL has left

  18. sonny has left

  19. sonny has joined

  20. alien has left

  21. alien has joined

  22. tom has left

  23. tom has joined

  24. Youssef has joined

  25. Youssef has left

  26. ackerman1scott has left

  27. ackerman1scott has joined

  28. sol has left

  29. sol has joined

  30. Roi has left

  31. Roi has joined

  32. sol has left

  33. sol has joined

  34. sonny has left

  35. sonny has joined

  36. lorddavidiii has left

  37. sol has left

  38. sol has joined

  39. sonny has left

  40. sonny has joined

  41. sol has left

  42. sol has joined

  43. sol has left

  44. sol has joined

  45. sol has left

  46. sol has joined

  47. SouL has joined

  48. kusoneko has left

  49. kusoneko has joined

  50. sonny has left

  51. sonny has joined

  52. sonny has left

  53. sonny has joined

  54. pod has joined

  55. paul has left

  56. sol has left

  57. sol has joined

  58. dinosaurdynasty has left

  59. dinosaurdynasty has joined

  60. Pingu from Woodquarter has joined

  61. mimi89999 has left

  62. mimi89999 has joined

  63. sonny has left

  64. sonny has joined

  65. kikuchiyo has joined

  66. jayteeuk has left

  67. jayteeuk has joined

  68. sonny has left

  69. sonny has joined

  70. ibikk has joined

  71. jayteeuk has left

  72. jayteeuk has joined

  73. sol has left

  74. sol has joined

  75. sonny has left

  76. sonny has joined

  77. cuc has joined

  78. lorddavidiii has joined

  79. Pingu from Woodquarter has left

  80. Pingu from Woodquarter has joined

  81. sonny has left

  82. sonny has joined

  83. sol has left

  84. sol has joined

  85. Pingu from Woodquarter has left

  86. Pingu from Woodquarter has joined

  87. sol has left

  88. sol has joined

  89. sonny has left

  90. sonny has joined

  91. kikuchiyo has left

  92. kikuchiyo has joined

  93. ackerman1scott has left

  94. jayteeuk has left

  95. jayteeuk has joined

  96. kikuchiyo has left

  97. sol has left

  98. sol has joined

  99. kusoneko has left

  100. kusoneko has joined

  101. kusoneko has left

  102. kusoneko has joined

  103. jayteeuk has left

  104. jayteeuk has joined

  105. felix has left

  106. felix has joined

  107. dinosaurdynasty has left

  108. dinosaurdynasty has joined

  109. kikuchiyo has joined

  110. sonny has left

  111. sonny has joined

  112. sol has left

  113. sol has joined

  114. rintinfinn has joined

  115. sonny has left

  116. sonny has joined

  117. tsk has left

  118. tsk has joined

  119. rintinfinn has left

  120. rintinfinn has joined

  121. sonny has left

  122. sonny has joined

  123. sonny has left

  124. sonny has joined

  125. sol has left

  126. sol has joined

  127. sonny has left

  128. sonny has joined

  129. ackerman1scott has joined

  130. kikuchiyo has left

  131. kikuchiyo has joined

  132. sonny has left

  133. sonny has joined

  134. sonny has left

  135. sonny has joined

  136. Huxx has joined

  137. sol has left

  138. sol has joined

  139. sonny has left

  140. sonny has joined

  141. rintinfinn has left

  142. rintinfinn has joined

  143. sezuan has left

  144. sol has left

  145. sol has joined

  146. ackerman1scott has left

  147. andrey.utkin has joined

  148. Maranda has left

  149. Maranda has joined

  150. perflyst has joined

  151. sonny has left

  152. sonny has joined

  153. Marzanna has joined

  154. ackerman1scott has joined

  155. Pingu from Woodquarter has left

  156. sol has left

  157. sol has joined

  158. Pingu from Woodquarter has joined

  159. perflyst has left

  160. rintinfinn has left

  161. rintinfinn has joined

  162. perflyst has joined

  163. ackerman1scott has left

  164. rintinfinn has left

  165. rintinfinn has joined

  166. ackerman1scott has joined

  167. rintinfinn has left

  168. rintinfinn has joined

  169. Martin

    @ping trashserver.net

  170. Echo1 has left

  171. sol has left

  172. sol has joined

  173. Martin

    @ping diebesban.de

  174. rintinfinn has left

  175. rintinfinn has joined

  176. rintinfinn has left

  177. rintinfinn has joined

  178. rintinfinn has left

  179. rintinfinn has joined

  180. robertooo has left

  181. rintinfinn has left

  182. rintinfinn has joined

  183. robertooo has joined

  184. rintinfinn has left

  185. rintinfinn has joined

  186. madmalkav has joined

  187. rintinfinn has left

  188. rintinfinn has joined

  189. sol has left

  190. sol has joined

  191. rintinfinn has left

  192. sonny has left

  193. sonny has joined

  194. rintinfinn has joined

  195. rintinfinn has left

  196. rintinfinn has joined

  197. ackerman1scott has left

  198. rintinfinn has left

  199. rintinfinn has joined

  200. rintinfinn has left

  201. rintinfinn has joined

  202. rintinfinn has left

  203. rintinfinn has joined

  204. sonny has left

  205. sonny has joined

  206. Ellenor Malik

    A.

  207. sol has left

  208. sol has joined

  209. ackerman1scott has joined

  210. Youssef has joined

  211. sol has left

  212. sol has joined

  213. rintinfinn has left

  214. felix has left

  215. sol has left

  216. sol has joined

  217. Pingu from Woodquarter has left

  218. Pingu from Woodquarter has joined

  219. sonny has left

  220. Nils (10rokita) has left

  221. sonny has joined

  222. sonny has left

  223. felix has joined

  224. sonny has joined

  225. sonny has left

  226. sol has left

  227. sol has joined

  228. Youssef has left

  229. Youssef has joined

  230. Nils (10rokita) has joined

  231. schorsch has left

  232. schorsch has joined

  233. jonas’ has left

  234. jonas’ has joined

  235. sol has left

  236. sol has joined

  237. Nils (10rokita) has left

  238. drops has left

  239. drops has joined

  240. Pingu from Woodquarter has left

  241. sol has left

  242. sol has joined

  243. alien has left

  244. alien has joined

  245. holger has joined

  246. Pingu from Woodquarter has joined

  247. sol has left

  248. sol has joined

  249. drops has left

  250. drops has joined

  251. drops has left

  252. drops has joined

  253. sol has left

  254. sol has joined

  255. sol has left

  256. sol has joined

  257. ackerman1scott has left

  258. ackerman1scott has joined

  259. sol has left

  260. sol has joined

  261. jayteeuk has left

  262. jayteeuk has joined

  263. alien has left

  264. alien has joined

  265. Nils (10rokita) has joined

  266. 10rokita has joined

  267. sol has left

  268. sol has joined

  269. Pingu from Woodquarter has left

  270. sol has left

  271. sol has joined

  272. Pingu from Woodquarter has joined

  273. 10rokita has left

  274. jayteeuk has left

  275. jayteeuk has joined

  276. felix has left

  277. ajeremias has joined

  278. sol has left

  279. sol has joined

  280. perflyst has left

  281. paul has joined

  282. Nils (10rokita) has left

  283. jjrh has left

  284. jjrh has joined

  285. jjrh has left

  286. Nils (10rokita) has joined

  287. perflyst has joined

  288. jjrh has joined

  289. holger has left

  290. holger has joined

  291. jayteeuk has left

  292. jayteeuk has joined

  293. sol has left

  294. sol has joined

  295. Pingu from Woodquarter has left

  296. Pingu from Woodquarter has joined

  297. jayteeuk has left

  298. jayteeuk has joined

  299. jayteeuk has left

  300. jayteeuk has joined

  301. jayteeuk has left

  302. jayteeuk has joined

  303. madmalkav has left

  304. madmalkav has joined

  305. perflyst has left

  306. perflyst has joined

  307. sol has left

  308. sol has joined

  309. madmalkav has left

  310. Pingu from Woodquarter has left

  311. Pingu from Woodquarter has joined

  312. perflyst has left

  313. perflyst has joined

  314. sol has left

  315. sol has joined

  316. madmalkav has joined

  317. insanity has left

  318. Ellenor Malik

    What would cause Prosody to hog CPU?

  319. Martin

    For me it was mam hitting 10000 messages in one archive and using fine storage.

  320. Martin

    For me it was mam hitting 10000 messages in one archive and using internal file storage.

  321. Link Mauve

    For me, smacks going through many queued messages for a given user.

  322. Martin

    > What would cause Prosody to hog CPU? Something enlightening might be found in your logs.

  323. sol has left

  324. sol has joined

  325. ackerman1scott has left

  326. jayteeuk has left

  327. jayteeuk has joined

  328. ackerman1scott has joined

  329. cinco has left

  330. cinco has joined

  331. sol has left

  332. sol has joined

  333. rintinfinn has joined

  334. Ellenor Malik has left

  335. Ellenor Malik has joined

  336. jayteeuk has left

  337. jayteeuk has joined

  338. robertooo has left

  339. perflyst has left

  340. sol has left

  341. sol has joined

  342. rintinfinn has left

  343. rom1dep has left

  344. rom1dep has joined

  345. rintinfinn has joined

  346. jayteeuk has left

  347. jayteeuk has joined

  348. rintinfinn has left

  349. joerg has left

  350. jayteeuk has left

  351. jayteeuk has joined

  352. joerg has joined

  353. joerg has left

  354. joerg has joined

  355. ackerman1scott has left

  356. holger has left

  357. rintinfinn has joined

  358. joerg has left

  359. holger has joined

  360. joerg has joined

  361. sonny has joined

  362. sol has left

  363. sol has joined

  364. rintinfinn has left

  365. rintinfinn has joined

  366. ackerman1scott has joined

  367. sol has left

  368. sol has joined

  369. robertooo has joined

  370. rintinfinn has left

  371. Echo1 has joined

  372. nmhsm has joined

  373. holger has left

  374. Maranda

    Martin: define "hog"

  375. holger has joined

  376. edhelas has left

  377. Maranda has recently upped the archives cap to 23000.. Is still waiting to see the performance hit.

  378. ru_maniac has left

  379. rintinfinn has joined

  380. sol has left

  381. sol has joined

  382. insanity has joined

  383. edhelas has joined

  384. ru_maniac has joined

  385. Maranda

    @version myst.blue

  386. Echo1

    Maranda: myst.blue is running Metronome version 3.13.5 on Linux

  387. ru_maniac has left

  388. ru_maniac has joined

  389. rintinfinn has left

  390. rintinfinn has joined

  391. 404.city has joined

  392. sol has left

  393. sol has joined

  394. nmhsm has left

  395. rintinfinn has left

  396. Martin

    Maranda: > Martin: define "hog" Why are you asking me?

  397. Maranda

    because you mentioned "flat files storage" in the same sentence

  398. Martin

    But the hig came from the citation so the citation is not the same sentence and you should ask Ellenor Malik

  399. Martin

    But the hog came from the citation so the citation is not the same sentence and you should ask Ellenor Malik

  400. Ellenor Malik

    GRR

  401. 404.city has left

  402. Maranda

    Martin, should I? Ellenor, didn't mention MAM, didn't mention flat files, didn't mention "after reaching ten thousands of messages in an archive" which is what I just raise the CAP from.... :)

  403. Maranda

    I'm more interested in numbers from that

  404. Martin

    But she brought the term "hog" into the ring, so if you ask definitions for "hog" you should ask her.

  405. Licaon_Kter has left

  406. Martin

    For me it was: prosody going up to 100% and being unusable (clients disconnected and couldn't log in again) pasting debug log into prosody muc I was asked if I have a huge archive. By counting my users archive it turned out it was exactly 10000, so the limit for archive messages in flat file storage. After stopping prosody, migrating to xmlarchive and restarting it was working/usable again.

  407. rintinfinn has joined

  408. Maranda is puzzles by *how actually big* was that _10000_

  409. Neustradamus has joined

  410. Neustradamus has left

  411. jayteeuk has left

  412. jayteeuk has joined

  413. madmalkav has left

  414. madmalkav has joined

  415. Maranda is puzzled by *how actually big* was that _10000_

  416. Martin

    Afair it was something between 10 and 20 MB

  417. jayteeuk has left

  418. jayteeuk has joined

  419. Neustradamus has joined

  420. Neustradamus has left

  421. rintinfinn has left

  422. rintinfinn has joined

  423. Martin

    du -sh /var/lib/prosody/mdosch%2ede/archive/ 21M /var/lib/prosody/mdosch%2ede/archive/ du -sh /var/lib/prosody/mdosch%2ede/archive/martin.list 12M /var/lib/prosody/mdosch%2ede/archive/martin.list

  424. Maranda

    -rw-r----- 1 metronome metronome 18M May 1 15:13 maranda.dat ---> I'll have to do some testing on cpu usage when Metronome loads/stores the archive into/from RAM

  425. sol has left

  426. sol has joined

  427. Martin

    Don't know why but it seems when I hit the 10000 cap prosody freaked out, took 100% CPU and was not usable anymore.

  428. Martin

    Usually it idles around having almost no CPU impact.

  429. perflyst has joined

  430. ackerman1scott has left

  431. Neustradamus has joined

  432. Neustradamus has left

  433. jayteeuk has left

  434. jayteeuk has joined

  435. ackerman1scott has joined

  436. jonas’

    Martin, that sounds familiar

  437. jayteeuk has left

  438. jonas’

    verily

  439. jonas’

    cc @ Ge0rG ^

  440. jayteeuk has joined

  441. Neustradamus has joined

  442. Neustradamus has left

  443. ru_maniac has left

  444. insanity has left

  445. ru_maniac has joined

  446. Neustradamus has joined

  447. Neustradamus has left

  448. sol has left

  449. sol has joined

  450. insanity has joined

  451. Maranda

    well I think my current storage strategy with atomic writes will be fine until datastores stay within the underlying (os/)hardware IO performance range

  452. Maranda

    well I guess my current storage strategy with atomic writes will be fine until datastores stay within the underlying (os/)hardware IO performance range

  453. Maranda

    well I guess my current storage strategy with atomic read/writes will be fine until datastores stay within the underlying (os/)hardware IO performance range

  454. insanity has left

  455. insanity has joined

  456. Licaon_Kter has joined

  457. sol has left

  458. sol has joined

  459. perflyst has left

  460. sol has left

  461. sol has joined

  462. stpeter has joined

  463. stpeter has left

  464. jayteeuk has left

  465. jayteeuk has joined

  466. perflyst has joined

  467. sol has left

  468. sol has joined

  469. jayteeuk has left

  470. jayteeuk has joined

  471. jayteeuk has left

  472. jayteeuk has joined

  473. perflyst has left

  474. kusoneko has left

  475. kusoneko has joined

  476. kusoneko has left

  477. kusoneko has joined

  478. sol has left

  479. sol has joined

  480. kusoneko has left

  481. kusoneko has joined

  482. kusoneko has left

  483. kusoneko has joined

  484. sol has left

  485. ij has left

  486. perflyst has joined

  487. jayteeuk has left

  488. jayteeuk has joined

  489. ij has joined

  490. sol has joined

  491. Ge0rG

    Martin: that issue almost killed yax.im yesterday. Apparently internal storage is not fast at all.

  492. jayteeuk has left

  493. jayteeuk has joined

  494. Ge0rG

    Martin: there will be a solution to this soon, I'm sure.

  495. ij has left

  496. Maranda suspects it's not about internal storage

  497. Ge0rG

    Maranda: it is. deleting one line from internal storage requires fully rewriting the huuuuuge serialized file

  498. ackerman1scott has left

  499. ackerman1scott has joined

  500. kusoneko has left

  501. kusoneko has joined

  502. holger has left

  503. kusoneko has left

  504. kusoneko has joined

  505. holger has joined

  506. sol has left

  507. sol has joined

  508. sol has left

  509. lorddavidiii has left

  510. Martin

    Ge0rG: I was hoping that xmlstorage might help already. Maybe the structured data is easier to process.

  511. Maranda

    Ge0rG, that's not a problem here tbh, and me thinks it's more about that ".list" file there

  512. ij has joined

  513. perflyst has left

  514. sol has joined

  515. Maranda

    and that also you shouldn't keep to rewrite one huge serialized file to disk everytime just one line is popped

  516. jayteeuk has left

  517. jayteeuk has joined

  518. insanity has left

  519. sol has left

  520. sol has joined

  521. insanity has joined

  522. lorddavidiii has joined

  523. MattJ

    Ge0rG [18:49]: > Martin: there will be a solution to this soon, I'm sure. There is no real plan to fix it, it's been known that this does not perform well since before the release, which is why we tell people not to have large archives with internal storage

  524. MattJ

    It's possible that in a future release we will merge xmlarchive or a derivative

  525. ackerman1scott has left

  526. MattJ

    And maybe we can tweak e.g. removing more than one item at a time

  527. MattJ

    But rewriting how the archive store works on the stable branch is not on the cards, and would be a large project

  528. sol has left

  529. sol has joined

  530. sakhmatd has left

  531. sakhmatd has joined

  532. kusoneko has left

  533. kusoneko has joined

  534. kusoneko has left

  535. ackerman1scott has joined

  536. Ge0rG

    MattJ: does this affect the stable branch? I've only encountered it after going to trunk

  537. kusoneko has joined

  538. sonny has left

  539. sonny has joined

  540. Ge0rG

    and IIRC the 10k limit is the default, and it already makes prosody almost break down ;)

  541. sonny has left

  542. sonny has joined

  543. MattJ

    I thought it was in 0.11.x but not certain

  544. colochon has joined

  545. kusoneko has left

  546. kusoneko has joined

  547. Ge0rG

    MattJ: I'm sure I'd have run into it before then.

  548. MattJ

    And the default is not to persist MAM at all actually :)

  549. kusoneko has left

  550. kusoneko has joined

  551. MattJ

    (I don't believe in shipping software that logs peoples' messages by default)

  552. kusoneko has left

  553. kusoneko has joined

  554. kusoneko has left

  555. kusoneko has joined

  556. Ge0rG

    I don't believe in services that don't do everything they can to deliver messages

  557. MattJ

    mod_offline

  558. tom has left

  559. jayteeuk has left

  560. jayteeuk has joined

  561. sol has left

  562. sol has joined

  563. insanity has left

  564. insanity has joined

  565. joerg has left

  566. joerg has joined

  567. lorddavidiii has left

  568. ij has left

  569. ij has joined

  570. lorddavidiii has joined

  571. jayteeuk has left

  572. jayteeuk has joined

  573. sol has left

  574. sol has joined

  575. Licaon_Kter has left

  576. Luciole has joined

  577. colochon has left

  578. colochon has joined

  579. insanity has left

  580. insanity has joined

  581. kikuchiyo has left

  582. Licaon_Kter has joined

  583. robertooo has left

  584. insanity has left

  585. colochon has left

  586. insanity has joined

  587. colochon has joined

  588. kikuchiyo has joined

  589. sol has left

  590. sol has joined

  591. stpeter has joined

  592. stpeter has left

  593. kikuchiyo has left

  594. Luciole has left

  595. Nils (10rokita) has left

  596. Nils (10rokita) has joined

  597. kikuchiyo has joined

  598. Nils (10rokita) has left

  599. kikuchiyo has left

  600. ij has left

  601. ij has joined

  602. sol has left

  603. Pingu from Woodquarter has left

  604. Nils (10rokita) has joined

  605. kikuchiyo has joined

  606. cuc has left

  607. sol has joined

  608. Youssef has left

  609. kikuchiyo has left

  610. sol has left

  611. sol has joined

  612. perflyst has joined

  613. kikuchiyo has joined

  614. kikuchiyo has left

  615. sol has left

  616. sol has joined

  617. felix has joined

  618. lorddavidiii has left

  619. ackerman1scott has left

  620. lorddavidiii has joined

  621. ackerman1scott has joined

  622. kikuchiyo has joined

  623. Youssef has joined

  624. sol has left

  625. sol has joined

  626. ibikk has left

  627. ibikk has joined

  628. kikuchiyo has left

  629. kikuchiyo has joined

  630. perflyst has left

  631. perflyst has joined

  632. kikuchiyo has left

  633. sol has left

  634. sol has joined

  635. perflyst has left

  636. perflyst has joined

  637. sonny has left

  638. sonny has joined

  639. holger has left

  640. perflyst has left

  641. sonny has left

  642. sonny has joined

  643. drops has left

  644. drops has joined

  645. jayteeuk has left

  646. ru_maniac has left

  647. ru_maniac has joined

  648. holger has joined

  649. sol has left

  650. holger has left

  651. sol has joined

  652. ibikk has left

  653. perflyst has joined

  654. holger has joined

  655. sol has left

  656. sol has joined

  657. kikuchiyo has joined

  658. SouL has left

  659. madmalkav has left

  660. lorddavidiii has left

  661. sol has left

  662. sol has joined

  663. perflyst has left

  664. perflyst has joined

  665. Licaon_Kter has left

  666. jayteeuk has joined

  667. holger has left

  668. ackerman1scott has left

  669. holger has joined

  670. sol has left

  671. sol has joined

  672. Neustradamus has joined

  673. Neustradamus has left

  674. SouL has joined

  675. ackerman1scott has joined

  676. jayteeuk has left

  677. jayteeuk has joined

  678. kikuchiyo has left

  679. jayteeuk has left

  680. jayteeuk has joined

  681. 11111 has joined

  682. sol has left

  683. sol has joined

  684. perflyst has left

  685. 11111 has left

  686. drops has left

  687. drops has joined

  688. rintinfinn has left

  689. rintinfinn has joined

  690. sol has left

  691. sol has joined

  692. Youssef has left

  693. Youssef has joined

  694. kikuchiyo has joined

  695. kikuchiyo has left

  696. sol has left

  697. sol has joined

  698. colochon has left

  699. colochon has joined

  700. Huxx has left

  701. colochon has left

  702. colochon has joined

  703. Roi has left

  704. sol has left

  705. sol has joined

  706. rintinfinn has left

  707. colochon has left