XMPP Service Operators - 2020-05-01


  1. Neustradamus has joined
  2. Neustradamus has left
  3. stpeter has joined
  4. stpeter has left
  5. Neustradamus has joined
  6. Neustradamus has left
  7. sol has left
  8. sol has joined
  9. Huxx has left
  10. lorddavidiii has left
  11. lorddavidiii has joined
  12. sol has left
  13. sol has joined
  14. sol has left
  15. sol has joined
  16. rintinfinn has left
  17. SouL has left
  18. sonny has left
  19. sonny has joined
  20. alien has left
  21. alien has joined
  22. tom has left
  23. tom has joined
  24. Youssef has joined
  25. Youssef has left
  26. ackerman1scott has left
  27. ackerman1scott has joined
  28. sol has left
  29. sol has joined
  30. Roi has left
  31. Roi has joined
  32. sol has left
  33. sol has joined
  34. sonny has left
  35. sonny has joined
  36. lorddavidiii has left
  37. sol has left
  38. sol has joined
  39. sonny has left
  40. sonny has joined
  41. sol has left
  42. sol has joined
  43. sol has left
  44. sol has joined
  45. sol has left
  46. sol has joined
  47. SouL has joined
  48. kusoneko has left
  49. kusoneko has joined
  50. sonny has left
  51. sonny has joined
  52. sonny has left
  53. sonny has joined
  54. pod has joined
  55. paul has left
  56. sol has left
  57. sol has joined
  58. dinosaurdynasty has left
  59. dinosaurdynasty has joined
  60. Pingu from Woodquarter has joined
  61. mimi89999 has left
  62. mimi89999 has joined
  63. sonny has left
  64. sonny has joined
  65. kikuchiyo has joined
  66. jayteeuk has left
  67. jayteeuk has joined
  68. sonny has left
  69. sonny has joined
  70. ibikk has joined
  71. jayteeuk has left
  72. jayteeuk has joined
  73. sol has left
  74. sol has joined
  75. sonny has left
  76. sonny has joined
  77. cuc has joined
  78. lorddavidiii has joined
  79. Pingu from Woodquarter has left
  80. Pingu from Woodquarter has joined
  81. sonny has left
  82. sonny has joined
  83. sol has left
  84. sol has joined
  85. Pingu from Woodquarter has left
  86. Pingu from Woodquarter has joined
  87. sol has left
  88. sol has joined
  89. sonny has left
  90. sonny has joined
  91. kikuchiyo has left
  92. kikuchiyo has joined
  93. ackerman1scott has left
  94. jayteeuk has left
  95. jayteeuk has joined
  96. kikuchiyo has left
  97. sol has left
  98. sol has joined
  99. kusoneko has left
  100. kusoneko has joined
  101. kusoneko has left
  102. kusoneko has joined
  103. jayteeuk has left
  104. jayteeuk has joined
  105. felix has left
  106. felix has joined
  107. dinosaurdynasty has left
  108. dinosaurdynasty has joined
  109. kikuchiyo has joined
  110. sonny has left
  111. sonny has joined
  112. sol has left
  113. sol has joined
  114. rintinfinn has joined
  115. sonny has left
  116. sonny has joined
  117. tsk has left
  118. tsk has joined
  119. rintinfinn has left
  120. rintinfinn has joined
  121. sonny has left
  122. sonny has joined
  123. sonny has left
  124. sonny has joined
  125. sol has left
  126. sol has joined
  127. sonny has left
  128. sonny has joined
  129. ackerman1scott has joined
  130. kikuchiyo has left
  131. kikuchiyo has joined
  132. sonny has left
  133. sonny has joined
  134. sonny has left
  135. sonny has joined
  136. Huxx has joined
  137. sol has left
  138. sol has joined
  139. sonny has left
  140. sonny has joined
  141. rintinfinn has left
  142. rintinfinn has joined
  143. sezuan has left
  144. sol has left
  145. sol has joined
  146. ackerman1scott has left
  147. andrey.utkin has joined
  148. Maranda has left
  149. Maranda has joined
  150. perflyst has joined
  151. sonny has left
  152. sonny has joined
  153. Marzanna has joined
  154. ackerman1scott has joined
  155. Pingu from Woodquarter has left
  156. sol has left
  157. sol has joined
  158. Pingu from Woodquarter has joined
  159. perflyst has left
  160. rintinfinn has left
  161. rintinfinn has joined
  162. perflyst has joined
  163. ackerman1scott has left
  164. rintinfinn has left
  165. rintinfinn has joined
  166. ackerman1scott has joined
  167. rintinfinn has left
  168. rintinfinn has joined
  169. Martin @ping trashserver.net
  170. Echo1 has left
  171. sol has left
  172. sol has joined
  173. Martin @ping diebesban.de
  174. rintinfinn has left
  175. rintinfinn has joined
  176. rintinfinn has left
  177. rintinfinn has joined
  178. rintinfinn has left
  179. rintinfinn has joined
  180. robertooo has left
  181. rintinfinn has left
  182. rintinfinn has joined
  183. robertooo has joined
  184. rintinfinn has left
  185. rintinfinn has joined
  186. madmalkav has joined
  187. rintinfinn has left
  188. rintinfinn has joined
  189. sol has left
  190. sol has joined
  191. rintinfinn has left
  192. sonny has left
  193. sonny has joined
  194. rintinfinn has joined
  195. rintinfinn has left
  196. rintinfinn has joined
  197. ackerman1scott has left
  198. rintinfinn has left
  199. rintinfinn has joined
  200. rintinfinn has left
  201. rintinfinn has joined
  202. rintinfinn has left
  203. rintinfinn has joined
  204. sonny has left
  205. sonny has joined
  206. Ellenor Malik A.
  207. sol has left
  208. sol has joined
  209. ackerman1scott has joined
  210. Youssef has joined
  211. sol has left
  212. sol has joined
  213. rintinfinn has left
  214. felix has left
  215. sol has left
  216. sol has joined
  217. Pingu from Woodquarter has left
  218. Pingu from Woodquarter has joined
  219. sonny has left
  220. Nils (10rokita) has left
  221. sonny has joined
  222. sonny has left
  223. felix has joined
  224. sonny has joined
  225. sonny has left
  226. sol has left
  227. sol has joined
  228. Youssef has left
  229. Youssef has joined
  230. Nils (10rokita) has joined
  231. schorsch has left
  232. schorsch has joined
  233. jonas’ has left
  234. jonas’ has joined
  235. sol has left
  236. sol has joined
  237. Nils (10rokita) has left
  238. drops has left
  239. drops has joined
  240. Pingu from Woodquarter has left
  241. sol has left
  242. sol has joined
  243. alien has left
  244. alien has joined
  245. holger has joined
  246. Pingu from Woodquarter has joined
  247. sol has left
  248. sol has joined
  249. drops has left
  250. drops has joined
  251. drops has left
  252. drops has joined
  253. sol has left
  254. sol has joined
  255. sol has left
  256. sol has joined
  257. ackerman1scott has left
  258. ackerman1scott has joined
  259. sol has left
  260. sol has joined
  261. jayteeuk has left
  262. jayteeuk has joined
  263. alien has left
  264. alien has joined
  265. Nils (10rokita) has joined
  266. 10rokita has joined
  267. sol has left
  268. sol has joined
  269. Pingu from Woodquarter has left
  270. sol has left
  271. sol has joined
  272. Pingu from Woodquarter has joined
  273. 10rokita has left
  274. jayteeuk has left
  275. jayteeuk has joined
  276. felix has left
  277. ajeremias has joined
  278. sol has left
  279. sol has joined
  280. perflyst has left
  281. paul has joined
  282. Nils (10rokita) has left
  283. jjrh has left
  284. jjrh has joined
  285. jjrh has left
  286. Nils (10rokita) has joined
  287. perflyst has joined
  288. jjrh has joined
  289. holger has left
  290. holger has joined
  291. jayteeuk has left
  292. jayteeuk has joined
  293. sol has left
  294. sol has joined
  295. Pingu from Woodquarter has left
  296. Pingu from Woodquarter has joined
  297. jayteeuk has left
  298. jayteeuk has joined
  299. jayteeuk has left
  300. jayteeuk has joined
  301. jayteeuk has left
  302. jayteeuk has joined
  303. madmalkav has left
  304. madmalkav has joined
  305. perflyst has left
  306. perflyst has joined
  307. sol has left
  308. sol has joined
  309. madmalkav has left
  310. Pingu from Woodquarter has left
  311. Pingu from Woodquarter has joined
  312. perflyst has left
  313. perflyst has joined
  314. sol has left
  315. sol has joined
  316. madmalkav has joined
  317. insanity has left
  318. Ellenor Malik What would cause Prosody to hog CPU?
  319. Martin For me it was mam hitting 10000 messages in one archive and using fine storage.
  320. Martin For me it was mam hitting 10000 messages in one archive and using internal file storage.
  321. Link Mauve For me, smacks going through many queued messages for a given user.
  322. Martin > What would cause Prosody to hog CPU? Something enlightening might be found in your logs.
  323. sol has left
  324. sol has joined
  325. ackerman1scott has left
  326. jayteeuk has left
  327. jayteeuk has joined
  328. ackerman1scott has joined
  329. cinco has left
  330. cinco has joined
  331. sol has left
  332. sol has joined
  333. rintinfinn has joined
  334. Ellenor Malik has left
  335. Ellenor Malik has joined
  336. jayteeuk has left
  337. jayteeuk has joined
  338. robertooo has left
  339. perflyst has left
  340. sol has left
  341. sol has joined
  342. rintinfinn has left
  343. rom1dep has left
  344. rom1dep has joined
  345. rintinfinn has joined
  346. jayteeuk has left
  347. jayteeuk has joined
  348. rintinfinn has left
  349. joerg has left
  350. jayteeuk has left
  351. jayteeuk has joined
  352. joerg has joined
  353. joerg has left
  354. joerg has joined
  355. ackerman1scott has left
  356. holger has left
  357. rintinfinn has joined
  358. joerg has left
  359. holger has joined
  360. joerg has joined
  361. sonny has joined
  362. sol has left
  363. sol has joined
  364. rintinfinn has left
  365. rintinfinn has joined
  366. ackerman1scott has joined
  367. sol has left
  368. sol has joined
  369. robertooo has joined
  370. rintinfinn has left
  371. Echo1 has joined
  372. nmhsm has joined
  373. holger has left
  374. Maranda Martin: define "hog"
  375. holger has joined
  376. edhelas has left
  377. Maranda has recently upped the archives cap to 23000.. Is still waiting to see the performance hit.
  378. ru_maniac has left
  379. rintinfinn has joined
  380. sol has left
  381. sol has joined
  382. insanity has joined
  383. edhelas has joined
  384. ru_maniac has joined
  385. Maranda @version myst.blue
  386. Echo1 Maranda: myst.blue is running Metronome version 3.13.5 on Linux
  387. ru_maniac has left
  388. ru_maniac has joined
  389. rintinfinn has left
  390. rintinfinn has joined
  391. 404.city has joined
  392. sol has left
  393. sol has joined
  394. nmhsm has left
  395. rintinfinn has left
  396. Martin Maranda: > Martin: define "hog" Why are you asking me?
  397. Maranda because you mentioned "flat files storage" in the same sentence
  398. Martin But the hig came from the citation so the citation is not the same sentence and you should ask Ellenor Malik
  399. Martin But the hog came from the citation so the citation is not the same sentence and you should ask Ellenor Malik
  400. Ellenor Malik GRR
  401. 404.city has left
  402. Maranda Martin, should I? Ellenor, didn't mention MAM, didn't mention flat files, didn't mention "after reaching ten thousands of messages in an archive" which is what I just raise the CAP from.... :)
  403. Maranda I'm more interested in numbers from that
  404. Martin But she brought the term "hog" into the ring, so if you ask definitions for "hog" you should ask her.
  405. Licaon_Kter has left
  406. Martin For me it was: prosody going up to 100% and being unusable (clients disconnected and couldn't log in again) pasting debug log into prosody muc I was asked if I have a huge archive. By counting my users archive it turned out it was exactly 10000, so the limit for archive messages in flat file storage. After stopping prosody, migrating to xmlarchive and restarting it was working/usable again.
  407. rintinfinn has joined
  408. Maranda is puzzles by *how actually big* was that _10000_
  409. Neustradamus has joined
  410. Neustradamus has left
  411. jayteeuk has left
  412. jayteeuk has joined
  413. madmalkav has left
  414. madmalkav has joined
  415. Maranda is puzzled by *how actually big* was that _10000_
  416. Martin Afair it was something between 10 and 20 MB
  417. jayteeuk has left
  418. jayteeuk has joined
  419. Neustradamus has joined
  420. Neustradamus has left
  421. rintinfinn has left
  422. rintinfinn has joined
  423. Martin du -sh /var/lib/prosody/mdosch%2ede/archive/ 21M /var/lib/prosody/mdosch%2ede/archive/ du -sh /var/lib/prosody/mdosch%2ede/archive/martin.list 12M /var/lib/prosody/mdosch%2ede/archive/martin.list
  424. Maranda -rw-r----- 1 metronome metronome 18M May 1 15:13 maranda.dat ---> I'll have to do some testing on cpu usage when Metronome loads/stores the archive into/from RAM
  425. sol has left
  426. sol has joined
  427. Martin Don't know why but it seems when I hit the 10000 cap prosody freaked out, took 100% CPU and was not usable anymore.
  428. Martin Usually it idles around having almost no CPU impact.
  429. perflyst has joined
  430. ackerman1scott has left
  431. Neustradamus has joined
  432. Neustradamus has left
  433. jayteeuk has left
  434. jayteeuk has joined
  435. ackerman1scott has joined
  436. jonas’ Martin, that sounds familiar
  437. jayteeuk has left
  438. jonas’ verily
  439. jonas’ cc @ Ge0rG ^
  440. jayteeuk has joined
  441. Neustradamus has joined
  442. Neustradamus has left
  443. ru_maniac has left
  444. insanity has left
  445. ru_maniac has joined
  446. Neustradamus has joined
  447. Neustradamus has left
  448. sol has left
  449. sol has joined
  450. insanity has joined
  451. Maranda well I think my current storage strategy with atomic writes will be fine until datastores stay within the underlying (os/)hardware IO performance range
  452. Maranda well I guess my current storage strategy with atomic writes will be fine until datastores stay within the underlying (os/)hardware IO performance range
  453. Maranda well I guess my current storage strategy with atomic read/writes will be fine until datastores stay within the underlying (os/)hardware IO performance range
  454. insanity has left
  455. insanity has joined
  456. Licaon_Kter has joined
  457. sol has left
  458. sol has joined
  459. perflyst has left
  460. sol has left
  461. sol has joined
  462. stpeter has joined
  463. stpeter has left
  464. jayteeuk has left
  465. jayteeuk has joined
  466. perflyst has joined
  467. sol has left
  468. sol has joined
  469. jayteeuk has left
  470. jayteeuk has joined
  471. jayteeuk has left
  472. jayteeuk has joined
  473. perflyst has left
  474. kusoneko has left
  475. kusoneko has joined
  476. kusoneko has left
  477. kusoneko has joined
  478. sol has left
  479. sol has joined
  480. kusoneko has left
  481. kusoneko has joined
  482. kusoneko has left
  483. kusoneko has joined
  484. sol has left
  485. ij has left
  486. perflyst has joined
  487. jayteeuk has left
  488. jayteeuk has joined
  489. ij has joined
  490. sol has joined
  491. Ge0rG Martin: that issue almost killed yax.im yesterday. Apparently internal storage is not fast at all.
  492. jayteeuk has left
  493. jayteeuk has joined
  494. Ge0rG Martin: there will be a solution to this soon, I'm sure.
  495. ij has left
  496. Maranda suspects it's not about internal storage
  497. Ge0rG Maranda: it is. deleting one line from internal storage requires fully rewriting the huuuuuge serialized file
  498. ackerman1scott has left
  499. ackerman1scott has joined
  500. kusoneko has left
  501. kusoneko has joined
  502. holger has left
  503. kusoneko has left
  504. kusoneko has joined
  505. holger has joined
  506. sol has left
  507. sol has joined
  508. sol has left
  509. lorddavidiii has left
  510. Martin Ge0rG: I was hoping that xmlstorage might help already. Maybe the structured data is easier to process.
  511. Maranda Ge0rG, that's not a problem here tbh, and me thinks it's more about that ".list" file there
  512. ij has joined
  513. perflyst has left
  514. sol has joined
  515. Maranda and that also you shouldn't keep to rewrite one huge serialized file to disk everytime just one line is popped
  516. jayteeuk has left
  517. jayteeuk has joined
  518. insanity has left
  519. sol has left
  520. sol has joined
  521. insanity has joined
  522. lorddavidiii has joined
  523. MattJ Ge0rG [18:49]: > Martin: there will be a solution to this soon, I'm sure. There is no real plan to fix it, it's been known that this does not perform well since before the release, which is why we tell people not to have large archives with internal storage
  524. MattJ It's possible that in a future release we will merge xmlarchive or a derivative
  525. ackerman1scott has left
  526. MattJ And maybe we can tweak e.g. removing more than one item at a time
  527. MattJ But rewriting how the archive store works on the stable branch is not on the cards, and would be a large project
  528. sol has left
  529. sol has joined
  530. sakhmatd has left
  531. sakhmatd has joined
  532. kusoneko has left
  533. kusoneko has joined
  534. kusoneko has left
  535. ackerman1scott has joined
  536. Ge0rG MattJ: does this affect the stable branch? I've only encountered it after going to trunk
  537. kusoneko has joined
  538. sonny has left
  539. sonny has joined
  540. Ge0rG and IIRC the 10k limit is the default, and it already makes prosody almost break down ;)
  541. sonny has left
  542. sonny has joined
  543. MattJ I thought it was in 0.11.x but not certain
  544. colochon has joined
  545. kusoneko has left
  546. kusoneko has joined
  547. Ge0rG MattJ: I'm sure I'd have run into it before then.
  548. MattJ And the default is not to persist MAM at all actually :)
  549. kusoneko has left
  550. kusoneko has joined
  551. MattJ (I don't believe in shipping software that logs peoples' messages by default)
  552. kusoneko has left
  553. kusoneko has joined
  554. kusoneko has left
  555. kusoneko has joined
  556. Ge0rG I don't believe in services that don't do everything they can to deliver messages
  557. MattJ mod_offline
  558. tom has left
  559. jayteeuk has left
  560. jayteeuk has joined
  561. sol has left
  562. sol has joined
  563. insanity has left
  564. insanity has joined
  565. joerg has left
  566. joerg has joined
  567. lorddavidiii has left
  568. ij has left
  569. ij has joined
  570. lorddavidiii has joined
  571. jayteeuk has left
  572. jayteeuk has joined
  573. sol has left
  574. sol has joined
  575. Licaon_Kter has left
  576. Luciole has joined
  577. colochon has left
  578. colochon has joined
  579. insanity has left
  580. insanity has joined
  581. kikuchiyo has left
  582. Licaon_Kter has joined
  583. robertooo has left
  584. insanity has left
  585. colochon has left
  586. insanity has joined
  587. colochon has joined
  588. kikuchiyo has joined
  589. sol has left
  590. sol has joined
  591. stpeter has joined
  592. stpeter has left
  593. kikuchiyo has left
  594. Luciole has left
  595. Nils (10rokita) has left
  596. Nils (10rokita) has joined
  597. kikuchiyo has joined
  598. Nils (10rokita) has left
  599. kikuchiyo has left
  600. ij has left
  601. ij has joined
  602. sol has left
  603. Pingu from Woodquarter has left
  604. Nils (10rokita) has joined
  605. kikuchiyo has joined
  606. cuc has left
  607. sol has joined
  608. Youssef has left
  609. kikuchiyo has left
  610. sol has left
  611. sol has joined
  612. perflyst has joined
  613. kikuchiyo has joined
  614. kikuchiyo has left
  615. sol has left
  616. sol has joined
  617. felix has joined
  618. lorddavidiii has left
  619. ackerman1scott has left
  620. lorddavidiii has joined
  621. ackerman1scott has joined
  622. kikuchiyo has joined
  623. Youssef has joined
  624. sol has left
  625. sol has joined
  626. ibikk has left
  627. ibikk has joined
  628. kikuchiyo has left
  629. kikuchiyo has joined
  630. perflyst has left
  631. perflyst has joined
  632. kikuchiyo has left
  633. sol has left
  634. sol has joined
  635. perflyst has left
  636. perflyst has joined
  637. sonny has left
  638. sonny has joined
  639. holger has left
  640. perflyst has left
  641. sonny has left
  642. sonny has joined
  643. drops has left
  644. drops has joined
  645. jayteeuk has left
  646. ru_maniac has left
  647. ru_maniac has joined
  648. holger has joined
  649. sol has left
  650. holger has left
  651. sol has joined
  652. ibikk has left
  653. perflyst has joined
  654. holger has joined
  655. sol has left
  656. sol has joined
  657. kikuchiyo has joined
  658. SouL has left
  659. madmalkav has left
  660. lorddavidiii has left
  661. sol has left
  662. sol has joined
  663. perflyst has left
  664. perflyst has joined
  665. Licaon_Kter has left
  666. jayteeuk has joined
  667. holger has left
  668. ackerman1scott has left
  669. holger has joined
  670. sol has left
  671. sol has joined
  672. Neustradamus has joined
  673. Neustradamus has left
  674. SouL has joined
  675. ackerman1scott has joined
  676. jayteeuk has left
  677. jayteeuk has joined
  678. kikuchiyo has left
  679. jayteeuk has left
  680. jayteeuk has joined
  681. 11111 has joined
  682. sol has left
  683. sol has joined
  684. perflyst has left
  685. 11111 has left
  686. drops has left
  687. drops has joined
  688. rintinfinn has left
  689. rintinfinn has joined
  690. sol has left
  691. sol has joined
  692. Youssef has left
  693. Youssef has joined
  694. kikuchiyo has joined
  695. kikuchiyo has left
  696. sol has left
  697. sol has joined
  698. colochon has left
  699. colochon has joined
  700. Huxx has left
  701. colochon has left
  702. colochon has joined
  703. Roi has left
  704. sol has left
  705. sol has joined
  706. rintinfinn has left
  707. colochon has left