XSF Discussion - 2018-11-06


  1. mrdoctorwho has joined
  2. j.r has left
  3. blabla has left
  4. rion has left
  5. blabla has joined
  6. j.r has joined
  7. Zash has joined
  8. Zash has left
  9. Zash has joined
  10. matlag has left
  11. l has left
  12. matlag has left
  13. efrit has left
  14. peter has left
  15. UsL has left
  16. UsL has joined
  17. j.r has joined
  18. j.r has joined
  19. lskdjf has left
  20. ralphm has left
  21. ralphm has joined
  22. genofire has left
  23. genofire has left
  24. genofire has joined
  25. lskdjf has joined
  26. peter has joined
  27. j.r has joined
  28. j.r has joined
  29. jjrh has left
  30. jjrh has left
  31. jjrh has left
  32. jjrh has joined
  33. l has left
  34. jjrh has left
  35. jjrh has joined
  36. alacer has joined
  37. SamWhited has left
  38. l has joined
  39. alacer has left
  40. alacer has joined
  41. matlag has left
  42. j.r has joined
  43. j.r has joined
  44. alacer has left
  45. alacer has joined
  46. MattJ has left
  47. peter has left
  48. alacer has left
  49. jjrh has left
  50. jjrh has joined
  51. jjrh has left
  52. alacer has joined
  53. alacer has left
  54. alacer has joined
  55. jjrh has joined
  56. jjrh has left
  57. jjrh has joined
  58. jjrh has left
  59. SamWhited has left
  60. jjrh has joined
  61. j.r has joined
  62. j.r has joined
  63. jjrh has left
  64. jjrh has joined
  65. Andrew Nenakhov has left
  66. Andrew Nenakhov has joined
  67. matlag has left
  68. jjrh has left
  69. j.r has joined
  70. moparisthebest has left
  71. moparisthebest has joined
  72. j.r has joined
  73. krauq has joined
  74. krauq has left
  75. krauq has joined
  76. labdsf has left
  77. matlag has left
  78. alacer has left
  79. alacer has joined
  80. j.r has joined
  81. lorddavidiii has left
  82. lorddavidiii has joined
  83. Kev has joined
  84. Steve Kille has joined
  85. j.r has joined
  86. jjrh has left
  87. dwd has joined
  88. dwd has left
  89. alacer has left
  90. krauq has left
  91. krauq has left
  92. lnj has joined
  93. krauq has left
  94. rion has left
  95. krauq has left
  96. krauq has joined
  97. guusdk has left
  98. Guus has left
  99. Guus has joined
  100. guusdk has joined
  101. Str4tocaster has joined
  102. dwd has joined
  103. Nekit has joined
  104. goffi has joined
  105. alacer has joined
  106. mimi89999 has left
  107. dwd has left
  108. j.r has left
  109. j.r has joined
  110. Str4tocaster has left
  111. Str4tocaster has joined
  112. labdsf has joined
  113. Yagiza has joined
  114. Str4tocaster has left
  115. Str4tocaster has joined
  116. waqas has left
  117. lorddavidiii has left
  118. andy has joined
  119. lorddavidiii has joined
  120. Str4tocaster has left
  121. Str4tocaster has joined
  122. thorsten has left
  123. Str4tocaster has left
  124. Str4tocaster has joined
  125. waqas has joined
  126. Str4tocaster has left
  127. Str4tocaster has joined
  128. thorsten has left
  129. rago has joined
  130. Steve Kille has joined
  131. Str4tocaster has left
  132. Str4tocaster has joined
  133. Str4tocaster has left
  134. Str4tocaster has joined
  135. Str4tocaster has left
  136. Str4tocaster has joined
  137. krauq has joined
  138. krauq has joined
  139. waqas has left
  140. Str4tocaster has left
  141. Str4tocaster has joined
  142. lskdjf has joined
  143. Str4tocaster has left
  144. l has joined
  145. Str4tocaster has joined
  146. Zash has left
  147. Zash has left
  148. Zash has joined
  149. krauq has joined
  150. Str4tocaster has left
  151. Str4tocaster has joined
  152. krauq has joined
  153. Ge0rG lovetox: I'm not sure if there are situations where Gajim is using an ID generated by another entity, like e.g. Last message correction (where it's not a security problem, but to illustrate the attack channel)
  154. lskdjf has joined
  155. Lance has joined
  156. Lance has left
  157. Str4tocaster has left
  158. moparisthebest has joined
  159. moparisthebest has joined
  160. Str4tocaster has joined
  161. sonny has joined
  162. lskdjf has joined
  163. Zash has left
  164. sonny has left
  165. Zash has joined
  166. l has left
  167. Str4tocaster has left
  168. Str4tocaster has joined
  169. Str4tocaster has left
  170. Str4tocaster has joined
  171. Str4tocaster has left
  172. Str4tocaster has joined
  173. alacer has left
  174. alacer has joined
  175. lnj has left
  176. genofire has left
  177. dedekin has joined
  178. Ge0rG What's the official way to talk to iteam?
  179. Yagiza has left
  180. Ge0rG I'd like to get https://www.mediawiki.org/wiki/Extension:MobileFrontend installed/enabled on our wiki
  181. jonas’ join iteam muc
  182. Alex has joined
  183. Alex has left
  184. j.r has joined
  185. Steve Kille has left
  186. ta has joined
  187. Steve Kille has joined
  188. guusdk has left
  189. sonny has joined
  190. genofire has left
  191. Valerian has joined
  192. ralphm has left
  193. dwd has joined
  194. Kev has joined
  195. ta has left
  196. j.r has left
  197. j.r has joined
  198. j.r has left
  199. j.r has joined
  200. Steve Kille has left
  201. Steve Kille has joined
  202. genofire has left
  203. genofire has joined
  204. j.r has left
  205. j.r has joined
  206. dedekin has left
  207. dedekin has joined
  208. alacer has left
  209. alacer has joined
  210. lnj has joined
  211. dedekin has left
  212. j.r has left
  213. j.r has joined
  214. dedekin has joined
  215. j.r has left
  216. j.r has joined
  217. alacer has left
  218. Seve I still don't receive emails from the members list. Can somebody double check, please?
  219. Seve I'm not sure if my new email address was added.
  220. j.r has left
  221. j.r has joined
  222. moparisthebest has joined
  223. alacer has joined
  224. moparisthebest has joined
  225. j.r has left
  226. j.r has joined
  227. APach has left
  228. dedekin has left
  229. j.r has left
  230. j.r has joined
  231. dedekin has joined
  232. Str4tocaster has left
  233. Str4tocaster has joined
  234. Str4tocaster has left
  235. Str4tocaster has joined
  236. APach has joined
  237. ta has left
  238. Nekit has left
  239. Nekit has joined
  240. Str4tocaster has left
  241. Str4tocaster has joined
  242. Zash has left
  243. Zash has joined
  244. guusdk has left
  245. guusdk has joined
  246. labdsf has left
  247. labdsf has joined
  248. blabla has left
  249. ta has left
  250. lnj has left
  251. genofire has left
  252. genofire has joined
  253. genofire has left
  254. genofire has joined
  255. Steve Kille has left
  256. Yagiza has joined
  257. Alex Seve: which email address? i can check
  258. Seve Alex, seve@delape.net, I used to have my JID the same as my email address before in case you see that still there
  259. alacer has left
  260. Alex Seve: its there, but sais `nomail, reason B`
  261. Alex looks like you have disabled it once. I can revert he checkbox
  262. Alex you also maybe alble to congigure it here yourself here: https://mail.jabber.org/mailman/admin/members/ or send commands to the list. Just let me know what you prefer
  263. Seve That's weird... Yes please do, Alex. Very appreciated!
  264. alacer has joined
  265. Alex resetted, I think you should be good now
  266. Seve Alex: thank you!
  267. Str4tocaster has left
  268. Str4tocaster has joined
  269. lorddavidiii has left
  270. alacer has left
  271. l has left
  272. l has joined
  273. Zash has left
  274. alacer has joined
  275. l has joined
  276. daniel has left
  277. daniel has joined
  278. Zash has left
  279. Seve has left
  280. vaulor has joined
  281. 404.city has joined
  282. Yagiza has left
  283. Yagiza has joined
  284. lorddavidiii has left
  285. alacer has left
  286. Seve Alex, I have no password to edit it myself. I tried to see if I could ask for a new password and it says `Your subscription request has been received, and will soon be acted upon.` I wonder if that has some relation to it?
  287. alacer has joined
  288. Valerian has left
  289. Valerian has joined
  290. Str4tocaster has left
  291. Nekit has left
  292. Nekit has joined
  293. Str4tocaster has joined
  294. vanitasvitae has left
  295. alacer has left
  296. alacer has joined
  297. Valerian has left
  298. Valerian has joined
  299. daniel has left
  300. daniel has joined
  301. ThibG has joined
  302. ThibG has joined
  303. daniel has left
  304. daniel has joined
  305. Valerian has left
  306. matlag has left
  307. lnj has joined
  308. tux has joined
  309. rago has left
  310. alacer has left
  311. daniel has left
  312. daniel has joined
  313. alacer has joined
  314. daniel has left
  315. daniel has joined
  316. rago has joined
  317. daniel has left
  318. daniel has joined
  319. Andrew Nenakhov has left
  320. rago has left
  321. Alex has left
  322. blabla has left
  323. Andrew Nenakhov has joined
  324. rago has left
  325. lnj has left
  326. Andrew Nenakhov has joined
  327. blabla has left
  328. alacer has left
  329. alacer has joined
  330. l has left
  331. lskdjf has joined
  332. lnj has joined
  333. Alex has joined
  334. Str4tocaster has left
  335. dedekin has left
  336. Alex Seve: lets see if you get new messages to the list. If not then please contact me again and we try to figure it out. To me it looks all good now.
  337. j.r has left
  338. Seve Sure, Alex. Thank you very much for your time, I will let you know :)
  339. blabla has left
  340. moparisthebest has joined
  341. j.r has joined
  342. moparisthebest has left
  343. Zash has left
  344. blabla has left
  345. dedekin has joined
  346. matlag has left
  347. Zash has left
  348. ThibG has joined
  349. Valerian has joined
  350. matlag has left
  351. alacer has left
  352. matlag has left
  353. matlag has left
  354. dedekin has left
  355. ThibG has joined
  356. alacer has joined
  357. Zash has left
  358. Zash has left
  359. vanitasvitae has left
  360. dedekin has joined
  361. Valerian has left
  362. Valerian has joined
  363. Alex has left
  364. dedekin has left
  365. matlag has left
  366. dwd has left
  367. l has joined
  368. matlag has left
  369. labdsf has left
  370. labdsf has joined
  371. Yagiza has left
  372. krauq has left
  373. krauq has joined
  374. Alex has joined
  375. andy has left
  376. lorddavidiii has left
  377. APach has left
  378. APach has joined
  379. jjrh has left
  380. jjrh has left
  381. efrit has joined
  382. j.r has left
  383. ta has left
  384. mrdoctorwho has joined
  385. j.r has joined
  386. Valerian has left
  387. Valerian has joined
  388. jjrh has left
  389. jjrh has left
  390. jjrh has left
  391. thorsten has left
  392. mrdoctorwho has joined
  393. jjrh has left
  394. waqas has joined
  395. thorsten has left
  396. mrdoctorwho has left
  397. rago has left
  398. lumi has joined
  399. thorsten has left
  400. thorsten has left
  401. Nekit has left
  402. Nekit has joined
  403. rago has left
  404. ta has left
  405. tux has left
  406. Tobias has joined
  407. Tobias has joined
  408. ralphm has left
  409. guusdk has left
  410. guusdk has joined
  411. Guus has left
  412. Guus has joined
  413. Ge0rG has left
  414. Valerian has left
  415. Valerian has joined
  416. !xsf_martin has left
  417. peter has joined
  418. dwd has left
  419. dwd has joined
  420. guusdk has left
  421. daniel has left
  422. Nekit has left
  423. Nekit has joined
  424. Valerian has left
  425. Valerian has joined
  426. rago has left
  427. rago has joined
  428. rago has left
  429. Ge0rG has left
  430. Ge0rG has left
  431. Guus has left
  432. Ge0rG has left
  433. Guus has joined
  434. guusdk has left
  435. guusdk has joined
  436. Ge0rG has joined
  437. lskdjf has left
  438. alacer has left
  439. efrit has left
  440. mightyBroccoli has left
  441. mightyBroccoli has joined
  442. lovetox has joined
  443. sonny has left
  444. Valerian has left
  445. Valerian has joined
  446. labdsf has left
  447. mimi89999 has joined
  448. ta has left
  449. ta has joined
  450. l has joined
  451. lskdjf has joined
  452. krauq has left
  453. krauq has joined
  454. tux has left
  455. Yagiza has joined
  456. guusdk has left
  457. vanitasvitae has left
  458. Valerian has left
  459. Valerian has joined
  460. Seve has joined
  461. l has left
  462. lskdjf has joined
  463. vaulor has joined
  464. sonny has joined
  465. Steve Kille has left
  466. Steve Kille has left
  467. daniel has joined
  468. Valerian has left
  469. Steve Kille has joined
  470. Valerian has joined
  471. jonas’ in-band bytestreams. is there a way to close an IBB with an error?
  472. jonas’ in-band bytestreams. is there a way to close an IBB with an error while the peer is *not* sending to you?
  473. marc has joined
  474. SamWhited has left
  475. Andrew Nenakhov has left
  476. Andrew Nenakhov has joined
  477. Ge0rG jonas’: remember the last incoming message id?
  478. flow jonas’, can't you always send a session-terminate (if we are talking Jingle based IBB)?
  479. ralphm has left
  480. Alex has left
  481. Nekit has left
  482. Nekit has joined
  483. Yagiza has left
  484. Steve Kille has left
  485. Kev has left
  486. Yagiza has joined
  487. vanitasvitae has joined
  488. dwd has left
  489. edhelas has left
  490. edhelas has joined
  491. Valerian has left
  492. Valerian has joined
  493. lorddavidiii has left
  494. Yagiza has left
  495. jjrh has left
  496. guusdk has left
  497. lskdjf has left
  498. l has left
  499. marc has left
  500. labdsf has joined
  501. marc has joined
  502. jjrh has left
  503. jonas’ flow, no, plain IBB
  504. ThibG has joined
  505. guusdk has left
  506. guusdk has joined
  507. labdsf has left
  508. labdsf has joined
  509. guusdk has joined
  510. jjrh has left
  511. Alex has joined
  512. sonny has joined
  513. sonny has joined
  514. sonny has joined
  515. Valerian has left
  516. jjrh has left
  517. labdsf has left
  518. labdsf has joined
  519. jjrh has left
  520. guusdk has left
  521. guusdk has joined
  522. Steve Kille has left
  523. sonny has left
  524. genofire has left
  525. lumi has joined
  526. !xsf_martin has joined
  527. !xsf_martin has joined
  528. matlag has left
  529. ta has joined
  530. ta has joined
  531. Valerian has joined
  532. lskdjf has joined
  533. Valerian has left
  534. Valerian has joined
  535. jjrh has left
  536. labdsf has left
  537. Link Mauve jonas’, AFAIK you can’t even do that if they’re sending to you, since they could use the <message/> transport.
  538. Valerian has left
  539. Valerian has joined
  540. labdsf has joined
  541. jjrh has left
  542. labdsf has left
  543. labdsf has joined
  544. lorddavidiii has left
  545. dwd has joined
  546. !xsf_martin has left
  547. Valerian has left
  548. Valerian has joined
  549. MattJ <message type='error' id='...'>
  550. Lance has joined
  551. dwd has left
  552. jjrh has left
  553. lnj has left
  554. jjrh has left
  555. Valerian has left
  556. Valerian has joined
  557. lovetox has left
  558. Ge0rG Speaking of which, can we get error messages stored in offline storage, because Carbons and multi client?
  559. MattJ Yes
  560. ta has left
  561. lovetox has joined
  562. ta has joined
  563. ta has left
  564. ta has joined
  565. !xsf_martin has joined
  566. rion has left
  567. j.r has joined
  568. j.r has joined
  569. jjrh has left
  570. valo has left
  571. valo has joined
  572. Kev has joined
  573. ta has joined
  574. ta has joined
  575. Ge0rG MattJ: In prosody 0.10?
  576. MattJ "LOL"
  577. Holger Ge0rG: You mean in MAM?
  578. dwd has joined
  579. jjrh has left
  580. Ge0rG Holger: MAM is not needed if you have per device offline storage queues
  581. Kev has left
  582. Holger Hah.
  583. Holger Why proper solutions if we can have ugly hacks!
  584. Ge0rG And my evil secret plan is to defer implementing MAM in yaxim (and annoying MattJ with message loss) until he gives up and finishes client tracking
  585. lnj has left
  586. Ge0rG Holger: MAM is an ugly hack.
  587. lnj has left
  588. Holger How do you handle outgoing messages with offline storage? Wait whether the client enables carbons and then push them out?
  589. Holger How do you do paging?
  590. jonas’ different use-cases
  591. Holger Hm?
  592. jonas’ although
  593. jonas’ ignore me, I want to see how this plays out
  594. dwd has left
  595. Ge0rG Holger: how do you handle sync of messages between MAM and offline? Just drop all offline messages before sending presence?
  596. lorddavidiii has left
  597. Holger That's what Conversations does, the alternative is de-dup, obviously.
  598. Holger Whatever that has to do with my question.
  599. Alex has left
  600. Tobias has joined
  601. Tobias has joined
  602. Holger I think MAM becomes problematic to implement if you *don't* want full-sync. If you do, like you'd get with per-device offline storage, it's trivial. I don't get why you wouldn't just want to implement this.
  603. SamWhited has left
  604. Ge0rG Holger: MAM is *also* a dirty hack. Is it better now?
  605. Holger Ok, so that's go for a worse hack instead.
  606. Ge0rG Holger: because it's complicated with my current code base
  607. ta has joined
  608. Ge0rG Holger: MAM is the worse hack.
  609. Holger Why?
  610. Ge0rG Actually sending out Carbons from offline is a I nice idea
  611. lnj has joined
  612. Holger Haha.
  613. Ge0rG Holger: it's full of race conditions!
  614. Holger For example?
  615. Ge0rG You don't need paging if you do full sync.
  616. Ge0rG Holger: between querying MAM and dropping offline history
  617. Zash It's dirty hacks all the way down to the silicon
  618. ta has left
  619. ta has joined
  620. Ge0rG Holger: also between completing your MAM sync and receiving first live messages
  621. jonas’ Ge0rG, isn’t bind2 there to solve all those races?
  622. Ge0rG jonas’: yes
  623. jonas’ purge offline, enable carbons, give you the id of the last stanza in MAM
  624. marc has left
  625. marc has joined
  626. Ge0rG jonas’: also magically enable / resume SM
  627. Holger Until we have that, de-dup should be trivial using stanza-IDs.
  628. Ge0rG Holger: you mean unique ids?
  629. Ge0rG Will MAM inject ids into offline storage?
  630. Holger mam:2 guarantees that, yes.
  631. daniel Fwiw Conversations would handle the dedup just fine. But I don't like the extra traffic
  632. jjrh has left
  633. Ge0rG But if you just drop offline history, you'll get message loss if your MAM is "contacts only"
  634. Holger Yes, I don't know why we offer that option.
  635. daniel Yep
  636. Ge0rG And dropping before MAM sync is lossy
  637. daniel Or disabled
  638. Holger You get even more message loss if MAM is disabled.
  639. Holger Right.
  640. daniel I'd like the mam preference to be announced in disco
  641. daniel That could help circumvent that problem
  642. Ge0rG daniel: you drop offline history if MAM is disabled???
  643. Holger I'd like to see the "contacts only" option ditched.
  644. daniel Ge0rG: yes
  645. Ge0rG daniel: ...
  646. Holger > You don't need paging if you do full sync. You might need it for traffic throtting. Otherwise the server will flood you with messages and if you're not fast enough with acknowledging it, you'll exceed 0198 queue size limits and the server will kill your connection.
  647. Holger *throttling
  648. !xsf_martin has left
  649. Holger I open yaxim once in a few weeks, it would become unusable if I implemented that thing.
  650. jonas’ Holger, FWIW, Conversations *is* unusable when you open it only once in a few weeks.
  651. Zash and Gajim
  652. jonas’ or even once a week
  653. jonas’ I plan for like one hour or maybe two for it to sync when I haven’t used it for a week
  654. Holger jonas': Hm no I didn't run into that.
  655. jonas’ maybe it’s just me or my device?
  656. jonas’ ever since that full text search index each message takes like 0.5s to process
  657. jonas’ you can do the math with a few public MAM’d MUCs.
  658. Link Mauve Zash, Gajim fixed that (for public MUCs only) in their latest release from today.
  659. jonas’ it’s terrible in any case.
  660. Zash Link Mauve: By some random coincidence, I can't start Gajim anymore
  661. Ge0rG XMPP is terrible.
  662. Ge0rG &
  663. jonas’ fg
  664. Link Mauve That may be related, you should report this bug at gajim@conference.gajim.org.
  665. Link Mauve Maybe they’ll do a 1.1.1 fixing it.
  666. vanitasvitae has left
  667. jjrh has left
  668. Zash I think it's some Python search path thing
  669. lnj has left
  670. sonny has joined
  671. SamWhited has left
  672. SamWhited has joined
  673. mimi89999 has left
  674. !xsf_martin has joined
  675. goffi has left
  676. Lance has left
  677. alacer has joined
  678. lorddavidiii has left
  679. alacer has left
  680. Alex has joined
  681. jjrh has left
  682. lumi has joined
  683. sonny has left
  684. Valerian has left
  685. MattJ has joined
  686. lovetox yes the user can set a threshold now for public mucs how much gets synced
  687. lovetox and the default is 1 day, if you join 20 mucs, you still can expect around 30 seconds until everything is joined and everything is synced
  688. Valerian has joined
  689. lovetox problem is, you absolutly have to sync everything at start with MUC
  690. lovetox otherwise you just plain accept not delivering messages to your user that he might want to read
  691. lovetox im not seeing how we can optimize that in any way
  692. marc has left
  693. daniel The problem is that 1 day is pretty random. On some days you just have one message in the last 24h on some days you have 1000
  694. daniel I'm considering - for public mucs - to just ditch the entire history instead
  695. daniel Then normal backlog scrolling works as intended
  696. daniel Instead of trying to fill gaps or what ever
  697. daniel But nothing is ideal. There is no good solution
  698. lovetox so not storing messages in public muc to db, and making it completly load on demand
  699. daniel Yes
  700. lovetox yes the only way back scrolling can work i think
  701. daniel *in public with mam
  702. lovetox but this is probably acceptable for a mobile client, but if i do this in Gajim people will scream
  703. daniel Why?
  704. Kev has joined
  705. ta has joined
  706. lovetox they have there 200 MB "i have logs back to 1990" dbs
  707. lovetox and want to search them
  708. Kev has left
  709. lovetox but yeah indeed nothing speaks against making it default not storing, and if a user wishes he can store for some mucs
  710. lovetox but then no backscrolling there
  711. lovetox maybe thats a good solution for both worlds
  712. rion has left
  713. daniel Yeah I haven't thought this all the way through yet. It's just that idea I'm having
  714. daniel Especially for mobile and like short outages you might still want to have a local history
  715. daniel But certainly not catch up with a week or so
  716. jjrh has left
  717. lovetox and the whole backscrolling thing can get pretty easy if client devs could depend on the server using sequential mam ids
  718. lovetox then its trivial to fill a whole
  719. lovetox i still think whatever reason that was why this was dismissed in the XEP, was not worth it at all
  720. jjrh has left
  721. lovetox but mam exists a long time now, maybe we should ask around, and if there is no implementation that depends on mam ids not beeing sequential (because they technically can not do it) then just ditch this, there is no need for something that limiting us, that nobody plans to use anyway
  722. sonny has joined
  723. sonny has joined
  724. sonny has joined
  725. sonny has joined
  726. sonny has joined
  727. sonny has joined
  728. daniel It's complicated on a database level
  729. daniel Either pretty expensive or impossible in clusters
  730. lovetox hm doubt it seriously :D
  731. lovetox its just that it would be probably considerable more work to make it so
  732. lovetox but then again, where are these clusters, are we writing xeps for that one provider in X years that sets up a cluster
  733. lovetox or for the 1000s who do not
  734. lovetox but i guess we had this discussion, the conclusion was, add a disco feature
  735. lovetox "sequential-ids"
  736. sonny has joined
  737. lovetox if i see this i offer back scrolling, if not i dont
  738. jjrh has left
  739. Holger Well there certainly are clustered setups in practice and I wouldn't want to tell people "sorry XMPP doesn't support this".
  740. lovetox is ejabberd not a bad example, as you offer sequential ids :D
  741. Holger lovetox: I forgot, you actually need sequential IDs or are increasing IDs (i.e. ejabberd's timestamps) good enough to solve the problem?
  742. jjrh has left
  743. daniel If the use case is to know the gaps you need sequential and not just increasing
  744. lovetox maybe im getting my definitions wrong, but sequential and increasing are not counterpars
  745. Holger lovetox: Yeah these days we just ignore the clustering issue because it's somewhat academic in practice. With microsecond timestamps you won't end up with non-unique IDs, or if you ever manage to, then wow you have a message loss/duplicate. This is XMPP after all.
  746. daniel And that's complicated even on an single db
  747. Valerian has left
  748. daniel I mean can you tell me the sql command for insert with id=max(I'd) +1?
  749. Holger Don't SQL engines have this built-in? But that'll obviously be expensive on a cluster, yes.
  750. daniel I think the bad ones do
  751. Holger lovetox: Sequential is 1,2,3,4, incrementing is 1,4,394,1039.
  752. lovetox then incrementing is enough
  753. daniel But from my understanding you try to avoid this in db design
  754. daniel lovetox: how do you find gaps then?
  755. lovetox yeah this fixes just the message ordering problem
  756. lovetox you still have to track gaps somehow
  757. jjrh has left
  758. Zash I started writing a thing based on linked lists once
  759. Zash So what problem can I solve by tagging each message with the id of the previous message?
  760. Holger You solve the same problems and run into the same problems as with sequential IDs, no?
  761. Zash Given a bag of unordered messages, you can shuffle them into sequences, no?
  762. Holger I guess what you do these days is DAGs, i.e. you can add a merge message that has multiple parents once the cluster notices the conflict. Leave it to clients to cope with it.
  763. lovetox the problems we are facing are two fold, 1. have a way to determine where you have a gap in your local storage and fill it efficiently by requesting from mam 2. If you start your client, display all messages in the correct order
  764. ta has left
  765. ta has joined
  766. lovetox 2. can be solved by just increasing IDs, or just microtimestamp
  767. flow > 1 day is pretty random
  768. flow make mam allow query the last N stanzas?
  769. Zash flow: ... <before/N>
  770. lovetox we can do this already
  771. Zash wait no, before="" max=N
  772. Zash high resolution timestamps has problems too
  773. Zash like like being unavailable from C stdlib
  774. lovetox maybe the server can solve 1. for us, what if we have a query i give 2 mam-ids, can the server tell me if there are messages in between?
  775. Zash and also having no guarantee of being strictly increasing
  776. flow lovetox, then why 1 day and not, say, 100 messages?
  777. lovetox Zash its enough if its most unlikely to produce duplicates
  778. lovetox i can live with a duplicated timestamp 1 out of a million messages
  779. flow Holger, are you talking about Matrix? :)
  780. flow but serious, this sounds appealing
  781. Holger Zash: The C standard doesn't return the current time at all, no? So you can't implement MAM with it anyway.
  782. valo has joined
  783. lovetox flow it can be done, but its not the same thing, last 100 can only be done by backpaging
  784. lovetox you get the last 10
  785. lovetox then 10 before that etc
  786. Holger flow: Yeah Matrix and I think various other distributed DBs are doing it that way.
  787. lovetox while from a date, gives you all messages orderd from old to new
  788. Holger And all those DCVSes ...
  789. lovetox and this is pretty important, because i need the messages sent ordered to me
  790. flow lovetox, ahh so MAM is missing a "give me the last N messages starting with the oldest" query?
  791. lovetox i dont know if it needs it .. but yes i guess would be nice
  792. flow (I think we possibly have been there before)
  793. lovetox i more and more think, maybe we dont need this at all, internet gets faster and faster, if i join a muc i show a loading screen and count the messages with a nice UI
  794. Zash flow: I don't think MAM is missing query related things like that
  795. lovetox so the client needs 30 seconds, if you dont start it a week, so what?
  796. lovetox show me an application that does it much better
  797. lskdjf has left
  798. lskdjf has left
  799. jjrh has left
  800. flow Zash, possibly, possibly not
  801. flow lovetox, na, that's not what drives me, but I can see why one could be happy with that
  802. Zash Fetch the last chunk of messages and show them. Then do the sync thing quietly in the background.
  803. ta has joined
  804. flow Zash, fetch using <before/> and max=N?
  805. Zash flow: right
  806. lovetox i could pull with before say 20 messages, but dont store them to db then sync the db in the background
  807. flow Dunno, I think you run in all kinds of oddities with current MAM
  808. lovetox but there is no "background"
  809. lovetox there is only one connection to the server
  810. lovetox and it will be slow to the user if i fetch stuff contstantly
  811. lovetox it would be nice to know what the user wants to do and priorities that
  812. lovetox but he could switch to any muc instantly and then i need the full stuff there
  813. flow lovetox, do small chunks of background sync and pause them once such "high priority" things happen?
  814. lovetox and all that seems rather complex, instead of just a loading screen
  815. lovetox :D
  816. flow or just do small chunks and see if it turns out to be a real issue
  817. flow before we are talking about potential solutions for non-issues ;)
  818. lumi has left
  819. matlag has left
  820. lovetox joining 20 mucs is also slow if you dont fetch MAM at all
  821. lskdjf has left
  822. Zash It is
  823. lskdjf has left
  824. flow hmm, dunno, my poezio joins the ~15 MUCs reasonably fast I'd say, but YMMV
  825. 404.city has left
  826. lovetox yeah can you give me a time on that?
  827. lovetox just so i have something to compare Gajim with
  828. lskdjf has left
  829. flow lovetox, a few seconds I'd say, but it is really hard to tell as the UI elements are already seen even if the MUC is still in the process of joining
  830. ta has joined
  831. lovetox hm other topic, nickname conflicts when joining a muc how do clients handle these
  832. ta has joined
  833. lovetox gajim does a popup and the user has to choose another nick
  834. lovetox but im thinking i dont want to ask the user anymore and just join with a added "_" or something like that
  835. lskdjf has left
  836. lovetox has left
  837. lovetox has joined
  838. lskdjf has left
  839. ta has joined
  840. lovetox has left
  841. !xsf_martin has left
  842. lskdjf has left
  843. jjrh has left
  844. vanitasvitae has joined
  845. Zash has left
  846. vanitasvitae has left
  847. lskdjf has joined
  848. lskdjf has left
  849. jjrh has left
  850. jjrh has left
  851. jjrh has left
  852. lskdjf has joined
  853. ta has left
  854. l has left
  855. lorddavidiii has left
  856. lorddavidiii has left
  857. lorddavidiii has left
  858. lorddavidiii has left
  859. lorddavidiii has left
  860. SamWhited has left
  861. Alex has left
  862. jjrh has left
  863. mrdoctorwho has joined