XSF Discussion - 2018-11-06


  1. mrdoctorwho has joined

  2. j.r has left

  3. blabla has left

  4. rion has left

  5. blabla has joined

  6. j.r has joined

  7. Zash has joined

  8. Zash has left

  9. Zash has joined

  10. matlag has left

  11. l has left

  12. matlag has left

  13. efrit has left

  14. peter has left

  15. UsL has left

  16. UsL has joined

  17. j.r has joined

  18. j.r has joined

  19. lskdjf has left

  20. ralphm has left

  21. ralphm has joined

  22. genofire has left

  23. genofire has left

  24. genofire has joined

  25. lskdjf has joined

  26. peter has joined

  27. j.r has joined

  28. j.r has joined

  29. jjrh has left

  30. jjrh has left

  31. jjrh has left

  32. jjrh has joined

  33. l has left

  34. jjrh has left

  35. jjrh has joined

  36. alacer has joined

  37. SamWhited has left

  38. l has joined

  39. alacer has left

  40. alacer has joined

  41. matlag has left

  42. j.r has joined

  43. j.r has joined

  44. alacer has left

  45. alacer has joined

  46. MattJ has left

  47. peter has left

  48. alacer has left

  49. jjrh has left

  50. jjrh has joined

  51. jjrh has left

  52. alacer has joined

  53. alacer has left

  54. alacer has joined

  55. jjrh has joined

  56. jjrh has left

  57. jjrh has joined

  58. jjrh has left

  59. SamWhited has left

  60. jjrh has joined

  61. j.r has joined

  62. j.r has joined

  63. jjrh has left

  64. jjrh has joined

  65. Andrew Nenakhov has left

  66. Andrew Nenakhov has joined

  67. matlag has left

  68. jjrh has left

  69. j.r has joined

  70. moparisthebest has left

  71. moparisthebest has joined

  72. j.r has joined

  73. krauq has joined

  74. krauq has left

  75. krauq has joined

  76. labdsf has left

  77. matlag has left

  78. alacer has left

  79. alacer has joined

  80. j.r has joined

  81. lorddavidiii has left

  82. lorddavidiii has joined

  83. Kev has joined

  84. Steve Kille has joined

  85. j.r has joined

  86. jjrh has left

  87. dwd has joined

  88. dwd has left

  89. alacer has left

  90. krauq has left

  91. krauq has left

  92. lnj has joined

  93. krauq has left

  94. rion has left

  95. krauq has left

  96. krauq has joined

  97. guusdk has left

  98. Guus has left

  99. Guus has joined

  100. guusdk has joined

  101. Str4tocaster has joined

  102. dwd has joined

  103. Nekit has joined

  104. goffi has joined

  105. alacer has joined

  106. mimi89999 has left

  107. dwd has left

  108. j.r has left

  109. j.r has joined

  110. Str4tocaster has left

  111. Str4tocaster has joined

  112. labdsf has joined

  113. Yagiza has joined

  114. Str4tocaster has left

  115. Str4tocaster has joined

  116. waqas has left

  117. lorddavidiii has left

  118. andy has joined

  119. lorddavidiii has joined

  120. Str4tocaster has left

  121. Str4tocaster has joined

  122. thorsten has left

  123. Str4tocaster has left

  124. Str4tocaster has joined

  125. waqas has joined

  126. Str4tocaster has left

  127. Str4tocaster has joined

  128. thorsten has left

  129. rago has joined

  130. Steve Kille has joined

  131. Str4tocaster has left

  132. Str4tocaster has joined

  133. Str4tocaster has left

  134. Str4tocaster has joined

  135. Str4tocaster has left

  136. Str4tocaster has joined

  137. krauq has joined

  138. krauq has joined

  139. waqas has left

  140. Str4tocaster has left

  141. Str4tocaster has joined

  142. lskdjf has joined

  143. Str4tocaster has left

  144. l has joined

  145. Str4tocaster has joined

  146. Zash has left

  147. Zash has left

  148. Zash has joined

  149. krauq has joined

  150. Str4tocaster has left

  151. Str4tocaster has joined

  152. krauq has joined

  153. Ge0rG

    lovetox: I'm not sure if there are situations where Gajim is using an ID generated by another entity, like e.g. Last message correction (where it's not a security problem, but to illustrate the attack channel)

  154. lskdjf has joined

  155. Lance has joined

  156. Lance has left

  157. Str4tocaster has left

  158. moparisthebest has joined

  159. moparisthebest has joined

  160. Str4tocaster has joined

  161. sonny has joined

  162. lskdjf has joined

  163. Zash has left

  164. sonny has left

  165. Zash has joined

  166. l has left

  167. Str4tocaster has left

  168. Str4tocaster has joined

  169. Str4tocaster has left

  170. Str4tocaster has joined

  171. Str4tocaster has left

  172. Str4tocaster has joined

  173. alacer has left

  174. alacer has joined

  175. lnj has left

  176. genofire has left

  177. dedekin has joined

  178. Ge0rG

    What's the official way to talk to iteam?

  179. Yagiza has left

  180. Ge0rG

    I'd like to get https://www.mediawiki.org/wiki/Extension:MobileFrontend installed/enabled on our wiki

  181. jonas’

    join iteam muc

  182. Alex has joined

  183. Alex has left

  184. j.r has joined

  185. Steve Kille has left

  186. ta has joined

  187. Steve Kille has joined

  188. guusdk has left

  189. sonny has joined

  190. genofire has left

  191. Valerian has joined

  192. ralphm has left

  193. dwd has joined

  194. Kev has joined

  195. ta has left

  196. j.r has left

  197. j.r has joined

  198. j.r has left

  199. j.r has joined

  200. Steve Kille has left

  201. Steve Kille has joined

  202. genofire has left

  203. genofire has joined

  204. j.r has left

  205. j.r has joined

  206. dedekin has left

  207. dedekin has joined

  208. alacer has left

  209. alacer has joined

  210. lnj has joined

  211. dedekin has left

  212. j.r has left

  213. j.r has joined

  214. dedekin has joined

  215. j.r has left

  216. j.r has joined

  217. alacer has left

  218. Seve

    I still don't receive emails from the members list. Can somebody double check, please?

  219. Seve

    I'm not sure if my new email address was added.

  220. j.r has left

  221. j.r has joined

  222. moparisthebest has joined

  223. alacer has joined

  224. moparisthebest has joined

  225. j.r has left

  226. j.r has joined

  227. APach has left

  228. dedekin has left

  229. j.r has left

  230. j.r has joined

  231. dedekin has joined

  232. Str4tocaster has left

  233. Str4tocaster has joined

  234. Str4tocaster has left

  235. Str4tocaster has joined

  236. APach has joined

  237. ta has left

  238. Nekit has left

  239. Nekit has joined

  240. Str4tocaster has left

  241. Str4tocaster has joined

  242. Zash has left

  243. Zash has joined

  244. guusdk has left

  245. guusdk has joined

  246. labdsf has left

  247. labdsf has joined

  248. blabla has left

  249. ta has left

  250. lnj has left

  251. genofire has left

  252. genofire has joined

  253. genofire has left

  254. genofire has joined

  255. Steve Kille has left

  256. Yagiza has joined

  257. Alex

    Seve: which email address? i can check

  258. Seve

    Alex, seve@delape.net, I used to have my JID the same as my email address before in case you see that still there

  259. alacer has left

  260. Alex

    Seve: its there, but sais `nomail, reason B`

  261. Alex

    looks like you have disabled it once. I can revert he checkbox

  262. Alex

    you also maybe alble to congigure it here yourself here: https://mail.jabber.org/mailman/admin/members/ or send commands to the list. Just let me know what you prefer

  263. Seve

    That's weird... Yes please do, Alex. Very appreciated!

  264. alacer has joined

  265. Alex

    resetted, I think you should be good now

  266. Seve

    Alex: thank you!

  267. Str4tocaster has left

  268. Str4tocaster has joined

  269. lorddavidiii has left

  270. alacer has left

  271. l has left

  272. l has joined

  273. Zash has left

  274. alacer has joined

  275. l has joined

  276. daniel has left

  277. daniel has joined

  278. Zash has left

  279. Seve has left

  280. vaulor has joined

  281. 404.city has joined

  282. Yagiza has left

  283. Yagiza has joined

  284. lorddavidiii has left

  285. alacer has left

  286. Seve

    Alex, I have no password to edit it myself. I tried to see if I could ask for a new password and it says `Your subscription request has been received, and will soon be acted upon.` I wonder if that has some relation to it?

  287. alacer has joined

  288. Valerian has left

  289. Valerian has joined

  290. Str4tocaster has left

  291. Nekit has left

  292. Nekit has joined

  293. Str4tocaster has joined

  294. vanitasvitae has left

  295. alacer has left

  296. alacer has joined

  297. Valerian has left

  298. Valerian has joined

  299. daniel has left

  300. daniel has joined

  301. ThibG has joined

  302. ThibG has joined

  303. daniel has left

  304. daniel has joined

  305. Valerian has left

  306. matlag has left

  307. lnj has joined

  308. tux has joined

  309. rago has left

  310. alacer has left

  311. daniel has left

  312. daniel has joined

  313. alacer has joined

  314. daniel has left

  315. daniel has joined

  316. rago has joined

  317. daniel has left

  318. daniel has joined

  319. Andrew Nenakhov has left

  320. rago has left

  321. Alex has left

  322. blabla has left

  323. Andrew Nenakhov has joined

  324. rago has left

  325. lnj has left

  326. Andrew Nenakhov has joined

  327. blabla has left

  328. alacer has left

  329. alacer has joined

  330. l has left

  331. lskdjf has joined

  332. lnj has joined

  333. Alex has joined

  334. Str4tocaster has left

  335. dedekin has left

  336. Alex

    Seve: lets see if you get new messages to the list. If not then please contact me again and we try to figure it out. To me it looks all good now.

  337. j.r has left

  338. Seve

    Sure, Alex. Thank you very much for your time, I will let you know :)

  339. blabla has left

  340. moparisthebest has joined

  341. j.r has joined

  342. moparisthebest has left

  343. Zash has left

  344. blabla has left

  345. dedekin has joined

  346. matlag has left

  347. Zash has left

  348. ThibG has joined

  349. Valerian has joined

  350. matlag has left

  351. alacer has left

  352. matlag has left

  353. matlag has left

  354. dedekin has left

  355. ThibG has joined

  356. alacer has joined

  357. Zash has left

  358. Zash has left

  359. vanitasvitae has left

  360. dedekin has joined

  361. Valerian has left

  362. Valerian has joined

  363. Alex has left

  364. dedekin has left

  365. matlag has left

  366. dwd has left

  367. l has joined

  368. matlag has left

  369. labdsf has left

  370. labdsf has joined

  371. Yagiza has left

  372. krauq has left

  373. krauq has joined

  374. Alex has joined

  375. andy has left

  376. lorddavidiii has left

  377. APach has left

  378. APach has joined

  379. jjrh has left

  380. jjrh has left

  381. efrit has joined

  382. j.r has left

  383. ta has left

  384. mrdoctorwho has joined

  385. j.r has joined

  386. Valerian has left

  387. Valerian has joined

  388. jjrh has left

  389. jjrh has left

  390. jjrh has left

  391. thorsten has left

  392. mrdoctorwho has joined

  393. jjrh has left

  394. waqas has joined

  395. thorsten has left

  396. mrdoctorwho has left

  397. rago has left

  398. lumi has joined

  399. thorsten has left

  400. thorsten has left

  401. Nekit has left

  402. Nekit has joined

  403. rago has left

  404. ta has left

  405. tux has left

  406. Tobias has joined

  407. Tobias has joined

  408. ralphm has left

  409. guusdk has left

  410. guusdk has joined

  411. Guus has left

  412. Guus has joined

  413. Ge0rG has left

  414. Valerian has left

  415. Valerian has joined

  416. !xsf_martin has left

  417. peter has joined

  418. dwd has left

  419. dwd has joined

  420. guusdk has left

  421. daniel has left

  422. Nekit has left

  423. Nekit has joined

  424. Valerian has left

  425. Valerian has joined

  426. rago has left

  427. rago has joined

  428. rago has left

  429. Ge0rG has left

  430. Ge0rG has left

  431. Guus has left

  432. Ge0rG has left

  433. Guus has joined

  434. guusdk has left

  435. guusdk has joined

  436. Ge0rG has joined

  437. lskdjf has left

  438. alacer has left

  439. efrit has left

  440. mightyBroccoli has left

  441. mightyBroccoli has joined

  442. lovetox has joined

  443. sonny has left

  444. Valerian has left

  445. Valerian has joined

  446. labdsf has left

  447. mimi89999 has joined

  448. ta has left

  449. ta has joined

  450. l has joined

  451. lskdjf has joined

  452. krauq has left

  453. krauq has joined

  454. tux has left

  455. Yagiza has joined

  456. guusdk has left

  457. vanitasvitae has left

  458. Valerian has left

  459. Valerian has joined

  460. Seve has joined

  461. l has left

  462. lskdjf has joined

  463. vaulor has joined

  464. sonny has joined

  465. Steve Kille has left

  466. Steve Kille has left

  467. daniel has joined

  468. Valerian has left

  469. Steve Kille has joined

  470. Valerian has joined

  471. jonas’

    in-band bytestreams. is there a way to close an IBB with an error?

  472. jonas’

    in-band bytestreams. is there a way to close an IBB with an error while the peer is *not* sending to you?

  473. marc has joined

  474. SamWhited has left

  475. Andrew Nenakhov has left

  476. Andrew Nenakhov has joined

  477. Ge0rG

    jonas’: remember the last incoming message id?

  478. flow

    jonas’, can't you always send a session-terminate (if we are talking Jingle based IBB)?

  479. ralphm has left

  480. Alex has left

  481. Nekit has left

  482. Nekit has joined

  483. Yagiza has left

  484. Steve Kille has left

  485. Kev has left

  486. Yagiza has joined

  487. vanitasvitae has joined

  488. dwd has left

  489. edhelas has left

  490. edhelas has joined

  491. Valerian has left

  492. Valerian has joined

  493. lorddavidiii has left

  494. Yagiza has left

  495. jjrh has left

  496. guusdk has left

  497. lskdjf has left

  498. l has left

  499. marc has left

  500. labdsf has joined

  501. marc has joined

  502. jjrh has left

  503. jonas’

    flow, no, plain IBB

  504. ThibG has joined

  505. guusdk has left

  506. guusdk has joined

  507. labdsf has left

  508. labdsf has joined

  509. guusdk has joined

  510. jjrh has left

  511. Alex has joined

  512. sonny has joined

  513. sonny has joined

  514. sonny has joined

  515. Valerian has left

  516. jjrh has left

  517. labdsf has left

  518. labdsf has joined

  519. jjrh has left

  520. guusdk has left

  521. guusdk has joined

  522. Steve Kille has left

  523. sonny has left

  524. genofire has left

  525. lumi has joined

  526. !xsf_martin has joined

  527. !xsf_martin has joined

  528. matlag has left

  529. ta has joined

  530. ta has joined

  531. Valerian has joined

  532. lskdjf has joined

  533. Valerian has left

  534. Valerian has joined

  535. jjrh has left

  536. labdsf has left

  537. Link Mauve

    jonas’, AFAIK you can’t even do that if they’re sending to you, since they could use the <message/> transport.

  538. Valerian has left

  539. Valerian has joined

  540. labdsf has joined

  541. jjrh has left

  542. labdsf has left

  543. labdsf has joined

  544. lorddavidiii has left

  545. dwd has joined

  546. !xsf_martin has left

  547. Valerian has left

  548. Valerian has joined

  549. MattJ

    <message type='error' id='...'>

  550. Lance has joined

  551. dwd has left

  552. jjrh has left

  553. lnj has left

  554. jjrh has left

  555. Valerian has left

  556. Valerian has joined

  557. lovetox has left

  558. Ge0rG

    Speaking of which, can we get error messages stored in offline storage, because Carbons and multi client?

  559. MattJ

    Yes

  560. ta has left

  561. lovetox has joined

  562. ta has joined

  563. ta has left

  564. ta has joined

  565. !xsf_martin has joined

  566. rion has left

  567. j.r has joined

  568. j.r has joined

  569. jjrh has left

  570. valo has left

  571. valo has joined

  572. Kev has joined

  573. ta has joined

  574. ta has joined

  575. Ge0rG

    MattJ: In prosody 0.10?

  576. MattJ

    "LOL"

  577. Holger

    Ge0rG: You mean in MAM?

  578. dwd has joined

  579. jjrh has left

  580. Ge0rG

    Holger: MAM is not needed if you have per device offline storage queues

  581. Kev has left

  582. Holger

    Hah.

  583. Holger

    Why proper solutions if we can have ugly hacks!

  584. Ge0rG

    And my evil secret plan is to defer implementing MAM in yaxim (and annoying MattJ with message loss) until he gives up and finishes client tracking

  585. lnj has left

  586. Ge0rG

    Holger: MAM is an ugly hack.

  587. lnj has left

  588. Holger

    How do you handle outgoing messages with offline storage? Wait whether the client enables carbons and then push them out?

  589. Holger

    How do you do paging?

  590. jonas’

    different use-cases

  591. Holger

    Hm?

  592. jonas’

    although

  593. jonas’

    ignore me, I want to see how this plays out

  594. dwd has left

  595. Ge0rG

    Holger: how do you handle sync of messages between MAM and offline? Just drop all offline messages before sending presence?

  596. lorddavidiii has left

  597. Holger

    That's what Conversations does, the alternative is de-dup, obviously.

  598. Holger

    Whatever that has to do with my question.

  599. Alex has left

  600. Tobias has joined

  601. Tobias has joined

  602. Holger

    I think MAM becomes problematic to implement if you *don't* want full-sync. If you do, like you'd get with per-device offline storage, it's trivial. I don't get why you wouldn't just want to implement this.

  603. SamWhited has left

  604. Ge0rG

    Holger: MAM is *also* a dirty hack. Is it better now?

  605. Holger

    Ok, so that's go for a worse hack instead.

  606. Ge0rG

    Holger: because it's complicated with my current code base

  607. ta has joined

  608. Ge0rG

    Holger: MAM is the worse hack.

  609. Holger

    Why?

  610. Ge0rG

    Actually sending out Carbons from offline is a I nice idea

  611. lnj has joined

  612. Holger

    Haha.

  613. Ge0rG

    Holger: it's full of race conditions!

  614. Holger

    For example?

  615. Ge0rG

    You don't need paging if you do full sync.

  616. Ge0rG

    Holger: between querying MAM and dropping offline history

  617. Zash

    It's dirty hacks all the way down to the silicon

  618. ta has left

  619. ta has joined

  620. Ge0rG

    Holger: also between completing your MAM sync and receiving first live messages

  621. jonas’

    Ge0rG, isn’t bind2 there to solve all those races?

  622. Ge0rG

    jonas’: yes

  623. jonas’

    purge offline, enable carbons, give you the id of the last stanza in MAM

  624. marc has left

  625. marc has joined

  626. Ge0rG

    jonas’: also magically enable / resume SM

  627. Holger

    Until we have that, de-dup should be trivial using stanza-IDs.

  628. Ge0rG

    Holger: you mean unique ids?

  629. Ge0rG

    Will MAM inject ids into offline storage?

  630. Holger

    mam:2 guarantees that, yes.

  631. daniel

    Fwiw Conversations would handle the dedup just fine. But I don't like the extra traffic

  632. jjrh has left

  633. Ge0rG

    But if you just drop offline history, you'll get message loss if your MAM is "contacts only"

  634. Holger

    Yes, I don't know why we offer that option.

  635. daniel

    Yep

  636. Ge0rG

    And dropping before MAM sync is lossy

  637. daniel

    Or disabled

  638. Holger

    You get even more message loss if MAM is disabled.

  639. Holger

    Right.

  640. daniel

    I'd like the mam preference to be announced in disco

  641. daniel

    That could help circumvent that problem

  642. Ge0rG

    daniel: you drop offline history if MAM is disabled???

  643. Holger

    I'd like to see the "contacts only" option ditched.

  644. daniel

    Ge0rG: yes

  645. Ge0rG

    daniel: ...

  646. Holger

    > You don't need paging if you do full sync. You might need it for traffic throtting. Otherwise the server will flood you with messages and if you're not fast enough with acknowledging it, you'll exceed 0198 queue size limits and the server will kill your connection.

  647. Holger

    *throttling

  648. !xsf_martin has left

  649. Holger

    I open yaxim once in a few weeks, it would become unusable if I implemented that thing.

  650. jonas’

    Holger, FWIW, Conversations *is* unusable when you open it only once in a few weeks.

  651. Zash

    and Gajim

  652. jonas’

    or even once a week

  653. jonas’

    I plan for like one hour or maybe two for it to sync when I haven’t used it for a week

  654. Holger

    jonas': Hm no I didn't run into that.

  655. jonas’

    maybe it’s just me or my device?

  656. jonas’

    ever since that full text search index each message takes like 0.5s to process

  657. jonas’

    you can do the math with a few public MAM’d MUCs.

  658. Link Mauve

    Zash, Gajim fixed that (for public MUCs only) in their latest release from today.

  659. jonas’

    it’s terrible in any case.

  660. Zash

    Link Mauve: By some random coincidence, I can't start Gajim anymore

  661. Ge0rG

    XMPP is terrible.

  662. Ge0rG &

  663. jonas’

    fg

  664. Link Mauve

    That may be related, you should report this bug at gajim@conference.gajim.org.

  665. Link Mauve

    Maybe they’ll do a 1.1.1 fixing it.

  666. vanitasvitae has left

  667. jjrh has left

  668. Zash

    I think it's some Python search path thing

  669. lnj has left

  670. sonny has joined

  671. SamWhited has left

  672. SamWhited has joined

  673. mimi89999 has left

  674. !xsf_martin has joined

  675. goffi has left

  676. Lance has left

  677. alacer has joined

  678. lorddavidiii has left

  679. alacer has left

  680. Alex has joined

  681. jjrh has left

  682. lumi has joined

  683. sonny has left

  684. Valerian has left

  685. MattJ has joined

  686. lovetox

    yes the user can set a threshold now for public mucs how much gets synced

  687. lovetox

    and the default is 1 day, if you join 20 mucs, you still can expect around 30 seconds until everything is joined and everything is synced

  688. Valerian has joined

  689. lovetox

    problem is, you absolutly have to sync everything at start with MUC

  690. lovetox

    otherwise you just plain accept not delivering messages to your user that he might want to read

  691. lovetox

    im not seeing how we can optimize that in any way

  692. marc has left

  693. daniel

    The problem is that 1 day is pretty random. On some days you just have one message in the last 24h on some days you have 1000

  694. daniel

    I'm considering - for public mucs - to just ditch the entire history instead

  695. daniel

    Then normal backlog scrolling works as intended

  696. daniel

    Instead of trying to fill gaps or what ever

  697. daniel

    But nothing is ideal. There is no good solution

  698. lovetox

    so not storing messages in public muc to db, and making it completly load on demand

  699. daniel

    Yes

  700. lovetox

    yes the only way back scrolling can work i think

  701. daniel

    *in public with mam

  702. lovetox

    but this is probably acceptable for a mobile client, but if i do this in Gajim people will scream

  703. daniel

    Why?

  704. Kev has joined

  705. ta has joined

  706. lovetox

    they have there 200 MB "i have logs back to 1990" dbs

  707. lovetox

    and want to search them

  708. Kev has left

  709. lovetox

    but yeah indeed nothing speaks against making it default not storing, and if a user wishes he can store for some mucs

  710. lovetox

    but then no backscrolling there

  711. lovetox

    maybe thats a good solution for both worlds

  712. rion has left

  713. daniel

    Yeah I haven't thought this all the way through yet. It's just that idea I'm having

  714. daniel

    Especially for mobile and like short outages you might still want to have a local history

  715. daniel

    But certainly not catch up with a week or so

  716. jjrh has left

  717. lovetox

    and the whole backscrolling thing can get pretty easy if client devs could depend on the server using sequential mam ids

  718. lovetox

    then its trivial to fill a whole

  719. lovetox

    i still think whatever reason that was why this was dismissed in the XEP, was not worth it at all

  720. jjrh has left

  721. lovetox

    but mam exists a long time now, maybe we should ask around, and if there is no implementation that depends on mam ids not beeing sequential (because they technically can not do it) then just ditch this, there is no need for something that limiting us, that nobody plans to use anyway

  722. sonny has joined

  723. sonny has joined

  724. sonny has joined

  725. sonny has joined

  726. sonny has joined

  727. sonny has joined

  728. daniel

    It's complicated on a database level

  729. daniel

    Either pretty expensive or impossible in clusters

  730. lovetox

    hm doubt it seriously :D

  731. lovetox

    its just that it would be probably considerable more work to make it so

  732. lovetox

    but then again, where are these clusters, are we writing xeps for that one provider in X years that sets up a cluster

  733. lovetox

    or for the 1000s who do not

  734. lovetox

    but i guess we had this discussion, the conclusion was, add a disco feature

  735. lovetox

    "sequential-ids"

  736. sonny has joined

  737. lovetox

    if i see this i offer back scrolling, if not i dont

  738. jjrh has left

  739. Holger

    Well there certainly are clustered setups in practice and I wouldn't want to tell people "sorry XMPP doesn't support this".

  740. lovetox

    is ejabberd not a bad example, as you offer sequential ids :D

  741. Holger

    lovetox: I forgot, you actually need sequential IDs or are increasing IDs (i.e. ejabberd's timestamps) good enough to solve the problem?

  742. jjrh has left

  743. daniel

    If the use case is to know the gaps you need sequential and not just increasing

  744. lovetox

    maybe im getting my definitions wrong, but sequential and increasing are not counterpars

  745. Holger

    lovetox: Yeah these days we just ignore the clustering issue because it's somewhat academic in practice. With microsecond timestamps you won't end up with non-unique IDs, or if you ever manage to, then wow you have a message loss/duplicate. This is XMPP after all.

  746. daniel

    And that's complicated even on an single db

  747. Valerian has left

  748. daniel

    I mean can you tell me the sql command for insert with id=max(I'd) +1?

  749. Holger

    Don't SQL engines have this built-in? But that'll obviously be expensive on a cluster, yes.

  750. daniel

    I think the bad ones do

  751. Holger

    lovetox: Sequential is 1,2,3,4, incrementing is 1,4,394,1039.

  752. lovetox

    then incrementing is enough

  753. daniel

    But from my understanding you try to avoid this in db design

  754. daniel

    lovetox: how do you find gaps then?

  755. lovetox

    yeah this fixes just the message ordering problem

  756. lovetox

    you still have to track gaps somehow

  757. jjrh has left

  758. Zash

    I started writing a thing based on linked lists once

  759. Zash

    So what problem can I solve by tagging each message with the id of the previous message?

  760. Holger

    You solve the same problems and run into the same problems as with sequential IDs, no?

  761. Zash

    Given a bag of unordered messages, you can shuffle them into sequences, no?

  762. Holger

    I guess what you do these days is DAGs, i.e. you can add a merge message that has multiple parents once the cluster notices the conflict. Leave it to clients to cope with it.

  763. lovetox

    the problems we are facing are two fold, 1. have a way to determine where you have a gap in your local storage and fill it efficiently by requesting from mam 2. If you start your client, display all messages in the correct order

  764. ta has left

  765. ta has joined

  766. lovetox

    2. can be solved by just increasing IDs, or just microtimestamp

  767. flow

    > 1 day is pretty random

  768. flow

    make mam allow query the last N stanzas?

  769. Zash

    flow: ... <before/N>

  770. lovetox

    we can do this already

  771. Zash

    wait no, before="" max=N

  772. Zash

    high resolution timestamps has problems too

  773. Zash

    like like being unavailable from C stdlib

  774. lovetox

    maybe the server can solve 1. for us, what if we have a query i give 2 mam-ids, can the server tell me if there are messages in between?

  775. Zash

    and also having no guarantee of being strictly increasing

  776. flow

    lovetox, then why 1 day and not, say, 100 messages?

  777. lovetox

    Zash its enough if its most unlikely to produce duplicates

  778. lovetox

    i can live with a duplicated timestamp 1 out of a million messages

  779. flow

    Holger, are you talking about Matrix? :)

  780. flow

    but serious, this sounds appealing

  781. Holger

    Zash: The C standard doesn't return the current time at all, no? So you can't implement MAM with it anyway.

  782. valo has joined

  783. lovetox

    flow it can be done, but its not the same thing, last 100 can only be done by backpaging

  784. lovetox

    you get the last 10

  785. lovetox

    then 10 before that etc

  786. Holger

    flow: Yeah Matrix and I think various other distributed DBs are doing it that way.

  787. lovetox

    while from a date, gives you all messages orderd from old to new

  788. Holger

    And all those DCVSes ...

  789. lovetox

    and this is pretty important, because i need the messages sent ordered to me

  790. flow

    lovetox, ahh so MAM is missing a "give me the last N messages starting with the oldest" query?

  791. lovetox

    i dont know if it needs it .. but yes i guess would be nice

  792. flow

    (I think we possibly have been there before)

  793. lovetox

    i more and more think, maybe we dont need this at all, internet gets faster and faster, if i join a muc i show a loading screen and count the messages with a nice UI

  794. Zash

    flow: I don't think MAM is missing query related things like that

  795. lovetox

    so the client needs 30 seconds, if you dont start it a week, so what?

  796. lovetox

    show me an application that does it much better

  797. lskdjf has left

  798. lskdjf has left

  799. jjrh has left

  800. flow

    Zash, possibly, possibly not

  801. flow

    lovetox, na, that's not what drives me, but I can see why one could be happy with that

  802. Zash

    Fetch the last chunk of messages and show them. Then do the sync thing quietly in the background.

  803. ta has joined

  804. flow

    Zash, fetch using <before/> and max=N?

  805. Zash

    flow: right

  806. lovetox

    i could pull with before say 20 messages, but dont store them to db then sync the db in the background

  807. flow

    Dunno, I think you run in all kinds of oddities with current MAM

  808. lovetox

    but there is no "background"

  809. lovetox

    there is only one connection to the server

  810. lovetox

    and it will be slow to the user if i fetch stuff contstantly

  811. lovetox

    it would be nice to know what the user wants to do and priorities that

  812. lovetox

    but he could switch to any muc instantly and then i need the full stuff there

  813. flow

    lovetox, do small chunks of background sync and pause them once such "high priority" things happen?

  814. lovetox

    and all that seems rather complex, instead of just a loading screen

  815. lovetox

    :D

  816. flow

    or just do small chunks and see if it turns out to be a real issue

  817. flow

    before we are talking about potential solutions for non-issues ;)

  818. lumi has left

  819. matlag has left

  820. lovetox

    joining 20 mucs is also slow if you dont fetch MAM at all

  821. lskdjf has left

  822. Zash

    It is

  823. lskdjf has left

  824. flow

    hmm, dunno, my poezio joins the ~15 MUCs reasonably fast I'd say, but YMMV

  825. 404.city has left

  826. lovetox

    yeah can you give me a time on that?

  827. lovetox

    just so i have something to compare Gajim with

  828. lskdjf has left

  829. flow

    lovetox, a few seconds I'd say, but it is really hard to tell as the UI elements are already seen even if the MUC is still in the process of joining

  830. ta has joined

  831. lovetox

    hm other topic, nickname conflicts when joining a muc how do clients handle these

  832. ta has joined

  833. lovetox

    gajim does a popup and the user has to choose another nick

  834. lovetox

    but im thinking i dont want to ask the user anymore and just join with a added "_" or something like that

  835. lskdjf has left

  836. lovetox has left

  837. lovetox has joined

  838. lskdjf has left

  839. ta has joined

  840. lovetox has left

  841. !xsf_martin has left

  842. lskdjf has left

  843. jjrh has left

  844. vanitasvitae has joined

  845. Zash has left

  846. vanitasvitae has left

  847. lskdjf has joined

  848. lskdjf has left

  849. jjrh has left

  850. jjrh has left

  851. jjrh has left

  852. lskdjf has joined

  853. ta has left

  854. l has left

  855. lorddavidiii has left

  856. lorddavidiii has left

  857. lorddavidiii has left

  858. lorddavidiii has left

  859. lorddavidiii has left

  860. SamWhited has left

  861. Alex has left

  862. jjrh has left

  863. mrdoctorwho has joined