flowjonasw, after re-reading xep390 I wonder if the ASCII separators are valid in the separated strings itself. I know it likely qualifies as nit, but if they are valid then couldn't one could generate indistinguishable feature sets?
Dave Cridlandhas left
danielhas left
Dave Cridlandhas left
Dave Cridlandhas left
danielflow: they are forbidden in xml if that answers the question
moparisthebesthas joined
Dave Cridlandhas left
flowdaniel, probably does, thanks
flowalthough https://www.w3.org/TR/xml11/#NT-Char only discourages those
la|r|mahas joined
Dave Cridlandhas left
moparisthebesthas joined
danielOK let me rephrase. It was the intention of the xep to use something that is forbidden in xml or xmpp (can remember which). I didn't actually check that myself. Maybe jonasw messed up 😀
Dave Cridlandhas left
flowNa, it's probably a XML 1.0 vs 1.1 thingy
flowin 1.1 the separators appear to be valid but discouraged, and in 1.0 they are invalid
flowfun
mimi89999has joined
Dave Cridlandhas left
Guushas left
Guushas left
danielhas left
danielhas left
Dave Cridlandhas left
danielhas left
danielhas left
danielhas joined
Dave Cridlandhas left
Guushas left
danielhas left
lovetoxhas joined
Dave Cridlandhas left
lovetoxwhy do we have that in 0313
lovetoxThese IDs are strings that servers may construct in any manner, and clients must treat as opaque strings (e.g. there is no requirement for them to be numeric, sequenced or GUIDs).
lovetoxis it not the most natural thing for a database to have a numeric index
Dave Cridlandhas left
SaltyBoneslovetox, might be since you have to query for timestamp and interface with different DBs it might look different
lovetoxSaltyBones, 1. you dont have to query with a timestamp
lovetox2. this has nothing to do with why it would be some bad constraint for the server to have a numeric index as ID
SaltyBoneslovetox, according to MattJ Prosody alone uses multiple formats.
lovetoxi know that servers use different formats, its just not clear why
lovetoxthere is no faster search in an archive as with a numeric index
lovetoxalso i see no need to encode other informations into the index if i have a row with columns that can hold these information
Dave Cridlandhas left
dwdhas left
Dave Cridlandhas left
Dave Cridlandhas left
danielhas left
danielhas left
Dave Cridlandhas left
Seve/SouLhas left
Seve/SouLhas joined
lovetoxas i see it using a numeric sequential index as id, would open up more possibilites with MAM, and i dont see the downside for the server
danielhas left
jubalhhas joined
SaltyBonesWhich possibilities
lovetoxit currently makes no sense to request a certain id from an archive
lovetoxbecause you dont know where to place it
lovetoxbecause there is no order information in the ID
jubalhhas left
Dave Cridlandhas left
dwdhas left
danielhas left
Ge0rGlovetox: it makes sense for ranged requests. Give me the first 50 messages after X. Then you'll have a new last ID of Y, and ask for the next 50 after Y
dwdhas left
lovetoxthats how we use MAM now yes
lovetoxthis would not change
lovetoxit doesnt depend on the ID beeing numeric or not, this works with any kind of ID
lovetoxand with numeric i mean sequenced
marmistrzhas left
dwdhas left
Dave Cridlandhas left
dwdhas joined
jubalhhas joined
Dave Cridlandhas left
Dave Cridlandhas left
dwdhas left
winfriedhas left
Ge0rGlovetox: do you see any benefit in enforcing a certain implementation optimization into the XEP?
lumihas joined
jubalhhas left
j.rhas joined
mimi89999has joined
j.rhas joined
rtq3has left
jonaswflow, all XML parsers I tried rejected them even in entity form
intosihas joined
jonaswso it would at least be massively unsafe to use them in XMPP and get you disconnected very likely
Alexhas joined
lskdjfhas joined
nycohas left
marmistrzhas left
lskdjfhas left
jubalhhas joined
lskdjfhas joined
jubalhhas joined
jubalhhas joined
lskdjfhas joined
lskdjfhas joined
lskdjfhas left
lskdjfhas joined
lskdjfhas left
lskdjfhas joined
Dave Cridlandhas left
dwdhas joined
Dave Cridlandhas left
Nekithas joined
lskdjfhas joined
danielhas left
rionhas joined
Ge0rGhas left
Nekithas joined
j.rhas joined
j.rhas left
j.rhas joined
flowyep, because they are disallowed in XML 1.0 (but not 1.1)
flowjonasw ^
rionhas left
jubalhhas left
jerehas joined
jonaswflow, yeah...
jonaswRFC 6120 depends on XML 1.0 though
flowI wonder if xep30 should specify string preperation for the various values
Kevhas joined
flowjonasw, I'd love to add some rationale to xep390 explaining the situation. What do you think?
Alexhas left
jonaswflow, like this? https://xmpp.org/extensions/xep-0390.html#security-separators
jonaswone could add a mention that RFC 6120 bases on XML 1.0 and not 1.1
j.rhas joined
matlaghas left
matlaghas left
matlaghas left
Nekithas left
Guushas left
matlaghas joined
j.rhas joined
Marandahas left
vanitasvitaehas left
Yagizahas left
rtq3has joined
Tobiashas joined
valohas left
valohas joined
rtq3has left
Guushas left
marmistrzhas joined
Dave Cridlandhas left
dwdhas left
Yagizahas joined
dwdhas joined
dwdhas left
nycohas left
j.rhas joined
jerehas joined
j.rhas joined
Guushas left
ralphmhas left
goffihas left
efrithas joined
Nekithas joined
marmistrzhas left
lovetoxhas left
Ge0rGhas left
marmistrzhas left
Nekithas joined
jubalhhas joined
jubalhhas left
j.rhas joined
danielhas left
j.rhas joined
Dave Cridlandhas left
dwdhas joined
tuxhas left
Nekithas left
moparisthebesthas joined
Dave Cridlandhas left
moparisthebesthas joined
dwdhas left
dwdhas joined
Dave Cridlandhas left
rionhas joined
Dave Cridlandhas left
Dave Cridlandhas left
danielhas left
j.rhas joined
danielhas joined
dwdhas left
Guushas left
marmistrzhas left
Nekithas joined
ralphmhas left
j.rhas joined
Guushas left
marmistrzhas left
Nekithas joined
jubalhhas joined
jubalhhas left
Ge0rGhas joined
la|r|mahas left
Nekithas left
rionhas left
marcjonasw, what about merging my PRs for 401?
jonaswcan do that later today I guess
jonaswremind me tonight maybe
la|r|mahas left
j.rhas joined
marcokay
marcAt least Ge0rG and Kev have no objections anymore :)
Guushas left
Dave Cridlandhas left
dwdhas joined
Dave Cridlandhas left
j.rhas joined
jerehas joined
marchas left
marchas left
Yagizahas left
Nekithas left
Nekithas left
winfriedhas joined
Dave Cridlandhas left
dwdhas left
Yagizahas joined
Yagizahas left
Yagizahas joined
dwdhas joined
marchas joined
Dave Cridlandhas left
marchas left
marchas joined
Dave Cridlandhas left
Ge0rGhas left
dwdhas left
jerehas joined
Dave Cridlandhas left
dwdhas joined
vanitasvitaehas left
la|r|mahas left
la|r|mahas joined
Zashhas joined
rionhas joined
tuxhas joined
rionhas left
dwdhas left
dwdhas joined
j.rhas joined
Tobiashas joined
Ge0rGhas left
dwdhas left
jubalhhas joined
Dave Cridlandhas left
j.rhas joined
marchas left
dwdhas joined
Zashhas left
jubalhhas left
jubalhhas joined
Dave Cridlandhas left
Marandahas left
Dave Cridlandhas left
jerehas joined
Marandahas left
j.rhas joined
Marandahas left
Dave Cridlandhas left
dwdhas left
j.rhas joined
Yagizahas left
Marandahas left
Marandahas joined
Marandahas left
Marandahas joined
dwdhas left
Tobiashas joined
Zashhas joined
mimi89999has joined
Nekithas left
Nekithas joined
mimi89999has joined
Marandahas left
Marandahas joined
j.rhas joined
Marandahas left
matlaghas left
matlaghas joined
tuxhas joined
Guushas left
Dave Cridlandhas left
dwdhas left
dwdhas joined
lskdjfhas joined
jerehas joined
Guushas left
jubalhhas left
dwdhas left
j.rhas joined
Dave Cridlandhas left
dwdhas joined
Dave Cridlandhas left
ralphmhas left
la|r|mahas joined
Dave Cridlandhas left
Dave Cridlandhas left
rtq3has joined
dwdhas left
dwdhas joined
Yagizahas joined
Yagizahas left
Yagizahas joined
rionhas joined
danielhas left
Yagizahas left
moparisthebestHaha looking for backup solution and see jonasw commenting, do you still use Borg? :)
j.rhas joined
jonaswmoparisthebest, yes
moparisthebestBtrfs send/receive solves all my problems except on this one machine that is ext4 :( Borg looks like a good candidate though
flowis a happy borg user too
dwdhas left
Ge0rGmoparisthebest: btrfs will solve all your problems by corrupting your data and laughing in your face.
jonaswhah
Dave Cridlandhas left
moparisthebestGe0rG: my years of using it everywhere say otherwise, so far I've had corrupt (restore from backup) ext4 twice and only partially broken (still readable) btrfs once
dwdhas joined
Dave Cridlandhas left
marmistrzhas left
j.rhas joined
Dave Cridlandhas left
moparisthebestAll those failures happened on a machine with a bad PSU that caused them btw
Ge0rGmoparisthebest: btrfs has some nice checksumming features, but they tend to fail on EMEM and have a huge scary warning instead of just fixing their RAID: https://btrfs.wiki.kernel.org/index.php/RAID56
marchas joined
Ge0rGjonasw: thanks for #585
marcjonasw, thanks for merging
moparisthebestOh yea 5/6 has never been useable, 0/1/10 has been solid for years though
stuxnethas joined
Ge0rGmoparisthebest: not if you want to have 16TB of data on a 2GB RAM machine.
moparisthebestI have a 32tb array on a 16gb machine and it uses hardly any ram
sezuanhas joined
moparisthebestI can't imagine running a server with 2gb ram
ZashAll my servers have 2GB RAM
SamWhitedMost of my servers have 1 GB of ram…
moparisthebestGiant storage servers?
SamWhitedNo, I don't remember how much is in my big storage server. It's probably 2 or 4.
moparisthebestI mean if you are saying btrfs uses more memory then ext4 then sure, Linux uses more memory than an Arduino too, it's got a few more features though
SamWhitedI also have never had a problem with memory due to ZFS (which is broadly similar and people use the same complaint about it), so I dispute both of these arguments (that 16 gigs of ram can be expected, but also that the filesystem uses up too much ram)
Dave Cridlandhas left
Dave Cridlandhas left
waqashas joined
moparisthebestYea I agree I don't think btrfs uses much ram
Ge0rGSamWhited: the usual ZFS tutorials all begin with a huge red warning that your data is already as good as gone if you don't have 16GB or more RAM
SamWhitedDepends how big your storage pool is; 1GB of RAM per TB of storage is a good general guess for how much space you'll want for a cache.
Ge0rGSamWhited: and regarding bitter btrfs experiences, I happen to have a documented case: https://www.mail-archive.com/linux-btrfs@vger.kernel.org/msg48375.html
Ge0rG...with too little RAM
jjrhhas left
tuxhas joined
Ge0rGSamWhited: the question is actually how much *kernel memory* is needed to operate the fs, because you can't swap the kernel
moparisthebestI don't run swap either meh
SamWhitedoh yah, that's poor
Dave Cridlandhas left
dwdhas left
stuxnethas left
stuxnethas joined
dwdhas left
tuxhas joined
Yagizahas joined
j.rhas joined
Guushas left
Yagizahas left
Guushas left
j.rhas joined
la|r|mahas joined
la|r|mahas joined
Yagizahas joined
Yagizahas left
danielhas left
Yagizahas joined
Guushas left
tuxhas joined
Guushas left
Marandahas joined
Yagizahas left
Yagizahas joined
jubalhhas joined
nycohas left
j.rhas joined
danielhas left
SamWhitedhas left
marcDoes Cisco Jabber comply with the XMPP standard?
Marandahuhu
danielhas left
Ge0rGmarc: at least on cisco.com they still dont have TLS
danielhas joined
ZashLooks like they do on c2s?
marcGe0rG, is Cisco Jabber SaaS or do they provide a server software?
stuxnetSecurity and Cisco - what do you dream at night?
marmistrzhas left
Yagizahas left
Marandamarc, [19:58:22] Echo1: Maranda: cisco.com is running jabberd version 7.26.0.40895 on an unknown platform
Holger(Usually integrated with their VoIP stuff these days.)
j.rhas joined
marcHolger, ah okay. yes, the VoIP stuff is the reason why some people want to move from ejabberd(!) to cisco jabber ôÔ
HolgerYup.
Marandafacepalms.
marcBecause it works well with the Cisco Phones :D
marc:(
rionhas left
HolgerYes I get how this is nice for the enterprise use case.
HolgerUnfortunately their XMPP support degraded over the past few years.
HolgerThey never implemented the modern XEPs and now slowly come up with proprietary extensions to support the multi-device/mobile stuff.
marcHolger, does it mean that the phones will use VoIP via the jabber server or what's the use case?
Holgermarc: No it's mostly just an integrated address book for both (which can be Microsoft AD) and that you see the phone presence (or initiate calls) in your chat app. Stuff like that.
HolgerTheir VoIP is just SIP.
marcHolger, Sounds like very boring stuff to me. What does phone presence mean?
HolgerYou're currently in a call or not.
HolgerMy co-workers love it.
HolgerWell the administration people.
HolgerStaff council not so much.
Dave Cridlandhas left
dwdhas left
dwdhas joined
Dave Cridlandhas left
ZashHmm, something XMPP-optimized similar to https://tools.ietf.org/html/draft-ietf-acme-email-tls-02 ?
stuxnethas joined
Yagizahas joined
Yagizahas left
Yagizahas joined
Yagizahas left
Dave Cridlandhas left
dwdhas left
Marandahas joined
Nekithas left
Nekithas joined
Guushas left
Dave Cridlandhas left
dwdhas joined
Dave Cridlandhas left
Dave Cridlandhas left
Dave Cridlandhas left
Guushas left
Guushas left
j.rhas joined
jubalhhas joined
j.rhas joined
lovetoxhas joined
j.rhas joined
j.rhas joined
tuxhas joined
rionhas joined
goffihas joined
rionhas left
la|r|mahas joined
rionhas joined
la|r|mahas joined
danielhas left
goffihas left
stuxnethas joined
goffihas joined
jubalhhas left
marmistrzhas left
Tobiashas joined
marmistrzhas left
rionhas left
stuxnethas joined
Dave Cridlandhas left
dwdhas left
dwdhas joined
lskdjfhas joined
ChaosKid42has joined
dwdhas left
vanitasvitaehas left
jonaswhas left
winfriedhas left
marchas left
winfriedhas joined
jubalhhas joined
jerehas joined
j.rhas joined
boothj5has joined
valohas left
valohas joined
jubalhhas left
j.rhas joined
ChaosKid42has left
ChaosKid42has joined
danielhas left
danielhas joined
boothj5has left
boothj5has joined
danielhas left
danielhas joined
sezuanhas left
j.rhas joined
j.rhas joined
Marandahas joined
jubalhhas joined
marmistrzhas left
jubalhhas left
Dave Cridlandhas left
marmistrzhas left
ralphmhas joined
dwdhas joined
dwdhas left
boothj5has left
lumihas joined
Guushas left
goffihas left
tuxhas left
mimi89999has joined
efrithas left
lskdjfhas joined
ThurahThas left
ThurahThas joined
jerehas left
Dave Cridlandhas left
Dave Cridlandhas left
Dave Cridlandhas left
dwdhas joined
winfriedhas left
winfriedhas joined
winfriedhas left
Dave Cridlandhas left
Dave Cridlandhas left
winfriedhas joined
Guushas left
KevI feel I'm missing something with this MAM thread, as he seems to be asking for a whole bunch of things that MAM can already do.
KevHas anyone else got a better grasp on what he's asking? He asked me in private too, and I suggested he take it to the list, but it's not explained it to me any better.
winfriedhas joined
Dave Cridlandhas left
Dave Cridlandhas left
dwdhas left
Holgerhas left
ZashIf you have some random MAM id, how do you retrieve that specific message?
Dave Cridlandhas left
KevIf you have some random MAM id, why do you need that particular message? The holes he talks about are bounded by ids, and you can request the messages between two ids.
dwdhas left
lovetoxhe just finds it inefficient
dwdhas left
KevYes, that's the confusing thing. If you want the messages, then first asking for the ids and then asking for the messages is obviously inefficient.
dwdhas joined
KevAssuming you're getting the same ids and messages in both cases - which you seem to be able to do for all his use cases.
lovetoxi guess he doenst want to load all these messages
KevHe says he does.
Dave Cridlandhas left
lovetoxinstead he wants to load them later when looked at or something like that
lovetoxalso i think he has plotted out his client architecture without looking how the xep works first
waqasI skimmed through the thread. His mental model is a bit different than our normal one.
waqasHis model makes sense if this was REST/HATEOS
dwdhas left
waqasOr in cases where IDs have some significance or order is missing
dwdhas joined
waqasBut MAM isn't syncing of a key-value store, its syncing of a log, where content matters and IDs only play a supporting role.
Holgerhas left
Dave Cridlandhas left
dwdhas left
waqasMAM is like git, and unlike e.g., file system sync.
Dave Cridlandhas left
dwdhas joined
dwdhas left
ZashHow is MAM like git?
KevIt's sequenced.
KevYou use the content of one item to find the previous item, linked-list stylee.
waqasYes, and you'd notice similarities if you look at the git/hg/etc sync protocols
waqasWhere commit hashes (ids) are used more like database cursors, even if you'd otherwise think of them as database primary keys.
waqasThis is very common in log sync protocols
ZashI'd like to think that MAM is much simpler than dvcs sync protocols
KevI'm not sure why. Optimisations aside, git sync is very straightforward.
Kev(And then the optimisations and details make it all much less pleasant, naturally)
waqasYes, git sync is very simple at its core
SamWhitedhas left
ZashI don't know how git sync works. I only read the mailing list posts where it was said to be just scp/rsync/whatever
waqasrsync is different, and more like what that person wants
ZashBy "rsync" I mean "just transfer the files"
ChaosKid42has joined
danielhas joined
ZashIf it were truly a content-addressable thing, that would work
waqasThe protocol requires both sides to scan the entire dataset in rsync :)
waqasBecause there is no order
ZashBut that'd be rsyncs problem, not git
waqasYep, because git can have a much simpler protocol due to commit ordering, "give me everything since this hash"
Keva la MAM
ZashI'd imagine it'd be "between this hash and this branch/label/named commit"
waqasOther examples of log sync protocols include kafka's sync, db replication protocols used by mysql/postgres/mongodb/etc all of which implement a write ahead log, etc
waqasAt their core if you ignore implementation specific bells and whistles, it's the same logic
ZashFetching stuff from one DAG to another ought to be more complicated
ZashWhat I've seen of the hg protocol seems to agree
waqasThe main compleixity beyond MAM is multiple local and remote heads (or hg branches). It's largely the client communicating what it has and what it wants up to, give_me(from_hash_list, to_hash_list), plus some protocol elements and local git config to figure out what the server has.
XSF Discussion - 2018-03-04