XSF Discussion - 2020-09-14


  1. alameyo has left
  2. alameyo has joined
  3. stpeter has left
  4. intosi has left
  5. krauq has left
  6. krauq has joined
  7. intosi has joined
  8. lskdjf has joined
  9. stpeter has joined
  10. intosi has left
  11. mukt2 has left
  12. stpeter has left
  13. Andrzej has joined
  14. intosi has joined
  15. mukt2 has joined
  16. lskdjf has left
  17. intosi has left
  18. krauq has left
  19. krauq has joined
  20. Andrzej has left
  21. intosi has joined
  22. krauq has left
  23. krauq has joined
  24. krauq has left
  25. krauq has joined
  26. intosi has left
  27. neshtaxmpp has left
  28. neshtaxmpp has joined
  29. intosi has joined
  30. intosi has left
  31. adityaborikar has left
  32. adityaborikar has joined
  33. antranigv has joined
  34. stpeter has joined
  35. antranigv has left
  36. intosi has joined
  37. alameyo has left
  38. stpeter has left
  39. arc has joined
  40. mukt2 has left
  41. arc has left
  42. arc has joined
  43. intosi has left
  44. mukt2 has joined
  45. david has left
  46. david has joined
  47. alameyo has joined
  48. Andrzej has joined
  49. intosi has joined
  50. Yagiza has joined
  51. intosi has left
  52. adityaborikar has left
  53. adityaborikar has joined
  54. Andrzej has left
  55. krauq has left
  56. krauq has joined
  57. DebXWoody has joined
  58. intosi has joined
  59. mukt2 has left
  60. krauq has left
  61. krauq has joined
  62. Tobias has joined
  63. intosi has left
  64. intosi has joined
  65. mukt2 has joined
  66. dwd has joined
  67. alameyo has left
  68. alameyo has joined
  69. intosi has left
  70. intosi has joined
  71. marc0s has joined
  72. stpeter has joined
  73. Nekit has joined
  74. krauq has left
  75. krauq has joined
  76. mukt2 has left
  77. Mikaela has joined
  78. mukt2 has joined
  79. Vaulor has joined
  80. paul has joined
  81. stpeter has left
  82. lovetox has joined
  83. sonny has left
  84. lorddavidiii has joined
  85. intosi has left
  86. adityaborikar has left
  87. adityaborikar has joined
  88. intosi has joined
  89. Andrzej has joined
  90. adityaborikar has left
  91. adityaborikar has joined
  92. sonny has joined
  93. lorddavidiii has left
  94. emus has joined
  95. intosi has left
  96. intosi has joined
  97. adityaborikar has left
  98. adityaborikar has joined
  99. lorddavidiii has joined
  100. Mikaela has left
  101. mukt2 has left
  102. karoshi has joined
  103. Andrzej has left
  104. intosi has left
  105. lovetox has left
  106. strypey has joined
  107. lorddavidiii has left
  108. intosi has joined
  109. sonny has left
  110. sonny has joined
  111. j.r has left
  112. krauq has left
  113. krauq has joined
  114. goffi has joined
  115. j.r has joined
  116. sonny has left
  117. winfried has left
  118. winfried has joined
  119. intosi has left
  120. winfried has left
  121. winfried has joined
  122. sonny has joined
  123. intosi has joined
  124. j.r has left
  125. adityaborikar has left
  126. adityaborikar has joined
  127. jcbrand has joined
  128. intosi has left
  129. eevvoor has joined
  130. j.r has joined
  131. stpeter has joined
  132. sonny has left
  133. sonny has joined
  134. sonny has left
  135. sonny has joined
  136. lovetox has joined
  137. winfried has left
  138. winfried has joined
  139. lorddavidiii has joined
  140. Andrzej has joined
  141. eevvoor has left
  142. papatutuwawa has left
  143. papatutuwawa has joined
  144. stpeter has left
  145. intosi has joined
  146. Mikaela has joined
  147. sonny has left
  148. sonny has joined
  149. Mikaela has left
  150. serge90 has left
  151. Mikaela has joined
  152. winfried has left
  153. winfried has joined
  154. sonny has left
  155. winfried has left
  156. winfried has joined
  157. paul has left
  158. paul has joined
  159. sonny has joined
  160. serge90 has joined
  161. sonny has left
  162. peetah has left
  163. mukt2 has joined
  164. winfried has left
  165. winfried has joined
  166. winfried has left
  167. winfried has joined
  168. mukt2 has left
  169. mukt2 has joined
  170. lorddavidiii has left
  171. sonny has joined
  172. debacle has joined
  173. sonny has left
  174. eevvoor has joined
  175. sonny has joined
  176. sonny has left
  177. sonny has joined
  178. sonny has left
  179. Mikaela has left
  180. Mikaela has joined
  181. lorddavidiii has joined
  182. mukt2 has left
  183. mukt2 has joined
  184. winfried has left
  185. winfried has joined
  186. sonny has joined
  187. strypey has left
  188. matkor has joined
  189. sonny has left
  190. antranigv has joined
  191. eevvoor has left
  192. krauq has left
  193. krauq has joined
  194. krauq has left
  195. krauq has joined
  196. sonny has joined
  197. stpeter has joined
  198. sonny has left
  199. antranigv has left
  200. lskdjf has joined
  201. antranigv has joined
  202. lorddavidiii has left
  203. winfried has left
  204. winfried has joined
  205. arc has left
  206. arc has joined
  207. winfried has left
  208. winfried has joined
  209. adityaborikar has left
  210. adityaborikar has joined
  211. Andrzej has left
  212. sonny has joined
  213. peetah has joined
  214. thorsten has left
  215. winfried has left
  216. winfried has joined
  217. stpeter has left
  218. lorddavidiii has joined
  219. Dele Olajide has joined
  220. winfried has left
  221. winfried has joined
  222. Andrzej has joined
  223. eevvoor has joined
  224. thorsten has joined
  225. krauq has left
  226. krauq has joined
  227. winfried has left
  228. winfried has joined
  229. antranigv has left
  230. eevvoor has left
  231. eevvoor has joined
  232. antranigv has joined
  233. Andrzej has left
  234. antranigv has left
  235. antranigv has joined
  236. sonny has left
  237. sonny has joined
  238. winfried has left
  239. winfried has joined
  240. sonny has left
  241. sonny has joined
  242. eevvoor has left
  243. sonny has left
  244. sonny has joined
  245. winfried has left
  246. winfried has joined
  247. winfried has left
  248. winfried has joined
  249. sonny has left
  250. debacle has left
  251. thorsten has left
  252. adityaborikar has left
  253. adityaborikar has joined
  254. Andrzej has joined
  255. Nekit has left
  256. adityaborikar has left
  257. adityaborikar has joined
  258. sonny has joined
  259. Steve Kille has left
  260. debacle has joined
  261. Nekit has joined
  262. adityaborikar has left
  263. adityaborikar has joined
  264. thorsten has joined
  265. debacle has left
  266. debacle has joined
  267. debacle has left
  268. debacle has joined
  269. Steve Kille has joined
  270. debacle has left
  271. Andrzej has left
  272. adityaborikar has left
  273. winfried has left
  274. winfried has joined
  275. sonny has left
  276. sonny has joined
  277. adityaborikar has joined
  278. sonny has left
  279. sonny has joined
  280. winfried has left
  281. winfried has joined
  282. APach has left
  283. APach has joined
  284. sonny has left
  285. winfried has left
  286. winfried has joined
  287. winfried has left
  288. winfried has joined
  289. sonny has joined
  290. winfried has left
  291. winfried has joined
  292. eevvoor has joined
  293. winfried has left
  294. winfried has joined
  295. papatutuwawa has left
  296. eevvoor has left
  297. sonny has left
  298. sonny has joined
  299. sonny has left
  300. Andrzej has joined
  301. mukt2 has left
  302. sonny has joined
  303. thorsten has left
  304. sonny has left
  305. stpeter has joined
  306. winfried has left
  307. winfried has joined
  308. winfried has left
  309. winfried has joined
  310. Andrzej has left
  311. serge90 has left
  312. nyco has left
  313. Dele Olajide has left
  314. thorsten has joined
  315. nyco has joined
  316. serge90 has joined
  317. stpeter has left
  318. papatutuwawa has joined
  319. mukt2 has joined
  320. Dele Olajide has joined
  321. emus has left
  322. papatutuwawa has left
  323. papatutuwawa has joined
  324. winfried has left
  325. winfried has joined
  326. winfried has left
  327. winfried has joined
  328. sonny has joined
  329. mukt2 has left
  330. Andrzej has joined
  331. winfried has left
  332. winfried has joined
  333. intosi has left
  334. winfried has left
  335. winfried has joined
  336. sonny has left
  337. sonny has joined
  338. alameyo has left
  339. alameyo has joined
  340. mukt2 has joined
  341. lovetox has left
  342. sonny has left
  343. sonny has joined
  344. sonny has left
  345. sonny has joined
  346. sonny has left
  347. sonny has joined
  348. papatutuwawa has left
  349. papatutuwawa has joined
  350. intosi has joined
  351. winfried has left
  352. winfried has joined
  353. lorddavidiii has left
  354. winfried has left
  355. lorddavidiii has joined
  356. Lance has left
  357. papatutuwawa has left
  358. papatutuwawa has joined
  359. winfried has joined
  360. mukt2 has left
  361. lorddavidiii has left
  362. intosi has left
  363. lorddavidiii has joined
  364. mukt2 has joined
  365. intosi has joined
  366. winfried has left
  367. winfried has joined
  368. winfried has left
  369. winfried has joined
  370. Lance has joined
  371. winfried has left
  372. winfried has joined
  373. intosi has left
  374. stpeter has joined
  375. intosi has joined
  376. Mikaela has left
  377. Dele Olajide has left
  378. Dele Olajide has joined
  379. lovetox has joined
  380. stpeter has left
  381. winfried has left
  382. winfried has joined
  383. debacle has joined
  384. Mikaela has joined
  385. adityaborikar has left
  386. adityaborikar has joined
  387. mukt2 has left
  388. antranigv has left
  389. eevvoor has joined
  390. mukt2 has joined
  391. adityaborikar has left
  392. adityaborikar has joined
  393. strypey has joined
  394. antranigv has joined
  395. antranigv has left
  396. antranigv has joined
  397. eevvoor has left
  398. winfried has left
  399. winfried has joined
  400. neshtaxmpp has left
  401. Wojtek has joined
  402. mukt2 has left
  403. Andrzej has left
  404. Andrzej has joined
  405. adityaborikar has left
  406. adityaborikar has joined
  407. lorddavidiii has left
  408. mukt2 has joined
  409. lorddavidiii has joined
  410. mukt2 has left
  411. strypey has left
  412. strypey has joined
  413. adityaborikar has left
  414. adityaborikar has joined
  415. lorddavidiii has left
  416. lorddavidiii has joined
  417. mukt2 has joined
  418. Dele Olajide has left
  419. Dele Olajide has joined
  420. adityaborikar has left
  421. adityaborikar has joined
  422. krauq has left
  423. krauq has joined
  424. krauq has left
  425. krauq has joined
  426. j.r has left
  427. lovetox has left
  428. j.r has joined
  429. krauq has left
  430. krauq has joined
  431. calvin has joined
  432. j.r has left
  433. MattJ Sigh
  434. j.r has joined
  435. calvin has left
  436. MattJ I think for XEP-0335 I received conflicting feedback :)
  437. MattJ One request was to drop all mention of character encoding and anything below the "stream of XML characters" layer, and the other was a request to add details of characters that need to be XML-escaped
  438. stpeter has joined
  439. adityaborikar has left
  440. adityaborikar has joined
  441. emus has joined
  442. flow the former seems sensible
  443. flow converting an arbitrary unicode string into its xml representation is not something you should cover in an arbitrary xep
  444. flow it's something the the xmpp-core rfc covers by saying "we put XML encoded in UTF-8" on the wire
  445. Zash What about arbitrary Unicode? JSON is weird and requires that to be escaped to \uXXXX IIRC
  446. flow it would be different if we talk about codepoints that re not allowed in xml 1.0
  447. MattJ and XML forbids some characters (even escaped) that JSON allows
  448. MattJ so I don't think it's as simple as "don't mention it"
  449. Zash And probably in UTF-16 surrogate pair mode
  450. lorddavidiii has left
  451. flow Zash, for those the escaping happens on the json layer, before the xmpp library sees it and transformes the unicode string to xml, no?
  452. Zash Sure, yeah
  453. flow MattJ, are those characters kept in their naturual representation in json or, in the escaped representation?
  454. Zash MattJ: hm?
  455. flow if the latter, then we are fine, if the former, then you have to either define your custom escaping scheme, or convert the json string to base64
  456. Zash Bring out the Venn diagrams!
  457. MattJ https://mail.jabber.org/pipermail/standards/2019-February/035796.html
  458. flow Zash, how does the choosen unicode encoding (UTF-8, UTF-16) matter?
  459. Zash Does it say somewhere that an encoded JSON thing is ASCII?
  460. flow isn't json, just like xml, at first only a sequence of unicode code points?
  461. lovetox has joined
  462. Nekit has left
  463. Zash Aren't JS (and hence JSON) strings by definition UTF-16?
  464. j.r has left
  465. flow but then they are also a sequence of unicode codepoints
  466. Zash But the encoded JSON is either clean ASCII or ???
  467. Nekit has joined
  468. antranigv has left
  469. flow I guess the encoded JSON is whatever encoding you aggreed on to exchange the sequence of codepoints
  470. flow I guess the encoded JSON is whatever encoding you agreed on to exchange the sequence of codepoints
  471. Zash > JSON syntax describes a sequence of Unicode code points. http://www.ecma-international.org/publications/files/ECMA-ST/ECMA-404.pdf
  472. j.r has joined
  473. flow it appears to me that json strings must contain e.g. control characters in their escaped form only
  474. flow All Unicode characters may be placed within the quotation marks, except for the characters that must be escaped: quotation mark, reverse solidus, and the control characters (U+0000 through U+001F).
  475. flow RFC 7159 § 7
  476. mukt2 has left
  477. flow so if you feed a json string to an xml library, the xml library should never see e.g. U+0010, but only the sequence of codepoints that composes the escape sequence of U+0010
  478. Zash Seems so
  479. Zash But waqas refers to https://tools.ietf.org/html/rfc7159
  480. adityaborikar has left
  481. adityaborikar has joined
  482. Zash Why have one definition of JSON when there can be three?
  483. MattJ The XEP refers to https://tools.ietf.org/html/rfc4627 which was obsoleted by 7159, I guess I'll update that
  484. Zash Or .. twentyeleven.. probably about as many as there are JSON implementations
  485. Zash https://tools.ietf.org/html/rfc7159#section-7 > unescaped = %x20-21 / %x23-5B / %x5D-10FFFF
  486. Zash Huh, where did I see the thing about surrogate pairs then?
  487. mdosch has left
  488. MattJ If someone wants to tell me what characters are unrepresentable in XML, please add to the list thread I just revived and I can include it in the next revision
  489. mdosch has joined
  490. Ge0rG there are characters that can't be represented in XML?
  491. MattJ According to Waqas. I don't see them at a glance
  492. MattJ JSON characters, that is
  493. MattJ Some control characters are unrepresentable in XML 1.0
  494. MattJ It looks to me like they are also forbidden in JSON
  495. mdosch has left
  496. mdosch has joined
  497. lorddavidiii has joined
  498. Link Mauve Seems like they have a Wikipedia article: https://en.wikipedia.org/wiki/Valid_characters_in_XML
  499. xsf has left
  500. xsf has joined
  501. xsf has left
  502. xsf has joined
  503. strypey has left
  504. papatutuwawa has left
  505. papatutuwawa has joined
  506. lorddavidiii has left
  507. xsf has left
  508. xsf has joined
  509. flow MattJ, forbidden as in, they have to be escaped in JSON, right?
  510. MattJ Yes
  511. MattJ or
  512. MattJ looks at the RFC again
  513. flow I guess you have to check if any of those characters
  514. flow unescaped = %x20-21 / %x23-5B / %x5D-10FFFF
  515. flow is invalid/forbidden in XML 1.0
  516. MattJ Yes, I don't see anything forbidding escaped things in JSON
  517. flow Any character may be escaped.
  518. flow say RFC 7159 (the current JSON RFC it appears)
  519. flow says RFC 7159 (the current JSON RFC it appears)
  520. flow so a naive but safe json to xml converter simply escapes every character ;)
  521. arc has left
  522. arc has joined
  523. flow this errata, although rejected, may be of relevance: https://www.rfc-editor.org/errata/eid3984
  524. mukt2 has joined
  525. matkor has left
  526. sonny has left
  527. sonny has joined
  528. sonny has left
  529. lovetox has left
  530. sonny has joined
  531. lovetox has joined
  532. jonas’ MattJ, note that XML forbids control characters, even in escaped form
  533. jonas’ not that it matters for the JSON usecase
  534. jonas’ (here, "escaped form" means hex-entity-encoding)
  535. arc has left
  536. arc has joined
  537. arc has left
  538. arc has joined
  539. xsf has left
  540. xsf has joined
  541. serge90 has left
  542. mdosch has left
  543. mdosch has joined
  544. xsf has left
  545. xsf has joined
  546. adityaborikar has left
  547. adityaborikar has joined
  548. xsf has left
  549. xsf has joined
  550. serge90 has joined
  551. arc has left
  552. arc has joined
  553. xsf has left
  554. xsf has joined
  555. xsf has left
  556. xsf has joined
  557. xsf has left
  558. xsf has joined
  559. adityaborikar has left
  560. adityaborikar has joined
  561. mukt2 has left
  562. MattJ jonas’: I know, that's why I chose "unrepresentable"
  563. Steve Kille has left
  564. xsf has left
  565. Steve Kille has joined
  566. xsf has joined
  567. xsf has left
  568. xsf has joined
  569. serge90 has left
  570. serge90 has joined
  571. xsf has left
  572. xsf has joined
  573. xsf has left
  574. xsf has joined
  575. xsf has left
  576. xsf has joined
  577. xsf has left
  578. xsf has joined
  579. xsf has left
  580. xsf has joined
  581. lorddavidiii has joined
  582. xsf has left
  583. xsf has joined
  584. lovetox has left
  585. Steve Kille has left
  586. xsf has left
  587. xsf has joined
  588. xsf has left
  589. xsf has joined
  590. intosi has left
  591. debacle has left
  592. pasdesushi has joined
  593. xsf has left
  594. xsf has joined
  595. xsf has left
  596. Steve Kille has joined
  597. xsf has joined
  598. xsf has left
  599. xsf has joined
  600. pasdesushi has left
  601. goffi has left
  602. intosi has joined
  603. floretta has left
  604. xsf has left
  605. xsf has joined
  606. mukt2 has joined
  607. Yagiza has left
  608. lovetox has joined
  609. winfried has left
  610. winfried has joined
  611. winfried has left
  612. winfried has joined
  613. intosi has left
  614. xsf has left
  615. xsf has joined
  616. floretta has joined
  617. mukt2 has left
  618. mukt2 has joined
  619. winfried has left
  620. winfried has joined
  621. lovetox has left
  622. winfried has left
  623. winfried has joined
  624. pasdesushi has joined
  625. mukt2 has left
  626. xsf has left
  627. xsf has joined
  628. pasdesushi has left
  629. intosi has joined
  630. krauq has left
  631. krauq has joined
  632. mukt2 has joined
  633. krauq has left
  634. krauq has joined
  635. intosi has left
  636. krauq has left
  637. krauq has joined
  638. guus.der.kinderen has joined
  639. antranigv has joined
  640. mukt2 has left
  641. mukt2 has joined
  642. krauq has left
  643. krauq has joined
  644. sonny has left
  645. sonny has joined
  646. Tim has left
  647. Tim has joined
  648. intosi has joined
  649. Andrzej has left
  650. sonny has left
  651. sonny has joined
  652. intosi has left
  653. Andrzej has joined
  654. eta has left
  655. eta has joined
  656. eta has left
  657. eta has joined
  658. sonny has left
  659. sonny has joined
  660. arc has left
  661. arc has joined
  662. pasdesushi has joined
  663. sonny has left
  664. intosi has joined
  665. Andrzej has left
  666. pasdesushi has left
  667. pasdesushi has joined
  668. adityaborikar has left
  669. sonny has joined
  670. pasdesushi has left
  671. lorddavidiii has left
  672. sonny has left
  673. Andrzej has joined
  674. Dele Olajide has left
  675. lorddavidiii has joined
  676. mukt2 has left
  677. werdan has joined
  678. mukt2 has joined
  679. sonny has joined
  680. andrey.g has joined
  681. sonny has left
  682. lorddavidiii has left
  683. DebXWoody has left
  684. matkor has joined
  685. werdan has left
  686. Andrzej has left
  687. Andrzej has joined
  688. serge90 has left
  689. sonny has joined
  690. sonny has left
  691. stpeter FYI, we just received our GSoC payment. Thanks to everyone who contributed to this year's summer of code!
  692. pasdesushi has joined
  693. karoshi has left
  694. pasdesushi has left
  695. Andrzej has left
  696. sonny has joined
  697. sonny has left
  698. Tobias has left
  699. Nekit has left
  700. winfried has left
  701. winfried has joined
  702. Andrzej has joined
  703. winfried has left
  704. winfried has joined
  705. sonny has joined
  706. sonny has left
  707. winfried has left
  708. winfried has joined
  709. winfried has left
  710. winfried has joined
  711. antranigv has left
  712. eevvoor has joined
  713. antranigv has joined
  714. Mikaela has left
  715. krauq has left
  716. krauq has joined
  717. sonny has joined
  718. Andrzej has left
  719. sonny has left
  720. emus has left
  721. mukt2 has left
  722. intosi has left
  723. Andrzej has joined
  724. eevvoor has left
  725. mukt2 has joined
  726. sonny has joined
  727. krauq has left
  728. krauq has joined
  729. intosi has joined
  730. krauq has left
  731. krauq has joined
  732. guus.der.kinderen has left
  733. krauq has left
  734. Andrzej has left
  735. krauq has joined
  736. alameyo has left
  737. alameyo has joined
  738. mukt2 has left
  739. mukt2 has joined
  740. krauq has left
  741. krauq has joined
  742. intosi has left
  743. mukt2 has left
  744. jcbrand has left
  745. Andrzej has joined
  746. andrey.g has left
  747. dwd has left
  748. intosi has joined
  749. Tim has left
  750. alameyo has left
  751. Wojtek has left
  752. intosi has left
  753. Shell has joined
  754. Andrzej has left
  755. intosi has joined
  756. Andrzej has joined
  757. Vaulor has left
  758. Seve has left
  759. Andrzej has left
  760. intosi has left
  761. neshtaxmpp has joined
  762. eta has left
  763. alameyo has joined
  764. eta has joined
  765. intosi has joined
  766. krauq has left
  767. krauq has joined
  768. mukt2 has joined
  769. debacle has joined
  770. mimi89999 has left
  771. mimi89999 has joined
  772. intosi has left
  773. krauq has left
  774. mimi89999 has left
  775. mimi89999 has joined
  776. krauq has joined
  777. intosi has joined