XSF Discussion - 2020-09-14


  1. alameyo has left

  2. alameyo has joined

  3. stpeter has left

  4. intosi has left

  5. krauq has left

  6. krauq has joined

  7. intosi has joined

  8. lskdjf has joined

  9. stpeter has joined

  10. intosi has left

  11. mukt2 has left

  12. stpeter has left

  13. Andrzej has joined

  14. intosi has joined

  15. mukt2 has joined

  16. lskdjf has left

  17. intosi has left

  18. krauq has left

  19. krauq has joined

  20. Andrzej has left

  21. intosi has joined

  22. krauq has left

  23. krauq has joined

  24. krauq has left

  25. krauq has joined

  26. intosi has left

  27. neshtaxmpp has left

  28. neshtaxmpp has joined

  29. intosi has joined

  30. intosi has left

  31. adityaborikar has left

  32. adityaborikar has joined

  33. antranigv has joined

  34. stpeter has joined

  35. antranigv has left

  36. intosi has joined

  37. alameyo has left

  38. stpeter has left

  39. arc has joined

  40. mukt2 has left

  41. arc has left

  42. arc has joined

  43. intosi has left

  44. mukt2 has joined

  45. david has left

  46. david has joined

  47. alameyo has joined

  48. Andrzej has joined

  49. intosi has joined

  50. Yagiza has joined

  51. intosi has left

  52. adityaborikar has left

  53. adityaborikar has joined

  54. Andrzej has left

  55. krauq has left

  56. krauq has joined

  57. DebXWoody has joined

  58. intosi has joined

  59. mukt2 has left

  60. krauq has left

  61. krauq has joined

  62. Tobias has joined

  63. intosi has left

  64. intosi has joined

  65. mukt2 has joined

  66. dwd has joined

  67. alameyo has left

  68. alameyo has joined

  69. intosi has left

  70. intosi has joined

  71. marc0s has joined

  72. stpeter has joined

  73. Nekit has joined

  74. krauq has left

  75. krauq has joined

  76. mukt2 has left

  77. Mikaela has joined

  78. mukt2 has joined

  79. Vaulor has joined

  80. paul has joined

  81. stpeter has left

  82. lovetox has joined

  83. sonny has left

  84. lorddavidiii has joined

  85. intosi has left

  86. adityaborikar has left

  87. adityaborikar has joined

  88. intosi has joined

  89. Andrzej has joined

  90. adityaborikar has left

  91. adityaborikar has joined

  92. sonny has joined

  93. lorddavidiii has left

  94. emus has joined

  95. intosi has left

  96. intosi has joined

  97. adityaborikar has left

  98. adityaborikar has joined

  99. lorddavidiii has joined

  100. Mikaela has left

  101. mukt2 has left

  102. karoshi has joined

  103. Andrzej has left

  104. intosi has left

  105. lovetox has left

  106. strypey has joined

  107. lorddavidiii has left

  108. intosi has joined

  109. sonny has left

  110. sonny has joined

  111. j.r has left

  112. krauq has left

  113. krauq has joined

  114. goffi has joined

  115. j.r has joined

  116. sonny has left

  117. winfried has left

  118. winfried has joined

  119. intosi has left

  120. winfried has left

  121. winfried has joined

  122. sonny has joined

  123. intosi has joined

  124. j.r has left

  125. adityaborikar has left

  126. adityaborikar has joined

  127. jcbrand has joined

  128. intosi has left

  129. eevvoor has joined

  130. j.r has joined

  131. stpeter has joined

  132. sonny has left

  133. sonny has joined

  134. sonny has left

  135. sonny has joined

  136. lovetox has joined

  137. winfried has left

  138. winfried has joined

  139. lorddavidiii has joined

  140. Andrzej has joined

  141. eevvoor has left

  142. papatutuwawa has left

  143. papatutuwawa has joined

  144. stpeter has left

  145. intosi has joined

  146. Mikaela has joined

  147. sonny has left

  148. sonny has joined

  149. Mikaela has left

  150. serge90 has left

  151. Mikaela has joined

  152. winfried has left

  153. winfried has joined

  154. sonny has left

  155. winfried has left

  156. winfried has joined

  157. paul has left

  158. paul has joined

  159. sonny has joined

  160. serge90 has joined

  161. sonny has left

  162. peetah has left

  163. mukt2 has joined

  164. winfried has left

  165. winfried has joined

  166. winfried has left

  167. winfried has joined

  168. mukt2 has left

  169. mukt2 has joined

  170. lorddavidiii has left

  171. sonny has joined

  172. debacle has joined

  173. sonny has left

  174. eevvoor has joined

  175. sonny has joined

  176. sonny has left

  177. sonny has joined

  178. sonny has left

  179. Mikaela has left

  180. Mikaela has joined

  181. lorddavidiii has joined

  182. mukt2 has left

  183. mukt2 has joined

  184. winfried has left

  185. winfried has joined

  186. sonny has joined

  187. strypey has left

  188. matkor has joined

  189. sonny has left

  190. antranigv has joined

  191. eevvoor has left

  192. krauq has left

  193. krauq has joined

  194. krauq has left

  195. krauq has joined

  196. sonny has joined

  197. stpeter has joined

  198. sonny has left

  199. antranigv has left

  200. lskdjf has joined

  201. antranigv has joined

  202. lorddavidiii has left

  203. winfried has left

  204. winfried has joined

  205. arc has left

  206. arc has joined

  207. winfried has left

  208. winfried has joined

  209. adityaborikar has left

  210. adityaborikar has joined

  211. Andrzej has left

  212. sonny has joined

  213. peetah has joined

  214. thorsten has left

  215. winfried has left

  216. winfried has joined

  217. stpeter has left

  218. lorddavidiii has joined

  219. Dele Olajide has joined

  220. winfried has left

  221. winfried has joined

  222. Andrzej has joined

  223. eevvoor has joined

  224. thorsten has joined

  225. krauq has left

  226. krauq has joined

  227. winfried has left

  228. winfried has joined

  229. antranigv has left

  230. eevvoor has left

  231. eevvoor has joined

  232. antranigv has joined

  233. Andrzej has left

  234. antranigv has left

  235. antranigv has joined

  236. sonny has left

  237. sonny has joined

  238. winfried has left

  239. winfried has joined

  240. sonny has left

  241. sonny has joined

  242. eevvoor has left

  243. sonny has left

  244. sonny has joined

  245. winfried has left

  246. winfried has joined

  247. winfried has left

  248. winfried has joined

  249. sonny has left

  250. debacle has left

  251. thorsten has left

  252. adityaborikar has left

  253. adityaborikar has joined

  254. Andrzej has joined

  255. Nekit has left

  256. adityaborikar has left

  257. adityaborikar has joined

  258. sonny has joined

  259. Steve Kille has left

  260. debacle has joined

  261. Nekit has joined

  262. adityaborikar has left

  263. adityaborikar has joined

  264. thorsten has joined

  265. debacle has left

  266. debacle has joined

  267. debacle has left

  268. debacle has joined

  269. Steve Kille has joined

  270. debacle has left

  271. Andrzej has left

  272. adityaborikar has left

  273. winfried has left

  274. winfried has joined

  275. sonny has left

  276. sonny has joined

  277. adityaborikar has joined

  278. sonny has left

  279. sonny has joined

  280. winfried has left

  281. winfried has joined

  282. APach has left

  283. APach has joined

  284. sonny has left

  285. winfried has left

  286. winfried has joined

  287. winfried has left

  288. winfried has joined

  289. sonny has joined

  290. winfried has left

  291. winfried has joined

  292. eevvoor has joined

  293. winfried has left

  294. winfried has joined

  295. papatutuwawa has left

  296. eevvoor has left

  297. sonny has left

  298. sonny has joined

  299. sonny has left

  300. Andrzej has joined

  301. mukt2 has left

  302. sonny has joined

  303. thorsten has left

  304. sonny has left

  305. stpeter has joined

  306. winfried has left

  307. winfried has joined

  308. winfried has left

  309. winfried has joined

  310. Andrzej has left

  311. serge90 has left

  312. nyco has left

  313. Dele Olajide has left

  314. thorsten has joined

  315. nyco has joined

  316. serge90 has joined

  317. stpeter has left

  318. papatutuwawa has joined

  319. mukt2 has joined

  320. Dele Olajide has joined

  321. emus has left

  322. papatutuwawa has left

  323. papatutuwawa has joined

  324. winfried has left

  325. winfried has joined

  326. winfried has left

  327. winfried has joined

  328. sonny has joined

  329. mukt2 has left

  330. Andrzej has joined

  331. winfried has left

  332. winfried has joined

  333. intosi has left

  334. winfried has left

  335. winfried has joined

  336. sonny has left

  337. sonny has joined

  338. alameyo has left

  339. alameyo has joined

  340. mukt2 has joined

  341. lovetox has left

  342. sonny has left

  343. sonny has joined

  344. sonny has left

  345. sonny has joined

  346. sonny has left

  347. sonny has joined

  348. papatutuwawa has left

  349. papatutuwawa has joined

  350. intosi has joined

  351. winfried has left

  352. winfried has joined

  353. lorddavidiii has left

  354. winfried has left

  355. lorddavidiii has joined

  356. Lance has left

  357. papatutuwawa has left

  358. papatutuwawa has joined

  359. winfried has joined

  360. mukt2 has left

  361. lorddavidiii has left

  362. intosi has left

  363. lorddavidiii has joined

  364. mukt2 has joined

  365. intosi has joined

  366. winfried has left

  367. winfried has joined

  368. winfried has left

  369. winfried has joined

  370. Lance has joined

  371. winfried has left

  372. winfried has joined

  373. intosi has left

  374. stpeter has joined

  375. intosi has joined

  376. Mikaela has left

  377. Dele Olajide has left

  378. Dele Olajide has joined

  379. lovetox has joined

  380. stpeter has left

  381. winfried has left

  382. winfried has joined

  383. debacle has joined

  384. Mikaela has joined

  385. adityaborikar has left

  386. adityaborikar has joined

  387. mukt2 has left

  388. antranigv has left

  389. eevvoor has joined

  390. mukt2 has joined

  391. adityaborikar has left

  392. adityaborikar has joined

  393. strypey has joined

  394. antranigv has joined

  395. antranigv has left

  396. antranigv has joined

  397. eevvoor has left

  398. winfried has left

  399. winfried has joined

  400. neshtaxmpp has left

  401. Wojtek has joined

  402. mukt2 has left

  403. Andrzej has left

  404. Andrzej has joined

  405. adityaborikar has left

  406. adityaborikar has joined

  407. lorddavidiii has left

  408. mukt2 has joined

  409. lorddavidiii has joined

  410. mukt2 has left

  411. strypey has left

  412. strypey has joined

  413. adityaborikar has left

  414. adityaborikar has joined

  415. lorddavidiii has left

  416. lorddavidiii has joined

  417. mukt2 has joined

  418. Dele Olajide has left

  419. Dele Olajide has joined

  420. adityaborikar has left

  421. adityaborikar has joined

  422. krauq has left

  423. krauq has joined

  424. krauq has left

  425. krauq has joined

  426. j.r has left

  427. lovetox has left

  428. j.r has joined

  429. krauq has left

  430. krauq has joined

  431. calvin has joined

  432. j.r has left

  433. MattJ

    Sigh

  434. j.r has joined

  435. calvin has left

  436. MattJ

    I think for XEP-0335 I received conflicting feedback :)

  437. MattJ

    One request was to drop all mention of character encoding and anything below the "stream of XML characters" layer, and the other was a request to add details of characters that need to be XML-escaped

  438. stpeter has joined

  439. adityaborikar has left

  440. adityaborikar has joined

  441. emus has joined

  442. flow

    the former seems sensible

  443. flow

    converting an arbitrary unicode string into its xml representation is not something you should cover in an arbitrary xep

  444. flow

    it's something the the xmpp-core rfc covers by saying "we put XML encoded in UTF-8" on the wire

  445. Zash

    What about arbitrary Unicode? JSON is weird and requires that to be escaped to \uXXXX IIRC

  446. flow

    it would be different if we talk about codepoints that re not allowed in xml 1.0

  447. MattJ

    and XML forbids some characters (even escaped) that JSON allows

  448. MattJ

    so I don't think it's as simple as "don't mention it"

  449. Zash

    And probably in UTF-16 surrogate pair mode

  450. lorddavidiii has left

  451. flow

    Zash, for those the escaping happens on the json layer, before the xmpp library sees it and transformes the unicode string to xml, no?

  452. Zash

    Sure, yeah

  453. flow

    MattJ, are those characters kept in their naturual representation in json or, in the escaped representation?

  454. Zash

    MattJ: hm?

  455. flow

    if the latter, then we are fine, if the former, then you have to either define your custom escaping scheme, or convert the json string to base64

  456. Zash

    Bring out the Venn diagrams!

  457. MattJ

    https://mail.jabber.org/pipermail/standards/2019-February/035796.html

  458. flow

    Zash, how does the choosen unicode encoding (UTF-8, UTF-16) matter?

  459. Zash

    Does it say somewhere that an encoded JSON thing is ASCII?

  460. flow

    isn't json, just like xml, at first only a sequence of unicode code points?

  461. lovetox has joined

  462. Nekit has left

  463. Zash

    Aren't JS (and hence JSON) strings by definition UTF-16?

  464. j.r has left

  465. flow

    but then they are also a sequence of unicode codepoints

  466. Zash

    But the encoded JSON is either clean ASCII or ???

  467. Nekit has joined

  468. antranigv has left

  469. flow

    I guess the encoded JSON is whatever encoding you aggreed on to exchange the sequence of codepoints

  470. flow

    I guess the encoded JSON is whatever encoding you agreed on to exchange the sequence of codepoints

  471. Zash

    > JSON syntax describes a sequence of Unicode code points. http://www.ecma-international.org/publications/files/ECMA-ST/ECMA-404.pdf

  472. j.r has joined

  473. flow

    it appears to me that json strings must contain e.g. control characters in their escaped form only

  474. flow

    All Unicode characters may be placed within the quotation marks, except for the characters that must be escaped: quotation mark, reverse solidus, and the control characters (U+0000 through U+001F).

  475. flow

    RFC 7159 § 7

  476. mukt2 has left

  477. flow

    so if you feed a json string to an xml library, the xml library should never see e.g. U+0010, but only the sequence of codepoints that composes the escape sequence of U+0010

  478. Zash

    Seems so

  479. Zash

    But waqas refers to https://tools.ietf.org/html/rfc7159

  480. adityaborikar has left

  481. adityaborikar has joined

  482. Zash

    Why have one definition of JSON when there can be three?

  483. MattJ

    The XEP refers to https://tools.ietf.org/html/rfc4627 which was obsoleted by 7159, I guess I'll update that

  484. Zash

    Or .. twentyeleven.. probably about as many as there are JSON implementations

  485. Zash

    https://tools.ietf.org/html/rfc7159#section-7 > unescaped = %x20-21 / %x23-5B / %x5D-10FFFF

  486. Zash

    Huh, where did I see the thing about surrogate pairs then?

  487. mdosch has left

  488. MattJ

    If someone wants to tell me what characters are unrepresentable in XML, please add to the list thread I just revived and I can include it in the next revision

  489. mdosch has joined

  490. Ge0rG

    there are characters that can't be represented in XML?

  491. MattJ

    According to Waqas. I don't see them at a glance

  492. MattJ

    JSON characters, that is

  493. MattJ

    Some control characters are unrepresentable in XML 1.0

  494. MattJ

    It looks to me like they are also forbidden in JSON

  495. mdosch has left

  496. mdosch has joined

  497. lorddavidiii has joined

  498. Link Mauve

    Seems like they have a Wikipedia article: https://en.wikipedia.org/wiki/Valid_characters_in_XML

  499. xsf has left

  500. xsf has joined

  501. xsf has left

  502. xsf has joined

  503. strypey has left

  504. papatutuwawa has left

  505. papatutuwawa has joined

  506. lorddavidiii has left

  507. xsf has left

  508. xsf has joined

  509. flow

    MattJ, forbidden as in, they have to be escaped in JSON, right?

  510. MattJ

    Yes

  511. MattJ

    or

  512. MattJ looks at the RFC again

  513. flow

    I guess you have to check if any of those characters

  514. flow

    unescaped = %x20-21 / %x23-5B / %x5D-10FFFF

  515. flow

    is invalid/forbidden in XML 1.0

  516. MattJ

    Yes, I don't see anything forbidding escaped things in JSON

  517. flow

    Any character may be escaped.

  518. flow

    say RFC 7159 (the current JSON RFC it appears)

  519. flow

    says RFC 7159 (the current JSON RFC it appears)

  520. flow

    so a naive but safe json to xml converter simply escapes every character ;)

  521. arc has left

  522. arc has joined

  523. flow

    this errata, although rejected, may be of relevance: https://www.rfc-editor.org/errata/eid3984

  524. mukt2 has joined

  525. matkor has left

  526. sonny has left

  527. sonny has joined

  528. sonny has left

  529. lovetox has left

  530. sonny has joined

  531. lovetox has joined

  532. jonas’

    MattJ, note that XML forbids control characters, even in escaped form

  533. jonas’

    not that it matters for the JSON usecase

  534. jonas’

    (here, "escaped form" means hex-entity-encoding)

  535. arc has left

  536. arc has joined

  537. arc has left

  538. arc has joined

  539. xsf has left

  540. xsf has joined

  541. serge90 has left

  542. mdosch has left

  543. mdosch has joined

  544. xsf has left

  545. xsf has joined

  546. adityaborikar has left

  547. adityaborikar has joined

  548. xsf has left

  549. xsf has joined

  550. serge90 has joined

  551. arc has left

  552. arc has joined

  553. xsf has left

  554. xsf has joined

  555. xsf has left

  556. xsf has joined

  557. xsf has left

  558. xsf has joined

  559. adityaborikar has left

  560. adityaborikar has joined

  561. mukt2 has left

  562. MattJ

    jonas’: I know, that's why I chose "unrepresentable"

  563. Steve Kille has left

  564. xsf has left

  565. Steve Kille has joined

  566. xsf has joined

  567. xsf has left

  568. xsf has joined

  569. serge90 has left

  570. serge90 has joined

  571. xsf has left

  572. xsf has joined

  573. xsf has left

  574. xsf has joined

  575. xsf has left

  576. xsf has joined

  577. xsf has left

  578. xsf has joined

  579. xsf has left

  580. xsf has joined

  581. lorddavidiii has joined

  582. xsf has left

  583. xsf has joined

  584. lovetox has left

  585. Steve Kille has left

  586. xsf has left

  587. xsf has joined

  588. xsf has left

  589. xsf has joined

  590. intosi has left

  591. debacle has left

  592. pasdesushi has joined

  593. xsf has left

  594. xsf has joined

  595. xsf has left

  596. Steve Kille has joined

  597. xsf has joined

  598. xsf has left

  599. xsf has joined

  600. pasdesushi has left

  601. goffi has left

  602. intosi has joined

  603. floretta has left

  604. xsf has left

  605. xsf has joined

  606. mukt2 has joined

  607. Yagiza has left

  608. lovetox has joined

  609. winfried has left

  610. winfried has joined

  611. winfried has left

  612. winfried has joined

  613. intosi has left

  614. xsf has left

  615. xsf has joined

  616. floretta has joined

  617. mukt2 has left

  618. mukt2 has joined

  619. winfried has left

  620. winfried has joined

  621. lovetox has left

  622. winfried has left

  623. winfried has joined

  624. pasdesushi has joined

  625. mukt2 has left

  626. xsf has left

  627. xsf has joined

  628. pasdesushi has left

  629. intosi has joined

  630. krauq has left

  631. krauq has joined

  632. mukt2 has joined

  633. krauq has left

  634. krauq has joined

  635. intosi has left

  636. krauq has left

  637. krauq has joined

  638. guus.der.kinderen has joined

  639. antranigv has joined

  640. mukt2 has left

  641. mukt2 has joined

  642. krauq has left

  643. krauq has joined

  644. sonny has left

  645. sonny has joined

  646. Tim has left

  647. Tim has joined

  648. intosi has joined

  649. Andrzej has left

  650. sonny has left

  651. sonny has joined

  652. intosi has left

  653. Andrzej has joined

  654. eta has left

  655. eta has joined

  656. eta has left

  657. eta has joined

  658. sonny has left

  659. sonny has joined

  660. arc has left

  661. arc has joined

  662. pasdesushi has joined

  663. sonny has left

  664. intosi has joined

  665. Andrzej has left

  666. pasdesushi has left

  667. pasdesushi has joined

  668. adityaborikar has left

  669. sonny has joined

  670. pasdesushi has left

  671. lorddavidiii has left

  672. sonny has left

  673. Andrzej has joined

  674. Dele Olajide has left

  675. lorddavidiii has joined

  676. mukt2 has left

  677. werdan has joined

  678. mukt2 has joined

  679. sonny has joined

  680. andrey.g has joined

  681. sonny has left

  682. lorddavidiii has left

  683. DebXWoody has left

  684. matkor has joined

  685. werdan has left

  686. Andrzej has left

  687. Andrzej has joined

  688. serge90 has left

  689. sonny has joined

  690. sonny has left

  691. stpeter

    FYI, we just received our GSoC payment. Thanks to everyone who contributed to this year's summer of code!

  692. pasdesushi has joined

  693. karoshi has left

  694. pasdesushi has left

  695. Andrzej has left

  696. sonny has joined

  697. sonny has left

  698. Tobias has left

  699. Nekit has left

  700. winfried has left

  701. winfried has joined

  702. Andrzej has joined

  703. winfried has left

  704. winfried has joined

  705. sonny has joined

  706. sonny has left

  707. winfried has left

  708. winfried has joined

  709. winfried has left

  710. winfried has joined

  711. antranigv has left

  712. eevvoor has joined

  713. antranigv has joined

  714. Mikaela has left

  715. krauq has left

  716. krauq has joined

  717. sonny has joined

  718. Andrzej has left

  719. sonny has left

  720. emus has left

  721. mukt2 has left

  722. intosi has left

  723. Andrzej has joined

  724. eevvoor has left

  725. mukt2 has joined

  726. sonny has joined

  727. krauq has left

  728. krauq has joined

  729. intosi has joined

  730. krauq has left

  731. krauq has joined

  732. guus.der.kinderen has left

  733. krauq has left

  734. Andrzej has left

  735. krauq has joined

  736. alameyo has left

  737. alameyo has joined

  738. mukt2 has left

  739. mukt2 has joined

  740. krauq has left

  741. krauq has joined

  742. intosi has left

  743. mukt2 has left

  744. jcbrand has left

  745. Andrzej has joined

  746. andrey.g has left

  747. dwd has left

  748. intosi has joined

  749. Tim has left

  750. alameyo has left

  751. Wojtek has left

  752. intosi has left

  753. Shell has joined

  754. Andrzej has left

  755. intosi has joined

  756. Andrzej has joined

  757. Vaulor has left

  758. Seve has left

  759. Andrzej has left

  760. intosi has left

  761. neshtaxmpp has joined

  762. eta has left

  763. alameyo has joined

  764. eta has joined

  765. intosi has joined

  766. krauq has left

  767. krauq has joined

  768. mukt2 has joined

  769. debacle has joined

  770. mimi89999 has left

  771. mimi89999 has joined

  772. intosi has left

  773. krauq has left

  774. mimi89999 has left

  775. mimi89999 has joined

  776. krauq has joined

  777. intosi has joined