text:
-j and --write-description now incompatible with each other?

I have a script that runs youtube-dl like this:
youtube-dl.py  -j --write-description -o tmptmp "$url" | something ...
The objective of the above line is to write the description to the file "tmptmp.description" as well as to write the "json" data to the standard output (it is piped into some further program(s) that analyze the json data).
This was working correctly as recently as October 23rd (2014), but got broken some time after that (in particular, it is broken in the 10/27/2014 version).  Now, I get no "tmptmp.description" file.  Note that no error message is generated; it just silently ignores it.  If I remove "-j" form the command line, then it works as before.  So, it seems like it is a "one or the other, but not both" situation.
I would like to see the previous behavior restored.  I have work-around-ed it in my script, but I'd prefer it work the way it used to.
Note: This is all on Mac OSX, using the Unix command line.

Sorry for the delay. In the next version the _filename field will always exist, thanks for reporting it.
About the \n, they are perfectly fine in json, I don't know which programming language are you using for processing the output, but it will probably have json libraries. For shell scripts I recommend using jq.
About the description differences, for the test video http://www.youtube.com/watch?v=BaW_jenozKc, they look identical to me:
$ youtube-dl test:youtube -j | jq .description -r
test chars:  "'/\ä↭𝕐
test URL: https://github.com/rg3/youtube-dl/issues/1892

This is a test video for youtube-dl.

For more information, contact phihag@phihag.de .

$ cat youtube-dl\ test\ video\ \'\'_ä↭𝕐-BaW_jenozKc.info.json | jq .description -r
test chars:  "'/\ä↭𝕐
test URL: https://github.com/rg3/youtube-dl/issues/1892

This is a test video for youtube-dl.

For more information, contact phihag@phihag.de .

$ cat youtube-dl\ test\ video\ \'\'_ä↭𝕐-BaW_jenozKc.mp4.description
test chars:  "'/\ä↭𝕐
test URL: https://github.com/rg3/youtube-dl/issues/1892

This is a test video for youtube-dl.

For more information, contact phihag@phihag.de .

I think the only difference is that the .description file has a newline at the end, but I thinks that's expected, since most files have it.
I'm closing the issue, but feel free to open a new one if you think the description in the json dump has any problem or with any other issue you find.

I believe this issue to be fixed in youtube-dl version 2015.01.30.1 and newer. See our FAQ if you need help updating.

[quote]I believe this issue to be fixed in youtube-dl version 2015.01.30.1 and newer. See our FAQ if you need help updating.[/quote]
Two comments:

When you say "I believe this issue to be fixed", to which issue do you specifically refer?  There were several issues raised in this thread (I should know, I started most of them)

I recently "upgraded" to version 2015.01.30.2, and found a major breakage (not related to this thread specifically).  Whenever I view a certain kind of video (fetched via youtube-dl), VLC plays it as if it was only 10 seconds long.  Backing up to an earlier version of youtube-dl fixes the problem, so I know that's where the problem is.

The issue of _filename not always being present. If you want to have warnings for conflicting options, please open a new issue.

As explained in the BUG reporting guide, open a new issue with the output of youtube-dl --verbose URL, otherwise we can't really do anything.

The issue of _filename not always being present. If you want to have warnings for conflicting options, please open a new issue.

OK - thanks for the clarification.  No worries there.

As explained in the BUG reporting guide, open a new issue with the output of youtube-dl --verbose URL, otherwise we can't really do anything.

No worries.  I'm sure other people will notice this same problem and file more formal reports on it.

authors: jaimeMF joeschmoe40 phihag


text:
Styled subtitles are converted incompletely

When converting subtitles from .ttml to .srt, inline spans causes subtitles to be cut off prematurely.
Original (.ttml):

Ein lever berre éin gong. Ingen gjer
noko for meg. Eg må gjere det sjølv.

Conversion (.srt):
Ein lever berre éin gong. Ingen gjer
noko for

The following part is missing:
meg. Eg må gjere det sjølv.

Verbose output:
~$ youtube-dl -f mp4 --all-subs --convert-subtitles srt --embed-subs 'https://tv.nrk.no/serie/skeive-jenter/KOID37003614/sesong-1/episode-10'
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-c', u'-i', u'-f', u'mp4', u'--all-subs', u'--convert-subtitles', u'srt', u'--hls-prefer-native', u'--audio-format', u'm4a', u'-o', u'%(title)s.%(ext)s', u'--verbose', u'https://tv.nrk.no/serie/skeive-jenter/KOID37003614/sesong-1/episode-10']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2015.12.23
[debug] Python version 2.7.11 - Darwin-15.2.0-x86_64-i386-64bit
[debug] exe versions: ffmpeg 2.8.3, ffprobe 2.8.3
[debug] Proxy map: {}
[NRKTV] KOID37003614: Downloading webpage
[NRKTV] KOID37003614: Downloading f4m manifest
[NRKTV] KOID37003614: Downloading m3u8 information
[info] Writing video subtitles to: Skeive jenter.no.ttml
[debug] Invoking downloader on u'http://nordond16c-f.akamaihd.net/i/no/open/fb/fbaf6ba0eecbb3d23c7546e9e97371ef2fe4b798/9e7d670e-a5c0-4f61-a87d-1145f7f05315_,141,316,563,1266,2250,.mp4.csmil/index_4_av.m3u8?null='
[hlsnative] Downloading m3u8 manifest
[hlsnative] Total fragments: 73
[download] Destination: Skeive jenter.mp4
[download]   0.0% of ~216.35MiB at  2.42MiB/s ETA 01:50
frame= 1250 fps= 11 q=-1.0 Lsize=   14201kB time=00:00:50.00 bitrate=2326.4kbits/s
video:13187kB audio:977kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.258942%
Exiting normally, received signal 2.
[download] 100% of 214.49MiB in 04:11
[ffmpeg] Converting subtitles
WARNING: You have requested to convert dfxp (TTML) subtitles into another format, which results in style information loss
~$

Post the full output of youtube-dl when run with --verbose option.

Done

the same error happen to me.
the original line:

Security guard, sir. Mr Barlow, I
don't know what you've heard,

the srt line:
Security guard, sir.
don't know what you've heard,

in the python documentation about text and tail attributes of xml.etree.ElementTree.Element https://docs.python.org/3/library/xml.etree.elementtree.html#xml.etree.ElementTree.Element.text:

the text attribute holds either the text between the element’s start tag and its first child or end tag, or None, and the tail attribute holds either the text between the element’s end tag and the next tag, or None. For the XML data

so this code can't extract the text between tags.
        out = str_or_empty(node.text)

        for child in node:
            if child.tag in (_x('ttml:br'), _x('ttaf1:br'), 'br'):
                out += '\n' + str_or_empty(child.tail)

source: gharchive/issue

authors: dstftw forthrin remitamine

license: Unlicense

license_type: permissive

license_source: github-api


text:
Getting 403 forbidden error

I sawed a youtube for downloading udemy courses for free but when i did all the steps it started downloading but stuck with error 403 forbidden i also tried to update it but i said that u have use a manager,pip, use that to update any help pls i new over here and dont know much about these things

Read bug reporting guide.

authors: coolstreak dstftw


text:
[Gazeta] Some urls not work

URL like this work:  http://www.gazeta.ru/politics/video/2015/12/17/cherno-belye_polosy_press-konferentsii_vladimira_putina.shtml
But these doesn't:
http://www.gazeta.ru/video/main/main/2015/06/22/platit_ili_ne_platit_po_isku_yukosa.shtml
http://www.gazeta.ru/video/main/2015/01/20/buharov_v_krizis_russkaya_kuhnya_stanet_trendom.shtml

Thanks for the report. There's no video in http://www.gazeta.ru/video/main/2015/01/20/buharov_v_krizis_russkaya_kuhnya_stanet_trendom.shtml. For the other two links, youtube-dl will be working fine in the next version.

This too don't work:
http://www.gazeta.ru/8105009.shtml
http://www.gazeta.ru/8118245.shtml
http://www.gazeta.ru/8016839.shtml


text:
unable to download from miomio

Hi,
I just came about this issue, while trying to download from miomio:
ERROR: Unable to extract ref_path; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
I had been able to download normally until a few days ago....
Thanks,
Please follow the guide below

You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your issue (like that [x])
Use Preview tab to see how your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2016.05.30.2. If it's not read this FAQ entry and update. Issues with outdated version will be rejected.

[x] I've verified and I assure that I'm running youtube-dl 2016.05.30.2

Before submitting an issue make sure you have:

[x] At least skimmed through README and most notably FAQ and BUGS sections
[ ] Searched the bugtracker for similar issues including closed ones

What is the purpose of your issue?

[x] Bug report (encountered problems with youtube-dl)
[ ] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue

If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:
Add -v flag to your command line you run youtube-dl with, copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):
$ youtube-dl -v <your command line>
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-v', u'http://www.youtube.com/watch?v=BaW_jenozKcj']
[debug] Encodings: locale cp1251, fs mbcs, out cp866, pref cp1251
[debug] youtube-dl version 2016.05.30.2
[debug] Python version 2.7.11 - Windows-2003Server-5.2.3790-SP2
[debug] exe versions: ffmpeg N-75573-g1d0487f, ffprobe N-75573-g1d0487f, rtmpdump 2.4
[debug] Proxy map: {}
...
<end of log>

If the purpose of this issue is a site support request please provide all kinds of example URLs support for which should be included (replace following example URLs by yours):

Single video: https://www.youtube.com/watch?v=BaW_jenozKc
Single video: https://youtu.be/BaW_jenozKc
Playlist: https://www.youtube.com/playlist?list=PL4lCao7KL_QFVb7Iudeipvc2BCavECqzc

Description of your issue, suggested solution and other information
Explanation of your issue in arbitrary form goes here. Please make sure the description is worded well enough to be understood. Provide as much context and examples as possible.
If work on your issue required an account credentials please provide them or explain how one can obtain them.

Duplicate of #9605.

authors: dstftw kaygoeson


text:
Add support for Batch File

i want to run a .bat into atom.

or .cmd

Duplicate of #470

authors: andyrichardson ikeyan ojofranco

repo: rgbkrk/atom-script

license: mit

license_source: bigquery


text:
Fixed MIPS execution

Fixed the execution of MIPS scripts using spim.
Also added small HelloWorld example for testing.

👍

:ship: 3.11.0

how do i set up spim for atom, every time i try to run it i keep getting this

Unable to run
spim
Did you start Atom from the command line?
atom .
Is it in your PATH?
PATH: /opt/local/bin:/opt/local/sbin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/Library/Frameworks/Python.framework/Versions/3.6/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/Applications/VMware Fusion.app/Contents/Public:/opt/X11/bin:/Library/Frameworks/Mono.framework/Versions/Current/Commands:/usr/local/CrossPack-AVR/bin:/usr/local/bin

I mean the error message says it: You don't have spim in your path. Either you add the installation directory of spim to your $PATH variable or move it to /usr/local/bin for example.
If you install spim using homebrew, it already should be in your path, if not try 'brew link spim'

ok thanks, I installed it using the packing installer, didn't know there was a homebrew option as well, once I did that it worked, now the only problem is that it keeps printing out

Loaded: /usr/local/Cellar/spim/9.1.19/share/exceptions.s

and nothing else

It could just be the case that your code simply prints nothing?
Try running hello.asm which should print 'Hello world!'.

Hello world worked, but for some reason, mine does not even though it prints out in mars, also my script does ask for a user input which i think is causing the problem

Also on atom when i run it, i shows the hourglass and nothing happens.

Yeah but i think that's a general problem with this extention, it simply doesn't allow user input.

well, that sucks, as all the programs that I am having to write for school requires a users input.

source: gharchive/pull-request


text:
🛑 Sito Web is down

In b60161a, Sito Web (https://www.comune.preganziol.tv.it) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Sito Web is back up in d326e30 after 6 minutes.

repo: rglauco/upptime

license: MIT


text:
🛑 Sito Web is down

In 4e65a42, Sito Web (https://www.comune.preganziol.tv.it) was down:

HTTP code: 403
Response time: 622 ms

Resolved: Sito Web is back up in f52ca19 after 6 minutes.


text:
AWS Lambda account ISN'T free !

I'm trying to create an AWS Lambda account but it isn't free. I keep being asked for my credit card number or some kind of paiement. What shall I do ?

That's because only one tier is free, the details are needed for if you exceed that. eg go over 1,000,000 requests or 3 million seconds of computer time.

You have to use a CC to open an account. It will not be charged anything unless you exceed a free tier or consume a service that doesn't have a free tier. You pay for what you use. For personal use, it is not likely that you would ever exceed the Lambda free tier, so you will not get charged.

repo: rgraciano/echo-sonos


text:
Revert wrapping toolbox command in quotes

Double quotes break the script causing
./run_toolbox.py "ocm_addon install ... "
ERROR: Could not consume arg: ocm_addon install ...
Usage: run_toolbox.py <command>
  available commands:    benchmarking | cluster | entitlement | gpu_operator |
                         local_ci | nfd | nfd_operator | ocm_addon | repo | sro

For detailed information on this command, run:
  run_toolbox.py --help

/lgtm

authors: empovit sagidayan

repo: rh-ecosystem-edge/ci-artifacts


text:
Upgrade Kubernetes libraries to 0.26.4

OCP 4.13 is based on Kubernetes 1.26.
Use generic sets.
Bump other dependencies.

/lgtm

authors: mresvanis qbarrand


text:
error[E0658]: unions with non-Copy fields are unstable

Hi Dears,
I got below error,
Blocking waiting for file lock on package cache
Blocking waiting for file lock on package cache
Blocking waiting for file lock on package cache
Blocking waiting for file lock on build directory

Compiling smallvec v1.6.1
Compiling getrandom v0.2.2
Compiling num-traits v0.2.14
error[E0658]: unions with non-Copy fields are unstable
--> C:\Users\devuser.cargo\registry\src\github.com-1ecc6299db9ec823\smallvec-1.6.1\src\lib.rs:353:1
|
353 | / union SmallVecData<A: Array> {
354 | |     inline: core::mem::ManuallyDrop<MaybeUninit>,
355 | |     heap: (*mut A::Item, usize),
356 | | }
| |_^
|
= note: see issue #55149 https://github.com/rust-lang/rust/issues/55149 for more information
Compiling ahash v0.7.2
error: aborting due to previous error
For more information about this error, try rustc --explain E0658.
error: could not compile smallvec
To learn more, run the command again with --verbose.
warning: build failed,

The minimum version of Rust is 1.49 for this version of Rhai.  You need to upgrade Rust.

thanks, will check

Is it working for you OK?

authors: ArunGust schungx

repo: rhaiscript/rhai


text:
add rhai code example to readme

Hi, I was doing some research on embeddable programming languages, and I've found rhai, but i can't find any example of how this language looks like, it'd be great to add one, gluon adds examples such as hello world or fibonacci

There is a folder examples where you'd find some standard Rust samples such as hello world. In the scripts folder you'd find standard Rhai sample scripts such as Fibonacci.

Yes, but shouldn't that be in README to make it easier for new users?

There is also... you know... and entire Book, with a link in the README...

There is also... you know... and entire Book, with a link in the README...

try to put yourself as a someone who makes research on which embedded programming language to use, and want's only languages that are similar to OCaml, so he can easily chose which languages look like OCaml after simply looking through README, without going into subfolders.
yes there's a link to a book, but there are also many other links which makes it harder to notice.

Well, I would say this is quite clear...

But you're right.  Probably a sample Rhai script as an example in the README would work well to let the user know what kind of language he's looking at...

I have added an Example section in the README, which will go live for later versions.
https://github.com/rhaiscript/rhai/tree/bug-fixes

Looks great, thanks

authors: gbaranski schungx


text:
Medium quality level typo

I suppose, there is a missing 'M' next to the number of params in the medium quality level. Currently it reads as medium - 22.05Khz audio, 15-20 params

Made a pull request in the corresponding repository. Please, consider merging

repo: rhasspy/piper


text:
Websockets now use wss whenever https is used

Description
During internal use the problem arose that the app can't be used over https. This is because the connection to the websockets is always made over ws, which will be blocked by browsers due to a mixed content error.
This PR solves this issue by either using ws or wss for the websocket connection depending on the protocol used visiting the site.
Testing

Set up a local server to which you can connect to via http and https
Create two users and a poker session
2.1. Use one user to connect to the session via http
2.2. Use the other use to connect to the session via https
Simulate a session by voting for stories/changing the active story, etc.
Make sure, that all the expected thing happen (for both the http and https user)

Codecov Report

Merging #8 (ef68735) into main (5f82e37) will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff             @@
##              main        #8    +/-   ##
==========================================
  Coverage   100.00%   100.00%
==========================================
  Files           25        14    -11
  Lines          486       231   -255
  Branches        26        26
==========================================
- Hits           486       231   -255

Flag
Coverage Δ

unittests
100.00% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

planning_poker/admin.py

planning_poker/migrations/0001_initial.py

planning_poker/routing.py

planning_poker/apps.py

planning_poker/views.py

planning_poker/consumers.py

planning_poker/constants.py

planning_poker/__init__.py

planning_poker/urls.py

planning_poker/receivers.py

... and 1 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5f82e37...ef68735. Read the comment docs.

authors: Thomas-der-Azubi codecov-commenter

repo: rheinwerk-verlag/planning-poker


text:
EV3-G API: Infared sensor

Need to get screenshots of the infared sensor blocks

    def reflected_light_intensity(self):
        """
        Reflected light intensity as a percentage. Light on sensor is red.
        """

        if self.auto_mode:
            self.mode = self.MODE_COL_REFLECT

        return self.value(0)

Is there a scenario where auto_mode would be False?  Doesn't seem like anything would work if it were unless the user also did self.mode = self.MODE_COL_REFLECT so you have the same behavior in the end.  I'm scratching my head a bit on why we have this.

TouchSensor class also has the mysterious self.auto_mode

Every sensor has auto_mode field. When it is on, the appropriate mode will be selected before reading a value (e.g. when we read RGB from color sensor, it's mode will be set to 'RAW'). When it is off, user have to make sure sensor is in correct mode. This makes sense when user needs as much performance as possible.

The mode has to be set correctly anyway though...I'm missing how it increases performance by having the user set the mode vs us setting it for them?  We could just cache what the current mode is and only update that attribute when it needs to be in a different mode....then we could chop the auto_mode variable.

User can set the mode once and read the value many times. Caching current mode could work as long as we assume no one will change the mode from under our feet (e.g. another thread or process).

authors: ddemidov dlech dwalton76


text:
🛑 BOS2 is down

In 6089f4c, BOS2 ($URL_BOS2) was down:

HTTP code: 0
Response time: 0 ms

Resolved: BOS2 is back up in c2030cd after 15 minutes.

repo: rholak/upptime


text:
Issues with RTD and CommonMark > 0.5.6

Recently RTD just stopped building my docs with the following error:
python /home/docs/checkouts/readthedocs.org/user_builds/fyrd/envs/dev/bin/sphinx-build -T -E -b readthedocs -d _build/doctrees-readthedocs -D language=en . _build/html
Running Sphinx v1.5.3
making output directory...

Traceback (most recent call last):
  File "/home/docs/checkouts/readthedocs.org/user_builds/fyrd/envs/dev/lib/python3.5/site-packages/sphinx/application.py", line 512, in setup_extension
    mod = __import__(extension, None, None, ['setup'])
  File "/home/docs/checkouts/readthedocs.org/user_builds/fyrd/envs/dev/lib/python3.5/site-packages/sphinxarg/ext.py", line 13, in <module>
    from sphinxarg.markdown import parseMarkDownBlock
  File "/home/docs/checkouts/readthedocs.org/user_builds/fyrd/envs/dev/lib/python3.5/site-packages/sphinxarg/markdown.py", line 1, in <module>
    from CommonMark import Parser  # >= 0.5.6
ImportError: cannot import name 'Parser'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/docs/checkouts/readthedocs.org/user_builds/fyrd/envs/dev/lib/python3.5/site-packages/sphinx/cmdline.py", line 295, in main
    opts.warningiserror, opts.tags, opts.verbosity, opts.jobs)
  File "/home/docs/checkouts/readthedocs.org/user_builds/fyrd/envs/dev/lib/python3.5/site-packages/sphinx/application.py", line 199, in __init__
    self.setup_extension(extension)
  File "/home/docs/checkouts/readthedocs.org/user_builds/fyrd/envs/dev/lib/python3.5/site-packages/sphinx/application.py", line 516, in setup_extension
    err)
sphinx.errors.ExtensionError: Could not import extension sphinxarg.ext (exception: cannot import name 'Parser')

Extension error:
Could not import extension sphinxarg.ext (exception: cannot import name 'Parser')

I also reported the on the RTD issue tracker here: https://github.com/rtfd/readthedocs.org/issues/3032

Would you have a wordkaround for this problem on rtd ? Does it need a new sphinx-argparse version relaxing the dependency on CommonMark ?
Thanks

authors: MikeDacre vingar

repo: ribozz/sphinx-argparse


text:
NullPointerException Catch & more icon drawables

Fixes conditions where null pointer exception can cause the app to crash if the activity returns null (happens when app is closing but a call to a method like setTitle is still in progress).
Extends handleSetHomeAsUpIcon support icon fonts as well as strings.
Wrapps a helper method for generating icon drawable for DRY.

Deny the last PR. I simplified this branch.

Thank you! :blush:

authors: Anatidae-Project manumaticx

repo: ricardoalcocer/actionbarextras


text:
🛑 FIR is down

In c175c54, FIR ($FIR_SITE) was down:

HTTP code: 0
Response time: 0 ms

Resolved: FIR is back up in 766331b after 9 minutes.

repo: ricardoheil/test-uptime


text:
Ideias e base para o escopo do projeto

Idea: Poder trazer quais tipos de cafés existente se poder filtrar por alguma caracteristica ou o gosto da pessoa nas opções disponiveis. Tb poder cadastrar cafés.
Exemplo da entidade de café:
Café:
nome
características: []
Referencias:

https://www.tasteofhome.com/article/types-of-coffee/
https://beanbox.com/coffee-quiz
Imagens de tipos de café:
https://br.pinterest.com/pin/326159198016476808/
https://br.pinterest.com/pin/6473993204069927/

Ideias mudaram e implementadas em um jeito mais inteligente

repo: richardbertozzo/type-coffee


text:
Unknown face

I am using mtcnn as detector, encoder as facenet, classifier linear SVM and also tried neural network
training dataset 100 images each class.
When an unknown face is standing in front of camera it's classifying it from the known people and with  confidence score more than 90%  . What is wrong with the implementation

These stuffs need to be tuned based on the dataset.
There is no one-size fits all face recognition.
Otherwise, Amazon, Google or Microsoft would have release it already.
Tune the parameters. I have provided the code. Go deeper.

authors: KumailHussain richmondu

repo: richmondu/libfaceid


text:
RF amplifier

Good afternoon richonguzman.
I seen you have considered one output pin for an external RF amplifier, in order to increase the power of the transmission.
This can be very useful for my needs (localization in mountan paths where is no cellular coverage).
I searched in Internet, and found many devices, mainly two diffeent type:

specific bi-directional devices, with automatic switching for tx, powered from 3,7 to 5V, that drain about 10 mA if used in automatic mode. In order to save battery, I could switch it ON by using the output pin connected to a mosfet, with delay between power on and tx. But I'm afraid that the rx amplifier will saturate the receiver when I use it in noisy environment.

general-purpose wide band uni-directional devices. This can be also powered with the same pin and mosfet, but all iI found are powered with 5V or 12V, that are no good, due I would like to use a second 18650 battery dedicated to the amplifier.

Have you experienced with this devices?
I hope to build a small-weight device, in order to don't make my backpack heavier.
Many thanks
lostdog

I was testing with great results a power amp from
https://hamparts.shop/vhfuhflora/
they haven't it listed but they will,
contact Jan ;)


text:
Implement optimization strategies for functions of orthogonal matrices

Implement generic versions of some of the algorithms described here: https://arxiv.org/abs/physics/9806030 .

I have used this stuff for a side-project recently via pymanopt. If there's a (business) case for implementing this functionality in MAGICL but you're currently too busy, then I'd love to take care of it.

Definitely! The business case is the one described in VII.A here: https://arxiv.org/pdf/1904.10541.pdf . The "searching" compiler templates in src/compilers/approx.lisp currently use a high-dimensional Nelder-Mead instance to optimize a function over the space of single qubit operators, which is simultaneously slow and unreliable. After conjugation by the "magic operator" (i.e., +e-basis+), it's equivalent to optimize the (smooth) function over the space of orthogonal operators, which I'd hope would be much speedier.
I tried implementing this some months ago (wow! really, in February?) and got myself into trouble with poor numerics. I'd be very glad to have it implemented by someone else.

authors: ecpeterson jmbr

repo: rigetti/magicl


text:
Configure host with --host

e.g. using --host 127.0.0.1 restricts incoming connections to those
from localhost

@stylewarning those changes are less nice here, since there is some confusing between defaults for HTTP vs RPCQ.
When we get rid of HTTP, we can make those changes. Speaking of which, can we get rid of HTTP yet? @ecpeterson

It's been more than a month: we can get rid of quilc's HTTP.

FWIW, someone on Twitter said they want the HTTP API. hth

What I'm hearing is a request for rpcq.js.

@stevenheidel ^

@notmgsk You haven't convinced me that you can't use :initial-value despite the existence of the HTTP server. How is doing
:initial-value "*"

different from no :initial-value and having
(unless host
  (setf host "*"))

? Same for port, etc.

@stylewarning both of those things are different in HTTP vs RPCQ, so how do you have a default?

The docs say:
    (("host") :type string :optional t :documentation "host on which to run the RPCQ server")
    (("port" #\p) :type integer :optional t :documentation "port to run the RPCQ server on")

I thought it's RPCQ only.

when you're right you're right

authors: ecpeterson notmgsk stylewarning

repo: rigetti/quilc


text:
Exec tachikoma update 20170207163654

:hamster::hamster::hamster:   Strategy none
Powered by Interval Pull Request as a Service - Tachikoma.io Announcement: 2015-06-28 Updated permissions - Tachikoma.io

Coverage remained the same at 92.925% when pulling c03dac96b49d349f39ea6ec7ffe67055312eecf5 on pazjacket:tachikoma/update-20170207163654 into 47992b9f7577ecf534593d2304441ed702e67516 on rike422:master.

authors: coveralls pazjacket


text:
How to use constructor mapping and properties' mapping simultaneously

Is your feature request related to a problem? Please describe.
It seems that there is not way to generate mapping for class, which takes source object as a parameter and has required properties.
public class Source
{
    public string A { get; set; }
}

public class Target
{
    public Target(Foo foo)
    {
    }

    public required string A { get; set; }
}

Following mapper does not map property A
[Mapper]
public partial class MyMapper
{
    public partial  Target Map(Source source);
}

which causes compiler error CS9035: Required member 'Target.A' must be set in the object initializer or attribute constructor.
Describe the solution you'd like
Map required properties if ctor is not annotated with [SetsRequiredMembers]
Describe alternatives you've considered
Add mapping strategy option, whether to set properties (required or not) even if there is ctor.

I'm not sure if I understand the issue correctly...
In the title of the issue you mention User constructor mapping what are you referring to with this?

I fixed the title, it was a typo.
The issue is that the library allows to map either constructor parameters or properties, but not both. If the property is required, it is a problem.

@Liero I added a test with what I understand doesn't work according to this issue, but it seems to work fine as expected: https://github.com/riok/mapperly/pull/1243.
Could you maybe provide a full minimal repro?

Sorry for delayed answer.
Is it possible that this only works in a version that has not been released yet?
Here is output I'm getting:
public partial class MyMapper
{
    [global::System.CodeDom.Compiler.GeneratedCode("Riok.Mapperly", "3.5.1.0")]
    public partial global::MyProject.Target Map(global::MyProject.Source source)
    {
        return new global::MyProject.Target(source);
    }
}

Full source available here: https://dotnetfiddle.net/WDJkP3

Got it, this is actually expected behaviour. Mapperly supports several conversions. Only the first one that is able to convert the source object into the target object is used. In your case thats the "Constructor" conversion, the "New Instance" conversion is never applied. Your use-case (accepting the entire source object as the only target ctor parameter while also mapping other members) is not supported by Mapperly.

Well, I had this use case and had to opt out of using mapperly because of this.
The use case was to map domain object to a viewmodel, but also keep the original domain object instance, because it contained a lot of business logic that I didn't want to reinvent in viewmodels.

You could disable the constructor conversion (see docs), and use the new MapPropertyFromSource for the constructor (see docs).

You could disable the constructor conversion (see docs), and use the new MapPropertyFromSource for the constructor (see docs).

This worked for me, thanks.
Just as a side note, to use MapPropertyFromSource I had to update to the latest version (3.6) and restart the IDE. Without the IDE restart, the code generation would not update.

authors: Liero felichs-m latonz

repo: riok/mapperly


text:
Feature request: preview of file list

Using the template on the figure bellow, you get a prompt to fill with some information.
One of these information are the files that are being committed.
Is it possible to identify the already staged files when prompt for "{files}",
giving you a preview list that could be edited?
This would speedup the commit message!

Hmm thinking about the how, I add tag WIP when start working on ;)

It looks like it's difficult to get file list, I continue working on for 2.0.1

I publish a new version, the feature is not in, but the code is prepared for this 😉

This is what I was looking for!
My current schema is "{prefix}: {editedFile}, {message}" (if its only in one file).
Would be cool if it gets the files or (at least?) the file im in :D

I'm on a big update including files list and an UI to generate configuration for extension, I make a comment here when i deploy the new version

you can get a preview of the configuration UI at GCM config predefined values are missing (including files)

Hi, I'm on a bug with this feature, it's the only thing missing for next version 😉

Hi,
You can now get files list with the extension fell free to look at possibilities on doc https://gcm-config.netlify.app
PS: I deploy a new version (3.0.0) minutes ago
Have a nice day and be happy

Hi, thanks for that update! :)
But could you add an example for the files? I do not know how to add them :/
I tried some of those kind of configs:
 "vscodeGitCommit.template": [         "{prefix}: {message}",         "{files}"     ],     "vscodeGitCommit.variables": {         "MaKo": [             {                 "label": "🛠Changed"             },             {                 "label": "⚙Refactored"             },             {                 "label": "➕Added"             },             {                 "label": "❌Removed"             },             {                 "label": "\r\n📑",                 "detail": "Add an File Text"             }         ],         "prefix": "MaKo...keke"     }

oh...now I have found out:
"vscodeGitCommit.template": [
        "{prefix}: {message} {files}"
    ],
    "vscodeGitCommit.variables": {
        "prefix": "MaKo...keke",
        "files": "files",
        "MaKo": [
            {
                "label": "🛠Changed"
            },
            {
                "label": "⚙Refactored"
            },
            {
                "label": "➕Added"
            },
            {
                "label": "❌Removed"
            },
            {
                "label": "\r\n📑",
                "detail": "Add an File Text"
            }
        ]
    }

Thats realy cool! :) I like that!
But is there a possibility only to add the file name and not the whole path? that would be great :)

Hi,
No problem, Glad you found the solution 😉
I add it as a feature request for next updates
Thanks for your feedback

authors: Diogo-Rossi m3koenig rioukkevin

repo: rioukkevin/vscode-git-commit


text:
XRPL's testnet explorer, add token list

Could you guys add a list of tokens on the testnet page? There's a list of tokens on the mainnet page.
This would be beneficial to devs who want to add random trustlines and start issuing DeX Offers from there on, https://github.com/XRPLF/xrpl-dev-portal/issues/1185 would also benefit from this.

There is no token list on the testnet network because we don't have the same data for testnet - our data source is a BigQuery database that only has data from mainnet.
If you want to experiment with trustlines and DEX offers on the testnet, you can do that yourself pretty easily, with an issuer account and a couple of user accounts.

authors: mvadari wojake

repo: ripple/explorer


text:
Proposed 0.32.0-b9

Somehow these extra unused files slipped in unnoticed

[Current coverage][cc-pull] is 67.86%

Merging [#1681][cc-pull] into [develop][cc-base-branch] will increase coverage by +0.47%

4 files in ...c/ripple/app/tx/impl were modified. more

Misses -14
Hits +14

1 files in src/ripple/app were modified. more

Misses +3
Hits +563

1 files in src/ripple were modified. more

Misses -6
Hits +6

2 files (not in diff) in src/ripple/core/impl were modified. more

Misses -11
Hits +11

2 files (not in diff) in ...rc/ripple/beast/nudb were modified. more

Misses -2
Hits +2

3 files (not in diff) in ...c/ripple/app/tx/impl were modified. more

Misses -8
Hits +8

4 files (not in diff) in src/ripple/app were modified. more

Misses +3
Hits -3

6 files (not in diff) in src/ripple were modified. more

Misses +3
Hits -3

2 files (not in diff) in ...beast/websocket/impl were modified. more

Misses -20
Hits +21

2 files (not in diff) in ...ast/websocket/detail were modified. more

Misses -22
Hits +23

@@            develop      #1681   diff @@
==========================================
  Files           950        950
  Lines         70406      71284   +878
  Methods           0          0
  Messages        487          0   -487
  Branches          0          0
==========================================
+ Hits          47436      48373   +937
+ Misses        22970      22911    -59
  Partials          0          0

Powered by Codecov. Last updated by [073ccf2...59a0032][cc-compare]
[cc-base-branch]: https://codecov.io/gh/ripple/rippled/branch/develop?src=pr
[cc-compare]: https://codecov.io/gh/ripple/rippled/compare/073ccf270560a8a81d89a76d1c31f99686a16636...59a0032f8ea2be10365d34cff6686936706061c4
[cc-pull]: https://codecov.io/gh/ripple/rippled/pull/1681?src=pr

authors: codecov-io vinniefalco

repo: ripple/rippled

license: ISC


text:
TxQ full queue RPC info (RIPD-1404):

RPC ledger command returns all queue entries in "queue_data"
when requesting open ledger, and including boolean "queue: true".

Includes queue state. e.g.: fee_level, retries, last_result, tx.
Respects "expand" and "binary" parameters for the txs.

Remove some unused code.

Some sample Json output:
{
	"ledger" :
	{
		"closed" : false,
		"ledger_index" : "20",
		"parent_hash" : "AFE6058DD09B7320D2B3DDF8DDA1022F0ECC0EAF910ACB609FF5F5F7DD3A7A2E",
		"seqNum" : "20"
	},
	"ledger_current_index" : 20,
	"queue_data" :
	[

		{
			"account" : "rG1QQv2nh2gr7RCZ1P8YYcBUKCCN633jCn",
			"fee_level" : "256",
			"last_result" : "terPRE_SEQ",
			"preflight_result" : "tesSUCCESS",
			"retries_remaining" : 1,
			"tx" : "1B2C73099795359F8A14F81721C1995E955818F7A48DC36DB2CE03B32EF0308B"
		}
	],
	"status" : "success",
	"validated" : false
}

{
	"ledger" :
	{
		"closed" : false
	},
	"ledger_current_index" : 11,
	"queue_data" :
	[

		{
			"account" : "rG1QQv2nh2gr7RCZ1P8YYcBUKCCN633jCn",
			"auth_change" : false,
			"fee" : "10",
			"fee_level" : "256",
			"last_result" : "terPRE_SEQ",
			"max_spend_drops" : "10",
			"preflight_result" : "tesSUCCESS",
			"retries_remaining" : 8,
			"tx" :
			{
				"tx_blob" : "1200072400000008644000000BA43B740065D551C37937E080000000000000000000000000005553440000000000AE123A8556F3CF91154711376AFB0F894F832B3D68400000000000000A73210388935426E0D08083314842EDFBB2D517BD47699F9A4527318A8E10468C97C0527447304502210091222BAB6E5D8C0325D943600C7EBD55C8CB3AA110C71C415613B28CCCC4EB180220543AD25D2C695749F89448B1CCCB918A0CD0EE992A7B0807E2170B3B2E75B80B8114AE123A8556F3CF91154711376AFB0F894F832B3D"
			}
		},

		{
			"account" : "rG1QQv2nh2gr7RCZ1P8YYcBUKCCN633jCn",
			"fee_level" : "256",
			"preflight_result" : "tesSUCCESS",
			"retries_remaining" : 10,
			"tx" :
			{
				"tx_blob" : "120003240000000968400000000000000A73210388935426E0D08083314842EDFBB2D517BD47699F9A4527318A8E10468C97C0527446304402204F4D61DD5BBD1CC0468B3302A303AF732FA0887B817FC9CCCBF315CFE609BC3102202DA25B6EDD5E0DB263DE20EC59886477A88786E46F998C8918A88FC7D8C530CF8114AE123A8556F3CF91154711376AFB0F894F832B3D"
			}
		}
	],
	"status" : "success",
	"validated" : false
}

Codecov Report

Merging #2020 into develop will increase coverage by 0.09%.
The diff coverage is 90.09%.

@@             Coverage Diff             @@
##           develop    #2020      +/-   ##
===========================================
+ Coverage    67.27%   67.37%   +0.09%
===========================================
  Files          683      683
  Lines        49231    49267      +36
===========================================
+ Hits         33121    33193      +72
+ Misses       16110    16074      -36

Impacted Files
Coverage Δ

src/ripple/rpc/impl/Handler.cpp
97.61% <ø> (-0.06%)
:x:

src/ripple/rpc/impl/RPCHandler.cpp
61.84% <ø> (+14.36%)
:white_check_mark:

src/ripple/rpc/impl/Handler.h
20% <ø> (ø)
:white_check_mark:

src/ripple/app/misc/TxQ.h
96.87% <100%> (+0.1%)
:white_check_mark:

src/ripple/app/misc/impl/TxQ.cpp
96.25% <100%> (+0.52%)
:white_check_mark:

src/ripple/app/ledger/LedgerToJson.h
100% <100%> (ø)
:white_check_mark:

src/ripple/rpc/handlers/LedgerHandler.h
70.58% <100%> (ø)
:white_check_mark:

src/ripple/app/ledger/impl/LedgerToJson.cpp
88% <79.16%> (+15.27%)
:white_check_mark:

src/ripple/rpc/handlers/LedgerHandler.cpp
91.89% <94.73%> (+1.56%)
:white_check_mark:

src/ripple/app/misc/impl/LoadFeeTrack.cpp
81.53% <ø> (-4.62%)
:x:

... and 11 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 209fe8f...ae7aba6. Read the comment docs.

Nice coverage bump

@miguelportilla Thanks for the feedback! I rebased on to 0.60.0-rc4, and pushed a new commit to make those suggested changes.

Rebased again onto 0.60.0.

Squashed and marked Passed.

Merged to develop as 72657294462ebff63ee226c3cbb3fba75f8a9058

authors: codecov-io scottschurr vinniefalco ximinez


text:
Add a rerun if output to try to invalidate the build cache when sol files change

An attempt to resolve the issues with https://github.com/risc0/risc0-ethereum/issues/106 by adding a rerun-if output to the build.rs script

Converted this to draft as I didn't actually get a chance to test this yet


text:
Migrate factors & sha examples with shared methods

A variation on #373 with a shared methods folder and crate. Now edited with updates based on discussion with @flaub on how to unify the methods crate, not just directory.
Relative to #373, this we no longer need the factors-methods vs sha-methods disambiguation -- now both are part of methods and look similar to how they did as standalone examples.
The crate and directory structure is more different from standalone examples than it was in #373, however. Instead of a structure matching https://github.com/risc0/risc0-rust-starter, the host code is pulled up to the root directory, and the guest code now lives in a shared methods folder. This also means that if someone goes straight to this examples directory from our getting started page, they will be looking at
examples
-- factors
-- methods
-- sha

which IMO is not very clear about what examples we have (or even how many examples we have). Perhaps we could wrap the methods directory in a common directory to make it clearer what's happening. Fundamentally though, I'm finding this split structure hard to explain and likely to confuse newcomers. I do not relish adding explanation to our first tutorial clarifying which parts of the examples directory are and are not part of the factors example. This isn't unworkably confusing, but it seems substantially more confusing than deconflicting the methods name by calling it factors-methods or sha-methods.
I think we should land #373 instead.

Is this ready to land? I'd like to get some test coverage in for the upcoming release

Is this ready to land? I'd like to get some test coverage in for the upcoming release

Do we want all examples in and tested? If so then no, if it's ok to do a partial land and then finish later then yes it can land.

authors: flaub tzerrell


text:
Support more util functions for vector status register.

Currently, we have "vreadvl()" to get the vl, we could have more util functions for "mstatus", "vlenb", "vstart" and other status register.

You could propose a simple implementation like https://github.com/riscv/rvv-intrinsic-doc/issues/36

Exposing vlenb may be a feature to consider, but there is no benefit to expose mstatus and vstart. Let us revisit this after v1.0.

Revisiting this issue after a year now...
VLEN is now exposed.
The vstart CSR is currently not exposed to the intrinsics programmer, and the intrinsics have the semantics of vstart = 0. So I think it would be strange for us to expose control to vstart. Additionally, support for positive vstart values is implementation -defined; thus, portable application software should not set vstart > 0.
Other than vxsat and fflag that is left to be exposed, I don't think vstart and mstatus would be our consideration. Please open up another issue if you have a strong demand to this feature.

authors: JerryShih arcbbb eopXD

repo: riscv-non-isa/rvv-intrinsic-doc


text:
how does %hi work for RISC-V 64?

I know that %hi(symbol) will get the high 20 bits of the symbols' address and then be as a immediate number in RISC-V 32. In short, take the [31:12] bits in RISC-V 32.
But in RISC-V 64, will it get the [31:12] bits, or just get the [63:44] bits?
Thanks for your help.

BTW, if I want to test something, which tools can help me please? Which tools can run the ASM code?

%hi is always bits 31:12.  However it is a little more complicated than that, since we always use lui with an add, so if the low 12 bits are equal to or greater than 0x800 then we need to round the %hi value up by one, and then use a negative value for the %lo.
If you assemble and link asm code, then it can be run in any smiulator.  We have spike (riscv-isa-sim) which is best for hardware folk, qemu which is best for software folk, and a gdb sim which is useful if you are familiar with it.

%hi is always bits 31:12. However it is a little more complicated than that, since we always use lui with an add, so if the low 12 bits are equal to or greater than 0x800 then we need to round the %hi value up by one, and then use a negative value for the %lo.
If you assemble and link asm code, then it can be run in any smiulator. We have spike (riscv-isa-sim) which is best for hardware folk, qemu which is best for software folk, and a gdb sim which is useful if you are familiar with it.

Thanks for your valuable reply! I will close this issue soon.

I build a test toolchain on my machine, and run:
# 0xffff_ffff_8000_0000
lui a0, %hi(0xffffffff80000000)
call print_num
-------------------------------------------
number: ffffffff80000000

# 0xffff_ffff_8000_0000
lui a0, %hi(0xffffffff70000000)
call print_num
-------------------------------------------
number: 70000000

That looks like the [63:32] bits are same as the 31 bit in function %hi, and do you know why it works like this please? Thanks.

Because the immediate operand in the lui instruction is sign-extended to XLEN before it is stored into rd.  Note this is true for every instruction that has an imm field.

Thanks for your kindly help!

authors: PeterlitsZo jim-wilson johnwinans

repo: riscv/riscv-asm-manual


text:
PMP and MPRV description misleading

The PMP description in 3.7 says:

PMP checks are applied to all accesses whose effective privilege mode is S or U, including instruction fetches in S and U mode, data accesses in S and U mode when the MPRV bit in the mstatus register is clear, and data accesses in any mode when the MPRV bit in mstatus is set and the MPP field in mstatus contains S or U.

Since this change MPRV cannot be 1 outside of M-mode, so this is misleading when it qualifies accesses in S and U mode with MPRV being clear.
Suggestion:

PMP checks are applied to all accesses whose effective privilege mode is S or U, including instruction fetches and data accesses in S and U mode, data accesses in M mode when the MPRV bit in mstatus is set and the MPP field in mstatus contains S or U, and HLV/HLVX/HSV instructions from any mode.

(See #528 for a similar change.)

The HLV/HSV instructions haven't been introduced by this point, so I'm going to leave them out.

repo: riscv/riscv-isa-manual


text:
storage: abstract disk I/O

Currently, we have create_dir, etc. everywhere. We'd better have a single interface to operate files on disk, so as to support in-memory / disk / object store backends.

Isn't that only the disk backend depends on file operations?

Yes. But even disk backend has two modes -- pure in-memory mode (for testing, where files are stored in a hash map), and real on-disk mode.

If we can abstract all disk operations to use a trait like ObjectStore, we can prevent unwanted writes to disk.

I think we should use the real on-disk mode in testing, to make sure we are correctly using the system fs API. Data path can be redirected to ramfs/tmpfs to speed up.

Later we can also introduce the simulation testing, where all fs API will be mocked to a in-memory simulator.

I switch to pure in-memory mode because tmpfs is slow 🤣 fsync and manifest write will add 1s latency to every disk test case, which looks weird.
Maybe I can try switch off fsync for all writes (even manifest), and maybe things will work.

🤣 okay let's stay in memory mode for efficiency.

repo: risinglightdb/risinglight


text:
refactor: minor refactor scaleview package

Why does this function return a pointer? IMHO we can get away with returning an integer. Please correct me if I am wrong
panic("never reach here") IMHO we should refactor this to e.g. panic("unsupported component"). I would assume that that would be more descriptive
Please add a doctoring. What does this package do?

Why does this function return a pointer? IMHO we can get away with returning an integer. Please correct me if I am wrong

The nil pointer means that the given group is not found, so we actually have a meaning of optional<int> here.

panic("never reach here") IMHO we should refactor this to e.g. panic("unsupported component"). I would assume that that would be more descriptive

We don't have other components and if it reaches the default branch of that switch statement, it means there's definitely a bug either caused by hard-coded codes or wrong runtime configurations. There are no other unsupported components and we do not expect it to happen in any case, the "never reach here" would be more descriptive.

Please add a doctoring. What does this package do?

I would add a link to the RFC later.
Thanks for reporting this!

Addressing everything except the doctoring  in https://github.com/risingwavelabs/risingwave-operator/pull/233. @arkbriar could you please have a look?

PR is merged.
I will keep this issue open, because we still need to add documentation.

repo: risingwavelabs/risingwave-operator


text:
fix(sink): fix bigquery sink error

I hereby agree to the terms of the RisingWave Labs, Inc. Contributor License Agreement.
What's changed and what's your intention?
Since we have connector dependencies risingwave-object-storeand gcp-bigquery-client, and both risingwave-object-storeand gcp-bigquery-client depend on rustls
and then risingwave-object-store has  rustls 's feature aws-lc-rs turned on, and gcp-bigquery-client has rustls 's feature ring turned on, but rustls doesn't allow them to be turned on at the same time, and we've changed  risingwave-object-store's feature to ring.

Checklist

[ ] I have written necessary rustdoc comments
[ ] I have added necessary unit tests and integration tests
[ ] I have added test labels as necessary. See details.
[ ] I have added fuzzing tests or opened an issue to track them. (Optional, recommended for new SQL features #7934).
[ ] My PR contains breaking changes. (If it deprecates some features, please create a tracking issue to remove them in the future).
[ ] All checks passed in ./risedev check (or alias, ./risedev c)
[ ] My PR changes performance-critical code. (Please run macro/micro-benchmarks and show the results.)

[ ] My PR contains critical fixes that are necessary to be merged into the latest release. (Please check out the details)

Documentation

[ ] My PR needs documentation updates. (Please use the Release note section below to summarize the impact on users)

Release note
If this PR includes changes that directly affect users or other significant modifications relevant to the community, kindly draft a release note to provide a concise summary of these changes. Please prioritize highlighting the impact these changes will have on users.

The same issue has been resolved by #19136

repo: risingwavelabs/risingwave


text:
refactor: migrate from from_proto_bytes to value_encoding

I hereby agree to the terms of the Singularity Data, Inc. Contributor License Agreement.
What's changed and what's your intention?

migrate from from_proto_bytes to value_encoding while encoding to/decoding from storage
fix the bug that default values in struct and list are converted to NULLs caused by  from_proto_bytes
in addition, serialization of value encoding for List and Struct are faster than key encoding now because the overhead of protobuf encoding is eliminated, but deserialization is still slower(though much faster than before).

Checklist
~- [ ] I have written necessary rustdoc comments~
~- [ ] I have added necessary unit tests and integration tests~

[x] All checks passed in ./risedev check (or alias, ./risedev c)

Refer to a related PR or issue link (optional)
#4521
#4672

benchmark result on my computer:
Int16 key encoded len: 3
bench Int16 (key encoding serialization)
                        time:   [15.289 ns 15.354 ns 15.422 ns]
Found 3 outliers among 100 measurements (3.00%)
  3 (3.00%) high mild

Int16 value encoded len: 3
bench Int16 (value encoding serialization)
                        time:   [14.164 ns 14.223 ns 14.290 ns]
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild

Int32 key encoded len: 5
bench Int32 (key encoding serialization)
                        time:   [15.226 ns 15.288 ns 15.353 ns]
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) high mild

Int32 value encoded len: 5
bench Int32 (value encoding serialization)
                        time:   [13.324 ns 13.379 ns 13.459 ns]
Found 7 outliers among 100 measurements (7.00%)
  3 (3.00%) high mild
  4 (4.00%) high severe

Int64 key encoded len: 9
bench Int64 (key encoding serialization)
                        time:   [30.577 ns 30.728 ns 30.890 ns]

Int64 value encoded len: 9
bench Int64 (value encoding serialization)
                        time:   [24.752 ns 24.810 ns 24.867 ns]
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) high mild

Float32 key encoded len: 5
bench Float32 (key encoding serialization)
                        time:   [15.217 ns 15.308 ns 15.407 ns]

Float32 value encoded len: 5
bench Float32 (value encoding serialization)
                        time:   [13.518 ns 13.553 ns 13.589 ns]
Found 2 outliers among 100 measurements (2.00%)
  1 (1.00%) high mild
  1 (1.00%) high severe

Float64 key encoded len: 9
bench Float64 (key encoding serialization)
                        time:   [29.953 ns 30.018 ns 30.087 ns]
Found 5 outliers among 100 measurements (5.00%)
  1 (1.00%) low mild
  4 (4.00%) high mild

Float64 value encoded len: 9
bench Float64 (value encoding serialization)
                        time:   [25.081 ns 25.179 ns 25.273 ns]
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) high mild

Bool key encoded len: 2
bench Bool (key encoding serialization)
                        time:   [14.753 ns 14.820 ns 14.886 ns]
Found 2 outliers among 100 measurements (2.00%)
  1 (1.00%) high mild
  1 (1.00%) high severe

Bool value encoded len: 2
bench Bool (value encoding serialization)
                        time:   [13.564 ns 13.605 ns 13.648 ns]
Found 5 outliers among 100 measurements (5.00%)
  2 (2.00%) high mild
  3 (3.00%) high severe

Decimal key encoded len: 5
bench Decimal (key encoding serialization)
                        time:   [61.071 ns 61.218 ns 61.369 ns]
Found 4 outliers among 100 measurements (4.00%)
  3 (3.00%) high mild
  1 (1.00%) high severe

Decimal value encoded len: 17
bench Decimal (value encoding serialization)
                        time:   [28.035 ns 28.167 ns 28.338 ns]
Found 7 outliers among 100 measurements (7.00%)
  5 (5.00%) high mild
  2 (2.00%) high severe

Interval key encoded len: 17
bench Interval (key encoding serialization)
                        time:   [59.241 ns 59.401 ns 59.563 ns]
Found 3 outliers among 100 measurements (3.00%)
  1 (1.00%) low mild
  2 (2.00%) high mild

Interval value encoded len: 17
bench Interval (value encoding serialization)
                        time:   [56.623 ns 56.750 ns 56.878 ns]
Found 4 outliers among 100 measurements (4.00%)
  3 (3.00%) high mild
  1 (1.00%) high severe

NaiveDate key encoded len: 5
bench NaiveDate (key encoding serialization)
                        time:   [14.716 ns 14.752 ns 14.787 ns]
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) high severe

NaiveDate value encoded len: 5
bench NaiveDate (value encoding serialization)
                        time:   [13.767 ns 13.812 ns 13.859 ns]
Found 4 outliers among 100 measurements (4.00%)
  4 (4.00%) high mild

NaiveDateTime key encoded len: 13
bench NaiveDateTime (key encoding serialization)
                        time:   [30.853 ns 30.967 ns 31.088 ns]
Found 9 outliers among 100 measurements (9.00%)
  2 (2.00%) low mild
  6 (6.00%) high mild
  1 (1.00%) high severe

NaiveDateTime value encoded len: 13
bench NaiveDateTime (value encoding serialization)
                        time:   [26.167 ns 26.237 ns 26.318 ns]
Found 3 outliers among 100 measurements (3.00%)
  1 (1.00%) high mild
  2 (2.00%) high severe

NaiveTime key encoded len: 9
bench NaiveTime (key encoding serialization)
                        time:   [30.295 ns 30.364 ns 30.439 ns]
Found 4 outliers among 100 measurements (4.00%)
  1 (1.00%) high mild
  3 (3.00%) high severe

NaiveTime value encoded len: 9
bench NaiveTime (value encoding serialization)
                        time:   [24.984 ns 25.037 ns 25.091 ns]
Found 4 outliers among 100 measurements (4.00%)
  3 (3.00%) high mild
  1 (1.00%) high severe

Utf8 (len = 10) key encoded len: 20
bench Utf8 (len = 10) (key encoding serialization)
                        time:   [66.011 ns 66.224 ns 66.446 ns]
Found 5 outliers among 100 measurements (5.00%)
  4 (4.00%) high mild
  1 (1.00%) high severe

Utf8 (len = 10) value encoded len: 15
bench Utf8 (len = 10) (value encoding serialization)
                        time:   [26.115 ns 26.198 ns 26.284 ns]
Found 3 outliers among 100 measurements (3.00%)
  3 (3.00%) high mild

Utf8 (len = 1000) key encoded len: 1127
bench Utf8 (len = 1000) (key encoding serialization)
                        time:   [850.89 ns 852.82 ns 854.79 ns]
Found 5 outliers among 100 measurements (5.00%)
  2 (2.00%) high mild
  3 (3.00%) high severe

Utf8 (len = 1000) value encoded len: 1005
bench Utf8 (len = 1000) (value encoding serialization)
                        time:   [66.217 ns 66.396 ns 66.582 ns]
Found 4 outliers among 100 measurements (4.00%)
  2 (2.00%) low mild
  2 (2.00%) high mild

Utf8 (len = 10000) key encoded len: 112502
bench Utf8 (len = 10000) (key encoding serialization)
                        time:   [61.335 µs 61.529 µs 61.736 µs]
Found 5 outliers among 100 measurements (5.00%)
  5 (5.00%) high mild

Utf8 (len = 10000) value encoded len: 100005
bench Utf8 (len = 10000) (value encoding serialization)
                        time:   [1.6608 µs 1.6653 µs 1.6700 µs]
Found 3 outliers among 100 measurements (3.00%)
  3 (3.00%) high severe

Struct of Bool (len = 100) key encoded len: 201
bench Struct of Bool (len = 100) (key encoding serialization)
                        time:   [1.3220 µs 1.3248 µs 1.3276 µs]
Found 5 outliers among 100 measurements (5.00%)
  1 (1.00%) high mild
  4 (4.00%) high severe

Struct of Bool (len = 100) value encoded len: 201
bench Struct of Bool (len = 100) (value encoding serialization)
                        time:   [725.14 ns 726.89 ns 728.74 ns]
Found 3 outliers among 100 measurements (3.00%)
  2 (2.00%) high mild
  1 (1.00%) high severe

List of Bool (len = 100) key encoded len: 227
bench List of Bool (len = 100) (key encoding serialization)
                        time:   [1.6736 µs 1.6771 µs 1.6808 µs]
Found 5 outliers among 100 measurements (5.00%)
  3 (3.00%) high mild
  2 (2.00%) high severe

List of Bool (len = 100) value encoded len: 205
bench List of Bool (len = 100) (value encoding serialization)
                        time:   [699.31 ns 700.93 ns 702.68 ns]
Found 8 outliers among 100 measurements (8.00%)
  6 (6.00%) high mild
  2 (2.00%) high severe

bench Int16 (key encoding deserialization)
                        time:   [4.3788 ns 4.4010 ns 4.4281 ns]
Found 6 outliers among 100 measurements (6.00%)
  2 (2.00%) high mild
  4 (4.00%) high severe

bench Int16 (value encoding deserialization)
                        time:   [3.3505 ns 3.3591 ns 3.3684 ns]
Found 6 outliers among 100 measurements (6.00%)
  5 (5.00%) high mild
  1 (1.00%) high severe

bench Int32 (key encoding deserialization)
                        time:   [4.4010 ns 4.4140 ns 4.4278 ns]
Found 12 outliers among 100 measurements (12.00%)
  1 (1.00%) low mild
  9 (9.00%) high mild
  2 (2.00%) high severe

bench Int32 (value encoding deserialization)
                        time:   [3.3382 ns 3.3460 ns 3.3537 ns]
Found 5 outliers among 100 measurements (5.00%)
  3 (3.00%) high mild
  2 (2.00%) high severe

bench Int64 (key encoding deserialization)
                        time:   [4.5358 ns 4.5506 ns 4.5664 ns]
Found 11 outliers among 100 measurements (11.00%)
  4 (4.00%) low mild
  4 (4.00%) high mild
  3 (3.00%) high severe

bench Int64 (value encoding deserialization)
                        time:   [3.3930 ns 3.4050 ns 3.4186 ns]
Found 3 outliers among 100 measurements (3.00%)
  2 (2.00%) high mild
  1 (1.00%) high severe

bench Float32 (key encoding deserialization)
                        time:   [4.3750 ns 4.3831 ns 4.3910 ns]
Found 4 outliers among 100 measurements (4.00%)
  1 (1.00%) high mild
  3 (3.00%) high severe

bench Float32 (value encoding deserialization)
                        time:   [3.3390 ns 3.3453 ns 3.3521 ns]
Found 7 outliers among 100 measurements (7.00%)
  4 (4.00%) high mild
  3 (3.00%) high severe

bench Float64 (key encoding deserialization)
                        time:   [4.5830 ns 4.5911 ns 4.5992 ns]
Found 4 outliers among 100 measurements (4.00%)
  2 (2.00%) high mild
  2 (2.00%) high severe

bench Float64 (value encoding deserialization)
                        time:   [3.3331 ns 3.3391 ns 3.3453 ns]
Found 6 outliers among 100 measurements (6.00%)
  3 (3.00%) high mild
  3 (3.00%) high severe

bench Bool (key encoding deserialization)
                        time:   [4.1757 ns 4.1851 ns 4.1959 ns]
Found 4 outliers among 100 measurements (4.00%)
  3 (3.00%) high mild
  1 (1.00%) high severe

bench Bool (value encoding deserialization)
                        time:   [3.3413 ns 3.3504 ns 3.3606 ns]
Found 6 outliers among 100 measurements (6.00%)
  5 (5.00%) high mild
  1 (1.00%) high severe

bench Decimal (key encoding deserialization)
                        time:   [37.286 ns 37.358 ns 37.430 ns]
Found 5 outliers among 100 measurements (5.00%)
  4 (4.00%) high mild
  1 (1.00%) high severe

bench Decimal (value encoding deserialization)
                        time:   [7.0831 ns 7.0988 ns 7.1149 ns]
Found 7 outliers among 100 measurements (7.00%)
  4 (4.00%) high mild
  3 (3.00%) high severe

bench Interval (key encoding deserialization)
                        time:   [5.4229 ns 5.4347 ns 5.4462 ns]
Found 4 outliers among 100 measurements (4.00%)
  3 (3.00%) high mild
  1 (1.00%) high severe

bench Interval (value encoding deserialization)
                        time:   [3.9637 ns 3.9721 ns 3.9810 ns]
Found 6 outliers among 100 measurements (6.00%)
  2 (2.00%) high mild
  4 (4.00%) high severe

bench NaiveDate (key encoding deserialization)
                        time:   [7.0366 ns 7.0492 ns 7.0621 ns]
Found 8 outliers among 100 measurements (8.00%)
  5 (5.00%) high mild
  3 (3.00%) high severe

bench NaiveDate (value encoding deserialization)
                        time:   [5.8505 ns 5.8650 ns 5.8808 ns]
Found 6 outliers among 100 measurements (6.00%)
  4 (4.00%) high mild
  2 (2.00%) high severe

bench NaiveDateTime (key encoding deserialization)
                        time:   [9.6108 ns 9.6347 ns 9.6606 ns]
Found 4 outliers among 100 measurements (4.00%)
  3 (3.00%) high mild
  1 (1.00%) high severe

bench NaiveDateTime (value encoding deserialization)
                        time:   [7.7553 ns 7.7738 ns 7.7921 ns]
Found 7 outliers among 100 measurements (7.00%)
  4 (4.00%) high mild
  3 (3.00%) high severe

bench NaiveTime (key encoding deserialization)
                        time:   [4.8020 ns 4.8148 ns 4.8286 ns]
Found 4 outliers among 100 measurements (4.00%)
  1 (1.00%) high mild
  3 (3.00%) high severe

bench NaiveTime (value encoding deserialization)
                        time:   [3.5495 ns 3.5583 ns 3.5675 ns]
Found 4 outliers among 100 measurements (4.00%)
  3 (3.00%) high mild
  1 (1.00%) high severe

bench Utf8 (len = 10) (key encoding deserialization)
                        time:   [37.607 ns 37.725 ns 37.841 ns]
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) high mild

bench Utf8 (len = 10) (value encoding deserialization)
                        time:   [29.185 ns 29.248 ns 29.312 ns]
Found 4 outliers among 100 measurements (4.00%)
  4 (4.00%) high mild

bench Utf8 (len = 1000) (key encoding deserialization)
                        time:   [420.20 ns 421.55 ns 423.02 ns]
Found 6 outliers among 100 measurements (6.00%)
  4 (4.00%) high mild
  2 (2.00%) high severe

bench Utf8 (len = 1000) (value encoding deserialization)
                        time:   [80.090 ns 80.290 ns 80.497 ns]
Found 4 outliers among 100 measurements (4.00%)
  1 (1.00%) low mild
  2 (2.00%) high mild
  1 (1.00%) high severe

bench Utf8 (len = 10000) (key encoding deserialization)
                        time:   [17.046 µs 17.099 µs 17.153 µs]
Found 5 outliers among 100 measurements (5.00%)
  3 (3.00%) high mild
  2 (2.00%) high severe

bench Utf8 (len = 10000) (value encoding deserialization)
                        time:   [4.8609 µs 4.8743 µs 4.8883 µs]
Found 3 outliers among 100 measurements (3.00%)
  2 (2.00%) high mild
  1 (1.00%) high severe

bench Struct of Bool (len = 100) (key encoding deserialization)
                        time:   [2.2646 µs 2.2700 µs 2.2756 µs]
Found 4 outliers among 100 measurements (4.00%)
  2 (2.00%) high mild
  2 (2.00%) high severe

bench Struct of Bool (len = 100) (value encoding deserialization)
                        time:   [2.1774 µs 2.1841 µs 2.1914 µs]
Found 3 outliers among 100 measurements (3.00%)
  2 (2.00%) high mild
  1 (1.00%) high severe

bench List of Bool (len = 100) (key encoding deserialization)
                        time:   [1.2371 µs 1.2404 µs 1.2437 µs]
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild

bench List of Bool (len = 100) (value encoding deserialization)
                        time:   [2.1033 µs 2.1079 µs 2.1129 µs]
Found 5 outliers among 100 measurements (5.00%)
  4 (4.00%) high mild
  1 (1.00%) high severe

bench List of Bool (len = 100) (key encoding deserialization)
                        time:   [1.2371 µs 1.2404 µs 1.2437 µs]
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild

bench List of Bool (len = 100) (value encoding deserialization)
                        time:   [2.1033 µs 2.1079 µs 2.1129 µs]
Found 5 outliers among 100 measurements (5.00%)
  4 (4.00%) high mild
  1 (1.00%) high severe

This is intersting. Maybe it's caused by collecting of value refs. How about this?
https://github.com/risingwavelabs/risingwave/blob/2dbbbade9fc4386db8a0c66a84f3b0accbdb87a4/src/common/src/array/list_array.rs#L493-L497

bench List of Bool (len = 100) (key encoding deserialization)
                        time:   [1.2371 µs 1.2404 µs 1.2437 µs]
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild

bench List of Bool (len = 100) (value encoding deserialization)
                        time:   [2.1033 µs 2.1079 µs 2.1129 µs]
Found 5 outliers among 100 measurements (5.00%)
  4 (4.00%) high mild
  1 (1.00%) high severe

This is intersting. Maybe it's caused by collecting of value refs. How about this?
https://github.com/risingwavelabs/risingwave/blob/2dbbbade9fc4386db8a0c66a84f3b0accbdb87a4/src/common/src/array/list_array.rs#L493-L497

I'll try it locally first.

bench List of Bool (len = 100) (key encoding deserialization)
                        time:   [1.2371 µs 1.2404 µs 1.2437 µs]
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild

bench List of Bool (len = 100) (value encoding deserialization)
                        time:   [2.1033 µs 2.1079 µs 2.1129 µs]
Found 5 outliers among 100 measurements (5.00%)
  4 (4.00%) high mild
  1 (1.00%) high severe

This is intersting. Maybe it's caused by collecting of value refs. How about this?
https://github.com/risingwavelabs/risingwave/blob/2dbbbade9fc4386db8a0c66a84f3b0accbdb87a4/src/common/src/array/list_array.rs#L493-L497

Here is deserialization, and iter_elems_ref! is used for serialization.

I'm drunk 🍻. But it will be nice to use iter_elems_ref for serializing list & struct.

I'm drunk 🍻. But it will be nice to use iter_elems_ref for serializing list & struct.

but it's hard to get the length of the list before collecting.


text:
Python SSL: CERTIFICATE_VERIFY_FAILED for Mac (High Sierra) - SOLUTION - add this to WIKI!

What is the purpose of your issue?

[ ] Bug
[ ] Feature Request
[ ] Question
[x ] Other

Description
Wiki for Mac says to call pip/pip3 install -U spotdl but without this call pip/pip3 install --upgrade certifi You will get SSL: CERTIFICATE_VERIFY_FAILED while downloading tracks.
Log
ERROR: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1056)>
    Traceback (most recent call last):
      File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/urllib/request.py", line 1317, in do_open
        encode_chunked=req.has_header('Transfer-encoding'))
      File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1229, in request
        self._send_request(method, url, body, headers, encode_chunked)
      File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1275, in _send_request
        self.endheaders(body, encode_chunked=encode_chunked)
      File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1224, in endheaders
        self._send_output(message_body, encode_chunked=encode_chunked)
      File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1016, in _send_output
        self.send(msg)
      File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 956, in send
        self.connect()
      File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1392, in connect
        server_hostname=server_hostname)
      File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/ssl.py", line 412, in wrap_socket
        session=session
      File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/ssl.py", line 853, in _create
        self.do_handshake()
      File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/ssl.py", line 1117, in do_handshake
        self._sslobj.do_handshake()
    ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1056)

Yep, good idea! I'll also mention about #125 in FAQ.

I added this under FAQ.

authors: ritiek sephuxeresh

repo: ritiek/spotify-downloader


text:
Editing the digit doesn't work properly in Focus state of an Input field

Describe the Feature Request
When I enter the OTP and want to edit any digit, If I enter into the focus state by double-clicking the input field and try to edit that digit, it doesn't work. In the below sandbox example, it does nothing in the focus state but in some other use cases, it edits the next digit, and the focus also goes to any random place.
Link of the image with the referred focus state - https://drive.google.com/file/d/15wA4Cxq9HX8NrsVZ1MfeQAVSMt3WaREV/view?usp=sharing
CodeSandbox Link
Describe Preferred Solution

Issue Video
Sure, I've added the video of the error here. Let me walk you through the steps that lead to this issue:

Start by entering the One-Time Password (OTP) for all the fields.
Now, go to any input field and click on it to edit the digit. You'll see, just like in the video, you can change a digit, such as from '2' to '9.'
The problem arises when you try to double-click on an input field and reach to focus state to edit it further. It doesn't work. As shown in the video, trying multiple times to edit the number '3,' the field remains unfazed and doesn't let you make any changes.

In my opinion, the input field shouldn't show the focus state if it doesn't allow editing. Alternatively, it would be better if the system had a consistent behavior with 'one click and edit' in the focus state too for a smoother user experience.

Hi @prachi09051999 , there are a few things.
1: In your codesandbox, you are using react18-otp-input package while you should be using react18-input-otp
2: That's the reason, you are not able to update to version 1.1.4
3. Kindly update your codesandbox to use this package and the problem will be solved.

Re-open this ticket if you still face the issue.

Thank you very much for bringing this matter to my attention. It has greatly assisted me in identifying the actual problem.
The issue is related to the focus state when editing one input field, as it inadvertently affects the next input field, and the focus behavior becomes erratic, leading to unexpected results.
I am using the latest version available in Sandbox which is 1.1.3.

Sandbox Link
I would like to share a video illustrating the exact problem for further clarification. Your prompt attention to this matter is greatly appreciated.
https://github.com/ritikbanger/react18-input-otp/assets/34397111/d41bcec7-8a56-458c-abd7-67a3b6d278ea
Let me also add the steps to generate the issue -

Start by entering the One-Time Password (OTP) for all the fields.
Now, go to any input field and click on it to edit the digit. You'll see, just like in the video, you can change a digit, such as from '2' to '9.'
The actual problem arises when you try to double-click on an input field and reach to focus state to edit it further. It doesn't work. As shown in the video, trying to edit the number '3' to '8' leads to the alteration of the next digit '4' to '8', and the focus goes to the last field.

The behaviour is expected. If your cursor selects the field then the field will be edited. While if your cursor has not selected the field then it will update the nearest input field. If your cursor is on right on the input text then right side field would be edited, if your cursor is on left then left side field would be edited.
let me know your thoughts.

The cursor behavior when editing an input field should align with user expectations.
Currently, when the cursor is on the right of one field, but editing the next one, it confuses users. To improve, we can keep the cursor within the edited field only to enhance user experience and predictability.


text:
JSON to Immutable prop types

Should we do JSON to Immutable prop types ?
If yes, I would be happy to implement it!

I think if @ritz078 would like to implement it, it is better for it to be a checkbox in JSON to PropTypes section.

That would make more sense.

Thanks! I'll give it a shot!

@Raathigesh are you working on this ? Let me know if you are stuck somewhere.

I really did not look into it yet. Planning to work on it during the
weekend.
On Thu., 31 Aug. 2017, 6:05 pm Ritesh Kumar, notifications@github.com
wrote:

@Raathigesh https://github.com/raathigesh are you working on this ? Let
me know if you are stuck somewhere.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/ritz078/transform-www/issues/14#issuecomment-326221795,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AC9tQP9r7_nrnSadURCof9hAqDKQ7P_5ks5sdmk-gaJpZM4PDvg7
.

No problem.

authors: Raathigesh morajabi ritz078


text:
fix(clusters): update pools in dc-update

Changes

[!WARNING]
This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

#959  👈
#958
#950
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @NathanFlurry and the rest of your teammates on  Graphite

repo: rivet-gg/rivet


text:
Overwrite min_soc in generate_from_csv, if min_soc to low for next trip

In generate_from_csv there is no function yet to overwrite the min_soc, if it is to low for the next trip. If the next trip requires more energy than min_soc*capacity the desired_soc should be adjusted for this trip.
This function already exists in other generate-scripts: A warning like "1 trips use more than 30.0% capacity." appears.
This warning should also appear in generate_from_csv.py. If possible the warning could be extended to "X of XX trips use more than XX.X% capacity."

implemented in #97


text:
Update build.gradle

Adding maoni-slack provokes Graddle error saying that the khttp dependency is not found.
Khttp is no more accessible by the following link com.github.jkcclemens:khttp:0.1.0.
The new one is : khttp:khttp:0.1.0

Thanks @baudev !


text:
🛑 Micro.blog is down

In fe7b88f, Micro.blog (https://roberto.mateu.me) was down:

HTTP code: 404
Response time: 6508 ms

Resolved: Micro.blog is back up in 30d41cf.

repo: rmateu/statuspage


text:
feature request: inverse matches

In srcery-vim there is an option to inverse the colour of matches and match parenthesis of treesitter-highlight module or a / search:

Could you please add a similar feature to onenord? Because I think this can improve visibility of these matches.

I think this commit should do it!


text:
Relax uniqueness restriction on input to MaxPrioritySearchTree

The code requires all x values to be distinct and all y values to be distinct. This simplifies the algorithm code, but is an unnatural restriction.
Remove this restriction.

Note: x values must still be unique


text:
Gas formatter

The lookup variable is called "pu" for a double-meaning.   It's the "price/unit" and the code doesn't really smell very good because the unitBreakdown array is being built on every invocation.  Fixes #12

Oops.  Leaked another PR's changes into this one.   Figuring out how to fix it!

Abandoning in favor of one that isn't messed up!

repo: rndlabs/monSI


text:
Can't find loader utils

I get this error when trying to run the example

I think you can repro this following these steps (after fixing #1)
git clone https://github.com/rnons/elm-svg-loader.git
cd elm-svg-loader/examples
npm install
npm start

closed by #6

authors: JuanCaicedo rnons

repo: rnons/elm-svg-loader


text:
More Features

If you have any feature you would like let us know

Add a prop for weekStartDay.  Can use the Date day object index range.  For example:
<DatePicker
  value={value}
  locale="en-AU"
  weekStartDay={1}
/>

Should then display the calendar grid as:

Mon
Tue
Wed
Thu
Fri
Sat
Sun

1
2
3
4
5
6

7
8
9
10
11
12
etc

Oh cool

Implemented. Please Upgrade to version 0.4.1. You can also check it out on the Demo. Customize Dates no 4 and 5

repo: rnwonder/solid-date-picker


text:
how to edit ?

Hi,
I try to active editing of cells in the component but I don't understand how to active that ?  do you have an example ?
Thank you
S.

Sorry I'm just now getting to this. Started a new job and haven't had any time to work on open source stuff.
Looks like there was a bug not allowing the grid to go into "editable" mode, but it should be fixed in 0.1.39
Also added an example to the README documentation.

repo: rob-white/vue-slimgrid


text:
preexec causing borked output

This line in .oh-my-zsh/lib/termsupport.zsh is causing unexpected output to appear:
title "$CMD" "%100>...>$2%<<"

Without commenting out that line, this is the (incorrect) output from awk:
$ printf "foo\nbar\n" | awk '{printf "%s\n", $1}'
[m\n", printf}'foo
bar

With that line commented out, this is the (correct) output:
$ printf "foo\nbar\n" | awk '{printf "%s\n", $1}'
foo
bar

Closing - looks like a duplicate of #890.

repo: robbyrussell/oh-my-zsh


text:
Add Cloudflare

What is the vendor's name?
Cloudflare
What is the vendor's pricing site?
https://www.cloudflare.com/en-gb/plans/
What is the base pricing? Use the lowest tier that looks sane for a small business customer, not free or personal tiers.
Pro is $20/month.
What is the minimum pricing for SSO support?
Enterprise (for SSO) is "call us" from experience its in the region of $2.5k+ per month!
Does this pricing info come from a quote or other non-public source?
Pro pricing is public, Enterprise from quote over a year ago for my org
Are there any caveats we should list in the footnotes?
No RBAC control until enterprise plans either. Makes it impossible to safely share domain management with 3rd party suppliers to my org.

Resolved by #199

authors: gazwilliams robchahin

repo: robchahin/sso-wall-of-shame


text:
Is it able to decode other language such as Chinese

New to python but I think it's having issue decoding Chinese, need encoding="utf-8" maybe?:
Error:
return codecs.charmap_decode(input,self.errors,decoding_table)[0]
UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 121: character maps to

Did the error say which line was causing the problems?  I don't think I've ever tried it on Chinese characters / Kanji etc.
Also, which python version are you using?

I am running on python 3.8 but had try 3.9 too. Thanks a bunch

Hi! Same problem trying to use your script, Python 3.7.6, and books in English and Spanish:
Traceback (most recent call last):   File "KindleClippings.py", line 116, in <module>     parse_clippings(source_file, destination)   File "KindleClippings.py", line 57, in parse_clippings     for highlight in f.read().split("=========="):   File "d:\Miniconda3\lib\encodings\cp1252.py", line 23, in decode     return codecs.charmap_decode(input,self.errors,decoding_table)[0] UnicodeDecodeError: 'charmap' codec can't decode byte 0x9d in position 1589: character maps to <undefined>
Thanks

Hi @aiturri,
Thanks for raising this. Would it be possible for you to share the part of the clipping file that is causing the errors? I'd love to try and fix this but can't reproduce the error.
Best,
Robert

Sure!
Thanks in advance!
My Clippings - Copy.txt

Hi @robertmartin8 , I tried again, and still not working:
Traceback (most recent call last):
File "KindleClippings.py", line 116, in
parse_clippings(source_file, destination)
File "KindleClippings.py", line 88, in parse_clippings
outfile.write(clipping_text + "\n\n...\n\n")
File "d:\Miniconda3\lib\encodings\cp1252.py", line 19, in encode
return codecs.charmap_encode(input,self.errors,encoding_table)[0]
UnicodeEncodeError: 'charmap' codec can't encode character '\u03c3' in position 142: character maps to
I will attach here my original clippings file so you can try, but I will delete as soon as you download it (please, let me know so I can delete (for privacy reasons!))
Thanks again!
My Clippings.zip

@aiturri OK, I've downloaded it. Feel free to remove

@aiturri still can't reproduce it – I can parse your file accents and all. I think it's a mac/windows issue.
Can you try again? I forgot to add encoding="utf8" to a couple of the file opens.

@robertmartin8
_Traceback (most recent call last):
File "KindleClippings.py", line 117, in
parse_clippings(source_file, destination)
File "KindleClippings.py", line 82, in parse_clippings
current_text = textfile.read()
File "d:\Miniconda3\lib\codecs.py", line 322, in decode
(result, consumed) = self.buffer_decode(data, self.errors, final)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0x92 in position 472: invalid start byte

@aiturri Ok it seems this is related to a particular windows encoding. Other people seem to have had the same issue.
(Please save your clippings file beforehand just in case)
I've put two fixes: the first just ignores the errors – have a go and see whether it works (the output might be garbled).
The second is a new argument to specify the encoding:
python KindleClippings.py -encoding=cp1252

It might solve your problem?


text:
Can't find CVAR optimization in the module

Hello! I can't find value at risk function described here: https://pyportfolioopt.readthedocs.io/en/latest/OtherOptimisers.html#pypfopt.value_at_risk.CVAROpt
It says "AttributeError: module 'pypfopt' has no attribute 'value_at_risk'"
How can I use CVAR optimization within this pypfopt module?
Thanks!

Hi, thanks for raising the issue. The CVaR optimisation is currently broken, I will be removing it from PyPortfolioOpt soon until I can figure out how to properly fix it (see #5)


text:
🛑 Temasili is down

In bc35d61, Temasili (https://temasili.dgdc.unam.mx) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Temasili is back up in 6549bc1 after 34 minutes.

repo: robertormzg/upptime-dgdc


text:
docs: fix typo in README.md

🤡

Oops!

authors: orhun robertpsoane

repo: robertpsoane/ducker


text:
0auth not refreshing

I'm encountering an issue with 0auth not refreshing on subsequent initializations.
Code being executed:

from pyrh import Robinhood, load_session, dump_session
from pyrh.models import SessionManager

try:
    load_session("./login.json")
    print("Loading previous session")
except:
    rh = Robinhood(username="xxx@xxx.com", password="12345")
finally:
    sm = SessionManager(username="xxx@xxx.com", password="12345")
    sm.login(force_refresh=True)
    print("Updating session")
    dump_session(sm, "./login.json")
    print("Saving updated session")
    print(sm)

login.json output on the first initialization with mfa

{
    "expires_at": "2022-12-07T11:14:23.234234+00:00",
    "challenge_type": "sms",
    "oauth": {
        "access_token": "ALKAJW3LJL3ASDLMKKLASsaldkfjalsdfai939afalj339a9dujs",
        "refresh_token": "33KL32AMCADA9IDSA9",
        "expires_in": 813842
    },
    "password": "12345",
    "device_token": "a3adsj345-e9w3-323a-a4a3-32lkj32ha8",
    "username": "xxx@xxx.com"
}

login.json output on next execution

{
    "username": "xxx@xxx.com",
    "expires_at": "1970-01-01T00:00:00+00:00",
    "challenge_type": "sms",
    "oauth": {},
    "password": "12345",
    "device_token": "dslak3lj2342-e234-14ls-3k39-jlf9sd93wlk39"
}

Where I'm at and what I'm attempting
After initialization with mfa, there is a 0auth token in the saved credentials, and the next execution is able to login fine and bypass unnecessary mfa.  However, the login() function appears to not be refreshing the 0auth, even when the force_refresh is set to True.  Thus on the third execution, it defaults back to mfa.
I'm looking at the pyrh methods to see where something might be amiss, but as of yet I haven't found anything obvious.  Apologies if I'm merely looking over something.

I've resolved this issue by implementing OTP verification in pyrh itself and made a pull request.

This will land when I cut the next release of pyrh, until then feel free to install from master

authors: RobertAgee adithyabsk

repo: robinhood-unofficial/pyrh


text:
engine: Add a test that fetches stylesheets in parallel

This exercises the multithreading in //engine so tsan can detect any
potential errors.

Looking at this, I wonder if it wouldn't be a better idea to use non-blocking IO instead of threading. Thoughts?

repo: robinlinden/hastur


text:
Is there a way to put the password in the url and auto login?

This would be useful for sending out a private link to friends that could automatically log them in because the password is a url parameter! Is this possible?

Thanks for the suggestion, could be interesting! I don't want to allow having the password in plaintext in the URL though, so it would be hashed just like the way it's stored in localStorage when checking "remember me".
What I'm thinking as an interface would be staticrypt --share [optional url] MY_PASSWORD, and that outputs something like [example.com/foo/bar]?staticrypt_pwd=<hashed_password> you can share to auto-decrypt the page. A GUI would have been nice but I don't think it makes sense on the html password prompt.
Would that fit your use case? Any feedback (from yourself or anyone) is welcome.

Yes that would work! Thank you!

Would be a wonderful feature! Would help us when using staticrypt in the classroom to protect mock math tests.

Staticrypt new 2.2 release now includes the --share flag - when you encrypt something and include this flag, it will output the shareable URL (or just the query param ?staticrypt_pwd=<hashed_password> if you don't include your URL).
You have to encrypt a file to display the URL which feels a bit clumsy - staticrypt v3 will both include WebCrypto and do revamp of the CLI parameters, which will allow something like
staticrypt -p <my_password> --share <my_optional_url>

without having to actually encrypt a file just to get the share URL, but this is a breaking change so it will have to wait the next version bump.
Thanks for opening the issue, let me know if there's anything else on that topic!

The decryption logic has been updated on that release, it shouldn't break existing functionality on custom password templates but this new share feature depends on the new logic.
So if you where using a custom password template the share feature will require you to update it.

Awesome!

authors: dillfrescott oleteacher robinmoisson

repo: robinmoisson/staticrypt


text:
Acces to Local Path is denied

Hi Robin,
I'm having a problem trying to download to local path Using " ftpClient.DownloadFile",
The error I get is:
System.UnauthorizedAccessException: Access to the path 'C:\Users\my user' is denied.
Regards,
Trevor Pitse.

OH wow! I'm sorry but I've tried already tried downloading to other folders and thought you could help.

What input arguments are you using??

Try downloading to another drive, sometimes C drive has tight security...

I was downloading to a folder on the desktop then I tried using a removable disk "G:/" but I still can't access the file system.

I'm using (local path, remote path) as my parameters.

Why don't you search stackoverflow for the error that you are getting, because it's nothing to do with this lib.

@robinrodricks I've been searching up and down but I'll keep trying stackoverflow,
Thanks.

Your issue is very confusing and indicates that your app does not have file
system permissions. Try writing a file with File.WriteAllText (not sure
about the name of the method, but similar) and see if that works first...
On 26 Sep 2017 8:03 pm, "TrevorPremium" notifications@github.com wrote:

@robinrodricks https://github.com/robinrodricks I've been searching up
and down but I'll keep trying stackoverflow,
Thanks.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/robinrodricks/FluentFTP/issues/205#issuecomment-332218101,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AGe6KgMjILhJ7GHZ_Fdi-QxlxsXjnV9vks5smQsfgaJpZM4PkOzY
.

@robinrodricks  let me try that and see if it works.

@robinrodricks I used StreamWriter to create a txt file and write to it and it did work, I don't understand how Download file doesn't have the correct permissions.

I have the same sence with Bro TrevorPremium,....  Still  not resolved ?

I have the same sence with Bro TrevorPremium,....  Still  not resolved ?

problem...,, sorry  ,I used a  wrong word

problem...,, sorry  ,I used a  wrong word

ahah, I got the reason,  your argument  'localPath'  with DownloadFile()    missing the last fileName block.
It must be a FullPath with filename, could not be a  directory path.

ahah, I got the reason,  your argument  'localPath'  with DownloadFile()    missing the last fileName block.
It must be a FullPath with filename, could not be a  directory path.

ahah, I got the reason, your argument 'localPath' with DownloadFile() missing the last fileName block.
It must be a FullPath with filename, could not be a directory path.

This is what got me. I was first testing with DownloadFilesAsync, then realized I needed more logging so I was going to iterate over the list myself, and changed it to DownloadFileAsync, not realizing the hints changed from localDir to localPath. Though even that subtle word change could still be interpreted as the same thing.
Maybe we need it to be something like localFullPathWithFilename for the slightly less observant :)

Wade can you create a new issue for this please. I will work on it.
On Thu, Apr 1, 2021, 7:42 PM Wade @.***> wrote:

ahah, I got the reason, your argument 'localPath' with DownloadFile()
missing the last fileName block.
It must be a FullPath with filename, could not be a directory path.
This is what got me. I was first testing with DownloadFilesAsync, then
realized I needed more logging so I was going to iterate over the list
myself, and changed it to DownloadFileAsync, not realizing the hints
changed from localDir to localPath. Though even that subtle word change
could still be interpreted as the same thing.
Maybe we need it to be something like localFullPathWithFilename for the
slightly less observant :)
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/robinrodricks/FluentFTP/issues/205#issuecomment-811936601,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABT3UKXDRDBDEY2ZTWKE4DLTGR5ONANCNFSM4D4Q5TMA
.

authors: TrevorPremium WadeTheFade robinrodricks ym9288

repo: robinrodricks/FluentFTP


text:
Adduct / ion type validation

I have some Python scripts for adduct validation and will port them over.
All these should be valid?

M+H
M + H
[M+H]
[M+H]+

SIRIUS uses NH3+H

M+NH4+
[M+NH4]+
[M+NH3+H]+

I once started a table to have synonyms for adducts from different software tools. Need to find it. Could be of interest. This was something I always wanted to add to the MetaboCoreUtils R package

https://docs.google.com/spreadsheets/d/1r4dPw1shIEy_W2BkfgPsihinwg-Nah654VlNTn8Gxo0/edit?usp=sharing

Maybe a good case for going for the participant to provide the neutral molecular formula.

authors: lfnothias michaelwitting robinschmid


text:
schema.org/JobPosting support

Adding schema.org compatibility to careers/templates/careers/jobpost_detail.html
The markup is located at:
http://schema.org/JobPosting

pull request?

authors: robmoggach teolemon

repo: robmoggach/mezzanine-careers


text:
Bugfix: dropForeignKey SQLite adapter

Removing a foreign key with SQLite adapter caused the table to be removed. Also the create syntax left out the original column.

Thank you!

authors: boedy shadowhand

repo: robmorgan/phinx


text:
Changes to internal utility functions and classes

This issue tracks  changes to internal utility functions, classes, etc. in the robot.utils package in RF 3.0.

Changed
Replacement
Comment

decode_output
console_decode

encode_output
console_encode

decode_from_system
system_decode

encode_to_system
system_encode

html_attr_escape
attribute_escape
Replacement has been available since RF 2.8.

Related to this, unnecessary aliases where removed from robot.utils.asserts as part of #2202.

There are no more changes planned so I'll close this issue. Possible changes can still be added here later.

Result related model objects TestSuite, TestCase, Keyword and Message were moved to common robot.result.model module. Old robot.result.(testsuite|testcase|keyword|message) modules have been removed. See 1622eea for details.

http://askubuntu.com/questions/614657/install-gnome-desktop-ubuntu-15-04
sudo apt-get install ubuntu-gnome-desktop
sudo service gdm restart
http://www.techrepublic.com/blog/linux-and-open-source/how-to-install-gnome-38-on-ubuntu/
sudo add-apt-repository ppa:gnome3-team/gnome3
sudo apt-get update && sudo apt-get install gnome-shell ubuntu-gnome-desktop
On 21 December 2015 at 22:58, Pekka Klärck notifications@github.com wrote:

Result related model objects TestSuite, TestCase, Keyword and Message
were moved to common robot.result.model module. Old
robot.result.(testsuite|testcase|keyword|message) modules have been
removed. See 1622eea
https://github.com/robotframework/robotframework/commit/1622eea636fd8241081aef89dad101b6813bc1a4
for details.
—
Reply to this email directly or view it on GitHub
https://github.com/robotframework/robotframework/issues/2200#issuecomment-166448119
.

repo: robotframework/robotframework


text:
Accessing nested dictionaries returns empty bytes type

That's a pretty hard-to-reproduce issue here.
The problem is that I cannot access a nested dict element by typing:
${dict['key1']['key2']}
But there is no problem with:
${sub_dict}=  Get From Dictionary  ${dict['key1']}  key2
The issue seems to be a huge bad luck, because whenever I add/remove/change any letter from 'key1' string, everything works fine. Could you please check this?
PS: The only difference between 2 logs.html is last letter in dict key.
Best regards
Michał Szajkowski
Nokia Solutions and Networks
logs.zip

Found the source of the problem. It's not framework's fault.