text:
Inputstream-helper 0.7.0 fails to install/update widevine [Erro N 02] no such file or directory

Hi
The newest version of Inputstream-helper 0.7.0 fails to install/update Widevine on the latest nightly of Libreelec.
A message saying that [Erro N 02] no such file or directory is displayed.

Log is below:
https://paste.libreelec.tv/easy-colt.log
Please, let me know if I can be of any more help
Regards.

Hi!
I am not sure why this would happen. Did you manually remove any backups at one point? This exception should definitely be caught gracefully though.
Can you try with commit https://github.com/emilsvennesson/script.module.inputstreamhelper/commit/8a3bdd9b0ecf787bbdeb421936ce60a705b863c7?

Hi!
I am not sure why this would happen. Did you manually remove any backups at one point? This exception should definitely be caught gracefully though.
Can you try with commit https://github.com/emilsvennesson/script.module.inputstreamhelper/commit/8a3bdd9b0ecf787bbdeb421936ce60a705b863c7?

Hi
Thanks for the quick reply.
I'm the one who reported the distills issue on the 0.6.x version that you fixed by releasing the 0.7.0.
Only today did the newest version of Inputstream-helper appear as an update to be installed.
Then I went to try to test it and found this issue I just reported. Before coming here I tried to troubleshoot this by removing widevine and manually installing using the Inputstream-helper menu to no avail.
About the commit I'm afraid unless you can provide me a newer version that can be manually installed by my end I can't do much of that information alone.
I am here to help if you see another way I can before debugging this.

It should be possible to install from .zip using: https://github.com/emilsvennesson/script.module.inputstreamhelper/archive/8a3bdd9b0ecf787bbdeb421936ce60a705b863c7.zip

It should be possible to install from .zip using: https://github.com/emilsvennesson/script.module.inputstreamhelper/archive/8a3bdd9b0ecf787bbdeb421936ce60a705b863c7.zip

I'm having a different behavior now.
I installed the zip version with the commit. Then I removed widevine from the Inputstream-helper menu. Then reinstalled it.
It went almost to the end of the progression bar when it got stucked. My Libreelec didn't crash.
I wait a little more. Then I SSH'd to make a copy of the kodi.log and to my surprise the file size is already in the 640MB and it keeps growing.
Any suggestions?

Hmm, is the file size of kodi.log 640MB?

Hmm, is the file size of kodi.log 640MB?

Greater then that. I was able to make a copy and compressed it to 5MB.
If you are interested here it is.
https://mega.nz/file/RtICTLZL#CyY37uXQOeLhARIvrOekje7BoBorl0alQGZL5X_s_vU

Hmm, is the file size of kodi.log 640MB? What does tail -n 20 kodi.log show?

I did it all over again.
Here's is the output of tail -n 20 Kodi.log
2024-10-05 16:12:10.914 T:1424  critical : [script.module.inputstreamhelper] Error removing tree: [Errno 2] No such file or directory: '/storage/.kodi/userdata/addon_data/script.module.inputstreamhelper/backup/15699.72.0.0'
2024-10-05 16:12:10.914 T:1424    debug : [script.module.inputstreamhelper] Removing oldest backup which is not installed: 15699.72.0.0
2024-10-05 16:12:10.914 T:1424  critical : [script.module.inputstreamhelper] Error removing tree: [Errno 2] No such file or directory: '/storage/.kodi/userdata/addon_data/script.module.inputstreamhelper/backup/15699.72.0.0'
2024-10-05 16:12:10.914 T:1424    debug : [script.module.inputstreamhelper] Removing oldest backup which is not installed: 15699.72.0.0
2024-10-05 16:12:10.915 T:1424  critical : [script.module.inputstreamhelper] Error removing tree: [Errno 2] No such file or directory: '/storage/.kodi/userdata/addon_data/script.module.inputstreamhelper/backup/15699.72.0.0'
2024-10-05 16:12:10.915 T:1424    debug : [script.module.inputstreamhelper] Removing oldest backup which is not installed: 15699.72.0.0
2024-10-05 16:12:10.915 T:1424  critical : [script.module.inputstreamhelper] Error removing tree: [Errno 2] No such file or directory: '/storage/.kodi/userdata/addon_data/script.module.inputstreamhelper/backup/15699.72.0.0'

Please try with https://github.com/emilsvennesson/script.module.inputstreamhelper/archive/refs/heads/catch-fnf-error.zip.
Also, could you please give me the output of ls -la /storage/.kodi/userdata/addon_data/script.module.inputstreamhelper/backup?

Run the ls command before trying the new .zip, because that might remove what I am looking for haha!

Run the ls command before trying the new .zip, because that might remove what I am looking for haha!

I hope it's not too late.
I had already updated the .zip file but didn't executed.
Here's it;
LibreELEC (community): nightly-20241005-8b22d03 (RPi5.aarch64)
LibreELEC:~ # ls -la /storage/.kodi/userdata/addon_data/script.module.inputstreamhel
per/backup?
ls: /storage/.kodi/userdata/addon_data/script.module.inputstreamhelper/backup?: No such file or directory
LibreELEC:~ #

Sorry. I made an obvious error on the previous one.
Here's it:
LibreELEC:~ # ls -la /storage/.kodi/userdata/addon_data/script.module.inputstreamhelper/backup
total 8
drwxr-xr-x    8 root     root          1024 Oct  5 14:14 .
drwxr-xr-x    4 root     root          1024 Oct  5 16:04 ..
drwxr-xr-x    2 root     root          1024 Apr 16 20:26 15699.72.0
drwxr-xr-x    2 root     root          1024 Apr 20 00:14 15786.48.0
drwxr-xr-x    2 root     root          1024 May 26 20:23 15823.60.0
drwxr-xr-x    2 root     root          1024 Jul  3 19:22 15886.44.0
drwxr-xr-x    2 root     root          1024 Sep  3 23:52 15917.71.0
drwxr-xr-x    2 root     root          1024 Oct  5 14:14 15964.59.0
LibreELEC:~ #

Can I proceed with the test of the newest version?

Thanks! Yes, please do. :-)

I believe widevine west successfully installed.
However I have no video. Only the loading icon.
No sound either.
Here's the output from tail:
LibreELEC:~/.kodi/temp # tail -n 20 kodi.log
2024-10-05 16:40:30.519 T:1546     info : Skipped 9475 duplicate messages..
2024-10-05 16:40:30.519 T:1546    debug : CVideoPlayerVideo - video decoder returned error
2024-10-05 16:40:33.036 T:1347     info : Skipped 2384 duplicate messages..
2024-10-05 16:40:33.036 T:1347    debug : CheckIdle - Closing session to http://127.0.0.1 (easy=0x7ffe847774b0, multi=0x7ffe842da870)
2024-10-05 16:40:33.036 T:1546    debug : CVideoPlayerVideo - video decoder returned error
2024-10-05 16:40:33.670 T:1540     info : Skipped 601 duplicate messages..
2024-10-05 16:40:33.670 T:1540    debug : Thread JobWorker 140731368943232 terminating (autodelete)
2024-10-05 16:40:33.671 T:1546    debug : CVideoPlayerVideo - video decoder returned error
2024-10-05 16:40:34.036 T:1347     info : Skipped 346 duplicate messages..
2024-10-05 16:40:34.036 T:1347    debug : CheckIdle - Closing session to https://ipv4-c004-ssa001-itsbrasil-isp.1.oca.nflxvideo.net (easy=0x7ffe84813e10, multi=0x7ffe848152b0)
2024-10-05 16:40:34.037 T:1546    debug : CVideoPlayerVideo - video decoder returned error
2024-10-05 16:40:34.038 T:1347    debug : CheckIdle - Closing session to https://ipv4-c004-ssa001-itsbrasil-isp.1.oca.nflxvideo.net (easy=0x7ffe80068d00, multi=0x7ffe80013050)
2024-10-05 16:40:34.038 T:1546    debug : CVideoPlayerVideo - video decoder returned error
2024-10-05 16:40:34.040 T:1347     info : Skipped 1 duplicate messages..
2024-10-05 16:40:34.040 T:1347    debug : CheckIdle - Closing session to https://ipv4-c002-ssa001-itsbrasil-isp.1.oca.nflxvideo.net (easy=0x7ffe2915c640, multi=0x7ffe290ad9e0)
2024-10-05 16:40:34.041 T:1546    debug : CVideoPlayerVideo - video decoder returned error
2024-10-05 16:40:44.042 T:1546     info : Skipped 9480 duplicate messages..
2024-10-05 16:40:44.042 T:1546    debug : CVideoPlayerVideo - video decoder returned error
2024-10-05 16:40:54.042 T:1546     info : Skipped 9474 duplicate messages..
2024-10-05 16:40:54.042 T:1546    debug : CVideoPlayerVideo - video decoder returned error
LibreELEC:~/.kodi/temp #
Any ideas?

No idea. I am afraid you would have to report playback issues to the Netflix Kodi maintainers. :/
Could you also please test to do an install from https://github.com/emilsvennesson/script.module.inputstreamhelper/archive/refs/heads/ver-parsing.zip? I hope this fixes the real issue (see https://github.com/emilsvennesson/script.module.inputstreamhelper/pull/577).

No idea. I am afraid you would have to report playback issues to the Netflix Kodi maintainers. :/
Could you also please test to do an install from https://github.com/emilsvennesson/script.module.inputstreamhelper/archive/refs/heads/ver-parsing.zip? I hope this fixes the real issue (see https://github.com/emilsvennesson/script.module.inputstreamhelper/pull/577).

I will do it
Just to report more correctly. This issue I mentioned last it only happens when I try to resume a title.
It plays perfectly when playing from the beginning.
I will let you know if something new appears after I install this last version.

No idea. I am afraid you would have to report playback issues to the Netflix Kodi maintainers. :/
Could you also please test to do an install from https://github.com/emilsvennesson/script.module.inputstreamhelper/archive/refs/heads/ver-parsing.zip? I hope this fixes the real issue (see https://github.com/emilsvennesson/script.module.inputstreamhelper/pull/577).

I removed Widevine from the Inputstream-helper menu.
Rebooted my Pi5/Libreelec Piers Nightly
From the Netflix addon I try to play a title and the Inputstream-helper addon took over the job as always did and finished the job like it used to.
Playback starts.
It seems solved.
Does it look the same for you?
Is there any more I can do?

Thank you! Can you do another ls -la /storage/.kodi/userdata/addon_data/script.module.inputstreamhelper/backup? The 15699.72.0.0 folder should hopefully have been removed now.

Thank you! Can you do another ls -la /storage/.kodi/userdata/addon_data/script.module.inputstreamhelper/backup? The 15699.72.0.0 folder should hopefully have been removed now.

LibreELEC:~ # ls -la /storage/.kodi/userdata/addon_data/script.module.inputstreamhel
per/backup
total 7
drwxr-xr-x    7 root     root          1024 Oct  5 17:11 .
drwxr-xr-x    3 root     root          1024 Oct  5 17:11 ..
drwxr-xr-x    2 root     root          1024 Apr 20 00:14 15786.48.0
drwxr-xr-x    2 root     root          1024 May 26 20:23 15823.60.0
drwxr-xr-x    2 root     root          1024 Jul  3 19:22 15886.44.0
drwxr-xr-x    2 root     root          1024 Sep  3 23:52 15917.71.0
drwxr-xr-x    2 root     root          1024 Oct  5 14:14 15964.59.0
LibreELEC:~ #

Thank you! A fix for this issue will be included in 0.7.1.
Regarding the playback issues on Netflix; this is probably an issue in inputstream.adaptive, so I'd suggest you search on that Github repo for similar issues.

Thank you! A fix for this issue will be included in 0.7.1.
Regarding the playback issues on Netflix; this is probably an issue in inputstream.adaptive, so I'd suggest you search on that Github repo for similar issues.

I'm truly grateful I could assist in resolving this issue.
Regarding the playback issue, I've already submitted a ticket to the Netflix Addon repository while waiting for your recent responses. You can find it here: https://github.com/CastagnaIT/plugin.video.netflix/issues/1722.
I’ll await a reply from the developer, who I believe is the same for both repositories.
If it's not too much trouble, I would sincerely appreciate it if you could kindly put in a word on our behalf, as early adopters of Kodi Piers. Your support would mean a lot to us.

Exactly the same problem here, but I am failing at

It should be possible to install from .zip using: https://github.com/emilsvennesson/script.module.inputstreamhelper/archive/8a3bdd9b0ecf787bbdeb421936ce60a705b863c7.zip

The zip contains a version of the inputstream helper addon, does it? I try to install via kodi's system menu, "Install addon from zip", but this makes kodi hang immediately and completely. Anything I am missing?

I managed to install 8a3bdd9b0ecf787bbdeb421936ce60a705b863c7.zip. I won't tell you why I failed the first time, because that is too embarrassing.
This version didn't get the inputstream driver, but the reason seems to be another one. Here's the log:
https://paste.libreelec.tv/sweeping-cattle.log .
ver-parsing.zip didn't work neither, but I can't create a log right now.

@joesse That's issue #581, which I fixed in master just a minute ago.
@emilsvennesson please rebase.

@joesse You can test this zip:
script.module.inputstreamhelper-0.7.0-HEAD-ab2d68b.zip

script.module.inputstreamhelper-0.7.0-HEAD-ab2d68b.zip has worked, thank you so much!

Thank you! A fix for this issue will be included in 0.7.1.

When is 0.7.1 likely to be released?

authors: emilsvennesson hbbernardo horstle joesse r8474


text:
Allow moving the search bar

In some chest mods they have chests that are so big that the hop bar is under the search bar it would be nice if there was a setting to move the search bar to the right

There is one, "center search bar"

I've been trying to figure out if you could do this or not I suggest making a little more clear in the config menu on what that setting does

Super glad I found this but yeah this option isn't obvious whatsoever. I found this thread by googling, which brought me to the EMI discord (from what I've seen there is no user wiki, just a dev wiki and a modpack dev wiki), the discord server managed to link back to this github issue but for whatever reason google couldn't, then bingo.
The setting really shouldn't be a true/false option. Makes it super not clear what that config does. For anyone else searching for the answer, setting "center search bar" config to true puts it in the bottom center (self explanatory) and setting to false puts it into the bottom right (this is the option that's not clear).

source: gharchive/issue

repo: emilyploszaj/emi

license: MIT

license_type: permissive

license_source: github-api


text:
[SM9/BN256] Special square in final exponentiation

Discussed in https://github.com/emmansun/gmsm/discussions/138

Originally posted by emmansun July  5, 2023
References:

Fast Squaring in the Cyclotomic Subgroup
dclxvi

// 这个是四次扩域上的平方
// Implicit fp4 squaring for Granger/Scott special squaring in final expo
// fp4e_square takes two fp2e op1, op2 representing the fp4 element
// op1*z^3 + op2, writes the square to rop1, rop2 representing rop1*z^3 + rop2.
// (op1*z^3 + op2)^2 = (2*op1*op2)*z^3 + (op1^2*xi + op2^2).
void fp4e_square(fp2e_t rop1, fp2e_t rop2, const fp2e_t op1, const fp2e_t op2)
{
  fp2e_t t1, t2;

  fp2e_square(t1, op1);		// t1 = op1^2
  fp2e_square(t2, op2);		// t2 = op2^2

  //fp2e_mul(rop1, op1, op2);    // rop1 = op1*op2
  //fp2e_add(rop1, rop1, rop1);  // rop1 = 2*op1*op2
  fp2e_add(rop1, op1, op2);
  fp2e_short_coeffred(rop1);
  fp2e_square(rop1, rop1);
  fp2e_sub2(rop1, t1);
  fp2e_sub2(rop1, t2);		// rop1 = 2*op1*op2

  fp2e_mulxi(rop2, t1);		// rop2 = op1^2*xi
  fp2e_add2(rop2, t2);		// rop2 = op1^2*xi + op2^2
}

// Special squaring for use on elements in T_6(fp2) (after the
// easy part of the final exponentiation. Used in the hard part
// of the final exponentiation. Function uses formulas in
// Granger/Scott (PKC2010).
void fp12e_special_square_finexp(fp12e_t rop, const fp12e_t op)
{
  fp2e_t f00, f01, f02, f10, f11, f12;
  fp2e_t t00, t01, t02, t10, t11, t12, t;
  fp6e_t f0, f1;

 // 对应表
 // m_a->m_a <-> x.x
 // m_a->m_b <-> z.x
 // m_a->m_c <-> y.y
 // m_b->m_a <-> y.x
 // m_b->m_b <-> x.y
 // m_b->m_c <-> z.y
  fp4e_square(t11, t00, op->m_a->m_b, op->m_b->m_c); // a.b 对应1-2-4-12扩域上的z.x，b.c对应1-2-4-12扩域上的z.y，所以也就是z^2
  fp4e_square(t12, t01, op->m_b->m_a, op->m_a->m_c); // b.a 对应1-2-4-12扩域上的y.x，a.c对应1-2-4-12扩域上的y.y，所以也就是y^2
  fp4e_square(t02, t10, op->m_a->m_a, op->m_b->m_b);// a.a 对应1-2-4-12扩域上的x.x，b.b对应1-2-4-12扩域上的x.y，所以也就是x^2

 // (t02, t10) = x^2 * xi
  fp2e_mulxi(t, t02);
  fp2e_set(t02, t10);
  fp2e_set(t10, t);

 // (f11, f00) = -2 * z'
 // (f12, f01) = -2 * x'
 // (f02, f10) = -2 * y'
  fp2e_mul_scalar(f00, op->m_b->m_c, -2);  // f00 = -2 * z.y
  fp2e_mul_scalar(f01, op->m_b->m_b, -2); // f01 = -2 * x.y
  fp2e_mul_scalar(f02, op->m_b->m_a, -2); // f02 = -2 * y.x
  fp2e_double(f10, op->m_a->m_c);   // f10 = 2 * y.y
  fp2e_double(f11, op->m_a->m_b);  // f11 = 2 * z.x
  fp2e_double(f12, op->m_a->m_a); // f12 = 2 * x.x

// (t11, t00) = 3 * z^2
// (t12, t01) = 3 * y^2
// (t02, t10) = 3 * x^2 * xi
  fp2e_triple2(t00);
  fp2e_triple2(t01);
  fp2e_triple2(t02);
  fp2e_triple2(t10);
  fp2e_triple2(t11);
  fp2e_triple2(t12);

 // (f11, f00) = 3 * z^2 - 2 * z'
 // (f12, f01) = 3 * y^2 - 2 * x'
 // (f02, f10) =  3 * x^2 * xi - 2 * y'
  fp2e_add2(f00, t00);
  fp2e_add2(f01, t01);
  fp2e_add2(f02, t02);
  fp2e_add2(f10, t10);
  fp2e_add2(f11, t11);
  fp2e_add2(f12, t12);

 // rop.b.a = f02 = y.x
 // rop.b.b = f01 = x.y
 // rop.b.c = f00 = z.y
 // rop.a.a = f12 = x.x
 // rop.a.b = f11 = z.x
 // rop.a.c = f10 = y.y
  fp6e_set_fp2e(f0, f02, f01, f00);
  fp6e_short_coeffred(f0);
  fp6e_set_fp2e(f1, f12, f11, f10);
  fp6e_short_coeffred(f1);
  fp12e_set_fp6e(rop, f1, f0);
}
```</div>

goos: windows
goarch: amd64
pkg: github.com/emmansun/gmsm/sm9
cpu: Intel(R) Core(TM) i5-8265U CPU @ 1.60GHz
BenchmarkGenerateSignPrivKey-8      	   17029	     62147 ns/op	     944 B/op	      14 allocs/op
BenchmarkGenerateEncryptPrivKey-8   	   10000	    128013 ns/op	    1072 B/op	      14 allocs/op
BenchmarkSign-8          	    4308	    252621 ns/op	    3376 B/op	      34 allocs/op
BenchmarkVerify-8        	    1407	    872257 ns/op	    4776 B/op	      35 allocs/op
BenchmarkEncrypt-8       	    3628	    276933 ns/op	    4447 B/op	      35 allocs/op
BenchmarkDecrypt-8       	    1953	    614789 ns/op	    2964 B/op	      17 allocs/op
BenchmarkDecryptASN1-8   	    1962	    626702 ns/op	    2984 B/op	      19 allocs/op

repo: emmansun/gmsm


text:
triplising the contents of this repo

@marc-portier will fill in the details here, but there is a request to triplise the contents of this repo, esp to get the info in the files in https://github.com/emo-bon/sequencing-data/tree/main/shipment/batch-001 into triples
of course, @laurianvm and @kmexter worked on incorporating this omics metadata into the emobon data model, so perhaps when that is done, this will also be done? @laurianvm where is that work?

not a lot of detail to add.
about the tech:
it looks like generated turtle is already foreseen (but currently empty)

see the *ttlfile at https://github.com/emo-bon/sequencing-data/tree/main/shipment/batch-001
I assume @bulricht has foreseen the code / pipeline already and is just waiting on the templates to actually fill that file
but even if it is not done yet: that should just be applying the subyt pipeline already active for the observatories (just using different inputs and templates)
as with the observatories we still need to agree (and then apply) on a smart marking of these turtle files in the rocrate-metadata.json (might be dc:conformsTo=some-profile? + schema:encodingFormat=text/turtle) this to streamline the harvesting of these in the kgap-process towards analysis recently started by @cedricdcc -- ie to avoid hacking the filename-patterns in there

about  the content and need:
afaiu this repo contains in its csv two essential elements (there could be more I am not aware of?  -- the more the merrier !)

the link between material-sample-id and ena accession-number --> both need to be turned into URI and associated to each other in a triple (to decide best predicate and direction)
the grouping of samples inside one batch + some meta-data on the batch --> it feels like this grouping could help detect if maybe some significant (?) recurring fault happened in the processing of all samples in it

@kmexter to ask if https://github.com/emo-bon/sequencing-data/blob/main/shipment/batch-001/run-information-batch-001.csv each sample is one genetype or multiple?
@kmexter & @laurianvm to add new properties to the ontology (find terms & relationship to)

answer: those particular ones are one gene type, but we need to allow that one sample can be multiple.

authors: kmexter laurianvm mpo-vliz

repo: emo-bon/sequencing-data


text:
Snowy crash during operation in AP mode

Now I'm sure Snowy Image Copy is the most powerful app for flashair.
I always thank for your energetic endeavor.
And I hope this is the last bug I found.^^
I am using flashair w-04 in "AP mode" and the wireless transmission to tablet PC is doing fine.
But, when the camera goes into Sleep mode (e.g. 1 minute) or
when I manually Turn off the camera during operation,
"Not Always but Occasionally" snowy windows close with an error message.
Please check this situation.
PS) No such error in Station mode
related log files
Sleep1-exception.log
Sleep2-exception.log
Sleep3-exception.log
Turn off1-exception.log
Turn off2-exception.log
Turn off3-exception.log

@dentphoto Thank you for reporting.
Although I could not reproduce it, I slightly modified exception handling.
https://github.com/emoacht/SnowyImageCopy/commit/148b77fa202acddf62e6e3a7d5216ad930e82ee5

Unfortunately you cannot reproduce.
For reference I upload a video.
When the camera is turned off while operating in AP mode,
This is an error that occurs.
https://youtu.be/J0NXSIPLkXQ

Thank you for the video.
Although it is hard to identify where the exception happens from the video, I could guess it from the log.
The modified version will be up in the Store in a few days as always.

Ver 2.2.2 become available in the Store. This time, it took less than half a day.

Oh, very serious bug...
After running version 2.2.2, if you press the check button, copy button or check&copy button, Snowy dies due to a serious bug.
It dies after 30 seconds by pressing the auto button.
Couldn't you go back to Old 2.2.1 until the new version stabilizes?

Oh, it must be a lack of files in packages to the Store.
Working on.

Ver 2.2.3 is now in the Store. I hope it would work.

Thanks for the quick action.
However, in sleep mode or in manual power off, there are still occasional errors.
Fortunately, the frequency of occurrence has decreased considerably.

Thank you for testing.
If the remaining errors are the same, it should not happen. Could you upload new logs again?

AP mode (sleep mode/power off) bug that occurred very occasionally in Ver 2.2.3
turn off-exception.log
sleep-exception.log
sleep2-exception.log
(PS) Station mode is nearly perfect for all functions!!

Thank you for the logs.
Working on.

Thanks~~Very good job !!
Finally, a minor bug in the flashair AP mode has been completely resolved.
Now Snowy Plus 2.2.4 is an omnipotent program.

Thank you for confirming.

authors: dentphoto emoacht

repo: emoacht/SnowyImageCopy

license: mit

license_source: bigquery


text:
Consider implementing the neuroelectronics SDK to record data directly in Bonsai

https://www.neuroelectrics.com/solution/software-integrations/sdk
Otherwise, it would be nice to find a way to automatically start acquisition from Bonsai. The SDK also seems to include some sort of CLI toolkit that might enable such a feature.

Experiments are using NIC2 software independently, bonsai is sending at random times LSL messages to sync devices.

authors: aspaNeuro bruno-f-cruz

repo: emotional-cities/pluma-experiments


text:
🛑 Wicked CPU (Play Dashboard) is down

In 7e663ec, Wicked CPU (Play Dashboard) (play.wickedcpu.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Wicked CPU (Play Dashboard) is back up in f6dc666 after 8 minutes.

repo: empmdk/upptime


text:
My new README Edit

testing pushing and pull requests.

some new update needed.

source: gharchive/pull-request

repo: empug/road-quality-project


text:
Persistent retained messages in k8s deployment

Are there any recommended way how to make retained messages persistent between EMQ deployments?
For me it looks like there is no use for EMQ in Kubernetes because:

by default kubernetes will mount /opt/emqttd/data/mnesia as root:root.
That lead be to rather hacky attempt to solve this by:

      securityContext:
        runAsUser: 0
        fsGroup: 1000
      containers:
      - name: emqtt
        image: private.registry/emqttd-docker:v2.3.9
        command: ["/bin/sh", "-c"]
        args:
          - chown emqtt:emqtt /opt/emqttd/data/mnesia && su -l emqtt -p -c /opt/emqttd/start.sh
        ports:

even with correct permissions for /opt/emqttd/data/mnesia EMQ will just start with new node nam e on each restart:

# ls /opt/emqttd/data/mnesia/
emqtt-56f55b4794-xfzcq@10.42.0.71
emqtt-644b575465-6s44d@10.42.0.68
emqtt-78ccff4f74-sstmt@10.42.0.70
emqtt-644b575465-6h8mj@10.42.0.69
emqtt-6669477d59-mgrqt@10.42.0.72

setting EMQ_NAME, EMQ_HOST or EMQ_NODE__NAME make no effect to use persistent mnesia path

Hi @miks I'm not sure why setting EMQ_NODE__NAME did not work for you.
This worked to me:
docker run --name emq --hostname local.host --rm -it -e EMQ_NODE__NAME=emq@local.host --add-host local.host:127.0.0.1 -v (pwd)/tmp:/opt/emqttd/data/mnesia emqttd-docker-v2.3.11
The host name has to contain a dot because so far we do not support short names.

repo: emqx/emqx-docker


text:
Unable to deploy emqx-exporter on Kubernetes

Hi,
I am unable to run emqx-exporter on my Kind cluster.
I am following  https://docs.emqx.com/en/emqx-operator/latest/tasks/configure-emqx-prometheus.html to deploy.
I have configured the following yaml with emqx-dashboard service name , api key and secret.
apiVersion: v1
kind: Service
metadata:
labels:
app: emqx-exporter
name: emqx-exporter-service
spec:
ports:
- name: metrics
port: 8085
targetPort: metrics
selector:
app: emqx-exporter
apiVersion: apps/v1
kind: Deployment
metadata:
name: emqx-exporter
labels:
app: emqx-exporter
spec:
selector:
matchLabels:
app: emqx-exporter
replicas: 1
template:
metadata:
labels:
app: emqx-exporter
spec:
securityContext:
runAsUser: 1000
containers:
- name: exporter
image: emqx-exporter:latest
imagePullPolicy: IfNotPresent
args:
# "emqx-dashboard-service-name" is the service name that creating by operator for exposing 18083 port
- --emqx.nodes=${emqx-dashboard-service-name}:18083
- --emqx.auth-username=${paste_your_new_api_key_here}
- --emqx.auth-password=${paste_your_new_secret_here}
securityContext:
allowPrivilegeEscalation: false
runAsNonRoot: true
ports:
- containerPort: 8085
name: metrics
protocol: TCP
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 100m
memory: 20Mi
After applying the yaml the pods are not coming in running state :
k logs pod/emqx-exporter-697f97866-zmvx6
emqx-exporter: error: unknown long flag '--emqx.nodes', try --help
royn2@W1164RNGY3:~$ k logs pod/emqx-exporter-7955d74bdb-9whrw
Error from server (BadRequest): container "exporter" in pod "emqx-exporter-7955d74bdb-9whrw" is waiting to start: trying and failing to pull image

EMQX operator doc wasn't updated
args with --emqx.nodes etc... was for version 0.1.x
Check this example: https://github.com/emqx/emqx-exporter/tree/main/examples/kubernetes if you want to use the latest version

authors: roynilanjan shiinro

repo: emqx/emqx-exporter


text:
BioPathNet on synthetic lethality (SL)

Hi,
Thanks for your work on BioPathNet! I'm trying to run it on synthetic lethality (SL) data but couldn't find specific instructions. Could you provide some guidance or point me to relevant examples?
Appreciate any help!
Best wishes!

Hi,
thanks for your question! The SynLethDB data we used is from the repository of KR4SL. We further processed the data (e.g. by removing reverse relations ('duplicated' triplets), as they are introduced natively in BioPathNet) using the script in reproduce/synleth/02_prepare_data.py.
Hope this helps! Let us know if there are further questions.
Best regards!

Thank you very much！

repo: emyyue/BioPathNet


text:
工单系统-后台任务开发和调试

1 支持celery异步任务执行和计划任务执行以及相关审计功能

已完成开发 和验证 待上线

done

repo: encodingl/skstack


text:
register participant ask for PIN twice

push button "register partirticipant" -> enter PIN
submit extrinsic -> enter PIN again

same applies when performing meetup: once at start, again when submitting attestations

Yes, we once agreed (although, we were in doubt) that sending extrinsics asks for the PIN again, regardless if it has been cached before.

we might want to reconsider....makes no sense to me (anymore)

I agree. We could argue that we want to keep it in place for transfers, but disable this for the rest. But as we have only community transfers anyhow, we could also completely disable this.

authors: brenzi clangenb

repo: encointer/encointer-wallet-flutter


text:
E upgader

Integration Upgrader package to update application. Added some driver test codes to test_driver/app_test.dart file for upgrade alert.

It is not last version...


text:
Add download button to unavailable channel

The template of the channels custom presentation should be changed to look like this when the channel is not available:

That is, show a download button in the header.
Current Explore plugin can't display unavailable channels, but this draft PR can: https://github.com/endlessm/kolibri-explore-plugin/pull/530/files
So this can be done now based on the PR above assuming that unavailable channels will be navigated in the future.
What is an unavailable channel? For Kolibri, it is an imported channel without imported content. So for implementing this we can call importchannel (without importcontent) from the command line:
kolibri manage importchannel network SOME_CHANNEL_ID

The download implementation itself will be part of another issue. For now the button should do nothing, or should redirect to the Device tab.

Hint: the channel information is in the custom presentation store already. it is fetched through API window.kolibri.getChannelMetadata() and commited by the setChannelInformation mutation.

For clarification, the only difference the header of channels with unavailable content should have is a button.
The re-style of the headers (title and description below the banner, for example) are for all.
So, we have two tasks:

Add a button to request the download of a full channel when it's unavailable
New header layout for better legibility

Here are flows for browsing online-only content within channels:
https://github.com/endlessm/endless-key-content-private/issues/21#issuecomment-1564850054

This task is now limited to adding a download button to the current channel header,
ok! I'm changing the issue title to account for it.

Landed in Ladybird 6.8-338

Download channel button only available in the channels that do not have content yet on the device - the button should be there in all the channels also serving as a way to download the rest of the content.

@jofilizola @erikos besides the partially download channel, we need to actually start a download. For that the implemented stuff in https://github.com/endlessm/kolibri-explore-plugin/pull/608 will be useful. But also we need design decisions. Should the button display a spinner while downloading? Or maybe a progress bar? Should the button display a check mark after downloading? Should it allow retrying? Basically do we want the different UI states like the resource card has.

@manuq design specs: https://github.com/endlessm/endless-key-content-private/issues/22#issuecomment-1584803343

The download button currently opens the Kolibri device page. That is why the button has been disabled #622
The other piece is to differentiate between a full channel download where no item is on the device yet and when parts are there and the rest should be downloaded. Which would not be a blocker to leave that out for a first implementation. Only have the channel download for a full-offline one.

Should we close this as "won't fix" @erikos ?

authors: erikos jofilizola manuq

repo: endlessm/kolibri-explore-plugin


text:
[wordpress] Add 6.1

https://wordpress.org/support/wordpress-version/version-6-1/

Looks like its release date is 2nd of this month ( today ) not the 1st

The tag was created on 2nd but the blog post https://wordpress.org/support/wordpress-version/version-6-1/ says:

On November 1, 2022, WordPress 6.1 “Misha” was released to the public.

probably that announcement/support page has a bug because in versions page says 2nd :
https://wordpress.org/download/releases/

also making this as 1st might confuse our automation bot :) [ because it is using github's git tags ]

I aggree, changed it to 2nd...

authors: BiNZGi usta


text:
Upgrade to graphql-java 4.2.x

needed to review and merge #8

👍

i wrote a final one #10

thanks @marcelalburg it is merged and published to maven as 0.10.0

authors: aschrijver marcelalburg


text:
Asset fields updated on import re-run

I have feeds which import assets, and assign the entry's pub date to the asset's own field ("assetDate"). Whenever I re-run an import, I see a lot of:

Updated Asset (ID 62874) inner-element with content: {"assetDate":"2016-08-03 14:00:00"}

At least going by the logs, it looks like this field always gets updated, even when the field's value hasn't changed from the previous import. Just mentioning it fwiw :)

This has been improved in the latest master. Note that you'll still need to set the checkExistingFieldData config option to make this work.

authors: engram-design ldstevens

repo: engram-design/FeedMe


text:
Some orphan replicas have never been recycled

Shutdown and restart the server after a period of time. After the system enters a stable state, it is found that there are still some orphan replicas in the server that have not been recycled.
In restarted server:
 raft_id: 30
  Aug 03 06:09:29.005 INFO starting a new election, term: 9
  Aug 03 06:09:29.006 INFO became pre-candidate at term 9, term: 9
  Aug 03 06:09:29.006 INFO broadcasting vote request, to: [29, 103], log_index: 55289, log_term: 3, term: 9, type: MsgRequestPreVote
 raft_id: 45
  Aug 03 06:09:29.014 INFO starting a new election, term: 5
  Aug 03 06:09:29.014 INFO became pre-candidate at term 5, term: 5
  Aug 03 06:09:29.014 INFO broadcasting vote request, to: [44, 43], log_index: 51742, log_term: 2, term: 5, type: MsgRequestPreVote
 raft_id: 59
  Aug 03 06:09:29.523 INFO starting a new election, term: 5
  Aug 03 06:09:29.523 INFO became pre-candidate at term 5, term: 5
  Aug 03 06:09:29.523 INFO broadcasting vote request, to: [60, 58], log_index: 5876, log_term: 3, term: 5, type: MsgRequestPreVote
 raft_id: 50
  Aug 03 06:09:30.017 INFO starting a new election, term: 6
  Aug 03 06:09:30.018 INFO became pre-candidate at term 6, term: 6
  Aug 03 06:09:30.018 INFO broadcasting vote request, to: [49, 51], log_index: 5852, log_term: 2, term: 6, type: MsgRequestPreVote
 raft_id: 30
  Aug 03 06:09:30.505 INFO starting a new election, term: 9
  Aug 03 06:09:30.505 INFO became pre-candidate at term 9, term: 9
  Aug 03 06:09:30.505 INFO broadcasting vote request, to: [29, 103], log_index: 55289, log_term: 3, term: 9, type: MsgRequestPreVote
 raft_id: 59
  Aug 03 06:09:31.023 INFO starting a new election, term: 5
  Aug 03 06:09:31.023 INFO became pre-candidate at term 5, term: 5
  Aug 03 06:09:31.023 INFO broadcasting vote request, to: [60, 58], log_index: 5876, log_term: 3, term: 5, type: MsgRequestPreVote
 raft_id: 45
  Aug 03 06:09:31.514 INFO starting a new election, term: 5
  Aug 03 06:09:31.515 INFO became pre-candidate at term 5, term: 5
  Aug 03 06:09:31.515 INFO broadcasting vote request, to: [44, 43], log_index: 51742, log_term: 2, term: 5, type: MsgRequestPreVote
 raft_id: 30
  Aug 03 06:09:32.005 INFO starting a new election, term: 9
  Aug 03 06:09:32.006 INFO became pre-candidate at term 9, term: 9
  Aug 03 06:09:32.006 INFO broadcasting vote request, to: [29, 103], log_index: 55289, log_term: 3, term: 9, type: MsgRequestPreVote

In leader server:
 raft_id: 49
  Aug 03 06:09:52.519 INFO [logterm: 6, index: 19709, vote: 49] ignored vote from 50 [logterm: 2, index: 5852]: lease is not expired, msg type: MsgRequestPreVote, remaining ticks: 1, term: 6, msg_index: 5852, msg_term: 2, from: 50, vote: 49, log_index: 19709, log_term: 6
 raft_id: 58
  Aug 03 06:09:53.524 INFO [logterm: 5, index: 20484, vote: 58] ignored vote from 59 [logterm: 3, index: 5876]: lease is not expired, msg type: MsgRequestPreVote, remaining ticks: 1, term: 5, msg_index: 5876, msg_term: 3, from: 59, vote: 58, log_index: 20484, log_term: 5
 raft_id: 49
  Aug 03 06:09:55.019 INFO [logterm: 6, index: 19709, vote: 49] ignored vote from 50 [logterm: 2, index: 5852]: lease is not expired, msg type: MsgRequestPreVote, remaining ticks: 2, term: 6, msg_index: 5852, msg_term: 2, from: 50, vote: 49, log_index: 19709, log_term: 6
 raft_id: 58
  Aug 03 06:09:55.024 INFO [logterm: 5, index: 20484, vote: 58] ignored vote from 59 [logterm: 3, index: 5876]: lease is not expired, msg type: MsgRequestPreVote, remaining ticks: 1, term: 5, msg_index: 5876, msg_term: 3, from: 59, vote: 58, log_index: 20484, log_term: 5
  Aug 03 06:09:56.524 INFO [logterm: 5, index: 20484, vote: 58] ignored vote from 59 [logterm: 3, index: 5876]: lease is not expired, msg type: MsgRequestPreVote, remaining ticks: 1, term: 5, msg_index: 5876, msg_term: 3, from: 59, vote: 58, log_index: 20484, log_term: 5
 raft_id: 49
  Aug 03 06:09:57.519 INFO [logterm: 6, index: 19709, vote: 49] ignored vote from 50 [logterm: 2, index: 5852]: lease is not expired, msg type: MsgRequestPreVote, remaining ticks: 3, term: 6, msg_index: 5852, msg_term: 2, from: 50, vote: 49, log_index: 19709, log_term: 6
 raft_id: 58
  Aug 03 06:09:58.024 INFO [logterm: 5, index: 20484, vote: 58] ignored vote from 59 [logterm: 3, index: 5876]: lease is not expired, msg type: MsgRequestPreVote, remaining ticks: 1, term: 5, msg_index: 5876, msg_term: 3, from: 59, vote: 58, log_index: 20484, log_term: 5
  Aug 03 06:09:59.524 INFO [logterm: 5, index: 20484, vote: 58] ignored vote from 59 [logterm: 3, index: 5876]: lease is not expired, msg type: MsgRequestPreVote, remaining ticks: 1, term: 5, msg_index: 5876, msg_term: 3, from: 59, vote: 58, log_index: 20484, log_term: 5
 raft_id: 49
  Aug 03 06:10:00.020 INFO [logterm: 6, index: 19709, vote: 49] ignored vote from 50 [logterm: 2, index: 5852]: lease is not expired, msg type: MsgRequestPreVote, remaining ticks:
1, term: 6, msg_index: 5852, msg_term: 2, from: 50, vote: 49, log_index: 19709, log_term: 6

In node 1:
{
   "group": 9,
   "id": 30,
   "raft_role": 3,
   "replica_role": 1                                                                                },

In group 9's descriptor:
{
  "epoch": 14,
  "id": 9,
  "replicas": [
    {
      "id": 29,
      "node": 2,
      "raft_role": 0,
      "replica_role": 0,
      "term": 9
    },
    {
      "id": 30,
      "node": 0,
      "raft_role": 3,
      "replica_role": 1,
      "term": 9
    },
    {
      "id": 103,
      "node": 1,
      "raft_role": 0,
      "replica_role": 0,
      "term": 9
    },
    {
      "id": 110,
      "node": 3,
      "raft_role": 2,
      "replica_role": 0,
      "term": 9
    }
  ],
  "shards": [
    {
      "collection": 7,
      "id": 13,
      "partition": "hash: 6 of 32"
    },
    {
      "collection": 7,
      "id": 34,
      "partition": "hash: 27 of 32"
    }
  ]
}

Replica 30 is a learner, why it starts election?

It looks like 30 should be a learner that needs to be removed?
 raft_id: 30
  Aug 03 07:02:08.768 INFO switched to configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {29, 30, 103} }, outgoing: Configuration { voters: {} } }, learners: {}, learners_next: {}, auto_leave: false }
  Aug 03 07:02:08.769 INFO became follower at term 9, term: 9
  Aug 03 07:02:08.769 INFO newRaft, peers: Configuration { incoming: Configuration { voters: {29, 30, 103} }, outgoing: Configuration { voters: {} } }, last term: 3, last index: 55289, applied: 55289, commit: 55289, term: 9
  Aug 03 07:02:08.769 INFO RawNode created with id 30., id: 30

 raft_id: 30
  Aug 03 07:02:11.271 INFO starting a new election, term: 9
  Aug 03 07:02:11.271 INFO became pre-candidate at term 9, term: 9
  Aug 03 07:02:11.271 INFO broadcasting vote request, to: [29, 103], log_index: 55289, log_term: 3, term: 9, type: MsgRequestPreVote

This is because the schedule is not persistent, so after the leader is transfered, the original task does not continue, resulting in a few remaining learners.

In node 3:
 raft_id: 110
  Aug 03 07:13:39.426 INFO switched to configuration, config: Configuration { voters: Configuration { incoming: Configuration { voters: {29, 110, 103} }, outgoing: Configuration { voters: {} } }, learners: {30}, learners_next: {}, auto_leave: false }
  Aug 03 07:13:39.426 INFO newRaft, peers: Configuration { incoming: Configuration { voters: {29, 110, 103} }, outgoing: Configuration { voters: {} } }, last term: 10, last index: 115099, applied: 115099, commit: 115099, term: 10
  Aug 03 07:13:39.426 INFO RawNode created with id 110., id: 110

There is no 30 in the members of group 9?

repo: engula/engula


text:
Look into today()

Should return xsd:date
so instead of  "2018-10-25T00:00:00.000+13:00", it should return "2018-10-25+13:00" (keep timezone or eliminate it).

[ ] check which tests fail when doing this with timezone component
[ ] check which tests fail when doing this without timezone component
[ ] based on previous results determine approach

And more importantly finalize this: https://github.com/opendatakit/xforms-spec/issues/56

repo: enketo/enketo-xpathjs


text:
RAG should be add-in for multipage document pdf

instructor.exceptions.InstructorRetryException: litellm.BadRequestError: litellm.ContextWindowExceededError: ContextWindowExceededError: OpenAIException - Error code: 400 - {'error': {'message': "openai error: Invalid 'messages[1].content': string too long. Expected a string with maximum length 1048576, but got a string with length 1976458 instead. (request id: 2024121114571845225027487090505) (request id: 2024121114572763326430369052749) (request id: 2024121114572718113572229234539) (request id: 2024121114572676525390052321699) (request id: 202412111457268173112210109997) (request id: 2024121114572460819032852968468)", 'type': 'invalid_request_error', 'param': 'messages[1].content', 'code': 'string_above_max_length'}}

Hello @doncat99 !
Im finishing this today, advanced mapping , that will be able to extract beyond context window and token count.
Is this the exception correct? I have that fixed in a few hours
Now, RAG will not be added. There is plenty of RAG librabries out there, this project will evolve into vertical agents.

Great Job! @enoch3712
I will try it out and give you feedback ASAP.

I just made a temp patch logic to have my 600-page PDF file accepted by Openai API.
I cut the 600 pages into pieces and analyzed them from chapters to sections.
The benefit is that, if I have a complex multi-layer data model framework, the LLM can keep focusing and not miss data.
nevertheless, I think advanced mapping will make it much easier and faster.
    def save_pages_to_new_pdf(input_pdf_path, output_pdf_path, page_numbers):
        """
        Extracts specified pages from a PDF and saves them into a new PDF.

        Args:
            input_pdf_path (str): Path to the original PDF file.
            output_pdf_path (str): Path to save the new PDF file.
            page_numbers (list of int): List of page numbers to extract (0-indexed).
        """
        # Load the original PDF
        reader = PdfReader(input_pdf_path)
        writer = PdfWriter()

        # Add specified pages to the writer
        for page_number in page_numbers:
            if 0 <= page_number < len(reader.pages):  # Ensure the page number is valid
                writer.add_page(reader.pages[page_number])
            else:
                print(f"Page number {page_number + 1} is out of range.")

        # Write to the new PDF
        with open(output_pdf_path, "wb") as output_pdf:
            writer.write(output_pdf)
        print(f"New PDF saved to: {output_pdf_path}")

hey @doncat99
Sorry for the delay, but i pull it off now after a couple of good tests .
https://github.com/enoch3712/ExtractThinker/pull/119
As you can see is a big one, but has a problem that im going to solve now, is that the documentLoader.load is not universal, so i need to take care of that.
Works with Tesseract and a couple of other, but not with others like pypdf

I merged, not published, but its here 87-advanced-mapping
I need everything in main so i can make the changes you pointed out easily

wow, great progress! yesterday i was thinking if the extractor could retrieve all images, diagrams from pdf file. then i can call up image model to analyse it. i m still working on it, i m confusing on how i could write the correct Contract data model. and directly setting vision mode just mess all up.

@doncat99
https://enoch3712.github.io/ExtractThinker/examples/image-chart-processing/
what you think about this?

@doncat99
https://enoch3712.github.io/ExtractThinker/examples/image-chart-processing/
what you think about this?
But thats the way yes :), make that abstractio with images

There are two approaches to completing the task (image retrieval).
One is a top-down approach, as you kindly shared in the example. We use an image loader to analyze every page image. The advantage is that it is universal to the majority of cases. A weakness is that it causes a lot (time and tokens). Besides, it is easier to lose focus, extracting irrelevant images (I am not testing yet but based on my experience it is very depending on the pdf file content itself, the content may mislead the model no matter how optimized the prompt string has indicated).
The other way is a bottom-up approach, we analyze the document coarse-to-fine. what I am doing is adding a field at DocumentContract, ChapterContract, or even at SectionContract to ask the text model if the page contains (pie, chart, bar, or other target image), then we start a background task to introduce image-model to do it work. The weakness is that the approach is strongly task-oriented.

what I am doing is adding a field at DocumentContract, ChapterContract, or even at SectionContract to ask the text model if the page contains (pie, chart, bar, or other target image), then we start a background task to introduce image-model to do it work. The weakness is that the approach is strongly task-oriented.

This is a great idea, and i already have similar approaches (tree classification). I never did that because the models i tend to use dont struggle with this issues since its usually SOTA models, but makes perfect sense.
Im going to add that as a feature that you can described. Could be a strategy that you pick

@doncat99
class Chart(ContractImage):
classification: Literal["line", "bar", "pie"] = Field(description="The type of the chart")
description: str = Field(description="Description of the chart")
coordinates: List[XYCoordinate] = Field(description="The x-axis and y-axis present in the chart. Will be multiple")
gdp_variation: str = Field(description="Description of the gdp variation")
ContractImage could tell the extractor to do it separately. On the back you just ask for the image separately, this will ofc be done with the image of the page, not just the image itself in a page.

Tell me what you think:

I see the bright future of this project. The top-level design may evolve from SOTA model extraction to an intelligent task flow pipeline. By indicating a (data model -> to do) relationship, such as an image extracted from a contract model, a sub-task will call up the image model to have the image summarized(predefined action 1) or re-generate(predefined action 2), etc.
This required a new description framework, followed by a capability declaration schema.
The balance between user-customized and model self-understanding is a big-thinking job to the above new framework and schema design.
****** OPENAI's UNDERSTANDING *******

From SOTA Model Extraction to an Intelligent Task Flow Pipeline
You aim to evolve from a state-of-the-art (SOTA) model primarily focused on extraction to an intelligent task flow pipeline. This pipeline orchestrates tasks intelligently based on predefined relationships and actions.

Key Idea:
You introduce a relationship between the data model (e.g., an extracted entity) and a "to-do" task.
For example, if an image is extracted under a contract model, the system can decide what to do with it:
Predefined Action 1: Summarize the image content (e.g., OCR + text summary).
Predefined Action 2: Re-generate the image in a new format (e.g., graph re-creation or enhancement).
The "intelligent task flow" determines the next step dynamically based on the extracted data type and predefined actions.

New Description Framework
This framework will describe the relationship between:

Data Model: Represents the data entities or assets extracted (e.g., images, graphs, sections of text).
Actions/Tasks: Predefined operations that can be performed on the data model.
For example, the description could look like this:
json
Copy code
{
"data_model": "ImageExtracted",
"to_do": [
{"action": "summarize", "description": "Summarize the image content using an image-to-text model"},
{"action": "regenerate", "description": "Recreate the image with updated formatting"}
]
}
This description framework acts as the instruction layer for the intelligent pipeline, enabling the system to decide which model or process to call based on the data_model and its associated actions.

Capability Declaration Schema
You need a schema where:

Each model or tool can declare its capabilities (what actions it supports and the inputs/outputs it expects).
The system dynamically matches the data model (and its required actions) with the available model/tool capabilities.
For example:
json
Copy code
{
"model": "ImageSummarizationModel",
"capabilities": [
{
"action": "summarize",
"input": "image",
"output": "text_summary"
},
{
"action": "regenerate",
"input": "image",
"output": "new_image"
}
]
}
With this schema, the intelligent pipeline can:
Match the required action (e.g., "summarize") to the model that declares support for it.
Pass the necessary inputs and retrieve the outputs.
4. Balance Between User-Customized and Model Self-Understanding
This is the core design challenge:
User-Customized: Allow the user to define tasks, workflows, and actions explicitly, providing maximum flexibility.
Model Self-Understanding: Enable the pipeline or the models themselves to infer the appropriate tasks/actions based on the input context, reducing the need for user-defined workflows.
The balance requires:
A clear framework to define tasks and relationships (for customization).
An adaptive task scheduler or reasoning engine (e.g., powered by an LLM) that dynamically understands and chooses actions when the workflow isn't explicitly defined.
For instance:
If the system sees an image extracted, it could infer:
Default action = "summarize" if no task is defined.
Custom action = "regenerate" if explicitly requested by the user.
Summary
Task Flow Pipeline: Intelligent pipeline connecting data models to actions.
Description Framework: Defines the relationship between extracted entities (data model) and associated tasks.
Capability Declaration Schema: Models/tools declare what tasks they can perform and their input/output.
Balance Challenge: Combine user-defined workflows with model-based self-understanding for flexible and dynamic task execution.
This approach lays the foundation for an intelligent, orchestrated AI task pipeline that can evolve and adapt to new tasks while maintaining a structured framework.

sorry for the delay @doncat99
Just launched the 0.0.28v, very close to a beta release at this point.
I will close this because was attached to a bug, but we can discuss it here. https://github.com/enoch3712/ExtractThinker/discussions/132


text:
Multipart upload for large files

Pull Request Description

Close https://github.com/enso-org/cloud-v2/issues/1492

Use multiplart upload for large files (>6MB)

Split file into chunks of exactly 10MB (backend currently returns a fixed number of chunks)
Call "start upload", then upload each chunk to S3 (currently sequentially), then "end upload"

Files <=6MB (lambda limit) still use the current endpoint

Important Notes
None
Checklist
Please ensure that the following checklist has been satisfied before submitting the PR:

[x] The documentation has been updated, if necessary.
[x] Screenshots/screencasts have been attached, if there are any visual changes. For interactive or animated visual changes, a screencast is preferred.
[x] All code follows the
Scala,
Java,
TypeScript,
and
Rust
style guides. In case you are using a language not listed above, follow the Rust style guide.
[x] Unit tests have been written where possible.

@MrFlashAccount @PabloBuchu @indiv0 thoughts? should we perhaps be uploading multiple chunks in parallel? (does that help at all with upload speed?)

| Files <=6MB (lambda limit) still use the current endpoint
that is not good :( I wanted to remove the old endpoint

ah that should be an easy fix

also I moved to download from S3 download files (both normal file and project files) so we should test that. Since download project files uses get_details endpoint I guess we need to hide get_file behind the flag. Generating presigned url for downloading requires copying project archive to tmp bucket. Its not a big deal if the archive is small but is user generates some big output then we might need to optmize this.

When I upload a file it appears for a second then its gone and then its back but with a delay after Finished uploading file. It is confusing for the users
Download a file doesn't work and it is something with FE I guess. Right now when you ask for file/project details we will copy the files to tmp bucket and generate a presigned url to download. When I try to download I am saving xml file with .. when I manually copy and use s3 url it works. Same with projects
2.1 Should we hide generate presigned behind the flag? Looks like we are copying files to tmp bucket every time for projects
Upload enso-archive for already exisitng project. I can click Update multiple time and multiple requests are being send. So far managed to click 3. Looks like the same is with rename but harder

Should we hide generate presigned behind the flag

probably yes

repo: enso-org/enso


text:
Updated for swift 3

This code should be merged to a new branch named swift-3. @entotsu Please create a new branch and I will create the PR again.
This should not be merged in master as of now, since Xcode 8 is still in beta mode.

@entotsu Please create a new branch named swift-3 and I will create a PR again.

repo: entotsu/TKSubmitTransition


text:
[ELWIC] iNfInItY CoMpLeX - 2nd Init Fails

Module Information

Identifier ELWIC
Module Name iNfInItY CoMpLeX
Version 6.0

Describe the bug
Initial install/init of iNfInItY CoMpLeX is successful but fails after a shutdown during init with:
2020-12-18 22:16:28.6699 Warn MBBSEmu.Btrieve.BtrieveFileProcessor.Insert modules\ELWIC\ELWICLIB.DB: Failed to insert record because SQLite Error 19: 'UNIQUE constraint failed: data_t.key_0'.
Critical Exception has occurred:
System.SystemException: Failed to insert database record
at MBBSEmu.HostProcess.ExportedModules.Majorbbs.insbtv()
at MBBSEmu.HostProcess.ExportedModules.Majorbbs.Invoke(UInt16 ordinal, Boolean offsetsOnly)
at MBBSEmu.HostProcess.ExecutionUnits.ExecutionUnit.ExternalFunctionDelegate(UInt16 ordinal, UInt16 functionOrdinal)
at MBBSEmu.CPU.CpuCore.Op_Call()
at MBBSEmu.CPU.CpuCore.Tick()
at MBBSEmu.HostProcess.ExecutionUnits.ExecutionUnit.Execute(IntPtr16 entryPoint, UInt16 channelNumber, Boolean simulateCallFar, Boolean bypassState, Queue1 initialStackValues, UInt16 initialStackPointer)    at MBBSEmu.Module.MbbsModule.Execute(IntPtr16 entryPoint, UInt16 channelNumber, Boolean simulateCallFar, Boolean bypassSetState, Queue1 initialStackValues, UInt16 initialStackPointer)
at MBBSEmu.HostProcess.MbbsHost.AddModule(MbbsModule module)
at MBBSEmu.HostProcess.MbbsHost.Start(List`1 moduleConfigurations)
at MBBSEmu.Program.Run(String[] args)
To Reproduce
Steps to reproduce the behavior:

Install ELWIC
Load MBBSEmu
Shutdown MBBSEmu
Load MBBSEmu
See error

Software Information:

OS: Microsoft Windows [Version 10.0.14393]
MBBSEmu Versions: mbbsemu-win-x64-111920-6 & mbbsemu-win-x64-121820-3

I think this is related to a printf bug with format strings. The module uses  ITEM%3.3d as a format string, which MBBS currently evaluates to  ITEM 10 for example. However when I run the same print statement with borland, it outputs  ITEM010. So it seems Borland is 0 padding with integers instead of space padding

repo: enusbaum/MBBSEmu


text:
CI: Add "macos" pool explicitly to fix CI failures

Description:
We're using --remote_default_exec_properties=Pool=macos (https://github.com/envoyproxy/envoy-mobile/blob/main/.bazelrc#L214) to set the pool name for the MacOS builds on Engflow, however, we also set some other exec_properties in some tests https://github.com/lfpino/envoy-mobile/blob/20caa5a61508b1abd8aa3578cc3eae528d5274b0/test/java/integration/BUILD#L51 and Bazel doesn't merge the exec properties set in the bazelrc with the ones in the rule (i.e. the ones in the rule takes precedence). Because of this we end up sending the MacOS builds to a non-existent "default" pool which triggers build failures (https://github.com/envoyproxy/envoy-mobile/runs/4095145581?check_suite_focus=true#step:7:1373).
This PR fixes this by setting the pool name explicitly (until we get rid of the sandbox exec property in the next PR)
Risk Level: Low
Testing: See workflows
Docs Changes: N/A
Release Notes: N/A

ERROR: /__w/envoy-mobile/envoy-mobile/test/kotlin/integration/BUILD:116:25: Compiling Kotlin to JVM //test/kotlin/integration:receive_data_test { kt: 64, java: 0, srcjars: 0 } failed: (Exit 1): builder failed: error executing command
  (cd /github/home/.cache/bazel/_bazel_root/e390684146b86f31340021c5495bb190/execroot/envoy_mobile && \
  exec env - \
    LC_CTYPE=en_US.UTF-8 \
  bazel-out/host/bin/external/io_bazel_rules_kotlin/src/main/kotlin/builder '--flagfile=bazel-out/k8-fastbuild/bin/test/kotlin/integration/receive_data_test.jar-0.params')
Execution platform: @engflow_remote_config_clang//config:platform
bazel-out/host/bin/external/io_bazel_rules_kotlin/src/main/kotlin/builder: line 366: /private/var/lib/engflow/worker/work/4/exec/bazel-out/host/bin/external/io_bazel_rules_kotlin/src/main/kotlin/builder.runfiles/remotejdk11_linux/bin/java: cannot execute binary file
bazel-out/host/bin/external/io_bazel_rules_kotlin/src/main/kotlin/builder: line 366: /private/var/lib/engflow/worker/work/4/exec/bazel-out/host/bin/external/io_bazel_rules_kotlin/src/main/kotlin/builder.runfiles/remotejdk11_linux/bin/java: Undefined error: 0

🤔

I forgot we were using the same targets in both linux and mac. https://github.com/envoyproxy/envoy-mobile/pull/1922/files is better to solve this.

authors: keith lfpino

repo: envoyproxy/envoy-mobile


text:
Is there a way to return a custom HTTP response code using the grpc_json_transcoder filter?

I'm implementing an API using the grpc_json_transcoder filter and working well. I know the HTTP response code is mapped to grpc-status according to the code.proto  definition. But, I have a doubt if it would be possible to customize the HTTP return code, like answering HTTP 201 (Created) or HTTP 202 (Accepted) in a successful response without using the Lua script to intercept the upstream. Do we have more information about it? Thanks in advance.

cc @lizan @qiwzhang

your desired http_status code will be based on what?  a field from response_body?   or grpc status code in the response headers?  But for a successfully grpc response, there will not be grpc_status code in the response header.

@qiwzhang Reading the code.proto  I understood that isn't possible to use grpc-status because doesn't have this mapping. Is there another native way in Envoy to do that?
To make this feasible, I implemented a Lua script to change the HTTP response based on a custom header returned by the application, more and less like that:
local function isempty(s)
  return s == nil or s == ''
end

function envoy_on_response(response_handle)
  local headers = response_handle:headers()
  local custom_response_code = headers:get("x-http-response-code")
  response_handle:logInfo("Custom Response Code: " .. custom_response_code)
  if response_handle:headers():get(":status") == "200" and (not isempty(custom_response_code)) then
    response_handle:headers():replace(":status", custom_response_code)
  end
end

But, I'd like to understand if exists a better way to do that.

So you are requesting a feature that allowing gRPC server to set the HTTP status code after transcode the response to HTTP/json,  is that correct?   Current envoy grpc_transcoder doesn't support anything like this.  For your idea of using a response header,  it is not supported by grpc_transcoder either.
But it should be easy to add it.

In fact, my goal is to understand if the transcoder can customize HTTP codes that don't have mapped in code.proto.
As the transcoding specs talk about "... RESTful JSON API client to send requests to a gRPC service ...", I'd like to design my APIs returning HTTP codes more connected with this paradigm (REST). As I implementing a RESTful async API, I believe the better HTTP code to return would be 202 for this case (at least, according to https://www.rfc-editor.org/rfc/rfc7231#section-6.3.3).

Sorry,  grpc transcoder could not customize http code from grpc status-code. I also feel it is not the right approach, in grpc world, only 0 means success,  non-zero codes mean errors. I guess your requirement doesn't fit into grpc world.

Thanks,  @qiwzhang  for your time to talk about a little of this topic. Feel free to close this comment or let me know if can do that.

@qiwzhang

But it should be easy to add it.

So the feature is not do map grpc codes to http codes, but to use response metadata like x-http-code (custom header) to inform the grpc_transcoder the desired HTTP response status code.
On the gRPC server, we'll need to write something like this to define a custom http response:
_ = grpc.SetHeader(ctx, metadata.Pairs("x-http-code", "201"))

Do you consider adding this as a new feature to the grpc_transcoder?
The flow can be: We define a custom http header (metadata) that the grpc_transcorder knows, and if present on the grpc server response, it uses the value of the header as the response code to the client.
ref 1: [Setting custom response metadata in a go grpc server)(https://github.com/grpc/grpc-go/blob/master/Documentation/grpc-metadata.md#sending-metadata-1).
ref 2: Similar implementation on gRPC-Gateway

Just chiming in as another party that would be interested in the ability to "cleanly" set the HTTP code corresponding to a transcoded gRPC call.

authors: augustomarinho fgmacedo ggreenway qiwzhang wrossmorrow

repo: envoyproxy/envoy


text:
Append a request header with a value from a secret

Description:
I'd like the ability to append a request header value from a secret (SDS) , this header represents the API key header and the secret represents the actual API key
The request_headers_to_add field in the RouteConfiguration uses the HeaderValueOption which only supports a literal value
Relates to https://github.com/envoyproxy/gateway/issues/4757
[optional Relevant Links:]

Any extra documentation required to understand the issue.

cc @mathetake @aabchoo

Sounds a bit risky.
Can you provide more details on the desired behavior (requirement) that you want to accomplish?

@adisuissa another use case: appending authentication header to the HTTP CONNECT request sent to the upstream forward proxy, like Squid. Currently, we can only set a literal value in tunneling_config.headers_to_add. Why do you think it's risky?
I could try to contribute this feature.

authors: adisuissa arkodg jewertow


text:
Unable to drain endpoints before removal

Title: Unable to drain endpoints before removal
Description:
I'm trying to implement endpoint connection draining (and not draining envoy itself) with sticky sessions configured.
At t=0, there are 5 endpoints configured in my envoy cluster with cookie based sticky sessions configured.
At t=10, I wish to drain 1 out of the 5 endpoints I have i.e. I do not want any new connections to be routed to that endpoint, but I want the current sessions to persist before I remove the endpoint from the list.
In order to drain an endpoint, I've tried 2 approaches -

Set 'health_status': 'DRAINING' in the endpoint  (See https://www.envoyproxy.io/docs/envoy/latest/api-v2/api/v2/core/health_check.proto#envoy-api-enum-core-healthstatus)
This takes care of not sending any new connections to the endpoint, but does not allow older sticky sessions to persist and they're broken off.
I got leads for this from https://github.com/envoyproxy/envoy/issues/2920#issuecomment-388123100, but doesn't seem to work :man_shrugging:

Set load_balancing_weight: 1 in the endpoint in the hope that a lower weight will not route any new requests to the endpoint but the sticky sessions will persist, but that didn't happen.

So, what am I missing here? Any pointers are appreciated! Thanks :)
Config:
This is how the endpoint configuration looks when I'm trying to drain it -
                                {
                                    "endpoint": {
                                        "address": {
                                            "socket_address": {
                                                "address": "172.17.0.9",
                                                "port_value": 8080
                                            }
                                        }
                                    }
                                },
                                {
                                    "endpoint": {
                                        "address": {
                                            "socket_address": {
                                                "address": "172.17.0.14",
                                                "port_value": 8080
                                            }
                                        }
                                    },
                                    "health_status": "DRAINING"
                                },

I think I understand what you are after, but I'm not sure how it can be implemented cleanly. How would Envoy know that a session is OK to keep sending to an endpoint? Do you expect this to be somehow encoded in the cookie?

@mattklein123 thanks for the prompt reply ;)
I think the best I can explain this is the way is quoting how Nginx drains sticky sessions (more at https://www.nginx.com/blog/nginx-plus-backend-upgrades-individual-servers#server-api-persistence)

Session persistence is required for any application that keeps state information for users (such as a shopping cart), but it complicates upgrades because now it is not enough just to wait until there are no active connections to our server before taking it offline. There might be clients that aren’t sending requests right now but haven’t ended their session with the server. For the best user experience, we want to keep the active sessions open – the amount of time depends on the application – but don’t want any new sessions to start.

In this case, before taking the server offline we don’t only want the number of active connections to be zero, but also for all sessions to end. That translates to the server being idle for some amount of time, which depends on the application. We can periodically check the dashboard or use the status API to determine that the server is idle, but we can also automate the process of marking a server drain and verifying it is idle before marking it down.

So, from what I understand, Envoy could do this 2 ways -

Allow the application to specify the drain time - during which no new connections are sent but older ones persist - and after which the endpoint is removed from the configuration
Allow an endpoint to be marked as draining (which is more like 'unhealthy soon' than 'unhealthy now') - and when marked no new connections are sent but older ones persist.

More reading

haproxy-ingress implements this by setting 0 weight to the endpoint which translates to no new connections but continue older ones - the implementation is at https://github.com/jcmoraisjr/haproxy-ingress/pull/95 which is well explained
An outstanding feature request on Nginx's Kubernetes' ingress at https://github.com/nginxinc/kubernetes-ingress/issues/267 - some pointers in the discussion there
Feature request on Ambassador (on which I am working on) - https://github.com/datawire/ambassador/issues/1473

I just tried separating the draining endpoints and healthy endpoints into 2 different clusters, and then pointed the route to both of them via weighted_clusters (draining cluster with weight 0, and healthy cluster with weight 100), but no luck. Sticky sessions do not persist -
                                                            "weighted_clusters": {
                                                                "clusters": [
                                                                    {
                                                                        "name": "cluster_qotm_er_ring_hash_cookie_sticky_cookie",
                                                                        "weight": 100
                                                                    },
                                                                    {
                                                                        "name": "draining_cluster",
                                                                        "weight": 0
                                                                    }
                                                                ]
                                                            }

I'm sorry I don't fully understand what you are after. Session stickiness is supported effectively via hashing of an incoming request cookie. How can Envoy understand whether to continue to route existing sessions without some state in the cookie itself?
Do you mean that you want users with existing cookies to keep routing, but no new cookies to be issued that target that upstream?

Do you mean that you want users with existing cookies to keep routing, but no new cookies to be issued that target that upstream?

@mattklein123 Yep, exactly :+1:
I want to drain an endpoint/upstream and I want to give it 1 hour to drain. In that one hour, I want already existing sticky sessions to keep routing to that very upstream, but I don't want any newer sticky sessions to be issued to that upstream.

OK I think I understand what you are after. Right now the cookie hashing policies just effectively store a hash value in the cookie and are meant for use with a consistent hashing load balancer. When a host is failed, the rest of the hosts will rehash. There is no actual state stored in the cookie itself.
I think we could support something like this but it would take a bunch of thinking on how to do it. @alyssawilk any thoughts on this one given the existing cookie support?

I'm not terribly familiar with Envoy upstream selection.    I also kind of see how this would work for H2, where you can check connection lifetime vs drain time if we move a bunch of APIs around but I'm less convinced it works well for HTTP/1 given that you may have a preexisting pipeline connection and then prefetch more, and have inconsistent state?
I think rather than base this on connection lifetime it might make sense to do some logic around cookie max-age, where if the client connection were in continued use Envoy could continue extending the max-age and if the client went idle the cookie would expire.  Then it's just a question of having a state where your backend selection always uses the hash when the cookie is present, and only selects from non-draining backend when the cookie is not present?

After kicking this around at Datawire for a bit, we think that it would work to add a way to mark a given upstream as "blacklisted for new hashes only":

if a request comes in with a valid (non-expired) cookie directing it to the blacklisted upstream, fine, go ahead and route.
if a request comes in with no cookie, or with an invalid or expired cookie, never allow the hash to select any blacklisted upstream.

Does that sound like a reasonable approach?

Does that sound like a reasonable approach?

Conceptually it would work, but I think the implementation will be complex, as then we need a per-host draining concept (which I guess we have today but I would need to refresh the details). Worse, and this is where I would really have to think it through, I'm not convinced this works well at all if the upstream hosts are stable and things rehash. Are we assuming upstream stability? Even if we assume upstream stability, once a host drains and then goes away, 1/N approximately are going to rehash again anyway so don't you still need to support migration?

@mattklein123 @alyssawilk can we mark this as 'help wanted'?

OK I think I understand what you are after. Right now the cookie hashing policies just effectively store a hash value in the cookie and are meant for use with a consistent hashing load balancer. When a host is failed, the rest of the hosts will rehash. There is no actual state stored in the cookie itself.
I think we could support something like this but it would take a bunch of thinking on how to do it. @alyssawilk any thoughts on this one given the existing cookie support?

@mattklein123 this isn't a concern now with sessionFilter
Since podIP is used directly.

authors: Pawan-Bishnoi alyssawilk containscafeine kflynn mattklein123


text:
Allow FakeHttpConnection to gracefully handle GOAWAY frame

Allow FakeHttpConnection to gracefully handle GOAWAY frame.
For an explanation of how to fill out the fields, please see the relevant section
in PULL_REQUESTS.md
Commit Message:
Additional Description:
Risk Level:
Testing:
Docs Changes:
Release Notes:
[Optional Runtime guard:]
[Optional Fixes #Issue]
[Optional Deprecated:]

Hi Matt, this change is needed for a fuzz test that we use in google, but I thought it might be useful to other users as well.

Thanks for the help, Matt!


text:
build: fix macos v8 build

Commit Message: fix macos v8 build
Additional Description: Adds no-range-loop-analysis for v8 builds
Risk Level: N/A
Testing: N/A
Docs Changes: N/A
Release Notes: N/A

/retest

authors: lizan ramaraochavali


text:
thrift_proxy: Add host req success/error and upstream decoding error

Commit Message: thrift_proxy: Add host req success/error and upstream resp decoding error
Additional Description: Add host locality stats metrics for thrift, use the definitions of success/error defined by outlier detection added in https://github.com/envoyproxy/envoy/pull/17019. The existing upstream responses metrics did not include a failure metric equivalent to the downstream decoding error metric. Therefore also added that metric for upstream when a decoding error and cover more response exception cases.
Risk Level: low
Testing: unit test
Docs Changes: Yes added decoding error/exception local remote
Release Notes: Yes adding decoding error and host metrics
Platform Specific Features: N/A

/retest


text:
Request to add Robert Femmer to setec from X41 to work on Fuzz issues

Signed-off-by: Kirtimaan krajshiva@google.com
Commit Message:Add Robert Femmer from X41 to setec for working on Fuzzers
Additional Description: Robert Femmer is new X41 team member to work on cleaning up fuzz issues

/assign @mattklein123

authors: krajshiva wbpcode


text:
ZK filter: Fix "buffer underflow" error

Commit Message: ZK filter: Fix "buffer underflow" error
Additional Description: When using ZK filter, we noticed some decoder errors. After looking into the issue, we found that some create requests had negative data len without real data and then the ZK filter failed to parse/skip the real data. Negative data len is because the data fetched from buffer is 0xffffffff in our case, and the type of len is int32_t. Since the data is beyond the max value of int32, it becomes negative.
Risk Level: low
Testing: unit tests
Docs Changes: N/A
Release Notes: N/A
Platform Specific Features: N/A
Signed-off-by: Zhewei Hu <zhu@pinterest.com>

cc @rgs1, if you have a chance to review, thanks!


text:
golang: fix replace path in go.mod

Commit Message:
Additional Description:
it makes the dependabot-updater processing error, also fix CFLAGS.
Risk Level: low
Testing:
Docs Changes:
Release Notes:
Platform Specific Features:
[Optional Runtime guard:]
[Optional Fixes #Issue]
[Optional Fixes commit #PR or SHA]
[Optional Deprecated:]
[Optional API Considerations:]

Hello @phlax , I think this could address the error from dependabot-updater.

would you be able to look at examples/grpc-bridge/server/kv/go.mod also ?
i think that is also creating an issue, and my attempt didnt work

sure, I'll take a look soon.


text:
owners: add @asraa and @lambdai to OWNERS.

@asraa is joining Envoy OSS security team.

@lambdai is joining Friends of Envoy as v2 xDS point.

Signed-off-by: Harvey Tuch htuch@google.com

Thank you!

authors: htuch lambdai


text:
docs: Attaching EnvoyProxy to Gateways

Description:

Describe the issue.

Support for attaching envoyProxy to Gateways was added in https://github.com/envoyproxy/gateway/pull/3532
https://gateway.envoyproxy.io/v1.0/tasks/operations/customize-envoyproxy/#add-gatewayclass-parametersref
our docs need to be updated to also highlight support for attaching to Gateway
[optional Relevant Links:]

Any extra documentation required to understand the issue.

Should note that: Support attaching EnvoyProxy resource to Gateways if MergeGateways is disabled on GatewayClass

authors: Xunzhuo arkodg

repo: envoyproxy/gateway


text:
Only last of repeated rules respected

Only one of repeated rules is applied when multiple are specified.
Reproduction
example.proto:
syntax = "proto3";

import "github.com/envoyproxy/protoc-gen-validate/validate/validate.proto";

package example;

message TestMessage {
  repeated string test_field = 1 [(validate.rules).repeated.max_items = 9, (validate.rules).repeated.items.string.max_len = 64];
}

go build -o bin/protoc-gen-validate
protoc -I . -I ${GOPATH}/src -I ${GOPATH}/src/github.com/envoyproxy/protoc-gen-validate --plugin=protoc-gen-validate=./bin/protoc-gen-validate --validate_out="lang=go:generated" example.proto
Observe the following Validate method generated for TestMessage in generated/example.pb.validate.go:

// Validate checks the field values on TestMessage with the rules defined in
// the proto definition for this message. If any rules are violated, an error
// is returned.
func (m *TestMessage) Validate() error {
	if m == nil {
		return nil
	}

	for idx, item := range m.GetTestField() {
		_, _ = idx, item

		if utf8.RuneCountInString(item) > 64 {
			return TestMessageValidationError{
				field:  fmt.Sprintf("TestField[%v]", idx),
				reason: "value length must be at most 64 runes",
			}
		}

	}

	return nil
}

Which is missing the max_len validation.

Remove (validate.rules).repeated.items.string.max_len = 64, such that contents of example.proto are now:

syntax = "proto3";

import "github.com/envoyproxy/protoc-gen-validate/validate/validate.proto";

package example;

message TestMessage {
  repeated string test_field = 1 [(validate.rules).repeated.max_items = 9];
}

Repeat step 3.
Observe the following Validate method generated for TestMessage in generated/example.pb.validate.go:

// Validate checks the field values on TestMessage with the rules defined in
// the proto definition for this message. If any rules are violated, an error
// is returned.
func (m *TestMessage) Validate() error {
	if m == nil {
		return nil
	}

	if len(m.GetTestField()) > 9 {
		return TestMessageValidationError{
			field:  "TestField",
			reason: "value must contain no more than 9 item(s)",
		}
	}

	return nil
}

This is a limitation of the proto syntax. See #203 and #206 for how to do this correctly.

authors: akonradi rvolosatovs

repo: envoyproxy/protoc-gen-validate


text:
Bump grpc, protos dependencies

Bumping up various grpc-related dependencies.
grpc 1.35.0 itself bumped re2j and google common protos (which are matched in this PR).

Thanks! Can you please sign your commit and re-push? See https://github.com/envoyproxy/envoy/blob/main/CONTRIBUTING.md#fixing-dco and https://docs.pi-hole.net/guides/github/how-to-signoff/.

@akonradi Fixed!

Thanks!

authors: akonradi eocantu


text:
renaming predict function to posterior_predict

We previously got the warning the StatsBase.predict conflicts with an existing identifier. I traced this back to naming a function predict. This function was now renamed to posterior_predict.

Codecov Report

Merging #3 (5bd7448) into main (44d956e) will not change coverage.
The diff coverage is 66.66%.

@@           Coverage Diff           @@
##             main       #3   +/-   ##
=======================================
  Coverage   88.55%   88.55%
=======================================
  Files          33       33
  Lines         690      690
=======================================
  Hits          611      611
  Misses         79       79

Impacted Files
Coverage Δ

src/likelihoods/abstract.jl
0.00% <0.00%> (ø)

src/model/posterior.jl
0.00% <0.00%> (ø)

src/likelihoods/feedforward.jl
100.00% <100.00%> (ø)

src/likelihoods/seq_to_one.jl
100.00% <100.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

authors: codecov-commenter enweg


text:
[Bug] [Module Name] Bug in First Useing

Search before asking

[X] I had searched in the issues and found no similar issues.

Operating system information
Linux
Python version information

=3.11

DB-GPT version
latest release
Related scenes

[ ] Chat Data
[ ] Chat Excel
[ ] Chat DB
[ ] Chat Knowledge
[ ] Model Management
[X] Dashboard
[ ] Plugins

Installation Information

[X] Installation From Source

[ ] Docker Installation

[ ] Docker Compose Installation

[ ] Cluster Installation

[ ] AutoDL Image

[ ] Other

Device information
CPU
Models information
LLM：chatgpt_proxyllm
text：proxy_openai/text2vec/mg3large
What happened
No sentence-transformers model ，but there are model in folder.

and If i use proxy_openai, I meet this bug:

What you expected to happen
I dont know
How to reproduce
I dont know
Additional context
No response
Are you willing to submit PR?

[X] Yes I am willing to submit a PR!

sorry about that, latest main branch have not bundle newest web static files. you can try enter web directory and start web app
cd web
npm i
update next.config.js set API_BASE_URL
API_BASE_URL: "http://127.0.0.1:5000",
npm run dev
and we will fix that problem soon.

sorry about that, latest main branch have not bundle newest web static files. you can try enter web directory and start web app cd web npm i update next.config.js set API_BASE_URL API_BASE_URL: "http://127.0.0.1:5000", npm run dev
and we will fix that problem soon.

But why meet

this problem

sorry about that, latest main branch have not bundle newest web static files. you can try enter web directory and start web app cd web npm i update next.config.js set API_BASE_URL API_BASE_URL: "http://127.0.0.1:5000", npm run dev
and we will fix that problem soon.

Thanks！ but this problem still happen

it's warning log, means m3e-large model is not sentence transformer, it did not influence dbgpt_server start.

这是警告日志，意味着m3e-large模型不是句子转换器，它不影响dbgpt_server启动。

谢谢！

这样设置是对的吗？

authors: Aries-ckt shaodongyan

repo: eosphoros-ai/DB-GPT


text:
Change time frommilitary to standard time

I have configured the calendar to display the event times however they are listed in military time. See screen shot below. how can i change the time to show standard non military time?

Ha!! I figured this one out myself. I edited the MMM-CalendarExt\config.js file with the code below and solved the issue.
		//timeFormat: "HH:mm",
timeFormat: "hh:mm",

repo: eouia/MMM-CalendarExt


text:
Replace broken heuristics

Instead of blindly assuming inventory size based on game (which does not work when a mod modifies inventory size), ask Minetest itself. When inventory width is not specified by game (MTG), assume it to be 8. Inventory height is reliably determined by looking at list length. If the list length is not a multiple of inventory width, remaining items are left untouched, avoiding any breakage.
Confirmed to work with MTG and MCL2.

Nice, Thank you!
I tested with MCl2, Minetest-game, and Exile (8*2) and it worked.
Appreciate the fix!

authors: Kimapr epCode


text:
[Custom application]: Field topic is not displayed on review form for publication request for Admin

EPAM AI DIAL chat version
0.18.0
How to reproduce
Steps:

by user create custom application
input any values in Topics field
input required fields and save
create publication request for custom app
by admin view publication request
click "Go to a review" link

Actual result
Review form with application details is displayed
Field Topics is not displayed
Expected result
Topics  field should be displayed in publication request on review form for Admin
https://www.figma.com/design/lwL5jneveZczAj5RLcLFH2/DIAL-Chat?node-id=10912-35964&node-type=frame&t=ffhiMdKlaLsjeGnG-0
Confidential information

[X] I confirm that do not share any confidential information

verified on staging
related issue #2723

repo: epam/ai-dial-chat


text:
Macro: Modify nucleotides from sequence in RNA builder

Background
In sequence representation user should be able to replace any part of nucleotide (sugar, phosphate and base) with modified analog from library.
Requirements

User should be able to modify single as well as multiple selected nucleotides on canvas in RNA-builder without saving them to library.
To switch RNA builder to Edit mode, user should choose the option "Modify in RNA builder" in context menu which appears after Rclick on selected nucleotides.
- If at least one of selected symbols is not nucleotide then option "Modify in RNA builder" is not available.
Once option "Modify in RNA builder" is chosen, nucleotide components (sugar, phosphate and base) should be displayed in RNA builder.
If several nucleotides are selected and they have the same monomer (sugar, phosphate, or base) in their structure, then this monomer is displayed in the RNA-builder in appropriate field, and for monomers, that are not identical in the structure of the selected nucleotides, [multiple] is displayed in the corresponding field.
Instead of field 'name your structure'  indication of the number of selected nucleotides should be displayed
Instead of 'Save' button the 'Update' button should be displayed.
When user presses 'Update' button the structure of selected nucleotides should be updated according to changes, made in builder.
In case of bulk modification the modal window with Warning message "You are going to make multiple changes in your sequence. Are you sure?"  should appear following pressing 'Update' button.
- 'Yes' option will apply all the changes made in builder to the selected nucleotides
- 'Cancel' option will discard all the changes.
Do not allow an user to unselect nucleotides if a sequence in "Modify in RNA builder" mode, while an user in "Modify in RNA builder" mode.
Show selected nucleotides (with green background) in sequence while an user in "Modify in RNA builder" mode.
Disable "layout-mode" and "Switch to Micro/Macro mode" selectors in Top bar, as well as "Undo", "Redo" buttons, if a sequence in "Modify in RNA builder" mode.
Disable all tabs except "RNA" tab  if a sequence in "Modify in RNA builder" mode.
Disable some "Sugars", "Bases", "Phosphates" in RNA builder relying on selected sequence nucleotides. Based on below rules:
- Sugar: if sugar has no R2 or R3 - always disable such sugars (i.e. remove from selection),
user selected nucleotide in the middle of sequence - disable all sugars that has no R1 connection points
but if user edit nucleotide at the beginning - sugars with no R1 should be available
- Phosphate: if phosphate has no R1 or R2 -  always disable such phosphates
- Base: if base has no R1 - always disable such bases (i.e. remove from selection)

Not in scope of the ticket:
1. Allow modifying Nucleosides of sequence in RNA Builder
2. Disable some "Sugars" and "Phosphates" in RNA builder relying on selected sequence nucleotides. Based on below rules:
- Sugar: R2 - if not last
- Phosphate: R2 -  if not last
UX

Tests added to the automation table.

Tested on build 2.21.0-rc.1 One minor bug registered.

authors: Zhirnoff olganaz

repo: epam/ketcher


text:
add fondations for LLM

merging LLM (from #619) requires some reshaping of the code, here goes some changes splitted from the original PR.

add a Model abstracting away tensorflow specifics

still incomplete as it input/output tf.Tensors for now, and one can extract the tf.LayersModel
remove Task.training.modelCompileData as it's now contained inside the models.TFJS

add typesafe event emitter to safely register/call callbacks
rename Task.taskID to Task.id
while at it: drop unused training_functions, update axios, use async file read

For what it's worth very good stuff! I only left comment for what I didn't understand but it's a very nice refactoring

For what it's worth very good stuff! I only left comments for what I didn't understand but it's a very nice refactoring

héhé, thanks :smile:
followup of fixes form your remarks #645

authors: JulienVig tharvik

repo: epfml/disco


text:
[BUG] FeroxScan not found when scanning multiple targets via STDIN

Describe the bug
I'm getting a Scan Error when piping multiple URLs into feroxbuster. Is this error expected when sending multiple different top level URLS?
To Reproduce
Steps to reproduce the behavior:

Use a tool to generate a list of targets. In this case I used aquatone to generate a list of URLs.   https://xxx.xxx.xxx.xxx
   https://xxx.xxx.xxx.xxx
   https://xxx.xxx.xxx.xxx
   https://xxx.xxx.xxx.xxx
   https://xxx.xxx.xxx.xxx
   http://xxx.xxx.xxx.xxx
   http://xxx.xxx.xxx.xxx
   https://xxx.xxx.xxx.xxx ```

Pipe those into feroxbuster using  cat targets.txt | feroxbuster --stdin ARGS
Get  Could not find FeroxScan associated with error.

Expected behavior
Scanning should continue as expected with multiple URLs
Traceback / Error Output
If applicable, add error output to help explain your problem.
Environment (please complete the following information):

feroxbuster version: Release Branch
OS: Amazon Linux 2

Thanks for the report!  After a quick look, it seems like this is a legitimate bug.
I'll take a closer look later, but in the interim, you can use something like
for i in $(cat targets); do ./feroxbuster -u $i ARGS; done

or parallel.

thanks for this!
Version 1.10.3 contains the fix (which I'll have published here shortly).

done
https://github.com/epi052/feroxbuster/releases/tag/v1.10.3


text:
Fix (SidebarLink, ScrollBar): bug fixes

close #412

@asva can we close this one?

Likely outdated.

authors: asvae smartapant vlad-shusterman

repo: epicmaxco/vuestic-admin


text:
Add adsDriver and autoparamDriver

Add adsDriver (https://epics.cosylab.com/documentation/adsDriver/) and autoParamDriver (dependency, https://epics.cosylab.com/documentation/autoparamDriver)
I'm not sure what is meant with the mandatory varname attribute (fairly new to EPICS) so I'm not sure if I got those correct, would like review on that.
Added myself as maintainer for these two.

Note that this is a different library from #45

Oh, another question: do you think it would be possible to have an automated test for these packages?

Oh, another question: do you think it would be possible to have an automated test for these packages?

And to do that if you want to dive in, @minijackson find this python lib if you need : https://pyads.readthedocs.io/en/latest/documentation/testserver.html
And example of ioc tests are here : https://github.com/epics-extensions/EPNix/tree/master/ioc/tests/support
I know that because I am supposed to do so for the other ADS driver :)

Hmm the driver uses sum reads, and the testServer doesn't seem to support this, so this requires upstream additions to the test server.

authors: Synthetica9 agaget minijackson

repo: epics-extensions/EPNix


text:
Make attribute type required in entity api spec

It would be very helpful if we could have attribute types as required, that would allow us to discriminate an attribute by its type, and avoid a lot of of the assertions around attributes in entity-ui.
Do you foresee any undesired consequences at the API level that could arise from this change?

Hi @josecarneiro! Please make sure to apply this change upstream in Entity API source openapi.yml
The openapi json files distributed via the SDK are not meant to be directly edited, but rather updated via the npm openapi script.
Otherwise this seems like a sensible change 👍

Hi @anttiviljami, my bad, I should've started this discussion upstream. I'll propose these changes for the entity API and close this PR for the time being. Thank you!

authors: anttiviljami josecarneiro

repo: epilot-dev/sdk-js


text:
[FEATURE REQUEST] Prepare EKS module

After the https://github.com/epiphany-platform/epiphany/issues/1637 AWS Basic Infrastructure module is ready we can start working on deploying EKS on top of it. It should have similar structure to the AKS Module.
We need to do:

create new git repo for the module
implement required methods, for starters: Metadata, Init, Plan, Apply, Audit.
Tests will be implemented in #1676 and #1677

Existing set of makefiles from https://github.com/epiphany-platform/epiphany/tree/develop/docs/design-docs/modular-cli/cpt-tests can be used as a template.
Here is an example of a working module https://github.com/seriva/component-cli

@sk4zuzu would you add some comment on that? I believe we tested it, so maybe we can move it further?

Yes initial test showed problems with internet connectivity in vms. It was later fixed in those PRs https://github.com/epiphany-platform/m-aws-kubernetes-service/issues/12 and https://github.com/epiphany-platform/m-aws-basic-infrastructure/issues/17.
I have seen issues with destroying EKS resources, but we'll deal with it in specific issues later.
So IMO for now it's all OK we can move forward. :+1::innocent:

@sk4zuzu But the issue with internet connectivity was not in this module. I've also seen some issues there, one is described in readme, and hopefully we will not have such issues when get rid of used terraform module.

authors: atsikham mkyc sk4zuzu

repo: epiphany-platform/epiphany


text:
Fix/802 docker version hardcoded

Changelog updated

Duplicated.


text:
Add Markov model in MTK

Basically a stochastic version of this:
https://github.com/epirecipes/sir-julia/blob/master/markdown/function_map_mtk/function_map_mtk.md
which is a port of the below to MTK:
https://github.com/epirecipes/sir-julia/blob/master/markdown/markov/markov.md
Any suggestions @ChrisRackauckas? I know I have to use substitute due to Sym/Int64 conflicts with Binomial

We don't have a symbolic setup right now, but https://github.com/SciML/DifferenceEquations.jl is getting written.

authors: ChrisRackauckas sdwfrost

repo: epirecipes/sir-julia


text:
Minor comments...

Looks like examples refer to inpainting models which are not downloaded by the download.py script (commented out). I removed the commenting and they seem to download (and work) ok.
Installing xformers as instructed did not work in practice (resulted in cpu only version) while pip install xformers  works ok.
(A bit unsure whether "Install CUDA11.8" means install from NVIDIA into /usr/local/, I did not as I prefer a conda-only install and it appears to work anyway).

thanks for noticing these [and sorry for leaving readme in the obsolete state after the recent update].
i uncommented depth model again for now - until i extend controlnet examples which should effectively replace it.
Also added Windows mention for CUDA setup [as I didn't really test it on other platforms, sorry for that].

i believe recent update fixed this issue (hopefully not bringing new ones), so closing it for now.