text:
Syslog-ng stability issues on 20.7

Not sure what the cause is, this needs more investigation, I'll try to update the ticket once we have more details.
Some tickets came in around syslog issues (https://github.com/opnsense/core/issues/4252, https://github.com/opnsense/core/issues/4262), which at first looked related to the legacy syslog (clog), but when syslog-ng is acting on it's own it seems to crash during startup in some cases as well.
What I've seen on one of the instances with the issue is that if it crashes during boot, it won't start for a couple of tries (service syslog-ng start  or via the user interface), at the 3rd or 4th try it just starts without issues and can be stopped/started without issues again while not rebooting.
Another thing that stands out that if I start syslog-ng in foreground, it crashes before delivering any console output using
/usr/local/sbin/syslog-ng -p /var/run/syslog-ng.pid -Fdev -v

Trying to debug the startup using truss in similar conditions doesn't crash unfortunately.
truss /usr/local/sbin/syslog-ng -p /var/run/syslog-ng.pid -Fdev -v

Another thing I noticed was the service description, we still name syslog-ng remote syslog, I think we better rename both instances to make it explicit that syslog is the legacy one only used with clog.
Long story short, start syslog-ng a coupe of times manually fixes the problem in the mean time as a work around, but we do have to figure out at some point why this happens.
update 16/08/2020
Build a test package including debug symbols using the following in  /etc/make.conf:
WITH_DEBUG_PORTS= sysutils/syslog-ng327

And installed it on the same machine with the issues, but then it gets weirder, where a non-debug build always crashes on boot (also when using syslog-ng328), the debug version seems to be stable on every boot.... which makes debugging even more difficult.
If someone has the same issue and want to try a debug kernel,  just install using (OPNsense 20.7.1 / amd64):
pkg add -f https://pkg.opnsense.org/FreeBSD:12:amd64/snapshots/misc/syslog-ng327_dbg-3.27.1_1.txz

update 17/08/2020
Just noticed on one of our machines that if syslog-ng doesn't crash on initial boot, it doesn't handle all messages either. Part of the log data just seem to vanish in thin air until you manage to restart syslog-ng into a normal state.

I can confirm that on many of our apu2.
After upgrading to 20.7.x syslog-ng doesn't start at boot and can't be started from the GUI.
If it's started from shell with /usr/local/etc/rc.d/syslog-ng start it work's, but after a reboot it's gone again.

@abplfab can you try the package with debug flags? we probably need a core dump file (mine didn't crash with symbols)

@abplfab can you try the package with debug flags? we probably need a core dump file (mine didn't crash with symbols)

Will try it this evening on some boxes.

Update 16/11/2020  - Have I time warped a few months ahead?

@marjohn56 :) copy-paste and a typo in the first one  ... the other option is that I'm writing you from the future, but you'll probably won't take my word on that ;)

If the second one is true then we are three months further on and still the issue goes unresolved. 😉

let's consider this a typo then, the unresolved option doesn't sound too attractive ;)

Did the pkg install, core dump on reboot..
https://www.dropbox.com/s/lkhy9bul3plh3jj/syslog-ng.core?dl=0

Same here on an apu1: https://transfer.bug.ch/59566a97f42e9/syslog-ng.core (valid 5 days)

@marjohn56 @abplfab thanks, the backtrace looks the same as mine at a first glance
 # gdb syslog-ng
GNU gdb (GDB) 9.2 [GDB v9.2 for FreeBSD]
Copyright (C) 2020 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "x86_64-portbld-freebsd12.1".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
    <http://www.gnu.org/software/gdb/documentation/>.

For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from syslog-ng...
(gdb) core  abplfab-syslog-ng.core
[New LWP 100169]
Core was generated by `/usr/local/sbin/syslog-ng -p /var/run/syslog-ng.pid'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0  0x0000000000000000 in ?? ()
(gdb) bt
#0  0x0000000000000000 in ?? ()
#1  0x00000348ae6cf5c1 in g_process_perform_supervise () at lib/gprocess.c:1160
#2  g_process_start () at lib/gprocess.c:1434
#3  0x000002fc4987c797 in main (argc=1, argv=0x673325f7a400) at syslog-ng/main.c:278
(gdb) core marjohn56-syslog-ng.core
[New LWP 100113]
Core was generated by `/usr/local/sbin/syslog-ng -p /var/run/syslog-ng.pid'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0  0x0000000000000000 in ?? ()
(gdb) bt
#0  0x0000000000000000 in ?? ()
#1  0x000005b54a12c5c1 in g_process_perform_supervise () at lib/gprocess.c:1160
#2  g_process_start () at lib/gprocess.c:1434
#3  0x000003fef6273797 in main (argc=1, argv=0x6739ee3fa060) at syslog-ng/main.c:278
(gdb)

Looks like this was an issue back in 2012, unless I'm reading this wrong,
https://lists.balabit.hu/pipermail/syslog-ng/2012-May/018757.html

just did a fresh install of 20.7 and upgraded to OPNsense 20.7.1-amd64.
randomly getting
(syslog-ng), jid 0, uid 0: exited on signal 11 (core dumped)
running on
Intel(R) Atom(TM) CPU C2358 @ 1.74GHz (2 cores)
Manufacturer	Sophos
Product Name	SG
Version	125r2

@marjohn56 @abplfab can you try installing https://pkg.opnsense.org/FreeBSD:12:amd64/snapshots/misc/syslog-ng327_dbg-3.27.1_1.txz  ?
pkg add -f https://pkg.opnsense.org/FreeBSD:12:amd64/snapshots/misc/syslog-ng327_dbg-3.27.1_1.txz

No core dump on first boot... core dump on second.
https://www.dropbox.com/s/zctnj6dlufefei6/marjohn56-18-08-20-syslog-ng.core?dl=0

No core dump on first boot... core dump on second.
https://www.dropbox.com/s/zctnj6dlufefei6/marjohn56-18-08-20-syslog-ng.core?dl=0

done. if i notice another core dump i should find them under /syslog-ng.core ?

it can also be under /var/, best find it using
find / -name "syslog-ng*core"

Make sure to check the timestamp.
We probably need to push another version of the package with symbols, this is a version without debug symbols (it didn't die on my end)

Can you guys please post version for syslog too:
# pkg query %v syslog-ng327

Thanks,
Franco

Sorry guys, initial pkg update appears to have left v _1 in place, killed it and pkg install again and this time looks OK, three reboots and no core dump.
pkg query %v syslog-ng327
3.27.1_2

damn paste!!

Fixed the paste :) Ok, that's more like it. We had some versions internally as well so sorry for the confusion.

Live system now has it too, that's still on 20.7.0, no issues after install and start from GUI.

root@fw:~ # pkg query %v syslog-ng327 3.27.1_2
no more crashes...

Syslog-ng peeps are still split over the fix, which is just a proof of concept really so that our users can have a happy syslog experience. Closing this as it will be in 20.7.2. Thanks everyone for helping out. ❤

Hello,
Thank you for this project.
I have read through the reports here and on the syslog-ng github page.
FYI:
I just installed a fresh copy of Opensense 2.7.7 in a VM machine and imported my config from 2.1.9 previously in use.
Syslog NG consistently crashes two to three times after bootup.
After disabling circular logging, disabling  'writing log files locally' and removing all plugins except unbound (disabled), Syslog NG finally stays on after the initial core dumps.
The situation I am seeing looks a lot like this bug marked as closed...
Thank you.

authors: AdSchellevis abplfab aljazzair fichtner igpit marjohn56


text:
system: optional state kill for tier 2 -> 1 transition

Important notices
Our forum is located at https://forum.opnsense.org , please consider joining discussions there in stead of using GitHub for these matters.
Before you ask a new question, we ask you kindly to acknowledge the following:

[x] I have read the contributing guide lines at https://github.com/opnsense/core/blob/master/CONTRIBUTING.md
[x] I am convinced that my issue is new after having checked both open and closed issues at https://github.com/opnsense/core/issues?q=is%3Aissue

To be discussed if it would make sense to offer this since stateful firewall will stick the connections to the "worse" connection.
https://forum.opnsense.org/index.php?topic=35690.0
While default gateway switching has a similar issue I'd like to not offer such things there...

Found another forum thread requesting this feature back. Here's an idea -  how about shipping some (disabled by default) Monit service test / service which can be enabled by people who really need this?

Following this. I was going crazy when some of my wireguard peers (not running on opsense) couldn't reconnect after switching back to my tier 1 gateway. Once the state were cleared all was back to normal.

I need this feature! We are about to switch from Draytek Routers to OPNSense. But our first tests with MultiWAN showed the wronge behaviour to keep existing connections on the wrong WAN gateway. Once the primary one is back online, all states/connections from the failover gateway should be killed.

I got it working currently with a "workaround" by using a simple script which is running in the background. In my setup the primary wan is on interface igc0 and the backup wan is on interface igc1. This script runs in the background and checks every 60 seconds. In case the default gateway changes, it flushes out the old gateway ip states:
autoStateKill.sh
#!/bin/sh

#Config
primary_wan_if="igc0"
backup_wan_if="igc1"

#check if an instance is already running
otherInstance=`ps auxf | grep autoStateKill.sh | grep -v 'grep' | wc -l | tr -d ' '`
if [ ${otherInstance} -gt 2 ]; then exit 0; fi

#Do a sleep of 30 seconds at the beginning, in case script autostarts with the system
sleep 30

#Setup variables
primary_wan_gw_ip=""
backup_wan_gw_ip=""

#Get default gateway
default_gw_if=`netstat -rn | grep default | awk '{print $4}'`
default_gw_if_old=${default_gw_if}

#Inform the logging system
logger "AutoStateKill-Script: Started, default gateway is ${default_gw_if}"

#Main loop
while true; do

        #get current default gateway
        default_gw_if=`netstat -rn | grep default | awk '{print $4}'`
        default_gw_ip=`netstat -rn | grep default | awk '{print $2}'`

        case ${default_gw_if} in

                "${primary_wan_if}")    #primary wan interface is default gateway
                        primary_wan_gw_ip=${default_gw_ip};

                        if [ "${default_gw_if_old}" == "${backup_wan_if}" ] && [ "${backup_wan_gw_ip}" != "" ]; then #primary is up again, kill the states of the backup wan
                                killedStates=`/sbin/pfctl -k gateway -k ${backup_wan_gw_ip} 2> /dev/stdout`
                                logger "AutoStateKill-Script: ${default_gw_if} is now the default gateway, killing states of old gateway ip ${backup_wan_gw_ip}... ${killedStates}"
                        fi
                        default_gw_if_old=${default_gw_if}
                        ;;

                "${backup_wan_if}")     #backup wan interface is default gateway
                        backup_wan_gw_ip=${default_gw_ip};

                        if [ "${default_gw_if_old}" == "${primary_wan_if}" ] && [ "${primary_wan_gw_ip}" != "" ]; then #backup is up again, kill the states of the primary wan
                                killedStates=`/sbin/pfctl -k gateway -k ${primary_wan_gw_ip} 2> /dev/stdout`
                                logger "AutoStateKill-Script: ${default_gw_if} is now the default gateway, killing states of old gateway ip ${primary_wan_gw_ip}... ${killedStates}"
                        fi
                        default_gw_if_old=${default_gw_if}
                        ;;

        esac

#Sleep for 1minute and check again
sleep 60

done

I currently start it with a crontab entry like:
@reboot          root          autoStateKill.sh &

and the script is placed in the /usr/local/bin folder.
But it really would be nice to have a "clear state" function directly built in OPNsense.

For WireGuard clients becoming stale, see my workaround here: https://forum.opnsense.org/index.php?topic=38485.msg201348#msg201348

I hope this gets implemented again in some form; it is terrible for failback not to have this.
What would be the reason to remove the option for this!?

What would be the reason to remove the option for this!?

Multiple issues with that implementation mentioned in https://github.com/opnsense/core/issues/5045 - such as breaking Unbound DNS (https://github.com/opnsense/core/issues/5367) and causing other severe disruption.

I understand. Maybe a warning would have been better rather than yanking it out with no replacement; I suppose there is no "official" fix?
From: doktornotor @.>
Sent: 4 August, 2024 08:20
To: opnsense/core @.>
Cc: Andreas M. Iwanowski @.>; Comment @.>
Subject: Re: [opnsense/core] system: optional state kill for tier 2 -> 1 transition (Issue #6803)
What would be the reason to remove the option for this!?
Multiple issues with that implementation mentioned in #5045https://github.com/opnsense/core/issues/5045 - such as breaking Unbound DNS (#5367https://github.com/opnsense/core/issues/5367) and causing other severe disruption.
—
Reply to this email directly, view it on GitHubhttps://github.com/opnsense/core/issues/6803#issuecomment-2267423030, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AAHWIBUPN4BOZOBOAVAMRC3ZPXPZVAVCNFSM6AAAAAA4FBM4XKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDENRXGQZDGMBTGA.
You are receiving this because you commented.Message ID: @.***>

Requesting this feature as well. Current behavior destroys the ISP w/ metered 5G/LTE Failover use-case

Seems script listed above is working out well. I use ntopng and could see the connections drop off backup wan when primary came back online. Only difference is i put it in rc.syshook.d instead of cron tab so i could see the script start in the logs. that directory is /usr/local/etc/rc.syshook.d/start

source: gharchive/issue

authors: awptechnologies cretl doktornotor fichtner gitmachtl lcasale namezero111111 wgrana

repo: opnsense/core

license_type: permissive

license_source: github-api


text:
mass edit in firewall rules

Important notices
Before you add a new report, we ask you kindly to acknowledge the following:

[x] I have read the contributing guide lines at https://github.com/opnsense/core/blob/master/CONTRIBUTING.md
[x] I am convinced that my issue is new after having checked both open and closed issues at https://github.com/opnsense/core/issues?q=is%3Aissue

Is your feature request related to a problem? Please describe.
Yes my issue related to the problem. I have several thousands firewall rules and sometimes i need to do changes for multiply rules(In most cases hundreds). In current moment exist only one way to do it in opnsense - manual edit one by one. Due to it normally for simple change(  for example gateway item ) for hundred firewall rules need to spend 2 -3 hours doing stupid task .
( Select rule , press edit , do change , press save and repeat again.)
Describe the solution you like
it is very simple . You already have possibility to select rules . Only what needed to add button "edit selected" and implement edition of field which was changed for all selected rules.
Describe alternatives you considered
such way mass edit quite good implemented in Netbox Gui. It is not alternative but can be used as a concept.
Additional context
Add any other context or screenshots about the feature request here or links to relevant forum thread or similar

Wow, this could be a MASSIVE improvements in OPNsense usability!!!
As a Network Engineer used to work with Cisco ASA through CLI, I often find quite slow to work with multiple rules on OPNsense.


text:
Unbound: allow discard-timeout to be configured

Important notices
Before you add a new report, we ask you kindly to acknowledge the following:

[X] I have read the contributing guide lines at https://github.com/opnsense/core/blob/master/CONTRIBUTING.md
[X] I am convinced that my issue is new after having checked both open and closed issues at https://github.com/opnsense/core/issues?q=is%3Aissue

Is your feature request related to a problem? Please describe.
In Unbound DNS, if RFC 8767 support is configured with defaults (1800ms), replies that arrive >1900ms (discard-timeout) do not update the cache. This severely impacts the usability of RFC 8767 which can be invaluable when dealing with slow resolvers.
Describe the solution you like
I would like to be able to configure 'discard-timeout' on the UI (Advanced settings), probably within 'serve expired settings'
The help should guide the user to make this value higher than the client expired response timeout and warn that otherwise these late responses will not update the cache
Describe alternatives you considered
An alternative would be to allow custom settings, However this was previously removed, and does not help/guide the user who's using serve-expired to get a valid configuration.
I tried manually editing some of the unbound configuration, but these of course get overwritten on service start....
Additional context
See initial discussion at https://forum.opnsense.org/index.php?topic=40738.0
Note the reference to being a bit larger than server-expired-client-timeout in the official docs at https://unbound.docs.nlnetlabs.nl/en/latest/manpages/unbound.conf.html
discard-timeout:
The wait time in msec where recursion requests are dropped. This is to stop a large number of replies from accumulating. They receive no reply, the work item continues to recurse. It is nice to be a bit larger than serve-expired-client-timeout if that is enabled. A value of 1900 msec is suggested. The value 0 disables it.
Default: 1900
I am planning to experiment with a value around 3000 (since there is a related timeout for all tcp queries against auth servers that defaults to 3000)
The biggest cause of slow replies in my case was 'far away' servers. I am using quad9 DoT, but some chinese servers in particular can on occasion take 2,3,4 seconds to reply. serve-expired can work well here, but I want to catch the responses that finally come back so that I keep the cache as fresh as possible
Note that this particular code path results in the request queue exceeded counter increasing. A little misleading, as really this is a 'requests dropped' counter. However that's a base unbound issue... This was how I originally noticed the issue, questioning why the counter was increasing when I was nowhere near queue size limits.
Finally if it helps I could consider trying to build a PR. I'm an experienced dev & have worked with open source, but never opnsense.

It should be quite easy to add if you want to take a stab at it follow 387fc592d7cbd68

It should be quite easy to add if you want to take a stab at it follow 387fc59

I'll give it a go (may be a few days). thx

Thanks for the tip. I got past some build glitches (git) and I think the PR is appropriate.

Left small review notes, but I'm confident this will land soon :)


text:
security/acme-client: feature request for DNS Service Loopia (dns_loopia)

Hi!
Would be great if the API for the DNS service provider "loopia.com" (acme/dnsapi/dns_loopia) could be added to the list in opnsense Let's Encrypt GUI.
/Thanks

See pull request https://github.com/opnsense/plugins/pull/1524

However, I don't think it was added to the upstream project yet, see their README:

Potential providers are as follows. If you would like to contribute one, follow the CONTRIBUTING.md and then open a pull request.

Loopia is below that list. What you need to do first is to make your contribution to the lexicon project.

Loopia is below that list. What you need to do first is to make your contribution to the lexicon project.

No, that's not true. It is natively supported by acme.sh, so it's pretty easy to add support for it. I'll try toadd it for one of the next releases.

True, I was trapped in my realm it seems.

Support for Loopia will be available in the next release (not today's release, though).

Thanks a lot!

authors: fraenki jpawlowski moldino

repo: opnsense/plugins


text:
Quagga: Error when redistributing more than one source

@fabianfrz I tried to redistribute multiple sources but I always get a:

No matter which values I choose, it's only when theres mor than one.
Do you have any clue?
Thanks

this looks like there has been a character sent, which is not a valid option of the list. Is a wrong character in the list? Maybe a special char?

It's picked from here:
https://github.com/opnsense/plugins/blob/master/net/quagga/src/opnsense/mvc/app/models/OPNsense/Quagga/OSPF.xml#L25-L37
The problem is, I can select every entry if I only select one. But when a second one is added I get the error

@fabianfrz When I change the FieldType to CSV and type in e.g. kernel and static manually it works.
I'm not sure if OptionField really allows/accpets Y?

@mimugmail If it fixes the issue, you can create a pull request and I will merge it.

Ok, can I add it to #186 ? But what happens to existing installations when the field type in the model changes?

@mimugmail If they are compatible, nothing happens but if they are not, the validation will fail so the user has to change it. In such a case a migration needs to be created.

@fabianfrz Since the values wont change this should be fine.
Can I rename #186 and add the change for BGP and OSPF to it (perhaps also RIP)?

Yes, you should be able to rename it (click edit right of the title)

@fabianfrz This one fixes the issue, so no change is needed:
https://github.com/opnsense/core/commit/ac75ef6f10665b495f4d7503dc05dc804d63a061

authors: fabianfrz mimugmail


text:
Add logrotate prerotate option

Mirror the log rotation postrotate attribute with a prerotate attribute.

Hi. I am an automated pull request bot named Curry. There are commits in this pull request whose authors are not yet authorized to contribute to Chef Software, Inc. projects or are using a non-GitHub verified email address. To become authorized to contribute, you will need to sign the Contributor License Agreement (CLA) as an individual or on behalf of your company. You can read more on Chef's blog.
GitHub Users Who Are Not Authorized To Contribute
The following GitHub users do not appear to have signed a CLA:

@zepheiryan

Please sign the CLA here.

Hi. Your friendly Curry bot here. Just letting you know that all commit authors have become authorized to contribute. I have added the "Signed CLA" label to this issue so it can easily be found in the future.

Rebased and merged as c0054f2954adc209dce009b7d988cdd22b098b2f

source: gharchive/pull-request

authors: chef-supermarket juliandunn zepheiryan

repo: opscode-cookbooks/chef-client

license_source: bigquery


text:
Windows Slaves Logon As A Service right automatically add

Added a new xml element to winsw here: https://github.com/kohsuke/winsw/pull/70
It has been since released in winsw 1.17.  Would address #374
/cc @mcallb

I would like to :+1:  this if it's a real blocker, but would also like it if @carpnick could give me a little more context on what this could affect. @mtyler Do you know how I would test this?

@someara Are you also able to review a PR like this?

@stephenlauck @someara , This involves adding the Logon As A Service right to the configured user of the WIndows Service.  By default, even the Administrator account is not in this group.  So basically if you have a Windows Slave not on a domain, where GPO could push this setting down,  you have no way to assign the user this logon right.
Basically without this change, the jenkins_windows_slave resource will configure the winsw configuration correctly, but the service will not start.  This is because the user was not added to the logon as a service security group.
Integrated into winsw 1.17, is the new logic to add the right automatically for the specified user in the winsw configuration file with this config change.

I :+1: this change

LGTM... @schisamo ?

This was merged to master as:
https://github.com/opscode-cookbooks/jenkins/commit/1448725fbdbc5d7e599dc9c7d1abcaaff026767f
https://github.com/opscode-cookbooks/jenkins/commit/1afca1ecafe8034cd20eb1f02dfbe492c4047923

authors: carpnick mtyler schisamo someara stephenlauck

repo: opscode-cookbooks/jenkins


text:
Slight refactor of "Changes to prepare rhel (ppc64/le) and ubuntu(ppc64le) build machines"

This PR is meant to replace https://github.com/opscode-cookbooks/omnibus/pull/94
/cc @opscode-cookbooks/ociv

Hi. I am an automated pull request bot named Curry. There are commits in this pull request whose authors are not yet authorized to contribute to Chef Software, Inc. projects or are using a non-GitHub verified email address. To become authorized to contribute, you will need to sign the Contributor License Agreement (CLA) as an individual or on behalf of your company. You can read more on Chef's blog.
Non-GitHub Verified Committers
There are 1 commit author(s) whose commits are authored by a non-GitHub verified email address. Chef will have to manually verify that they are authorized to contribute.
Please sign the CLA here.

:+1: thanks @kaustubh-d @schisamo

authors: chef-supermarket schisamo scotthain

repo: opscode-cookbooks/omnibus


text:
🛑 Clinician UI is down

In 5921f53, Clinician UI (https://clin.optbp.com/) was down:

HTTP code: 403
Response time: 144 ms

Resolved: Clinician UI is back up in 83bbfc2.

repo: optbp-monitor/optbp-monitor

license: MIT


text:
Add lambda code for replace API Destination

This Lambda is used to replace API Destination.

Why use this Lambda?

Because API Destination has a 5-second timeout limit.
Replace API Destination with Lambda and increase the timeout to 15 minutes.

In this function, use AWS SQS as the source and this Lambda function as the target. This Lambda receives messages from SQS and sends them to the webhook.

In This we have Go lang and Python 2 language code

Now the code is more generic and will work on also other than SQS.
Added FORWARD URL in Lambda Environment variables that is safe & easy to update.

repo: optiowl-cloud/lambda-api-destination


text:
SDXL inference

Adds support for SDXL inference.
The images look reasonable, but it needs a little more testing.

Turns out the issue with the fuzzy images was that I'd not updated the VAE latent scaling factor, which is different for SDXL vs SD. With that fix the images look clear again (though the schedulers likely need more updates for SDXL, but that can happen in another PR).


text:
TDE and CDB files

Type of question
I would like to know more about the background of the TDE toolchain and the CDB files which seem to be used as basis for generating large parts of the Coherence code.
Question
What did you do?
I wanted to do some experiments by tweaking the method public QueryResult query(Filter filter, int nQueryType, PartitionSet partMask) in com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache$Storage but struggled to find the Java source code for this.
It seems that the code is generated out of tde/core-net/3.0/cdb/Component/Util/Daemon/QueueProcessor/Service/Grid/PartitionedService/PartitionedCache.cdb  (and a lot of other code too analogously)?
I found the tde utility (Tangsol Desktop) under tools/bin/tde which allows to open those cdb files and look at them/modify them. With a bit of try and error I managed to modify the method I was interested in and by re-running the toolchain get the result I wanted to in the first place, but to be honest, half of the time I did not understand what I was doing.
So my questions are:

What are those cdb files and the tde tool and what is the general idea behind it? Is this something tangosol-properitary or part of/based on some other tooling?
Is there some documentation on how it all works in more details (e. g. what do all the options mean in tde, how as a developer you are supposed to use the tool, where would you do changes to code if you want to introduce new functionality, etc.)?
Are there plans to move away from this toolchain to something, let's say, more intuitive to the regular developer or is the current situation that tde/cdb is just too tightly integrated into the Coherence DNA to make it worth the effort?

Thanks, regards, Leo
What did you expect to see?
I would like to see documentation about TDE and the CDB format.
What did you see instead? Under which circumstances?
I couldn't find any documentation.
Environment
N/a
Additional context
N/a

Hi @leolegenie,
Here are some answers to the specific Qs you called out:

a cdb file is a binary format that serializes the entire definition of a Component including traits, behaviors, sub components, properties, etc. These cdb files are viewed, edited, created and deleted via TDE (Tangosol Development Environment). It is  proprietary and we put v.little investment in the tooling and compiler.
Our documentation is pretty thin - non-existent in this area other than what is more like a cheat sheet here. We will be developing some material to help both internal and external audiences develop with components easier as it truly is the core of the product.
We decided against a sweeping movement to migrate all components to some other JVM-based language and instead are designing new features to be primarily developed in java and provide integration points with the various components they need to integrate with, where possible. Good examples of this are persistence and our transport layer (message bus).

Happy to keep this issue open until we make good on our promise to provide better docs.

Hi @leolegenie,
Here are some answers to the specific Qs you called out:

a cdb file is a binary format that serializes the entire definition of a Component including traits, behaviors, sub components, properties, etc. These cdb files are viewed, edited, created and deleted via TDE (Tangosol Development Environment). It is  proprietary and we put v.little investment in the tooling and compiler.
Our documentation is pretty thin - non-existent in this area other than what is more like a cheat sheet here. We will be developing some material to help both internal and external audiences develop with components easier as it truly is the core of the product.
We decided against a sweeping movement to migrate all components to some other JVM-based language and instead are designing new features to be primarily developed in java and provide integration points with the various components they need to integrate with, where possible. Good examples of this are persistence and our transport layer (message bus).

Happy to keep this issue open until we make good on our promise to provide better docs.

Thanks for the info, I created some notes on how to get started with the tool here, just in case.

Thanks for the info, I created some notes on how to get started with the tool here, just in case.

Just wanted to comment on this in case anyone else is learning to work with TDE and edit CDB files.
We now generate compileable Java source in addition to compiled classes during TDE compilation, as part of coherence-core-components module build. We actually compile them as well, to make sure the source continues to compile as we make changes to CDBs it is created from, and you can also choose to compile and package the classes created from the generated sources by specifying -Ptde.sources when doing Maven build (instead of TDE-generated classes, which is the default, or if -Ptde.classes option is specified explicitly).
This allows you mark coherence-core-components/target/generated-sources as "generated sources" directory in IntelliJ and read, debug and even try things out in IntelliJ by making changes to the generated sources and running tests against them directly. Of course, any changes you make have to be applied to the right CDB files in order to be made permanent, at least for the time being.

Thanks, very helpful, particularly for debugging!

authors: aseovic harveyraja leolegenie

repo: oracle/coherence


text:
Port 478 to 3.x

Port #479 to 3.x

Fixed in #593

repo: oracle/helidon-build-tools


text:
Feedback on the package error issue in the operation of creating a new Java class.

Type: Bug
Steps:
1.Right-click on the folder in the project.
2.Create a new Java class.
Outcome:
An error will be reported in the package statement on the first line.Error message: "The package is incorrect (hints(1): 1:9-1:21)".
However, if you close the compiler and then restart it, the error will no longer be reported.
Extension version: 23.0.1
VS Code version: Code 1.96.0 (138f619c86f1199955d53b4166bef66ef252935c, 2024-12-11T02:29:09.626Z)
OS version: Windows_NT x64 10.0.22631
Modes:

System Info

Item
Value

CPUs
13th Gen Intel(R) Core(TM) i7-13650HX (20 x 2803)

GPU Status
2d_canvas: enabledcanvas_oop_rasterization: enabled_ondirect_rendering_display_compositor: disabled_off_okgpu_compositing: enabledmultiple_raster_threads: enabled_onopengl: enabled_onrasterization: enabledraw_draw: disabled_off_okskia_graphite: disabled_offvideo_decode: enabledvideo_encode: enabledvulkan: disabled_offwebgl: enabledwebgl2: enabledwebgpu: enabledwebnn: disabled_off

Load (avg)
undefined

Memory (System)
15.71GB (3.81GB free)

Process Argv
--crash-reporter-id 8ab3bab7-1a2e-4bd6-81af-d29115d458e1

Screen Reader
no

VM
57%

A/B Experiments
vsliv368:30146709
vspor879:30202332
vspor708:30202333
vspor363:30204092
vscod805cf:30301675
binariesv615:30325510
vsaa593cf:30376535
py29gd2263:31024239
c4g48928:30535728
azure-dev_surveyone:30548225
a9j8j154:30646983
962ge761:30959799
pythongtdpath:30769146
pythonnoceb:30805159
asynctok:30898717
pythonmypyd1:30879173
2e7ec940:31000449
pythontbext0:30879054
dsvsc016:30899300
dsvsc017:30899301
dsvsc018:30899302
cppperfnew:31000557
dsvsc020:30976470
pythonait:31006305
dsvsc021:30996838
bdiig495:31013172
a69g1124:31058053
dvdeprecation:31068756
dwnewjupyter:31046869
newcmakeconfigv2:31071590
impr_priority:31102340
nativerepl1:31139838
refactort:31108082
pythonrstrctxt:31112756
wkspc-onlycs-t:31132770
wkspc-ranged-t:31151552
cf971741:31144450
defaultse:31146405
notype1cf:31151524
5fd0e150:31155592

Thanks @Kxiaoguai3 for sharing this !
We are looking into this issue . Need some more info as we are currently unable to reproduce this .
Just check once if you are also using Language Support for Java(TM) by Red Hat  or Extension Pack for Java  because this Create a new Java class option is not contributed by our extension .
To create a new java class using our extension we recommend  following the steps below :-

Type Java: New File From Template in the Command Palette .
Choose Java
Template  Java Class

Let us know if this way works for you .

repo: oracle/javavscode


text:
Data Science Services artefacts inclusion

It would be great to get the Data Science Services artefcats  included in the toolkit

Projects
Notebook sessions
Models & Model Deployments
Vaults, keys, and secrets.

@borkur Vaults & Keys are already included but I'll look at the others.

Thanks! it would be a very useful feature for us

Data Science Project / Notebooks will be in 0.47.0

authors: borkur toxophilist

repo: oracle/oci-designer-toolkit


text:
fix server-time

comment from IRC:

dan-: oragono sends broken server-time (it removes trailing zeroes from the milliseconds)

seems our server-time impl doesn't always send out zero-padded last parts of the timestamp, e.g. client spit out this message: 2019-08-26 16:07:49 [Debug] Invalid timestamp from server-time tag: "2019-08-26T14:07:49.42Z"

Closing in favor of #620.

authors: DanielOaks slingamn

repo: oragono/oragono


text:
example of running with a config

an area showing that you can run oragono with a different config (which is great, thank you!) and that you can configure the yaml as well to change paths (I didn't want to enumerate all the settings, but the awareness of such is hopefully useful to others!)

Between this an #113 - I figured you'd have some specific formatting but it's easier to know what you want once your bootstrapped with maybe something you don't want as much!

Definitely, all good! I tend to be a stickler for formatting and all so I go a bit mental with the revisions sometimes. I really appreciate the work either way, it's awesome to have contributions :)

authors: DanielOaks enckse


text:
Developer Landing Page

As an iterative step towards a more comprehensive developer portal, a developer landing page will provide a focused place where all the various developer-related resources can be found in a consolidated listing

Great job on this @bencgreenberg!
Content
To really set that page apart from the rest of the website and get that “developer-y” feeling more pronounce, we could focus on developer-friendly content first:

Remove the Getting started and Integrations sections as those are more about the product than the platform;
Split the Community section in two: “Join the community” with a link to the Discord so that folks know that they can reach out to other builders and ask questions, and “Built by the community” with links to open source projects built by the community. Build by the community could be among the first blocks as I find it a very strong signal as a developer, and a good thing to browse and get ideas from.
Change “Beta Features” to “Join the Beta program” to switch from passive voice to the active one. Can also mention that the beta program is a great way to suggest improvements to features/API before they reach GA.
That would require deeper changes (although totally feasible) but if we had tags on the blog we could link to our “Engineering” blog directly, i.e. we filter down by the “Engineering” tag.
We have a few engineering-focused talks by the Orbit team that could maybe find a home in this page as well? Yours as Rails Conf, mines at the Eleventies and Jamstack Berlin… Not 100% sure this is a good idea, just throwing it out there.

Design

Wondering whether we should remove the Orbit Model banner at the bottom as it’s standing out a bit too much currently
I riffed on an alternative to the content on each card:

Adding a few words of description with each item can let us be more explicit, or creative, or geeky etc…

Here’s the markup if you want to reproduce

API reference

View and test all endpoints in the browser

Key concepts

Learn about Orbit concepts and primitives

Common API calls

Handy code snippets for the most common requests

Swagger/Postman definitions

Import the API reference into your favourite tool

@phacks, thank you for such a thoughtful review. I don't think I've been greeted before by such deliberateness in consideration and in the formatting of it! ❤
Let me respond to your points:
Content

Remove the Getting started and Integrations sections as those are more about the product than the platform;

I'm going to keep the getting started section, as information on the product is also integral, but I believe you are right about the integrations section. What I would like eventually is a showcase of our own eventual developer tooling to enable a developer to build their own integrations, but the integrations page is not that.

Split the Community section in two: “Join the community” with a link to the Discord so that folks know that they can reach out to other builders and ask questions, and “Built by the community” with links to open source projects built by the community. Build by the community could be among the first blocks as I find it a very strong signal as a developer, and a good thing to browse and get ideas from.

This is a fabulous idea! I'll integrate it as such.

Change “Beta Features” to “Join the Beta program” to switch from passive voice to the active one. Can also mention that the beta program is a great way to suggest improvements to features/API before they reach GA.

An active positioning means we need to have a link to join. Is it the link to the Airtable form? Ideally, we'd also have a landing page for the beta program that enumerated its benefits that this would link to, instead of directly linking to the form. TBC for later.

That would require deeper changes (although totally feasible) but if we had tags on the blog we could link to our “Engineering” blog directly, i.e. we filter down by the “Engineering” tag.

We do tag blog posts on Sanity. I've been using a "Developer Relations" one for example. Can we filter by those? I'm guessing that data is exposed somehow to our site and we could create a blog view based on tag?

We have a few engineering-focused talks by the Orbit team that could maybe find a home in this page as well? Yours as Rails Conf, mines at the Eleventies and Jamstack Berlin… Not 100% sure this is a good idea, just throwing it out there.

Yes! An entire area devoted to our presence in communities (meetups, talks, etc.) is a must-have. Consider that a coming soon feature.
Design

Wondering whether we should remove the Orbit Model banner at the bottom as it’s standing out a bit too much currently

I was feeling the same way. I do like having some call out to the conceptual work behind Orbit. I'd like for it to be minimal though as a developer page should focus on the practical, nonetheless, a small mention somewhere if someone wanted to read up on it would be good. Can be incorporated later.

I riffed on an alternative to the content on each card:

Much better! 👏🏻

Love how it turned out @bencgreenberg! Thanks for the amazingly quick turnaround on the suggestions. Couple more ideas:

For links inside card subheaders, use underline instead of font-purple-400 so that they feel “less important” than the subheaders links (top is my suggestion, bottom is the current look & feel):

The current contrast ratio of card description falls short of being accessible given the background color. Changing from font-gray-500 to font-gray-600 does the trick. In the following screenshots I change the “_ Explore and utilize open-source tooling built_” bit.

Before:

After:

Here’s a video on how I tested the contrast ratio using the dev tools
  https://user-images.githubusercontent.com/2587348/115002104-a5e4ea00-9ea4-11eb-8957-a90b81754409.mp4

Should Getting Started > Integrations be renamed Getting Started > GitHub Integration?
Orbit API > Batch/Bulk Data Import is also in the Community Built section, we might want to only have it there
Node-RED could link to https://nodered.org/
I think Kevin built another open source project for in-person events, should we add it in the Community Built section?
In the Beta section, Alerts & Destinations and Webhooks are nearly the same thing (i.e. Webhooks is the big thing powered by Alerts & Destinations). We might want to only keep Webhook for conciseness.
Should we add Community Built to the Join the Community card?

Can we filter by those? I'm guessing that data is exposed somehow to our site and we could create a blog view based on tag?

I think everything is set up in Sanity, but we’re missing the filtering code in the website. As it’s a fairly common use-case for Eleventy I don’t anticipate it being that difficult to implement though.

Once we’re confident in the content and the design, there’s a code refactoring that I have in mind that might help create a reusable component for those cards and make future changes simpler. We can leverage Nunjucks’ macros to create a card macro which will take its content as parameters. We’re using that patterns in a few places, most notably in the integrations page.
Here we create a new integration macro:
https://github.com/orbit-love/orbit-web/blob/d656aa888aa6fea18bfe352df5587d11fcf630dc/src/includes/macros/features.njk#L92-L124
Here we instantiate it for e.g. the Discourse integration:
https://github.com/orbit-love/orbit-web/blob/d656aa888aa6fea18bfe352df5587d11fcf630dc/src/integrations.html#L45-L67
Happy to pair on this if you’d like!

But as the website is going to change, I’m not sure yet if that’s worth the work. We can talk about that with Gareth!

That's a very good point. We can hold off.

Once we’re confident in the content and the design, there’s a code refactoring that I have in mind that might help create a reusable component for those cards and make future changes simpler. We can leverage Nunjucks’ macros to create a card macro which will take its content as parameters. We’re using that patterns in a few places, most notably in the integrations page.
Here we create a new integration macro:
https://github.com/orbit-love/orbit-web/blob/d656aa888aa6fea18bfe352df5587d11fcf630dc/src/includes/macros/features.njk#L92-L124
Here we instantiate it for e.g. the Discourse integration:
https://github.com/orbit-love/orbit-web/blob/d656aa888aa6fea18bfe352df5587d11fcf630dc/src/integrations.html#L45-L67
Happy to pair on this if you’d like!

Ah, I just saw this comment now. Yes, a reusable component looks like a good idea. The templating looks similar to Rails templates. I think I can work on this.

I think I can work on this.

Awesome. Let me know if I can help!
Out of curiosity I tried swapping the third and fourth cards, and it mitigates a bit the whitespace caused by the long “Community Built” card. Let me know what you think!

Apart from the few tiny comments/typos, I think this is ready to merge! Feel free to hit that button when you’re ready, it should be deployed about a minute after

authors: bencgreenberg phacks

repo: orbit-love/orbit-web


text:
check entry.refs

Adds check for entry.refs

LGTM :+1:

repo: orbitdb/ipfs-log


text:
Support for Haswell

Describe the bug
OrbStack has been broken on this 4th-gen Intel Mac mini for serval versions. It makes a lot of sense to drop support for these outdated systems, however, please opt them out from updates and provide the last supported version.
To Reproduce
Have latest version installed on a Haswell Mac.
Expected behavior

The App should not run, showing a block sign on the App icon, since it is known to be broken.
Auto update should not receive any further updates, if a last supported version of OrbStack is running.

Diagnostic report (REQUIRED)
Error message
🌲 vmgr | time="06-29 17:45:15" level=fatal msg="panic: new machine: Intel CPUs older than Skylake (6th generation) or newer than Ice Lake (10th generation), the newest CPU ever shipped in an Intel Mac, are not supported"

Screenshots and additional context (optional)
Environment

OS: macOS 12.7.5 21H1222 x86_64
Host: Macmini7,1
CPU: Intel i5-4278U (4) @ 2.60GHz

Unfortunately it's no longer possible to add update compatibility checks. Older versions of the app don't send enough info when checking for updates, so we can't detect that it's incompatible.
Older versions are already available at https://docs.orbstack.dev/downgrade.

repo: orbstack/orbstack


text:
No access on External Storage

Describe the bug
Bug details:
OrbStack VMs may lose access to /Volumes/$EXTERNAL_STORAGE_ON_MAC
When acess from VMs, the terminal shows "ls: cannot open directory '.': Not a directory"
This bug USUALLY occurr on my machine, not always.
To Reproduce
Make sure $EXTERNAL_STORAGE_ON_MAC is mounted on mac and have been accessed from orb VMs before reproduce.
Plug out and replug in external storage, then wait for storage can be accessed from mac.
On mac, run commands below:
cd /Volumes/$EXTERNAL_STORAGE_ON_MAC
ls
...show files on /Volumes/$EXTERNAL_STORAGE_ON_MAC...
orb
cd /Volumes/$EXTERNAL_STORAGE_ON_MAC
ls
...show "ls: cannot open directory '.': Not a directory"...
Expected behavior
The external storage can be access from VMs.
Diagnostic report (required)
OrbStack info:
Version: 0.15.0 (150000)
Commit: c5bda1bf8c660116c880c5f4fae3b7625ff19030 (v0.15.0)
System info:
macOS: 13.4.1 (22F82)
CPU: amd64, 8 cores
CPU model: Intel(R) Core(TM) i5-8257U CPU @ 1.40GHz
Full report: https://orbstack.dev/_admin/diag/orbstack-diagreport_2023-07-24T02-10-59.655473Z.zip
Screenshots and additional context (optional)
The image shows the situation.

Workaround: Restart OrbStack or change orbstack VM options like memory or cpus. (On some preview builds a button can poweroff/poweron orbstack, but recently builds removed it. I have to quit orbstack and reopen. READD A BUTTON to do this operation? )
The external storage fs is NTFS and I use Paragon NTFS.

I had similar issues with mounts through /Volumes on mac - could not read entire drive, very slow and would hang container (using navidrome music server with music on /Volumes/music NTFS). Had to go back to Rancher Desktop.

Issue still seems to be here - although now container doesn't hang.  Will still arbitrarily stop reading external drive.
Orbstack 1.0.0

Seeing the same as dro-ex; container goes up without complaint, but it cannot list any files from the mapped drive.

I use containers in my home lab, personal use, but out of curiosity, the Pricing page mentions "Priority support" for those under the Pro plan.  Would that include pushing up priority on issues like this one?  I can appreciate if not given that I'd just be a single license holder.

This explains so much about why my setup has been so unstable, hope there's a fix coming!

Fixed for the next ersion.

Released in v1.6.0 Canary 1.
To update to Canary: Settings > Update channel

Released in v1.6.0.
New: Truly fast container filesystems on macOS: 2–10x faster, within 75-95% of native


text:
serve Command Improvements

Signed-off-by: Mior Muhammad Zaki crynobone@gmail.com

Coverage remained the same at 80.247% when pulling 3e389d3099350a6f7b04ff317df744d09b4aaa70 on patch-serve into e241a41fa80bc4f5294ff8d0bf02e461dc37acc9 on 7.x.

authors: coveralls crynobone

repo: orchestral/testbench-dusk

license: mit


text:
About local ip address

Hi, Thank you for the amazing toolkit!
My local ip is 10.0.4.10, another PC is 192.160.0.158
My ip 10.0.4.10 cannot be linked with OSCKit, but 192.160.0.158 can be linked.
Do you think it is possibly due to the OSCKit or it should have worked?

I need more specific information in order to help. "Linked" can mean many different things. What exactly are you trying to do?

I want to send osc signal from my iphone to a pc, UDP way, just send to PC,
single way.
*func* startClient() {

    // OSC client setup

    oscClient = UDPClient(

        //host: "192.168.3.2",

        //host: "192.168.70.58",

        host: ip,

        port: 9000,

        queue: DispatchQueue.main//DispatchQueue.global(qos:

.userInteractive)
    )

    print("UDP client set up. \(ip)")

}

Fu-Hao Chen
Ph.D.
Chemical Engineering, Syracuse University
Dr. Ian D Hosein's lab
On Mon, Dec 19, 2022 at 3:31 PM Steffan Andrews @.***>
wrote:

I need more specific information in order to help. "Linked" can mean many
different things. What exactly are you trying to do?
—
Reply to this email directly, view it on GitHub
https://github.com/orchetect/OSCKit/issues/26#issuecomment-1357212830,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AUGHO2COU2UYIHGRGKZPDD3WOAFM5ANCNFSM6AAAAAATDBCPTA
.
You are receiving this because you authored the thread.Message ID:
@.***>

Are you using your own UDP framework?
Otherwise use OSCClient(), not UDPClient.

Got it. Thank you so much!!!
Fu-Hao Chen
Ph.D.
Chemical Engineering, Syracuse University
Dr. Ian D Hosein's lab
On Mon, Dec 19, 2022 at 3:46 PM Steffan Andrews @.***>
wrote:

Are you using your own UDP framework?
Otherwise use OSCClient(), not UDPClient.
—
Reply to this email directly, view it on GitHub
https://github.com/orchetect/OSCKit/issues/26#issuecomment-1357223307,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AUGHO2GIOBVCJ3SIAKYNNDLWOAHENANCNFSM6AAAAAATDBCPTA
.
You are receiving this because you authored the thread.Message ID:
@.***>

It may work. 11 values should fit within a UDP packet. I would not use an OSCBundle, just send one OSCMessage at a time.
If the packet is too large to send, it will just fail to send. You can try it and see if it works.

Hi,
Since iOS14 requires some privacy settings, may I ask if there is any
bonjour service in OSCKit?
Or do I just need the "privacy-local network description"?
Since some of my customers said they are unable to link to local ip.
I am wondering if I missed some privacy settings.
But in my home wifi, it works very well.
Thank you!
Fu-Hao Chen
Ph.D.
Chemical Engineering, Syracuse University
Dr. Ian D Hosein's lab
On Wed, Dec 21, 2022 at 11:36 AM Steffan Andrews @.***>
wrote:

It may work. 11 values should fit within a UDP packet. I would not use an
OSCBundle, just send one OSCMessage at a time.
If the packet is too large to send, it will just fail to send. You can try
it and see if it works.
—
Reply to this email directly, view it on GitHub
https://github.com/orchetect/OSCKit/issues/26#issuecomment-1360813364,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AUGHO2BS25IBDIZCEK23AMLWOJ3KFANCNFSM6AAAAAATDBCPTA
.
You are receiving this because you authored the thread.Message ID:
@.***>

OSCKit does not contain any built-in bonjour services. It's possible in future it could be added.
If you are trying to communicate with devices on the local area network (LAN) then yes you will want the local network entitlement(s).
If your app is an iOS app, the OS will ask the user to allow the local connection and they must allow it or connections will be blocked and it won't ask them to allow it again.
To check this, in device Settings they would tap on the app and make sure "Local Network" is turned on, like this:

repo: orchetect/OSCKit


text:
Export SHELL service to unetpy

Services.SHELL — while technically not part of Unet, it is convenient to export this for use from unetpy

Added in commit 92dd89ae55922c66ef568b627ccd86895c295e36

This needs to be added in fjagepy and not unetpy.

Fixed in 82282ce153eb4afbee35355b1605702d90b5a0f5

repo: org-arl/unet-contrib


text:
android:allowBackup="true"

please change android:allowBackup="true" to android:allowBackup="false"

It's already false.

compile 'com.orhanobut:logger:1.3'

On the recent versions, it is false. Why don't you use the latest version?

Thanks,I use 1.12 is ok

👍

authors: Lee-Wang-Jing orhanobut

repo: orhanobut/logger


text:
Add a xml printer with test code

Hi. Thanks for your library.
I'm using your library on my company, it is cool.
I added xml printer on Logger.java and I wrote test codes on LoggerTest.java.
Try it and merge please.
Thank you.

This is very nice. I'll go through for the code as soon as possible. Thanks!

authors: moltak orhanobut


text:
🛑 TTS (Oribi Speak) is down

In e6778c8, TTS (Oribi Speak) ($TTS_ENDPOINT/speak) was down:

HTTP code: 502
Response time: 484 ms

Resolved: TTS (Oribi Speak) is back up in 45c3aff after 32 minutes.

repo: oribisoftware/upptime


text:
Provide lock free version of sbtree index

Here is really great article about lock free b-tree case which can be easily ported - http://www.cs.technion.ac.il/~erez/Papers/lfbtree-full.pdf
Do not forget that we use JNA and support platforms beyond Oracle JDK which means that we should work with native memory barriers like this one http://trac.mcs.anl.gov/projects/openpa it has very good multiplatform support but robustness should be investigated.

Not relevant any more

repo: orientechnologies/orientdb


text:
What's the issue with javascript dynamic hooks ?

Issues with Dynamic-Hooks RC-1 #3250
Could someone explain why it's not working as intended ?

Please don't open a new issue to ask when another issue will be fixed.

authors: Bretto lvca


text:
2.1-rc3 i was able to corrupt the database very easily through studio

I was allowed to rename a Vertex Class with a name of its parent. Then I was getting overflow error with reason 505 if I remember correctly when I tried to rename other classes. Now it is to the point that I cannot even load the database through studio although some queries work through Java..
Please let me know how can I find logs or dump the database to find what happened..
I cannot even connect to the database
Disconnecting from the database [null]...OK
Connecting to database [remote:localhost/xxxxx] with user 'admin'...
Error: com.orientechnologies.common.exception.OException: Error on creation of shared resource
Error: com.orientechnologies.orient.core.exception.OConfigurationException: Super class 'InnerText' was declared in class 'FactInnerText' but was not found in schema. Remove the dependency or create the class to continue.

The bug is still there. I'm trapped.

Hi @retrography
when you say "I'm trapped", do you mean that you still cannot access your corrupted database? Do you need help in fixing it?

Yes I am locked out and can't log in. I will try downgrading to the last
version, fix the database and then upgrade again. Is there any other trick
I can try?
On Thu, Aug 6, 2015 at 03:06 luigidellaquila notifications@github.com
wrote:

Hi @retrography https://github.com/retrography
when you say "I'm trapped", do you mean that you still cannot access your
corrupted database? Do you need help in fixing it?
—
Reply to this email directly or view it on GitHub
https://github.com/orientechnologies/orientdb/issues/4539#issuecomment-128272347
.

Hi @retrography
I guess that's the only thing you can try.
If it doesn't work, you can try to send us the DB and we will see if something can be done at low level (if it's really important data)

authors: luigidellaquila retrography zifnab87


text:
[OrientDB 2.0.x] StackOverflowError / Infinite Recursion

Hello,
I am currently experiencing a StackOverflowError in OrientDB due to an infinite recursion. It happens when I perform a commit on a graph instance. I've tested this issue on 2.0.12 and 2.0.15, with identical results (except for the line numbers).
Unfortunately I cannot provide a reproduction example as the error occurs deep inside the business logic of my application, but here is the repetitive part of the stacktrace (from 2.0.15):
at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.executeSaveRecord(ODatabaseDocumentTx.java:1693)
at com.orientechnologies.orient.core.tx.OTransactionOptimistic.addRecord(OTransactionOptimistic.java:312)
at com.orientechnologies.orient.core.tx.OTransactionOptimistic.saveRecord(OTransactionOptimistic.java:253)
at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.save(ODatabaseDocumentTx.java:2316)
at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.save(ODatabaseDocumentTx.java:118)
at com.orientechnologies.orient.core.record.impl.ODocument.save(ODocument.java:1727)
at com.orientechnologies.orient.core.record.impl.ODocument.save(ODocument.java:1718)
at com.orientechnologies.orient.core.record.impl.ODocument.save(ODocument.java:76)
at com.orientechnologies.orient.core.db.record.ridbag.embedded.OEmbeddedRidBag.serialize(OEmbeddedRidBag.java:371)
at com.orientechnologies.orient.core.db.record.ridbag.ORidBag.toStream(ORidBag.java:274)
at com.orientechnologies.orient.core.serialization.serializer.record.binary.ORecordSerializerBinaryV0.writeSingleValue(ORecordSerializerBinaryV0.java:583)
at com.orientechnologies.orient.core.serialization.serializer.record.binary.ORecordSerializerBinaryV0.serialize(ORecordSerializerBinaryV0.java:262)
at com.orientechnologies.orient.core.serialization.serializer.record.binary.ORecordSerializerBinary.toStream(ORecordSerializerBinary.java:105)
at com.orientechnologies.orient.core.record.impl.ODocument.toStream(ODocument.java:2100)
at com.orientechnologies.orient.core.record.impl.ODocument.toStream(ODocument.java:695)
at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.executeSaveRecord(ODatabaseDocumentTx.java:1693)

I can consistently reproduce this issue in my codebase. I would be happy if someone could look into this, perhaps it is possible to reconstruct the issue from the stack trace by analyzing the exact call sequence.

Could it be that you're saving a big graph? In OrientDB v2.1 the save doesn't use the recursion anymore. Have you already tried with 2.1?

Hi,
the graph I am attempting to store has about 10.000 elements (vertices and edges), so it's not really huge.
I wanted to upgrade to 2.1.x in order to fix the problem, unfortunately I got blocked by this bug:
https://github.com/orientechnologies/spring-data-orientdb/issues/26

One more remark: OrientDB does not get in touch with any Spring or Spring Data class in my project. I just posted my comment in that bug report because the stack trace was almost identical and it seemed to be the same root cause. Please see my comment in the other bug report.

Hello again,
after fixing the issue from the other report, I followed your advice and tried using OrientDB 2.1.1 instead. Unfortunately the situation is still the same. Here's the repetitive part of the stack trace in 2.1.1:
at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.executeSaveRecord(ODatabaseDocumentTx.java:1830)
at com.orientechnologies.orient.core.tx.OTransactionOptimistic.addRecord(OTransactionOptimistic.java:432)
at com.orientechnologies.orient.core.tx.OTransactionOptimistic.saveRecord(OTransactionOptimistic.java:363)
at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.save(ODatabaseDocumentTx.java:2464)
at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.save(ODatabaseDocumentTx.java:120)
at com.orientechnologies.orient.core.record.impl.ODocument.save(ODocument.java:1768)
at com.orientechnologies.orient.core.record.impl.ODocument.save(ODocument.java:1759)
at com.orientechnologies.orient.core.record.impl.ODocument.save(ODocument.java:81)
at com.orientechnologies.orient.core.db.record.ridbag.embedded.OEmbeddedRidBag.serialize(OEmbeddedRidBag.java:372)
at com.orientechnologies.orient.core.db.record.ridbag.ORidBag.toStream(ORidBag.java:266)
at com.orientechnologies.orient.core.serialization.serializer.record.binary.ORecordSerializerBinaryV0.writeSingleValue(ORecordSerializerBinaryV0.java:579)
at com.orientechnologies.orient.core.serialization.serializer.record.binary.ORecordSerializerBinaryV0.serialize(ORecordSerializerBinaryV0.java:259)
at com.orientechnologies.orient.core.serialization.serializer.record.binary.ORecordSerializerBinary.toStream(ORecordSerializerBinary.java:105)
at com.orientechnologies.orient.core.record.impl.ODocument.toStream(ODocument.java:2285)
at com.orientechnologies.orient.core.record.impl.ODocument.toStream(ODocument.java:671)
at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.executeSaveRecord(ODatabaseDocumentTx.java:1830)

... this looks rather similar to the stacktrace from the earlier version. The exception is thrown at ODatabaseDocumentTx.java:1940:
com.orientechnologies.orient.core.exception.ODatabaseException: Error on saving record #47:-2986
at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.executeSaveRecord(ODatabaseDocumentTx.java:1940)
at com.orientechnologies.orient.core.tx.OTransactionOptimistic.addRecord(OTransactionOptimistic.java:432)
at com.orientechnologies.orient.core.tx.OTransactionOptimistic.saveRecord(OTransactionOptimistic.java:363)

I would like to provide more details, but unfortunately all of this code resides very deep down in my application. The graph itself is procedurally generated and different on each test run, so I can't even share the graph structure I'm afraid...

@Alan47 Any luck on this issue? We are facing the same issue and reported it as #4941 .

No, unfortunately not - I am still facing this problem, and I have no clue how to solve it :(

Hi Alan,
Before OrientDB 2.2 (soon in beta), saving used recursive algorithm, so if
you are saving many objects you could incur in this problem. With OrientDB
v2.2 we avoid recursion, so this problem doesn't exist anymore. What to do
with OrientDB v2.0 and v2.1? You have 2 options:

keep the transaction smaller by committing more often or
increase the Java stack size with the -Xss option. You could try
with -Xss1m

Best Regards,
Luca Garulli
Founder & CEO
OrientDB http://orientdb.com/
On 11 September 2015 at 09:50, Alan47 notifications@github.com wrote:

No, unfortunately not - I am still facing this problem, and I have no clue
how to solve it :(
—
Reply to this email directly or view it on GitHub
https://github.com/orientechnologies/orientdb/issues/4900#issuecomment-139476651
.

Hi Luca,
thanks for the response. Looking forward to v2.2. Is there any ETA when it will be out? Weeks, months? We will wait for 2.2 and focus on other tasks for now, it would be nice to have some time window for planning purposes.
Kind regards,
Alan

Hi,
2.2 has been released, you should not have any problem with big graphs now, closing this.

authors: Alan47 lvca shajigopal tglman


text:
"missing session and token" after a period of time without interacting with OrientDB

OrientDB Version: 3.0.14
Java Version: 1.8
OS: Red Hat Enterprise Linux
Actual behavior
We are getting the following exception consistently when our system is not being used for while and a new request comes in that requires querying OrientDB. Before that all idle time the queries work fine. The exception is:
! com.orientechnologies.orient.enterprise.channel.binary.OTokenSecurityException: missing session and token
! DB name="map"
! DB name="map"
! at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
! at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
! at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
...

Not sure if this is a bug or I am confused about the java Document API described: here
The current usage of the Document API looks like this:

When our product starts up I create a singleton instance of OrientDB and another of ODatabasePool.
User requests comes in, I build up a query based on the user needs
perform session = odbPool.acquire(); to get a ODatabaseSession
perform session.execute("SQL", command) to get the results
read necessary data from results
perform session.close();
return results

I thought the ODatabasePool was a pool of connections to a database. But looking at the javadoc on ODatabasePool says that it is "A Pool of databases". The documentation also mentions that we should close the database and it goes back to the pool. So I am not sure if I am hitting a bug or misusing the API.
Should I be creating a new ODatabasePool per request instead of having it as a singleton?
My goal is to have the equivalent of the factory.setupPool(10, 30); of the OrientGraphFactory in 2.2.X.

@luigidellaquila Any update on this possible issue?
Thanks

Hi @ismaelpernas
@wolf4ood is working on it, I'll let you know as soon as it's fixed
Thanks
Luigi

Hi @ismaelpernas
i've just proposed a fix in this PR,
https://github.com/orientechnologies/orientdb/pull/8805
Once merged it will solve the issue and it will be available hopefully in 3.0.18
Thanks

thanks @wolf4ood !
I'll keep an eye on the 3.0.18 release.

Same thing just happened to me now, on 3.0.19, please reopen.
Let me know if you prefer I'll open a new one, although everything is exactly the same.

authors: ismaelpernas luigidellaquila matanshukry wolf4ood


text:
Adds Task.do

As per issue #111.
I've seen it's scheduled for post-2.0 but I had the code lying around and I love my (syntactic) sugar.
It can be used like this:
Task.do(function *() {
  const a = yield delay(10);
  const b = yield delay(11);
  const c = yield Task.of(5);
  return Task.of(a + b + c + 4);
})

Right now all the yielded / returned values need to be an instance of Task and behave like Haskell's bind, while in JavaScript (async/await, coroutines) values get promisified if they're not Promises.
I personally think it's confusing to promisify things implicitly and caused a few misunderstanding while teaching newcomers.
What do you think about it?
EDIT: I forgot to say, I'm not sure I followed the right convention for the type annotation, so that may need some fixing
Thanks

Hey, thanks :)
I agree on the part of not trying to reify values into tasks implicitly. I do think this is better defined in terms of the Monad interface, though.
That way, given:
const  x = Task.do(function* () {
  const a = yield taskA;
  const b = yield taskB;
  return Task.of(a + b);
});

Gets translated to:
const x = taskA.chain(a => {
  return taskB.chain(b => {
    return Task.of(a + b);
  });
});

This ensures we respect things like external cancellation, which would be a bit more difficult doing this way because there's a bit of state that needs to be tracked.

Sure thing, updated to use the monadic interface

Sorry for taking so long to review the changes Orz I'll try to do it this weekend

Thanksies :)

authors: framp robotlolita

repo: origamitower/folktale


text:
OroConfigBundle: doesn't save new settings

Hello!
I'm working on the Akeneo integration, and adding one settings field, that should be handled by OroConfigBundle.
A field is displayed on a configuration page, but can't be saved - it says "Configuration saved" but after reloading a page the field is still empty, also no value written in DB.
Here's my system_configuration.yml example:
oro_system_configuration:
    groups:
        catalog:
            title: 'Catalog'
            icon:  'icon-folder-open'
        catalog_general_setup:
            title: 'General setup'
        products:
            title: 'Products'
        products_settings:
            title: 'Products settings'

    fields:
        mybundle.my_value:
            type: text
            priority: 10
            options:
                label: 'My Value'

    tree:
        system_configuration:
            catalog:
                children:
                    catalog_general_setup:
                        children:
                            products:
                                children:
                                    products_settings:
                                        children:
                                            - mybundle.my_value

I found this code prevents it from being saved:
\Oro\Bundle\ConfigBundle\Config\ConfigManager::getChanged():
// save only if setting exists and there's no default checkbox checked
            if (!is_null($currentValue) && empty($value['use_parent_scope_value'])) {
                $updated[$key] = $value;
            }

As it's a new field, $currentValue is null in my case and getChanged() returns an empty array, and now values are saved.
Will you fix it? Or do I miss something?

Hi
Please, check that you have added corresponding settings to your config tree in Configuration of your Bundle
Example
    SettingsBuilder::append(
            $rootNode,
            [
                'my_value' => ['type' => 'string', 'value' => ''],
            ]
    );

And them are applied in Extension
$container->prependExtensionConfig($this->getAlias(), array_intersect_key($config, array_flip(['settings'])));

No activity on this issue for 30 days so I assume it has been resolved. @alexkuk feel free to reopen it if necessary.

authors: alexkuk artml x86demon

repo: orocrm/platform


text:
Import from CLI always run in validation mode

"hasOption" will search option in InputDefinition, so, it is always exist and import_validation will run always instead of import

Hi @scapital
Thanks for pointing that out! This issue has been fixed in the latest master. Please, feel free to reopen it if you have any questions.

authors: mkudelya scapital


text:
Crashlytics dependency

Could we add dependency to 'CrashlyticsFramework'?

So now Crashlytics has pushed their official Podspec, could we assign it as required dependency?
For Podfile like
use_frameworks!
pod 'ARAnalytics', :subspecs => ['Crashlytics']

This is necessary (Since the built ARAnalytics.framework does require Crashlytics.framework)

for sure

authors: orta sodastsai ssuchanowski

repo: orta/ARAnalytics


text:
Extension not finding my jest-config.json

I have the following line in settings.json:
  "jest.pathToConfig": "${workspaceRoot}/.vscode/jest-config.json"

For some reason this extension still isn't finding my config file. Running the command node ./node_modules/jest/bin/jest.js --config ./.vscode/jest-config.js works without any issues. However because the extension isn't finding my jest-config.json tests are failing saying that fetch is undefined.
I have this message in the developer console:
ENOENT: no such file or directory, open 'extension-output-#4': Error: ENOENT: no such file or directory, open 'extension-output-#4'
    at Object.fs.openSync (fs.js:558:18)
    at Object.module.(anonymous function) [as openSync] (ELECTRON_ASAR.js:173:20)
    at fs.readFileSync (fs.js:468:33)
    at fs.readFileSync (ELECTRON_ASAR.js:506:29)
    at parse (/home/tam/.vscode/extensions/Orta.vscode-jest-2.2.0/node_modules/jest-editor-support/build/parsers/BabylonParser.js:21:16)
    at JestExt.triggerUpdateDecorations (/home/tam/.vscode/extensions/Orta.vscode-jest-2.2.0/out/src/JestExt.js:132:29)
    at vscode.window.onDidChangeActiveTextEditor.editor (/home/tam/.vscode/extensions/Orta.vscode-jest-2.2.0/out/src/fileChangeWatchers.js:9:21)
    at e.invoke (/usr/share/code/resources/app/out/vs/workbench/node/extensionHostProcess.js:23:14715)
    at e.fire (/usr/share/code/resources/app/out/vs/workbench/node/extensionHostProcess.js:23:53565)
    at /usr/share/code/resources/app/out/vs/workbench/node/extensionHostProcess.js:23:390025
    at e.invoke (/usr/share/code/resources/app/out/vs/workbench/node/extensionHostProcess.js:23:14715)
    at e.fire (/usr/share/code/resources/app/out/vs/workbench/node/extensionHostProcess.js:23:53565)
    at t.$acceptDocumentsAndEditorsDelta (/usr/share/code/resources/app/out/vs/workbench/node/extensionHostProcess.js:23:346353)
    at t.e.handle (/usr/share/code/resources/app/out/vs/workbench/node/extensionHostProcess.js:23:312304)
    at s (/usr/share/code/resources/app/out/vs/workbench/node/extensionHostProcess.js:23:176531)
    at h (/usr/share/code/resources/app/out/vs/workbench/node/extensionHostProcess.js:23:177208)

I've managed to get this working by looking through other issues. Since I'm using create-react-app all I needed to do was add this to my settings.json:
"jest.pathToJest": "npm run test --"

repo: orta/vscode-jest


text:
Mailgun 550 有没有好的解决方法？

Mailgun日志返回550 Ip frequency limited.
是发信服务器IP被限制，有没有好的解决方法？
而且Mailgun发送成功也只是Accepted，基本上也收不到。

自己加入了 SendCloud 替代 Mailgun，国内友好。完结此单

我也是sendcloud不过不成功提示500错误。你知道怎么解决吗？

authors: MoeGakuen gtihubAlimjan

repo: orvice/ss-panel


text:
ifcfg-dns: Allow DNS changes without restarting

This change allows DNS servers and search domains to be modified on the fly without restarting interfaces. The DNS nameservers and search domains are written to the ifcfg file and /etc/resolv.conf will be updated in place.
This change also includes some code cleanup and updates string formatting in some places to match Python3 style.
Link: https://bugzilla.redhat.com/2315341
Fixes: https://issues.redhat.com/browse/OSP-32857
Fixes: https://issues.redhat.com/browse/OSP-32858
Signed-off-by: Dan Sneddon dsneddon@redhat.com

If DNS is removed/added, then the new ifcfg has changes w.r.t PEERDNS which triggers the ifdown/ifup.
If DNS is not present in ifcfg and DOMAIN is removed now, then there is no update to the resolv.conf as well.
I understand that these are corner and specific cases that might not be required in the current context.

If DNS is removed/added, then the new ifcfg has changes w.r.t PEERDNS which triggers the ifdown/ifup. If DNS is not present in ifcfg and DOMAIN is removed now, then there is no update to the resolv.conf as well. I understand that these are corner and specific cases that might not be required in the current context.

It is not expected that changes to PEERDNS can be done without restart. The PEERDNS setting affects DHCP so the interface will be restarted to obtain a new DHCP response.

authors: dsneddon karthiksundaravel

repo: os-net-config/os-net-config


text:
Make a release of Python-OMX

ActivitySim needs to read OMX files. Based on feedback from the community we'd like to have OMX available as a standalone Python library installable via pip and conda (on PyPI and binstar, respectively). This kind of release is required so we can easily install the OMX library for things like automated testing and so it can be listed as an explicit dependency of ActivitySim.
Related to making a release, I'd recommend splitting the directories for each OMX library into separate repositories. That's not strictly necessary, but it has some conveniences:

users can install omx directly from GitHub via pip
tagged releases of Python code don't include the other languages
maintenance and development branches for one language don't include the other languages

As an example, the official GitHub API wrappers for different languages are kept in separate repositories: https://github.com/octokit.
Whether you decide to split the the directories or not, I'm happy to help with the infrastructure for a release. We'll need this available soon for ActivitySim development and testing. (Though not until after the New Year.)
You may also be interested in the changes I made for the proposed integration of OMX with ActivitySim: https://github.com/synthicity/activitysim/pull/7. The changes included PEP8 compliance, switch to pytest for running unit tests, and additional test coverage.

Just wanted to bump this. We'd like to get this available ASAP so we can rewrite existing ActivitySim PRs, merge them, and keep moving. cc @billyc Thanks!

@jiffyclub Can the stand alone library be created without splitting the project? If so, would you be willing to create a pull request to make this happen? I think it might help expedite the situation with the OMX team. Thanks.

I think a phone call to discuss what you are doing and what your needs are would be helpful.  After that, I'll engage the OMX community as needed.  Thanks.

@bstabler Thanks. I got a note back that @billyc has this on his todo list. Hopefully, he can start on it after TRB. Perhaps the two of you could touch base to determine if he will need any help.

@jiffyclub , I think @danielsclint question is still an open issue.  My sense is also that we would need to split the libraries (which I am in favor of anyway) - but just wanted to make sure we had all the options on the table.

This is workable whether it is decided to split the repo or keep everything
together. But my recommendation is to create language-specific repositories
(for the reasons above). I'm happy to make a PR once I know which direction
to go.
On Wed, Jan 14, 2015 at 5:42 PM Elizabeth Sall notifications@github.com
wrote:

@jiffyclub https://github.com/jiffyclub , I think @danielsclint
https://github.com/danielsclint question is still an open issue. My
sense is also that we would need to split the libraries (which I am in
favor of anyway) - but just wanted to make sure we had all the options on
the table.
—
Reply to this email directly or view it on GitHub
https://github.com/osPlanning/omx/issues/13#issuecomment-70027056.

Closing per https://github.com/synthicity/activitysim/issues/12#issuecomment-73619229.

authors: bstabler danielsclint e-lo jiffyclub

repo: osPlanning/omx


text:
can get same color both ios and android?

I'm having a problem that I can get the same color between 2 operating systems android and ios. Is there any way to have the same color with the same photo? Thanks!

hey, sorry not at the moment no. if you have a backend service it could generate image colors for your frontend there.

repo: osamaqarem/react-native-image-colors


text:
tests: Start splitting image info from upload & boot tests

See discussion here
https://github.com/osbuild/osbuild-composer/pull/949#pullrequestreview-476585040
and also here:
https://github.com/osbuild/osbuild-composer/issues/888#issuecomment-662933161

The image info portion should be moved to osbuild
The upload to cloud & boot portion in golang is also duplicated to some extent by test/image-tests/*.sh (these are not in the -tests RPM I think)
The upload & boot tests should be adjusted appropriately so that the images are actually built from the currently configured sources in osbuild-composer (e.g. nightly builds)

* The upload to cloud & boot portion in golang is also duplicated to some extent by `test/image-tests/*.sh` (these are not in the -tests RPM I think)

We would like to move the test/image-tests/*.sh scripts to the -tests RPM but noone has done it yet.
As for the golang implementation of cloud boot, if #956 and #960 get merged we will also use the code for running the "base" tests (https://github.com/osbuild/osbuild-composer/blob/master/schutzbot/run_base_tests.sh).

* The upload to cloud & boot portion in golang is also duplicated to some extent by `test/image-tests/*.sh` (these are not in the -tests RPM I think)

We would like to move the test/image-tests/*.sh scripts to the -tests RPM but noone has done it yet.
As for the golang implementation of cloud boot, if #956 and #960 get merged we will also use the code for running the "base" tests (https://github.com/osbuild/osbuild-composer/blob/master/schutzbot/run_base_tests.sh).

Much of this was now done/changed, but moving out image-info itself is still on the TODO.

Also note that the test/cases/api.sh now also boots images. At least AWS and GCP one...

authors: atodorov msehnout teg thozza

repo: osbuild/osbuild-composer


text:
fedora: f36 went EOL

Removes all references to Fedora 36 since it went EOL.
See: https://docs.fedoraproject.org/en-US/releases/eol/

There's a few ansible yaml files that contain fedora 36; I don't fully understand them.

manifest-diff is only talking about the removed f36 ones :)


text:
Convert to LinkML schema

Description
LinkML is a yaml-based schema definition language. It can be used to generate other schema formats, such as JSON Schema, JSON-LD, xml, etc. By using LinkML for the canonical OSC-EM schema we can then automatically generate schemas in other languages, as well as convert data between some different data container formats. LinkML has broad community support.
Steps

[ ] Convert OSC-EM schema to linkml format. The JSON Schema can be converted automatically using a schemauto importer
[ ] Set up CI/CD to create JSON Schema and JSON-LD automatically. The actions are provided automatically if we apply the linkml cookiecutter to this repository.

Definition of done

Instrument and Sample schemas are in LinkML
JSON Schema is generated automatically for each commit to master

I created a project using the cookiecutter template. I will test using schemasheets, which allows you to use a tsv file for the canonical schema and generate linkml from that.


text:
How do I switch to non-bridge mode？

AppBridge Installation successful and work good.
But I want to switch to non-bridging mode.
When I open app in shopify list, Stay on the following token page.
https://domin_xxx.com/authenticate/token?shop=test_xxx.myshopify.com&target=%2Fhome%3Fhost%3DZWx1by10ZXN0OC5teXNob3BpZnkuY29tL2FkbWlu
Specific Detail:
URL
APP URL: https://domin_xxx.com/home
Redirect URL: https://domin_xxx.com/authenticate

.env (The only thing that changed, it can't work.)
SHOPIFY_APPBRIDGE_ENABLED=false

Route::group(['prefix' => config('shopify-app.prefix'), 'middleware' => ['verify.shopify', 'billable']], function () {
    //Home
    require __DIR__ . '/../routes/app/home.php';
});

Stay on the following token.blade.php page.

the app is currently tethered to the app bridge

Because of the tokens we need app bridge. Correct, it's tied to it .

@osiset
Thank you for your reply.

Hi @osiset, will the package support non embedded apps again ?
Basically, my app has 2 sections. One is embedded, and the other one is not. In the embedded section, I need to click a link that opens an external Full screen view (an editor that contains an iframe preview of the shop frontend).
This used to work fine before updating to v17, now, whenever I click on the external link, it authenticates again then redirect to the embedded app instead of opening in full screen.
There is no way of using regular auth only for the non embedded part ?

authors: enmaboya jackwiy osiset xplodedthemes

repo: osiset/laravel-shopify


text:
Container Won't start

In order to start the container, the path variable for the config file needs to be changed to /container/run/service/phpldapadmin/assets/config/

It is /var/www/phpldapadmin/config/config.php now, else the change wont be reflected. Also the environment variables are broken currently.

authors: Keridos orkahmrust

repo: osixia/docker-phpLDAPadmin


text:
Kvantumanager not found in Arch Budgie

What happened?
When running Yin & Yang from the terminal using yin-yang this error comes up
Plugin Colors has no support for your desktop environment yet!
Using default configuration values.
Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "/opt/yin-yang/yin_yang/__main__.py", line 16, in <module>
    from yin_yang import daemon_handler
  File "/opt/yin-yang/yin_yang/daemon_handler.py", line 7, in <module>
    from .config import ConfigWatcher, config
  File "/opt/yin-yang/yin_yang/config.py", line 482, in <module>
    for pl in filter(lambda pl: pl.available, plugins):
  File "/opt/yin-yang/yin_yang/config.py", line 482, in <lambda>
    for pl in filter(lambda pl: pl.available, plugins):
                                ^^^^^^^^^^^^
  File "/opt/yin-yang/yin_yang/plugins/_plugin.py", line 167, in available
    return self.check_command([self.command[0], '--help'])
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/yin-yang/yin_yang/plugins/_plugin.py", line 156, in check_command
    subprocess.check_call(command, stdout=subprocess.DEVNULL)
  File "/usr/lib/python3.11/subprocess.py", line 408, in check_call
    retcode = call(*popenargs, **kwargs)
              ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/subprocess.py", line 389, in call
    with Popen(*popenargs, **kwargs) as p:
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/subprocess.py", line 1026, in __init__
    self._execute_child(args, executable, preexec_fn, close_fds,
  File "/usr/lib/python3.11/subprocess.py", line 1953, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
PermissionError: [Errno 13] Permission denied: 'kvantummanager'

When running it with sudo, the window appears which should not happen as the root user has no installed desktop environment. Also, none of the settings work. Changing the settings gives the error
Failed to connect to bus: No medium found
The repo says that it is supported with Budgie however i have no idea why it is not working.
Version
3.3
How did you install Yin & Yang?
AUR
What desktop environments are you seeing the problem on?
other :  Budgie for Arch Linux
Which plugin causes the issue?
None
What software version do you use?
OS: Arch Linux x86_64  DE: Budgie 10.9.1
Relevant log output
No response

Looks like yin yang can't execute kvantummanager --help. Make sure its executable as a normal user.

Failed to connect to bus: No medium found

That I have never seen. Which plugins are active? Looks like it's related to the dbus.

You're right @l0drex ! I don't have kvantumanager nor can I find where it is.
I don't know what you mean by plugins, sorry! I just clicked the Light/Dark button and this error popped up (when run as sudo)

Switching the themes after installing kvantum now throws the following error
Plugin Colors has no support for your desktop environment yet!
Error while loading translation. Using default language.
Exception in thread Wallpaper:
Traceback (most recent call last):
  File "/usr/lib/python3.11/threading.py", line 1045, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.11/threading.py", line 982, in run
    self._target(*self._args, **self._kwargs)
  File "/opt/yin-yang/yin_yang/plugins/_plugin.py", line 56, in set_mode
    self.set_theme(theme)
  File "/opt/yin-yang/yin_yang/plugins/_plugin.py", line 200, in set_theme
    raise ValueError(f'Theme \"{theme}\" is invalid')
ValueError: Theme "" is invalid

Oh, so you don't use kvantum? Then you don't need it. Thought you had it installed and yin yang couldn't use it. I'm in the middle of the woods right now, will take a look in the next days

I don't use Kvantum. No idea what it is to be fair. From first glance it just seems like another theming tool like GTK or KDE (as if that combination wasn't complicated enough!)
But knowing that it's not needed I'll uninstall it. No idea why the application requested for it.

Its kind of a theme manager for qt (kde) themes, like an alternative to breeze

repo: oskarsh/Yin-Yang


text:
Remove SVG download option

But keep the drop-down menu since we expect more formats here in the future (such as CSV).

LGTM. Vi beholder kanskje src/util/downloadFile.js til senere?

Tenkte kanskje den kunne bli nyttig for CSV.

repo: oslokommune/okr-tracker


text:
My Location overlay does not display

My Location overlay does not display
this.mLocationOverlay = new MyLocationNewOverlay(new GpsMyLocationProvider(context),mMapView);
this.mLocationOverlay.enableMyLocation();
mMapView.getOverlays().add(this.mLocationOverlay);

Did you check permissions?

Just don't show the icon (I can get the location information), and sometimes icon appear after a while!

You have a gps fix right? are you testing this outdoors?

Also, please install the play app, this is the osmdroid demo app and check to see if the same problem is present
https://play.google.com/store/apps/details?id=org.osmdroid

operation timeout. please reopen or comment back if you have further questions

repo: osmdroid/osmdroid


text:
Remember user's preferred task zoom level

When working on a challenge, as a user, you end up preferring a certain initial zoom level when a task is loaded. This can be for reasons of personal preferences, or for example because the desired base map is not available in the area you are working in, for the zoom level the challenge defines.
So I think it would be nice if you could, as a user, override the challenge-ordained initial zoom level and set your own.
Haven't really thought this through yet completely, up for discussion..

I haven't had anyone but me indicate a liking to this potential feature. Closing.


text:
Add Resource Type XMPP/Jabber

There are no type of resource for XMPP/Jabber Channels in  the index. Is it possible to  add this type? In Germany there are a channel(MUC) for Germany and the  Berlin area. In the  wiki I've found  more XMPP-MUCs if they are still active I will contact them to add these to the index.
After implement the new type I will add the XMPPs using a PR.

Sounds good, I've added xmpp as a supported type.  It will render with a keyboard icon like IRC.

authors: bhousel britiger

repo: osmlab/osm-community-index

license: ISC


text:
fix json deserialization into stableswap pool type

Context
The stableswap pool type has a scaling factor attribute of type Vec<u64>; however, the json schema defines the same field as an array of Strings. As a result, when querying this pool, the deserialization fails. This PR adds a custom serializer/deserializer to safely convert the Vec<String> type from the query response into the preferred Vec<u64> type.
Brief Changelog

Added as_str_vec serializers and deserializers
Added the functions as annotations to the scaling factor attribute

Code to reproduce the error
use osmosis_std::types::osmosis::gamm::poolmodels::stableswap::v1beta1::Pool as StableswapPool;
use osmosis_std::types::osmosis::poolmanager::v1beta1::PoolmanagerQuerier;

let query_pool_resp = PoolmanagerQuerier::new(&deps.querier).pool(pool_id)?;
let stableswap_pool: StableswapPool = query_pool_resp
    .pool
    .ok_or(ContractError::PoolNotFoundOsmosis { pool_id })?
    .try_into()
    .map_err(|e| {
        StdError::parse_err(
            "osmosis_std::types::osmosis::gamm::poolmodels::stableswap::v1beta1::Pool",
            e,
        )
    })?;

Error message before fix
Error: rpc error: code = InvalidArgument desc = failed to execute message; message index: 0: Error parsing into type osmosis_std::types::osmosis::poolmanager::v1beta1::PoolResponse: Invalid type string "100000". Expected u64: execute wasm contract failed: invalid request

Hi @sampocs! would you mind making this automated? With the current change, it will be replaced when type gets regenerated.
This is similar to https://github.com/osmosis-labs/osmosis-rust/blob/5489d6f29cf739bbc2635622aa073bde4a479732/packages/proto-build/src/transformers.rs#L150
So we can add another transformer function next to allow_serde_int_as_str and register it here: https://github.com/osmosis-labs/osmosis-rust/blob/5489d6f29cf739bbc2635622aa073bde4a479732/packages/proto-build/src/transform.rs#L164

Sorry for the delay @iboss-ptk! Please see the above commit and let me know if this addresses it for you.
Also, how can I test this?

@sampocs sorry for late response, you can unit test the transformer logic similar to these tests (basically test if the transformed tokens match expectation).
To see if actual code generation works as expected, you can cd packages/proto-build && cargo run (note that cargo run -p proto-build does not work for some reason I haven't investigated).

The changes and the fix is already in main https://github.com/osmosis-labs/osmosis-rust/commit/473d53917ec594872674b0d8b99f992a7d6b806a

authors: iboss-ptk sampocs

repo: osmosis-labs/osmosis-rust


text:
[CL][Swap Router Module]: investigate reducing the need for making public swap API with swapFee as parameter

Background
In #3128 we refactored gamm to lift multihop logic up to swap-router. This has led to
exporting a gamm and concentrated-liquidity swap APIs that take swap fee as parameter.
This poses a security risk since a developer might accidentally provide a fee that is lower than the actual pool fee.
Ultimately, the only reason for exposing swap fee in the API is so that we can reduce the fee for osmo routed mutlihop:
https://github.com/osmosis-labs/osmosis/blob/1f9680c448fe9496a2f400eb89feea9cbe021908/x/swaprouter/router.go#L27-L29
Suggested Design
We should investigate potential approaches to mitigate this security vulnerability and come up with an abstraction that does not expose swapFee publicly.
Acceptance Criteria

refactor to avoid exposing swapFee in SwapExactAmountIn globally
refactor to avoid exposing swapFee in SwapExactAmountOut globally
refactor tests
add new if applicable

@p0mvn Regarding this issue, it seems inevitable to completely remove swapFee related argument since we're handling multihop logic in the pool model layer. It seems that there are two possible ways to tackle this

move multihop related logic to each pool module layer
refactor so that we don't pass in the swapFee itself but change the swap Fee into a boolean argument names isMultihopRouted and then calculate the actual swap fee within each pool module's swap methods.

Although option 2 does not completely solve the problem this issue is particularly mentioning, it does reduce the security risk introduced in this issue. What are your thoughts?

Decision made to take option2 above. If code duplication seems unnecessarily excessive, dropping this issue since it would not make sense to make the trade off of massive code duplication vs minor API vulnerability

Blocked on investigation on how multihop fees are being charged right now

After some investigation, I came to the conclusion of having to leave swapFees as is.
Currently we're taking the multihop swap fees via max of individual swap fees and the average swap fees of the swaps). This means that we always need to calculate the swap fees at the highest level that multihop takes place and then provide them via parameters. This lead to the conclusion that our current API stands valid, open to any other ideas or suggestions

repo: osmosis-labs/osmosis


text:
refactor/test(x/cosmwasmpool): tokenfactory shares and updated transmuter

Closes: #XXX
What is the purpose of the change
This PR implements the change documented in: https://github.com/osmosis-labs/osmosis/pull/5350
With the transmuter contract from this branch: https://github.com/osmosis-labs/transmuter/tree/share_token
Testing and Verifying
Functionally tests the transmuter tokenfactory shares.
Documentation and Release Note

[ ] Does this pull request introduce a new feature or user-facing behavior changes?
[ ] Changelog entry added to Unreleased section of CHANGELOG.md?

Where is the change documented?

[ ] Specification (x/{module}/README.md)
[ ] Osmosis documentation site
[ ] Code comments?
[x] N/A

I saw the simulator failure and will address it tomorrow. If everything else looks good, please ACK the PR, and I will merge it after fixing the simulator


text:
Add dns resolver

Closes https://github.com/ospfranco/link-preview-js/issues/115
@AbdurrahmanA would you mind taking a look and making sure the implementation is correct?

released under 1.1.16

repo: ospfranco/link-preview-js


text:
show keyboard shortcut for clipboard manager

Currently
When unaware of keyboard shortcut for clipboard manager, there is no way to learn about it, if a user forgot about it from the initial tutorial.

Expected
Why not show the keyboard shortcut (if not invoked from keyboard shortcut) and give users the chance to learn.

Will be on the next version

authors: foss- ospfranco

repo: ospfranco/sol


text:
Erroneous Date Calculation in GPS Receivers: Future Time Settings Misalignment

When I set a future date using the parameter 'T' to May 18, 2039, at 00:00:00, the GPS receiver incorrectly displays the date as October 2, 2019, at 00:00:00. This pattern continues with other future years as follows:
If the year is set to 2040, the output shifts back to 2020.
If the year is set to 2041, the output shifts back to 2021.
If the year is set to 2050, the output shifts back to 2030.
If the year is set to 2060, the output shifts back to 2020.

https://en.wikipedia.org/wiki/GPS_week_number_rollover

authors: neu-aetd osqzss

repo: osqzss/gps-sdr-sim