text:
Exception when executing a lot of SMB targets: IndexError: list index out of range

Describe the bug
The output contains a couple of exceptions and stacktraces but seem to work for some hosts.
To Reproduce
Steps to reproduce the behavior i.e.:
Command: netexec smb lots-of-hosts-list.txt -u username -p password
Resulted in:
[16:32:13] ERROR    Exception while calling proto_flow() on target 10.1.21.11: list index out of range                                                                           connection.py:174
                    ╭─────────────────────────────────────────────────────────── Traceback (most recent call last) ────────────────────────────────────────────────────────────╮
                    │ /home/user/.local/share/pipx/venvs/netexec/lib/python3.12/site-packages/nxc/connection.py:166 in __init__                                                  │
                    │                                                                                │
                    │   163 │   │   self.logger.info(f"Socket info: host={self.host}, hostname={self.hostname},                                                                │
                    │       kerberos={self.kerberos}, ipv6={self.is_ipv6}, link-local                                                                                │
                    │       ipv6={self.is_link_local_ipv6}")                                                                                │
                    │   164 │   │                                                                                │
                    │   165 │   │   try:                                                                                │
                    │ ❱ 166 │   │   │   self.proto_flow()                                                                                │
                    │   167 │   │   except Exception as e:                                                                                │
                    │   168 │   │   │   if "ERROR_DEPENDENT_SERVICES_RUNNING" in str(e):                                                                                │
                    │   169 │   │   │   │   self.logger.error(f"Exception while calling proto_flow() on target                                                                 │
                    │       {target}: {e}")                                                                                │
                    │                                                                                │
                    │ /home/user/.local/share/pipx/venvs/netexec/lib/python3.12/site-packages/nxc/connection.py:232 in proto_flow                                                │
                    │                                                                                │
                    │   229 │   │   else:                                                                                │
                    │   230 │   │   │   self.logger.debug("Created connection object")                                                                                │
                    │   231 │   │   │   self.enum_host_info()                                                                                │
                    │ ❱ 232 │   │   │   if self.print_host_info() and (self.login() or (self.username == "" and                                                                │
                    │       self.password == "")):                                                                                │
                    │   233 │   │   │   │   if hasattr(self.args, "module") and self.args.module:                                                                              │
                    │   234 │   │   │   │   │   self.load_modules()                                                                                │
                    │   235 │   │   │   │   │   self.logger.debug("Calling modules")                                                                                │
                    │                                                                                │
                    │ /home/user/.local/share/pipx/venvs/netexec/lib/python3.12/site-packages/nxc/connection.py:560 in login                                                     │
                    │                                                                                │
                    │   557 │   │   if not self.args.no_bruteforce:                                                                                │
                    │   558 │   │   │   for secr_index, secr in enumerate(secret):                                                                                │
                    │   559 │   │   │   │   for user_index, user in enumerate(username):                                                                                │
                    │ ❱ 560 │   │   │   │   │   if self.try_credentials(domain[user_index], user, owned[user_index],                                                           │
                    │       secr, cred_type[secr_index], data[secr_index]):                                                                                │
                    │   561 │   │   │   │   │   │   owned[user_index] = True                                                                                │
                    │   562 │   │   │   │   │   │   if not self.args.continue_on_success:                                                                                │
                    │   563 │   │   │   │   │   │   │   return True                                                                                │
                    │                                                                                │
                    │ /home/user/.local/share/pipx/venvs/netexec/lib/python3.12/site-packages/nxc/connection.py:495 in try_credentials                                           │
                    │                                                                                │
                    │   492 │   │   │   │   │   return self.kerberos_login(domain, username, secret, "", "",                                                                   │
                    │       self.kdcHost, False)                                                                                │
                    │   493 │   │   │   │   elif hasattr(self.args, "domain"):  # Some protocols don't use domain                                                              │
                    │       for login                                                                                │
                    │   494 │   │   │   │   │   self.logger.debug("Trying to authenticate using plaintext with                                                                 │
                    │       domain")                                                                                │
                    │ ❱ 495 │   │   │   │   │   return self.plaintext_login(domain, username, secret)                                                                          │
                    │   496 │   │   │   │   elif self.args.protocol == "ssh":                                                                                │
                    │   497 │   │   │   │   │   self.logger.debug("Trying to authenticate using plaintext over SSH")                                                           │
                    │   498 │   │   │   │   │   return self.plaintext_login(username, secret, data)                                                                            │
                    │                                                                                │
                    │ /home/user/.local/share/pipx/venvs/netexec/lib/python3.12/site-packages/nxc/protocols/smb.py:423 in plaintext_login                                        │
                    │                                                                                │
                    │    420 │   │   │   self.logger.debug(f"Adding credential:                                                                                │
                    │        {domain}/{self.username}:{self.password}")                                                                                │
                    │    421 │   │   │   self.db.add_credential("plaintext", domain, self.username, self.password)                                                             │
                    │    422 │   │   │   user_id = self.db.get_credential("plaintext", domain, self.username,                                                                  │
                    │        self.password)                                                                                │
                    │ ❱  423 │   │   │   host_id = self.db.get_hosts(self.host)[0].id                                                                                │
                    │    424 │   │   │   self.db.add_loggedin_relation(user_id, host_id)                                                                                │
                    │    425 │   │   │                                                                                │
                    │    426 │   │   │   out = f"{domain}\\{self.username}:{process_secret(self.password)}                                                                     │
                    │        {self.mark_guest()}{self.mark_pwned()}"                                                                                │
                    ╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
                    IndexError: list index out of range

Expected behavior
No exceptions
Screenshots

NetExec info

OS: Kali
Version of nxc: v1.3.0 Need for Speed
Installed from: pipx

How many hosts you are talking about? Cause while I testing to banks, I didn't get error like this.

How many hosts you are talking about? Cause while I testing to banks, I didn't get error like this.

Im doing scan to multiple /24 networks, but I would say around 250 to 300 hosts at least with port 445 reachable. I'm not sure what triggers this error but for less hosts it does not happen...
Additionally if I scan the single host that provoked the exeception, the output is fine.

If the txt file contains subnets, this could be the reason. I always find active hosts first and then start testing. I'm talking about thousands hosts btw.

If the txt file contains subnets, this could be the reason. I always find active hosts first and then start testing. I'm talking about thousands hosts btw.

That make sense. I read the exception with attention and the issue shall be here, by retreiving non existent index [0]
❱  423 │   │   │   host_id = self.db.get_hosts(self.host)[0].id

Will have a look at this.

So today I am trying several things:

nxc smb hosts.txt -u user -p password where hosts.txt contains lots of /24 CIDR addresses
nxc smb hosts.txt -u user -p password where hosts.txt contains lots of ipv4 addresses without network prefix
same as above but with couple of empty lines, whitespaces, bad-formatted ipv4 addresses

I am not getting that exception now... Weird

Working with subnets could lead to such situations. Subnet scanning is much larger than host scanning. I'm glad you didn't encounter it. However, the maitainers will of course do in-depth research when they are available. I will examine it too in detail when available.

Can you give me your version info?

The issue is that apparently the host that you are trying to log into does not exist in the database. Though this should not happen as it gets added in enum_host_info earlier.
My best guess would be that you ran into a race condition with SQLite where you tried to read from the db before the host was added. Perhaps because SQLite was overwhelmed by all these connections?
Btw if you want to retest the issue you have to clear the database (or remove the nxc/workspace folder entirely). Otherwise the host was added by your previous scan

My best guess would be that you ran into a race condition with SQLite where you tried to read from the db before the host was added. Perhaps because SQLite was overwhelmed by all these connections?

Though, concurrency issues in the database should have been fixed with #400

The issue is that apparently the host that you are trying to log into does not exist in the database. Though this should not happen as it gets added in enum_host_info earlier.
My best guess would be that you ran into a race condition with SQLite where you tried to read from the db before the host was added. Perhaps because SQLite was overwhelmed by all these connections?
Btw if you want to retest the issue you have to clear the database (or remove the nxc/workspace folder entirely). Otherwise the host was added by your previous scan

Thanks @NeffIsBack at first I had the impression it was indeed some issue with concurrency. I will clear the database and try to reproduce again.

Ok so triggered the exception with --debug but don't really know if it will be helpful. I had to obfuscate some strings on the log,
nxc-exception.log

Took a look at the log but it is really hard to debug without being able to test it. The question would be why this host wasn't in the database in the first place. If you still have access you could:

Delete the DB
Trigger the error
Take a look at the DB to see if the host was added at some point
Take a look at the debug log to see if the protocol maybe failed to add the host to the db

Hello,
I've had the same (maybe) issue recently running
nxc 1.3.0 - NeedForSpeed - 72fee6a
It could also be just related to the code for listing shares, I'm usure.
just running:
nxc smb <redacted> --shares
2024-11-11 02:45:12,433 - INFO - SMB         <redacted>    445    <redacted>          [*] Windows 10 / Server 2019 Build 17763 x64 (name:<redacted>) (domain:<redacted>) (signing:False) (SMBv1:False)
2024-11-11 02:45:12,436 - INFO - SMB         <redacted>    445    <redacted>         [-] IndexError: list index out of range
2024-11-11 02:45:12,437 - INFO - SMB         <redacted>    445    <redacted>          [-] Error enumerating shares: [Errno 32] Broken pipe

Unfortunately I know that it's not really enough info for helping and I don't have access to that target anymore..
However checking in my logs, I had the issue in the past with the following backtrace:
2024-09-16 17:31:50,577 - ERROR - Exception while calling proto_flow() on target <redacted>: list index out of range
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/nxc/connection.py", line 166, in __init__
    self.proto_flow()
  File "/home/user/.local/lib/python3.10/site-packages/nxc/connection.py", line 226, in proto_flow
    if self.print_host_info() and (self.login() or (self.username == "" and self.password == "")):
  File "/home/user/.local/lib/python3.10/site-packages/nxc/connection.py", line 555, in login
    if self.try_credentials(domain[user_index], user, owned[user_index], secr, cred_type[secr_index], data[secr_index]):
  File "/home/user/.local/lib/python3.10/site-packages/nxc/connection.py", line 490, in try_credentials
    return self.plaintext_login(domain, username, secret)
  File "/home/user/.local/lib/python3.10/site-packages/nxc/protocols/smb.py", line 424, in plaintext_login
    host_id = self.db.get_hosts(self.host)[0].id
IndexError: list index out of range

Found the root cause for this yesterday. This is triggered by a logic flaw when running against hosts with anonymous auth (and we don't supply a user).
Will push a fix the next days.

authors: NeffIsBack joaovarelas nikaiw termanix


text:
[FEATURE]-Add timer to debug console operations to automatically disable debug after expiry

Is your feature request related to a problem? Please describe.
Currently, setting debug level to > 0 never expires and can cause additional processor overhead if left on unintentionally.
Describe the solution you'd like
Add a timer with a default value whenever the appdebug console command sets the level to > 0.  Add an optional argument to the command to explicitly set the timeout to a value different than the default.
This might be a bit tricky to implement with the way the current logic saves the level to a file to persist through reboot.  Some thought will have to be put in to consider how to deal with that when the program reboots and restores the previous level.

@jtalborough Moved this issue to the PepperDashCore library where the affected code resides

source: gharchive/issue

repo: PepperDash/PepperDashCore

license: MIT

license_type: permissive

license_source: github-api


text:
Support changing TLSMethod, enabling overrides from external projects, use PEM strings for SSL vs files

Support for inputting PEM strings for SSL (not just files)
Enables us to change the TLSMethod used
[Optional]: Exposes NetTCP and a few other functions like handleConnection so we could still forward some input not necessary coming from HTTP but still want to use the HTTPS server pipeline - Let me know if you don't want to merge this in and if its too custom - its definitely useful though!

Oh I see my changes have made it through. But through the PR. Thanks anyway.

source: gharchive/pull-request

repo: PerfectlySoft/Perfect-HTTPServer


text:
Question about GAT attention training

Hello.
To my understanding, the self attention step uses a learnable weight vector and a neural network. However, the code in this repo seems to use a very simple constant self-attention step.
https://github.com/PetarV-/GAT/blob/77d0d41b432df79184beb64bb6fcab557851e0b4/utils/layers.py#L13
Is my understanding incorrect? Is there a place in the code where the neural network used for the self-attention step is trained?
Thank you.

Hi,
Thank you for your issue! The neural network consists of the two conv1d layers applied right before the attention (these layers contain the weight vector). Backpropagating will hence train these networks along with every other part of the GAT.
Hope that helps!
Thanks,
Petar

authors: PetarV- l-hoang

repo: PetarV-/GAT


text:
BUG: err_connection_refused https://localhost/index.html

Describe the bug
I am trying to add cordova-plugin-crypto-file 1.4.0 to my ionic project with android 10 I have followed the guide by changing WebResourceResponse in platforms/android/app/src/main/java/com/ionicframework/cordova/webview/IonicWebViewEngine.java file and adding the tag of the port in the confix.xml file also but i got error
"err_connection_refused https://localhost/index.html"
To Reproduce
Steps to reproduce the behavior:

Build the project with cordova-plugin-crypto-file and get the apk file
Try to run the apk file on any android device and you will get the error "err_connection_refused https://localhost/index.html"

Expected behavior
The apk file will work without coonectin errors
Additional context
I thought this might be because the default port is 8080 so i tried to modify file after_propare,js to be
child.attrib.src = 'https://localhost/' + child.attrib.src;
but i still have the same problem
your help is much appreciated
thanks..

I am facing the same issue :( Please help.

Make these changes to the code
https://github.com/weareu/cordova-plugin-crypt-file/commit/96cdc4b8069c15cacfea824138a25ef906c51b5d

Hi @maxtroia
this commit you mentioned was related to the base repo (cordova-plugin-crypt-file) not this repo (cordova-plugin-crypto-file), however I tried to add that file and modify the other file as the commit but with no luck

I am also facing the same issue.
did any one solve it?
@maxtroia @odaialsughier

authors: bmunjal1990 maxtroia odaialsughier skmarwal

repo: PeterHdd/cordova-plugin-crypto-file


text:
Add Signer Account

Replace Overlord account with a Signer account to sign and verify OverlordMessages.

LGTM, so we should set Payee when the change online?

We would set Signer after the change. I am merging this in the pw-update-incubation branch now.

repo: Phala-Network/khala-parachain


text:
Introduce Tinkernet multisig XCM configs

This PR adds the XCM configs necessary to allow Tinkernet multisigs to transact on Rhala.
Tinkernet multisigs have the following MultiLocation pattern:
MultiLocation {
    parents: _, // ancestry depends on the point of reference. 0 if from parent, 1 if from sibling.
    interior: Junctions::X3(
        Junction::Parachain(2125), // Tinkernet ParaId in Kusama/Rococo.
        Junction::PalletInstance(71), // Pallet INV4, from which the multisigs originate.
        Junction::GeneralIndex(_) // Index from which the multisig account is derived.
    )
}

The following are the configs added by this PR to give the multisigs accounts and origins in Rhala:
In Barrier
WithComputedOrigin<
  AllowTopLevelPaidExecutionFrom<invarch_xcm_builder::TinkernetMultisigMultiLocation>,
  UniversalLocation,
  ConstU32<8>,
>,

This is a barrier from the official xcm-builder crate that computes descended origins and by using AllowTopLevelPaidExecution<TinkernetMultisigMultiLocation>> within it allows for our multisig XCM messages to pass through.
In LocationToAccountId
invarch_xcm_builder::TinkernetMultisigAsAccountId<AccountId>,

This MultiLocation converter derives an AccountId for locations matching the one described above, it does so by using the same exact derivation function used in Tinkernet, this is important to make sure the multisigs maintain the same address across all chains, providing the best UX possible.
Because this derivation happens in Rhala, it means the whole process is trustless and removes any possibility of account impersonation!
In XcmOriginToTransactDispatchOrigin
invarch_xcm_builder::DeriveOriginFromTinkernetMultisig<RuntimeOrigin>,

Same as explained above, except here we need to derive the AccountId and wrap it with a RawOrigin::Signed origin so this account can use the Transact XCM instruction and thus call extrinsics in the Rhala runtime's pallets.
Obs: My editor automatically formatted properly the files edited, I chose not to undo that formatting but if you think it should be undone I'll push another commit.

LGTM, @h4x3rotab please help double check

authors: arrudagates tolak


text:
[CMO] In preparation -> Ready for dispatch / Changes in labels and their order

Also Change:
Type->Mode of Transport
Add Volume UoM:

Meters
Feet/inch

Weight UoM
-Kg/Tone
Weight
Destination Address
•	Country
•	PO box
•	City
•	Street
•	Building
Conditions:mandatory

authors: Mastaleru klivit

repo: PharmaLedger-IMI/csc-workspace-main


text:
Which coordinate system for the markers for soder

Hello,
Thanks for the amazing work. I have one question regarding application of soder function?
Do the markers need to be in the segmental reference frame? Also, should the first row of data be markers in the segment reference frame during static trial?
Thanks,
Vignesh

Hi, We don't officially support the soder applications (kinemat toolbox). We have just shown that their toolbox can work within biomechZoo. See the original authors for support http://isbweb.org/software/movanal/kinemat/

license_source: bigquery


text:
Load logged value back into Julia?

Is there a convenient way to load the logged values?
For instance, I've logged a bunch of scalars in the usual way
using TensorBoardLogger, Logging
tb_logger = TBLogger("path/to/logfile")

function cb()
    with_logger(tb_logger) do
        @info "loss" Flux.data(loss())
    end
end

and now I want to plot/analyze those values back inside Julia. What's the recommended way to do this?

at the moment this is not supported.
It's true that It would be a nice feature.

Hm, okay, in the meantime I will also manually log these quantities into something like a BSON.
From the export section of TensorBoard GitHub it points to the train.summary function for exporting information from TensorBoard.

@jessebett you can probably use ProtoBuf.jl to load things out of the log event.pb files.
using the protocol buffer definitions included in TensorBoardLogger.jl
but better and easier I think would be to just export them out of TensorBoard, via the TensorBoard web-interface which lets you export to CSV or JSON

see https://stackoverflow.com/a/42358524/179081
I used it once when a reviewer requested that I add plots for the training loss to my paper, and I didn't want to rerun experiments.
Of course that is sub-ideal if you want to export a ton of them.
If you do want to log them into BSON, writting a BSON logging sink wouldn't be too hard.
(Though, I think BSON doesn't naturally support append, so maybe better would be Feather?)
Such a logging sink would be good to have in LoggingExtras.jl,
and then you would just use a DemuxLogger(TBLogger("logs_tb"), BSONLogger("logs_bson"))

Just for reference, reading back event files is quite easy:
using TensorBoardLogger

function read_event(f::IOStream)
    header = read(f, 8)
    crc_header = read(f, 4)

    # check
    crc_header_ck = reinterpret(UInt8, UInt32[TensorBoardLogger.masked_crc32c(header)])
    @assert crc_header == crc_header_ck

    # DATA
    data_len = first(reinterpret(Int64, header))
    data = read(f, data_len)
    crc_data = read(f, 4)

    # check
    crc_data_ck = reinterpret(UInt8, UInt32[TensorBoardLogger.masked_crc32c(data)])
    @assert crc_data == crc_data_ck

    pb = PipeBuffer(data)
    ev = TensorBoardLogger.readproto(pb, TensorBoardLogger.Event())
    return ev
end

fname="youreventfile"
f=open(fname, "r")

ev1 = read_event(f)
ev2 = read_event(f)
...

The slightly more complicated part would be restructuring the event files to extract the summaries. In principle we could add a method that dumps everything into a ValueHistories object....

@oxinabox I saw that TensorBoard web interface had the download option, but that is definitely too inconvenient for what I'm trying to do.
Is there an additional Logger that I can run that stores the values in a convenient to read format for this sort of use? At the moment there's nothing fancy going into these TensorBoard logs, just scalars. Though it would be nice if this could accommodate model check-pointing too. I'm wary of pushing to a custom array and saving that to a BSON during training because that is not very robust to cases where the server crashes.
@PhilipVinc I haven't taken a look at the inner workings of this. Is it interfacing the python API with PyCall? If so, could this expose the summary_iterator I posted above? Additionally, the option to download CSV or JSON on the web interface is presumably exposed in the API somewhere, maybe it is possible to access whatever that web interface is doing?

No, I avoid working with PyCall. I had created TensorBoardLogger exactly to avoid installing PyCall on the cluster where I run simulations. It is completely independent of Python and TensorBoard, as such you can't use it to call into the Python API.
I'm not familiar with summary_iterator, but the read_event(f::IOStream) function above simply takes as input the event file (as an IOStream) and recreates the protobuffer from it. You can have a look at this gist, which does exactly what you want.
The limit of that gist is that (i) (I believe) it won't work if you append to an existing log and (ii) it works only with scalars. Addressing those limits would be easy if there was a decent way to check if a field in a struct is undefined, but the macro @isdefined does not work (@oxinabox maybe you know something about it?)

isassigned IIRC

FYI I start implementing the loader based on read_event https://github.com/tkf/TensorBoardLoader.jl
@PhilipVinc Is it OK to redistribute your code snippet like this?
Something like TensorBoardLoader.loadscalars(DataFrame, "logdir") seems to work (where DataFrame can be replaced with any table-receiving function). Loading non-scalars shouldn't be hard but I haven't implemented high-level APIs yet.

Something like TensorBoardLoader.loadscalars(DataFrame, "logdir") seems to work (where DataFrame can be replaced with any table-receiving function

Why not make loadscalars return a Table directly, so can just use the constructor of DataFrame (or invoke any table-receiving function)
DataFrame(TensorBoardLoader.loadscalars("logdir"))
Also why a separate package, why not make a PR to this one?

Why not make loadscalars return a Table directly

That's a good question.  This is because Julia does not have a resource cleanup API for the iterators.  So, if you want to support lazy loading and close the files reliably, this has to use the callback interface (which is not so bad as you can use a do block).  I'd guess many people don't care about it and OK with letting the GC handle file close.  It's easy to add such an interface.  I just don't need it personally ATM.

Also why a separate package

It's heavily using my package Transducers.jl so I wasn't sure about selling it with a PR, considering that the iterator transforms are the major interface for this kind of task.  I also haven't used it enough to see if it makes sense to use lazy loader approach.

That's a good question. This is because Julia does not have a resource cleanup API for the iterators. So, if you want to support lazy loading and close the files reliably, this has to use the callback interface (which is not so bad as you can use a do block). I'd guess many people don't care about it and OK with letting the GC handle file close. It's easy to add such an interface. I just don't need it personally ATM.

Fair.
One option might be to default the type to either Tables.RowTable (i.e. Vector of NamedTuples),
or Tables.ColumnTable (i.e. NamedTuple of Vectors).
So it would be eagerly done and cleanup could be done ?

@PhilipVinc Is it OK to redistribute your code snippet like this?
Yes of course

Also why a separate package, why not make a PR to this one?
Eventually I will add support for de-serializing TB data to TBLogger (I have already a basis for this in the read-serialized branch, but I did not have that much time to finish it yet).
Eventually users will default to what is provided in the base package, I believe, unless your optional package provides something that really is worth the extra hops.

If you need this now and with your constraints, I understand, but otherwise does it make sense to implement this twice?
--
Having said that, I have the following questions:

So, if you want to support lazy loading and close the files reliably.
Is there any issue with not closing the files reliably, and letting the GC do the work? From the little I know computers can live with a couple (thousands) open files. And as we are opening them in read-only mode, is it that important to close them?

support lazy loading
Is this really needed for the case of TensorBoard scalar data? To my understanding you lazy-load things that take a lot of memory (or time) to load. Is this the case, especially for scalar data?

Is there any issue with not closing the files reliably,

I would need someone to confirm, but I think it might cause issues on Windows.
I recall something about windows making open files exclusive.
And you might want to be reading and writing?
Not sure though

And you might want to be reading and writing?

On Unix platforms I'm confident this is a non-issue because I used to do it often in C++ (open a fstream in a file, and write from there, read it from another process).
On Windows no idea. Please let me know.

Eventually users will default to what is provided in the base package, I believe, unless your optional package provides something that really is worth the extra hops.

@PhilipVinc I just needed this right now and so I hacked it up.  My intention was a friendly "hey I implemented this, you can use this if you need it now" and not causing any conflicts or confusion.

From the little I know computers can live with a couple (thousands) open files.

Quick googling showed me
https://discourse.julialang.org/t/massive-readstring-too-many-open-files/3426 (Linux)
https://superuser.com/questions/1356320/what-is-the-number-of-open-files-limits (Windows)

Is this really needed for the case of TensorBoard scalar data?

Maybe?  I actually don't care because transducers are lazy and efficient by default.  There is no trade off.

One option might be to default the type to either Tables.RowTable (i.e. Vector of NamedTuples),
or Tables.ColumnTable (i.e. NamedTuple of Vectors).

@oxinabox That sounds like a good API.  I need a good table integration for Transducers.jl and it would be nice to have some generic code for materializing a table (especially a column-oriented version) with the push-or-widen approach.  It'll be a nice case study.

Don't worry! I wasn't complaining at all. I just dislike wasting effort. Ignore me.

Quick googling showed me

Yes you are right. but with TB you will have a bunch of files. hardly even hundreds...
I'll still have a look at transducers.

I just dislike wasting effort.

I guess that's a typical instinct of good programmers. Sorry to set your nerves on edge.

with TB you will have a bunch of files

Maybe it can happen if someone builds a machine learning web service or something, using TB file loader? Also, IO close can cause other events like stop writing if it were a pipe. It makes sense to prefer a deterministic close. It's not hard to write code with reliable close so I think it's a good idea to just do it always.

Implemented in #57 , closing.

authors: PhilipVinc jessebett oxinabox tkf


text:
🛑 Plausible Analytics Server is down

In fe3aca0, Plausible Analytics Server ($ANALYTICS_URL) was down:

HTTP code: 403
Response time: 55 ms

Resolved: Plausible Analytics Server is back up in 1861bba.

repo: Phoenix-Net/PhoenixNet-Status-Page


text:
Upgrade AutoValue 1.10.1 -> 1.10.2

This PR contains the following updates:

Package
Type
Update
Change

AutoValue (source)

patch
1.10.1 -> 1.10.2

AutoValue (source)
compile
patch
1.10.1 -> 1.10.2

Release Notes

google/auto
v1.10.2: AutoValue 1.10.2

The constructor parameter names in the class generated by @Memoized no longer add a $. This may require changes to code that was depending on the old names, for example using Error Prone's /* param= */ comments. (4f8dbea)
An AutoValue or AutoBuilder property is now allowed to be null if its type is a type variable with a @Nullable bound, like <T extends @Nullable Object>. (1b58cff)
Better error message when AutoValue, AutoBuilder, etc give up because of missing types. We now say what the first missing type was. (2e734f6)
AutoBuilder copy-constructors no longer require an exact match between a property and the corresponding constructor parameter. (1440a25)
A property of type List<T> can be built by a property builder whose build() method returns List<? extends T>. (8ba4531)
Made it easier to support @CopyAnnotations in AutoValue extensions, via new methods classAnnotationsToCopy and methodAnnotationsToCopy. (a3f218d)
Generated builders now include a @Nullable type annotation on appropriate builder fields if one is available. (91d5f32)
Updated @AutoAnnotation documentation to say that it isn't needed in Kotlin. (600b4b6)
Maven dependencies have been updated, fixing #1532.

[ ] If you want to rebase/retry this PR, check this box

Warning
Renovate's suggested commit message is being replaced with improved initial commits to enable automerging. As a side effect, these suggested commit messages might have changed. Consider comparing the initial commit message and this message to determine the most suitable one. Please leave feedback in #sys-renovate.

Suggested commit message:
Upgrade AutoValue 1.10.1 -> 1.10.2

See:
- https://github.com/google/auto/releases/tag/auto-value-1.10.2
- https://github.com/google/auto/compare/auto-value-1.10.1...auto-value-1.10.2

repo: PicnicSupermarket/error-prone-support


text:
Does not count watch time and views

Hello,
It hasn't been counting watch time and views for a while now and it seems to be dropping. I think this might be due to your last update. There were no drops in the previous version 12.0.0. Can you do research on this subject?

Hi, view counts and watch time are controlled by the IFrame player, not my library. So no, the update is not causing the problem you're seeing.

authors: PierfrancescoSoffritti memobeyle


text:
Can't obtain any result

Hello Everyone,
First, thanks a lot for your efforts to make viral-Track available for the community.
I am running Viral_Track_scanning.R as follow:
Rscript Viral_Track_scanning.R parameters.txt target_files.txt
The contents of target_files.txt:
/mnt/d/scRNAseq_Linux/Genome/BD1-Mock2-GEX_100_R2_extracted.fastq.gz
/mnt/d/scRNAseq_Linux/Genome/BD2-WT718-GEX_100_R2_extracted.fastq.gz
The contents of parameters.txt:
N_thread=1
Output_directory="/mnt/d/scRNAseq_Linux/Genome/Test_Viral_Track/"
Index_genome="/mnt/d/scRNAseq_Linux/Genome/ref_genom/"
Viral_annotation_file="/mnt/d/scRNAseq_Linux/Genome/Virusite_annotation_file.txt"
Name_run="VSV_Viral_Test"
Load_STAR_module=FALSE
Load_samtools_module=FALSE
Load_stringtie_module=FALSE
Minimal_read_mapped=50
This is what I had:
Loading of the libraries.... ... done ! Warning message:                                                                                In read.table(Parameter_target_files, header = F, sep = "\t") :                                                                                incomplete final line found by readTableHeader on 'target_files.txt'                                                                                2 Fastq files are going to be processed !                                                                                Mapping BD1-Mock2-GEX_100_R2.fastq file                                                                                Jan 14 12:41:20 ..... started STAR run                                                                                Jan 14 12:41:20 ..... loading genome                                                                                Jan 14 12:45:42 ..... started 1st pass mapping                                                                                Jan 14 12:45:43 ..... finished 1st pass mapping                                                                                Jan 14 12:45:43 ..... started mapping                                                                                Jan 14 12:45:43 ..... finished mapping                                                                                Jan 14 12:45:45 ..... started sorting BAM                                                                                Jan 14 12:45:46 ..... finished successfully                                                                                Mapping ofBD1-Mock2-GEX_100_R2.fastq done !                                                                                Mapping BD2-WT718-GEX_100_R2.fastq file                                                                                Jan 14 12:45:46 ..... started STAR run                                                                                Jan 14 12:45:46 ..... loading genome                                                                                Jan 14 12:50:29 ..... started 1st pass mapping                                                                                Jan 14 12:50:30 ..... finished 1st pass mapping                                                                                Jan 14 12:50:31 ..... started mapping                                                                                Jan 14 12:50:33 ..... finished mapping                                                                                Jan 14 12:50:35 ..... started sorting BAM                                                                                Jan 14 12:50:35 ..... finished successfully                                                                                Mapping ofBD2-WT718-GEX_100_R2.fastq done !                                                                                All fastq files have been mapped successfully                                                                                Starting the BAM file analysis                                                                                Indexing of the bam file for BD1-Mock2-GEX_100_R2 is done                                                                                Computing stat file for the bam file for BD1-Mock2-GEX_100_R2 is done                                                                                Checking the mapping quality of each virus...                                                                                Export of the viral SAM file done for BD1-Mock2-GEX_100_R2                                                                                Error in colnames<-(*tmp*, value = c("N_reads", "N_unique_reads",  :                                                                                attempt to set 'colnames' on an object with less than two dimensions                                                                                Calls: colnames<- -> colnames<-                                                                                Execution halted
The content of BD2-WT718-GEX_100_R2_extracted_Log.final.out :
Started job on |	Jan 14 12:26:29
Started mapping on |	Jan 14 12:31:00
Finished on |	Jan 14 12:31:03
Mapping speed, Million of reads per hour |	0.00
                      Number of input reads |	0
                  Average input read length |	0
                                UNIQUE READS:
               Uniquely mapped reads number |	0
                    Uniquely mapped reads % |	0.00%
                      Average mapped length |	0.00
                   Number of splices: Total |	0
        Number of splices: Annotated (sjdb) |	0
                   Number of splices: GT/AG |	0
                   Number of splices: GC/AG |	0
                   Number of splices: AT/AC |	0
           Number of splices: Non-canonical |	0
                  Mismatch rate per base, % |	-nan%
                     Deletion rate per base |	0.00%
                    Deletion average length |	0.00
                    Insertion rate per base |	0.00%
                   Insertion average length |	0.00
                         MULTI-MAPPING READS:
    Number of reads mapped to multiple loci |	0
         % of reads mapped to multiple loci |	0.00%
    Number of reads mapped to too many loci |	0
         % of reads mapped to too many loci |	0.00%
                              UNMAPPED READS:

Number of reads unmapped: too many mismatches |	0
% of reads unmapped: too many mismatches |	0.00%
Number of reads unmapped: too short |	0
% of reads unmapped: too short |	0.00%
Number of reads unmapped: other |	0
% of reads unmapped: other |	0.00%
CHIMERIC READS:
Number of chimeric reads |	0
% of chimeric reads |	0.00%
Nothing Mapped!!!
Any help with that would be much appreciated.
Thanks!

Hi,
It basically seems that not alignement is done as it took less than a second to map your reads, in addition no reads are detected according to the log of STAR. Have you checked rigorously the fastq files you are using as an input ?
Best
Pierre

Hi,
It basically seems that not alignement is done as it took less than a second to map your reads, in addition no reads are detected according to the log of STAR. Have you checked rigorously the fastq files you are using as an input ?
Best
Pierre

Hello Pierre,
Thanks a lot for your reply.
This is what I obtain after the third step of UMI tools:
$ zcat BD2-WT718-GEX_S21_R2_001_extracted_fastq.gz | head -n4
@A00154:634:HT2GYDRXX:1:1101:4833:1000_GCTGCTTCACAATGATAG_GAAGAGCCGA 2:N:0:ACAATTCA
GGTGAGGCGGGGGGGCGAGCCCCGAGGGGCTCTCGCTTCTGGCGCCAAGCGCCCGGCCGCGCGCCGGCCGGGCGCGACCCGCTCCGG
+
FFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF:FFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF
Do you think that there is a problem?
Many thanks in advance.
Abdulkader

Okay so if the .fastq file is ok then you have to look at the reference Index you used. It says that it took a second to load it so maybe that's where you should check !

Thanks for your reply.
This is a second attempt and it says the same:
Mapping BD2-WT718-GEX_S21_R2_001_extracted.fastq file                                                                                Feb 03 16:02:19 ..... started STAR run                                                                                Feb 03 16:02:19 ..... loading genome                                                                                Feb 03 16:14:43 ..... started 1st pass mapping                                                                                Feb 03 16:14:51 ..... finished 1st pass mapping                                                                                Feb 03 16:15:45 ..... started mapping                                                                                Feb 03 16:16:02 ..... finished mapping                                                                                Feb 03 16:16:10 ..... started sorting BAM                                                                                Feb 03 16:16:11 ..... finished successfully                                                                                Mapping ofBD2-WT718-GEX_S21_R2_001_extracted.fastq done !                                                                                All fastq files have been mapped successfully                                                                                Starting the BAM file analysis                                                                                Indexing of the bam file for BD2-WT718-GEX_S21_R2_001_extracted is done                                                                                Computing stat file for the bam file for BD2-WT718-GEX_S21_R2_001_extracted is done                                                                                Checking the mapping quality of each virus...                                                                                Export of the viral SAM file done for BD2-WT718-GEX_S21_R2_001_extracted                                                                                Error in colnames<-(*tmp*, value = c("N_reads", "N_unique_reads",  :                                                                                attempt to set 'colnames' on an object with less than two dimensions                                                                                Calls: colnames<- -> colnames<-                                                                                Execution halted

Hi Abdulkader,
This is really weird... Can you describe me a bit :

the version of R you are using
describe the fastq file you wish to map
the computational platform you are using
Best

Pierre

Hello Pierre,
I am very sorry for the delay in replying to your feedback.
First of all, and just to let you know, we tested our scRNAseq libraries if we can detect a specific viral gene by qPCR. The result was positive, the viral gene came out after 20 cycles compared to 40 in the negative control.
Now, to come back to your questions, I am using Ubuntu 20.04.2 LTS under windows, and the R version used in Ubuntu is 4.0.4
Regarding the fastq files: they are coming from bovine CD8 T cells infected or not with Alcelaphine herpesvirus1 (the genome of this virus is present in your database).
I re-run it again and I obtain nothing!!
Any idea why it does not work?
If you prefer, I can provide you a fastq file to have a try.
Many thanks in advance.
Best
Abdulkader

Hi Abdulkader,
Sure no problem, we are living in harsh/hectic times !
I do not thing the problem has anything to do with the virus itself, and as you said the viral load seems to be quite high (which makes sense for an in-vitro infection).
The problems definitely comes from the aligner. Here is what I would suggest :

Download/subsample a small fastq file and align it using STAR directly. If this does not work then check STAR itself.
If this work then check the target_file.txt : I am pretty sure the problems comes from there. Check that it has exactly the same structure as this file : https://github.com/PierreBSC/Viral-Track/blob/master/Files_to_process.txt
If this still does not work you can send me a sample of the data !
Best

Pierre

Problem solved, closing.

@AbdulkaderA , @PierreBSC
May you please let me know how this issue was solved - I am facing a similar problem

authors: AbdulkaderA PierreBSC mohebg

repo: PierreBSC/Viral-Track


text:
"Talk To NPC(s)" name(s) aren't showed on quest steps (messages too during the quest)

Hello, the plugin had a minor issue, the NPCs name aren't properly displayed on messages (on screens)

Closing as OP did not follow issue instructions (missing Quests version and example quest). Feel free to comment below with the missing information to reopen.

authors: Corazun PikaMug

repo: PikaMug/Quests


text:
Quests Rewards are Decreasing Times after Time

What is your Quests version / build number (do not say "latest")?
3.9.4
Describe the problem and how to replicate it. Any console errors to post using Pastebin.com?
Quests reward are always decreasing, after people did the second run or third run.
Ex:
Quest_1 rewards 7 Blaze Powder, and has a cooldown for 15 minutes.
After person A took the quest for the 3rd time, the rewards are decreasing to 4 Blaze Powder.
Then Person B Took the quest for the 1st time, and still get 4 Blaze Powder until it fixed via quests editor.
If applicable, can you provide an example quest from quests.yml using Pastebin.com?

Update to the latest version (3.9.5), and if the issue still occurs, provide an example quest for testing.

authors: PikaMug Travefleix


text:
db table of plugins installed on pioreactors

pioreactor_unit       str
plugin_name           str
plugin_version        str
installed_at          str
uninstalled_at        str
is_installed          str

ORRR a local persistant cache of this data...

repo: Pioreactor/pioreactor


text:
Wrapping arithmetic API has changed in Rust 1.0, breaking compile

Compiling image fails with the new Rust 1.0 API. That's because the wrapping arithmetic API has changed. Specifically, functions like wrapping_shl have been removed from the numeric types in favor of the new Wrapping struct.
I've tried out Wrapping, and it works like this:
use std::num::Wrapping;

fn main() {
    // 10000001
    let num: u8 = 129;
    let wrapped: Wrapping<u8> = Wrapping(num);
    // 00000010
    let shifted: Wrapping<u8> = wrapped << 1;
    assert_eq!(Wrapping(2u8), shifted);
    let Wrapping(unwrapped_shifted) = shifted;
    assert_eq!(2u8, unwrapped_shifted);
}

See also https://github.com/PistonDevelopers/image/issues/392, where we decided to use wrapping shifts.
For reference, here is the compiler error:
/Users/username/.cargo/git/checkouts/image-03876f719561bb08/master/./src/jpeg/decoder.rs:676:16: 676:56 error: type `i32` does not implement any method in scope named `wrapping_shl`
/Users/username/.cargo/git/checkouts/image-03876f719561bb08/master/./src/jpeg/decoder.rs:676     i32 = 1i32.wrapping_shl((t as u32).wrapping_sub(1));
                                                                                ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/Users/username/.cargo/git/checkouts/image-03876f719561bb08/master/./src/jpeg/entropy.rs:151:21: 151:46 error: type `u16` does not implement any method in scope named `wrapping_shl`
/Users/username/.cargo/git/checkouts/image-03876f719561bb08/master/./src/jpeg/entropy.rs:151         code = code.wrapping_shl(diff as u32);

Has this been fixed already? It compiles fine here.

image 0.3.9 definitely works with Rust 1.0

Wrapping doesn't seem to prevent panicking on bit shift operation overflows anyways.
 let a = Wrapping(0u32) << 32;

Results in:
 thread '<main>' panicked at 'shift operation overflowed', C:/bot/slave/stable-dist-rustc-win-64/build/src/libcore\num\wrapping.rs:54

Ouch. Well in that case, we need a new way to solve those panics. Any ideas?

As it stands image compiles fine on Rust 1.0.
Apparently in C this is undefined behavior. The result is not guaranteed to be 0. I don't know enough about the JPEG decoder to know what is is trying to accomplish, but I did "fix" this issue here https://github.com/PistonDevelopers/image/pull/412 .
By adding checks if the shift amount is greater than the variable length. I do not know if this is the correct behavior but it does make debug builds build and act the same as release builds.

Alright. I'll close this for now. If I can figure out what, if anything, is wrong, I'll open a new issue with a more clear description.

I had problems with the shifts in a crate of mine as well. The way to avoid it, is to ensure not to shift by the width of the type or more.

authors: bvssvni jarrett pix64 ruud-v-a tomaka

repo: PistonDevelopers/image


text:
Custom data layer name

Nice to see a proper JS library for client side Piwik pro tracking. I'm eagerly waiting to take this into use in our projects. Unfortunately there is one issue blocking us from doing so.
While the Piwik PRO service support using custom data layer names, this library seems to have used a hardcoded default value dataLayer.
I'm wondering whether it would be possible for the library to support initialising the tracker with a custom data layer name. Looking at the code it shouldn't be too complicated to add a new parameter to the initialize function. For example initialize(containerId: string, containerUrl: string, nonce?: string, dataLayerName?: string).

Moved to https://github.com/PiwikPRO/tracking-base-library/issues/16

repo: PiwikPRO/react-piwik-pro


text:
[Feature request] Dum Dum Following Flag?

Hello sorry if this sounds like a silly question but is there a flag possible to have Dum Dum follow you around? or if its possible for it to implemented in a way? Thank you

I have no idea, you should ask other users and modders on the discord first : https://discord.gg/PQD3U4k5
If it happens to exist let me know and I could add a button for it.

I have no idea, you should ask other users and modders on the discord first : https://discord.gg/PQD3U4k5
If it happens to exist let me know and I could add a button for it.

authors: PixelRick sneedfeedseed

repo: PixelRick/CyberpunkSaveEditor


text:
Set empty flag layer to -1

Need to make sure if no tilemap-flag file is provided an empty one has all flags set to -1

This has been fixed.

license: MS-PL


text:
[Release-1.0] Removing members if you accidentally add the wrong one in Playlist Creation.

Allow to select the member name and remove. If you add multiple members and want to delete one in the middle because you decided to change who it is for, you cannot easily remove. You have to remove every name following it first via keyboard. This is during playlist Creation for Android. Done on Android Note 9

This makes a lot of sense. I think this ends up being a redesign of how we add playlists/members to our playlists.

authors: LuisACorreaCSUMB adilanchian

repo: PixelogicDev/Gruvee-Mobile


text:
[BUG] Can't run pnpm create plasmo

What happened?
Just trying to follow the getting started steps in the README to create a new project and getting an error.
pnpm create plasmo example-dir
ERROR  No package.json (or package.yaml, or package.json5) was found in "/workingdir"

Created example-dir and ran npm init to get the package.json, then got a different error:
ERROR  Command failed with ENOENT: create plasmo
spawn create ENOENT

Version
Latest
What OS are you seeing the problem on?
MacOSX
What browsers are you seeing the problem on?
Chrome
Relevant log output
No response
(OPTIONAL) Contact Details
No response
Code of Conduct

[X] I agree to follow this project's Code of Conduct
[X] I checked the current issues for duplicate problems.

@bsstoner can you output the whole log? Also, what's the version of pnpm that you're using? Also, is /workingdir a virtual drive or some kind of special mount point? - I just tested out and it worked on my end ;d...
🟣 Plasmo v0.55.3
🟠 The browser extension development framework.
🔵 INFO   | Creating new blank project
🔵 INFO   | Copying template files...
🔵 INFO   | Copying BPP workflow...
🔵 INFO   | Installing dependencies...

dependencies:
+ plasmo 0.55.3
+ react 18.2.0
+ react-dom 18.2.0

devDependencies:
+ @plasmohq/prettier-plugin-sort-imports 1.2.2 (3.5.2 is available)
+ @types/chrome 0.0.196 (0.0.197 is available)
+ @types/node 18.7.15 (18.8.1 is available)
+ @types/react 18.0.18 (18.0.21 is available)
+ @types/react-dom 18.0.6
+ prettier 2.7.1
+ typescript 4.8.2 (4.8.4 is available)
🟢 DONE   | Your extension is ready in:  P:\Projects\plasmo-test\bug\bug-256-init-not-work

    To start hacking, run:

       cd bug-256-init-not-work
       pnpm dev

    Visit https://docs.plasmo.com for documentation and more examples.

@bsstoner if possible, please run pnpm create plasmo example-stuff --verbose and paste the log here if there's still error

Doesn't seem to give any new info...
pnpm create plasmo example-stuff --verbose
 ERROR  No package.json (or package.yaml, or package.json5) was found in "/Users/brianstoner/projects/extensions".

From .pnpm-debug.log
{
  "0 debug pnpm:scope": {
    "selected": 1
  },
  "1 error pnpm": {
    "code": "ERR_PNPM_NO_IMPORTER_MANIFEST_FOUND",
    "err": {
      "name": "Error",
      "message": "No package.json (or package.yaml, or package.json5) was found in \"/Users/brianstoner/projects/extensions\".",
      "code": "ERR_PNPM_NO_IMPORTER_MANIFEST_FOUND",
      "stack": "Error: No package.json (or package.yaml, or package.json5) was found in \"/Users/brianstoner/projects/extensions\".\n    at readProjectManifest (/Users/brianstoner/.node/corepack/pnpm/6.11.0/dist/pnpm.cjs:40283:13)\n    at async Object.readProjectManifestOnly (/Users/brianstoner/.node/corepack/pnpm/6.11.0/dist/pnpm.cjs:40287:28)\n    at async Object.readProjectManifestOnly (/Users/brianstoner/.node/corepack/pnpm/6.11.0/dist/pnpm.cjs:40506:24)\n    at async Object.handler (/Users/brianstoner/.node/corepack/pnpm/6.11.0/dist/pnpm.cjs:121554:24)\n    at async /Users/brianstoner/.node/corepack/pnpm/6.11.0/dist/pnpm.cjs:125614:20\n    at async run (/Users/brianstoner/.node/corepack/pnpm/6.11.0/dist/pnpm.cjs:125589:34)\n    at async runPnpm (/Users/brianstoner/.node/corepack/pnpm/6.11.0/dist/pnpm.cjs:125799:5)\n    at async /Users/brianstoner/.node/corepack/pnpm/6.11.0/dist/pnpm.cjs:125791:7"
    }
  }
}

Ahhh, that worked, sorry don't usually use pnpm. Thanks!

authors: bsstoner louisgv

repo: PlasmoHQ/plasmo


text:
Inline functions

For example, the following code:
inline function add(a, b)
    return a + b
end
print(add(1, 2))

should compile as if the following was written:
print(1 + 2)

Some work regarding this has already been done in #117.

I think the best shot for actually getting this to work (without major efforts to rework how parsing and codegen work) would be to add a kind of preprocessor after the tokenization step, which could allow for the following:
$alias ONE = 1
$alias add(a, b) = a + b

print(add(ONE, 2)) --> 3

repo: PlutoLang/Pluto


text:
Question about Test mode of GridSample

thanks for your great work. I'm confuse about why to use a for loop with the max points of the all voxels here. could you please tell me the reason? And the input data is a list which is different with train( a dict).
https://github.com/Pointcept/Pointcept/blob/c759914eb3ab8255455c80c00472ab0bc664a20c/pointcept/datasets/transform.py#L855

Make sure each point belongs to a sub point cloud and is directly predicted by network.

authors: Gofinge pycoco


text:
Question about the adjusted p-values reported in mafCompare

Describe the issue
Hi, I am wondering what method you used for the adjusted p-values reported in mafCompare().
Thank you!
Command
Please post your commands and the output (errors or any unexpected output)

Session info
Run sessionInfo() and post the output below

Hi,
Its uses fdr

repo: PoisonAlien/maftools


text:
Bot make unhuman moviments

Expected Behavior
Walk with a few turns
Actual Behavior
Walk with tens of turns in 1 meter :S

This is the max zoom to make the idea of what it does..
Steps to Reproduce
Launch bot and walk..
Maybe problem should is that my first task is FollowSpiral???
My config file:
{
    "auth_service": "google",
    "username": "xxxxxxxxx@gmail.com",
    "password": "xxxxxxxxxxxxxxxxxx",
    "location": "45.494083,12.247316",
    "gmapkey": "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx",
    "tasks": [
      {
        "type": "FollowSpiral"
      },
      {
        "type": "HandleSoftBan"
      },
      {
        "type": "CollectLevelUpReward"
      },
      {
        "type": "IncubateEggs",
        "config": {
          "longer_eggs_first": true
        }
      },
      {
        "type": "TransferPokemon"
      },
      {
        "type": "RecycleItems"
      },
      {
        "type": "CatchVisiblePokemon"
      },
      {
        "type": "CatchLuredPokemon"
      },
      {
        "type": "SpinFort"
      },
      {
        "type": "MoveToFort"
      },
      {
        "type": "EvolveAll",
        "config": {
          "evolve_speed": 20,
          "use_lucky_egg": false
        }
      }
    ],
    "max_steps": 5,
    "forts": {
      "avoid_circles": true,
      "max_circle_size": 50
    },
    "websocket_server": false,
    "walk": 11.89,
    "action_wait_min": 1,
    "action_wait_max": 4,
    "debug": false,
    "test": false,
    "health_record": true,
    "location_cache": true,
    "distance_unit": "km",
    "reconnecting_timeout": 10,
    "item_filter": {
      "Potion": { "keep" : 75 },
      "Super Potion": { "keep" : 60 },
      "Hyper Potion": { "keep" : 50 },
      "Revive": { "keep" : 60 }
    },
    "evolve_all": "none",
    "evolve_cp_min": 300,
    "evolve_captured": "none",
    "catch_randomize_reticle_factor": 1.0,
    "catch_randomize_spin_factor": 1.0,
    "catch": {
      "any": {"catch_above_cp": 0, "catch_above_iv": 0, "logic": "or" },
      "// Pokemons with example": { "always_catch": true },
      "// Gets filtered with release parameters": {}
    },
    "release": {
      "any": {"release_below_cp": 0, "release_below_iv": 0, "logic": "or"},
      "// Example of always releasing Rattata:": {},
      "// Rattata": {"always_release": true},
      "// Example of keeping 3 stronger (based on CP) Pidgey:": {},
      "// Pidgey": {"keep_best_cp": 3},
      "// Example of keeping 2 stronger (based on IV) Zubat:": {},
      "// Zubat": {"keep_best_iv": 2},
      "// Also, it is working with any": {},
      "// any": {"keep_best_iv": 3},
      "// Example of keeping the 2 strongest (based on CP) and 3 best (based on IV) Zubat:": {},
      "// Zubat": {"keep_best_cp": 2, "keep_best_iv": 3},

      "Abra": {"keep_best_cp": 1},
      "Aerodactyl": {"keep_best_cp": 3},
      "Alakazam": {"keep_best_cp": 2},
      "Arbok": {"keep_best_cp": 2},
      "Arcanine": {"keep_best_cp": 2},
      "Articuno": {"keep_best_cp": 3},
      "Beedrill": {"keep_best_cp": 1},
      "Bellsprout": {"keep_best_cp": 1},
      "Blastoise": {"keep_best_cp": 2},
      "Bulbasaur": {"keep_best_cp": 1},
      "Butterfree": {"keep_best_cp": 1},
      "Caterpie": {"keep_best_cp": 1},
      "Chansey": {"keep_best_cp": 1},
      "Charizard": {"keep_best_cp": 3},
      "Charmander": {"keep_best_cp": 1},
      "Charmeleon": {"keep_best_cp": 2},
      "Clefable": {"keep_best_cp": 2},
      "Clefairy": {"keep_best_cp": 2},
      "Cloyster": {"keep_best_cp": 2},
      "Cubone": {"keep_best_cp": 1},
      "Dewgong": {"keep_best_cp": 1},
      "Diglett": {"keep_best_cp": 1},
      "Ditto": {"keep_best_cp": 2},
      "Dodrio": {"keep_best_cp": 2},
      "Doduo": {"keep_best_cp": 1},
      "Dragonair": {"keep_best_cp": 2},
      "Dragonite": {"keep_best_cp": 3},
      "Drowzee": {"keep_best_cp": 2},
      "Dugtrio": {"keep_best_cp": 2},
      "Eevee": {"keep_best_cp": 3},
      "Ekans": {"keep_best_cp": 1},
      "Electabuzz": {"keep_best_cp": 1},
      "Electrode": {"keep_best_cp": 1},
      "Exeggcute": {"keep_best_cp": 1},
      "Exeggutor": {"keep_best_cp": 2},
      "Farfetch'd": {"keep_best_cp": 1},
      "Fearow": {"keep_best_cp": 2},
      "Flareon": {"keep_best_cp": 3},
      "Gastly": {"keep_best_cp": 1},
      "Gengar": {"keep_best_cp": 2},
      "Geodude": {"keep_best_cp": 1},
      "Gloom": {"keep_best_cp": 1},
      "Golbat": {"keep_best_cp": 1},
      "Goldeen": {"keep_best_cp": 1},
      "Golduck": {"keep_best_cp": 2},
      "Golem": {"keep_best_cp": 1},
      "Graveler": {"keep_best_cp": 2},
      "Grimer": {"keep_best_cp": 2},
      "Growlithe": {"keep_best_cp": 1},
      "Gyarados": {"keep_best_cp": 3},
      "Haunter": {"keep_best_cp": 1},
      "Hitmonchan": {"keep_best_cp": 2},
      "Hitmonlee": {"keep_best_cp": 1},
      "Horsea": {"keep_best_cp": 1},
      "Hypno": {"keep_best_cp": 1},
      "Ivysaur": {"keep_best_cp": 2},
      "Jigglypuff": {"keep_best_cp": 1},
      "Jolteon": {"keep_best_cp": 3},
      "Jynx": {"keep_best_cp": 1},
      "Kabuto": {"keep_best_cp": 1},
      "Kabutops": {"keep_best_cp": 2},
      "Kadabra": {"keep_best_cp": 3},
      "Kakuna": {"keep_best_cp": 1},
      "Kangaskhan": {"keep_best_cp": 2},
      "Kingler": {"keep_best_cp": 2},
      "Koffing": {"keep_best_cp": 2},
      "Krabby": {"keep_best_cp": 1},
      "Lapras": {"keep_best_cp": 2},
      "Lickitung": {"keep_best_cp": 1},
      "Machamp": {"keep_best_cp": 3},
      "Machoke": {"keep_best_cp": 2},
      "Machop": {"keep_best_cp": 1},
      "Magikarp": {"keep_best_cp": 1},
      "Magmar": {"keep_best_cp": 1},
      "Magnemite": {"keep_best_cp": 2},
      "Magneton": {"keep_best_cp": 3},
      "Mankey": {"keep_best_cp": 1},
      "Marowak": {"keep_best_cp": 2},
      "Meowth": {"keep_best_cp": 1},
      "Metapod": {"keep_best_cp": 1},
      "Mew": {"keep_best_cp": 2},
      "Mewtwo": {"keep_best_cp": 3},
      "Moltres": {"keep_best_cp": 2},
      "Mr. Mime": {"keep_best_cp": 1},
      "Muk": {"keep_best_cp": 1},
      "Nidoking": {"keep_best_cp": 3},
      "Nidoqueen": {"keep_best_cp": 3},
      "Nidorina": {"keep_best_cp": 2},
      "Nidorino": {"keep_best_cp": 2},
      "Ninetales": {"keep_best_cp": 1},
      "Oddish": {"keep_best_cp": 1},
      "Omanyte": {"keep_best_cp": 2},
      "Omastar":  {"keep_best_cp": 2},
      "Onix": {"keep_best_cp": 1},
      "Paras": {"keep_best_cp": 1},
      "Parasect": {"keep_best_cp": 1},
      "Persian": {"keep_best_cp": 2},
      "Pidgeot": {"keep_best_cp": 3},
      "Pidgeotto": {"keep_best_cp": 2},
      "Pidgey": {"keep_best_cp": 1},
      "Pikachu": {"keep_best_cp": 1},
      "Pinsir": {"keep_best_cp": 2},
      "Poliwag": {"keep_best_cp": 2},
      "Poliwhirl": {"keep_best_cp": 1},
      "Poliwrath": {"keep_best_cp": 3},
      "Ponyta": {"keep_best_cp": 1},
      "Porygon": {"keep_best_cp": 2},
      "Primeape": {"keep_best_cp": 2},
      "Psyduck": {"keep_best_cp": 1},
      "Raichu": {"keep_best_cp": 2},
      "Rapidash": {"keep_best_cp": 2},
      "Raticate": {"keep_best_cp": 1},
      "Rattata": {"keep_best_cp": 1},
      "Rhydon": {"keep_best_cp": 2},
      "Rhyhorn": {"keep_best_cp": 2},
      "Sandshrew": {"keep_best_cp": 2},
      "Sandslash": {"keep_best_cp": 2},
      "Scyther": {"keep_best_cp": 2},
      "Seadra": {"keep_best_cp": 1},
      "Seaking": {"keep_best_cp": 2},
      "Seel": {"keep_best_cp": 1},
      "Shellder": {"keep_best_cp": 2},
      "Slowbro": {"keep_best_cp": 2},
      "Slowpoke": {"keep_best_cp": 1},
      "Snorlax": {"keep_best_cp": 2},
      "Spearow": {"keep_best_cp": 1},
      "Squirtle": {"keep_best_cp": 1},
      "Starmie": {"keep_best_cp": 2},
      "Staryu": {"keep_best_cp": 1},
      "Tangela": {"keep_best_cp": 1},
      "Tauros": {"keep_best_cp": 1},
      "Tentacool": {"keep_best_cp": 1},
      "Tentacruel": {"keep_best_cp": 2},
      "Vaporeon": {"keep_best_cp": 3},
      "Venomoth": {"keep_best_cp": 2},
      "Venonat": {"keep_best_cp": 1},
      "Venusaur": {"keep_best_cp": 3},
      "Victreebel": {"keep_best_cp": 1},
      "Vileplume": {"keep_best_cp": 1},
      "Voltorb": {"keep_best_cp": 2},
      "Vulpix": {"keep_best_cp": 1},
      "Wartortle": {"keep_best_cp": 2},
      "Weedle": {"keep_best_cp": 1},
      "Weepinbell": {"keep_best_cp": 1},
      "Weezing": {"keep_best_cp": 1},
      "Wigglytuff": {"keep_best_cp": 1},
      "Zapdos": {"keep_best_cp": 3},
      "Zubat": {"keep_best_cp": 1}
    },
    "vips" : {
        "// Any pokemon put here directly force to use Berry & Best Ball to capture, to secure the capture rate!": {},
        "// any": {"catch_above_cp": 1000, "catch_above_iv": 0.5, "logic": "or" },

		"Arcanine": {"catch_above_cp": 1000, "catch_above_iv": 0.5, "logic": "or" },
		"Articuno": {"catch_above_cp": 1000, "catch_above_iv": 0.5, "logic": "or" },
		"Blastoise": {"catch_above_cp": 1000, "catch_above_iv": 0.5, "logic": "or" },
		"Charizard": {"catch_above_cp": 1000, "catch_above_iv": 0.5, "logic": "or" },
		"Dragonite": {"catch_above_cp": 1000, "catch_above_iv": 0.5, "logic": "or" },
		"Exeggutor": {"catch_above_cp": 1000, "catch_above_iv": 0.5, "logic": "or" },
		"Flareon": {"catch_above_cp": 1000, "catch_above_iv": 0.5, "logic": "or" },
		"Gyarados": {"catch_above_cp": 1000, "catch_above_iv": 0.5, "logic": "or" },
		"Lapras": {"catch_above_cp": 1000, "catch_above_iv": 0.5, "logic": "or" },
		"Mew": {"catch_above_cp": 1000, "catch_above_iv": 0.5, "logic": "or" },
		"Mewtwo": {"catch_above_cp": 1000, "catch_above_iv": 0.5, "logic": "or" },
		"Moltres": {"catch_above_cp": 1000, "catch_above_iv": 0.5, "logic": "or" },
		"Muk": {"catch_above_cp": 1000, "catch_above_iv": 0.5, "logic": "or" },
		"Snorlax": {"catch_above_cp": 1000, "catch_above_iv": 0.5, "logic": "or" },
		"Vaporeon": {"catch_above_cp": 1000, "catch_above_iv": 0.5, "logic": "or" },
		"Venusaur": {"catch_above_cp": 1000, "catch_above_iv": 0.5, "logic": "or" },
		"Weezing": {"catch_above_cp": 1000, "catch_above_iv": 0.5, "logic": "or" },
		"Zapdos": {"catch_above_cp": 1000, "catch_above_iv": 0.5, "logic": "or" }
    }
}

Other Information
OS: Windows 10 64bit
Git Commit: ff62273291a7e8e3ef13105c1be46a44830be0ba
Python Version: 2.7.12

Same for me. When looking on the logs, the bot try to go to multiple location at the same time.

Move the "FollowSpiral" task to the end. Otherwise it will collide with "MoveToFort"

I had to remove the FollowSpiral task to get the expected behaviour back again

@Bashin That actually not a real solution. You will walk to some forts and if your inventory is full you will just idle.

Bot is running for 2 hours and the path is looking good to me. I know it is not correcting the error but it's a workaround for now. If MoveToFort is enabled and FollowSpiral too the current version of the bot very often tries to reach both destinations even if it results in stepping for and back between fort and spiral direction.
As long as the bot is unable to manage both tasks at the same time without making this mistake  try to remove the spiral part and it could be working again.

I delete FollowSpiral from my config and bot walk linear perfectly..
But now, I've insert a path config file to make bot walk to specified location, but don't go here..
It make a similar issue, it make tens of turns in a few space, and however not go to specified location..

BoGnY there was another issue about that, and it is similar case - for now if you are using PATH you need to disable MoveToFort or you will have the bot stuck. If you disable it,  make sure you put enaugh path points in your config because they are the only ones that the bot will visit.

Same here, I'm on the latest dev, 494bc05, and the bot never reaches the pokestop. I just pretty much get this:
Moving towards fort xxx, 0.05km left Arrived at pokestop. Moving towards fort xxx, 0.04km left Arrived at pokestop. Moving towards fort xxx, 0.04km left Arrived at pokestop. Moving towards fort xxx, 0.09km left Moving towards fort xxx, 0.09km left
It says "arrived at pokestop" but it never actually does. I did a clean install with this dev version and modified the config only by putting my login info in, everything else is on default, including "FollowSpiral" at the end, just after "SpinFort".
I now removed the "FollowSpiral" and everything works as expected.

I use default config and remove "FollowSpiral", and it didn't help. After some minutes from start bot start to move to two different forts at the same time.

authors: Bashin BoGnY Lunik RomikB Simbe90 Yanush7 tstumm

repo: PokemonGoF/PokemonGo-Bot


text:
BUG - Bot does not choose higher ball if no intermediate balls available

Expected Behavior
Use UltraBall to catch a pokemon if normal ball < 0.35%
Actual Behavior
Use Pokeball and fail to catch
[2016-07-25 20:02:36] [#] Something rustles nearby!
[2016-07-25 20:02:37] [#] A Wild Dragonite appeared! [CP 2309] [Potential 0.64]
[2016-07-25 20:02:37] [#] IV [Stamina/Attack/Defense] = [8/15/6]
[2016-07-25 20:02:40] [x] Using Pokeball (chance: 3.06%)... (5 left!)
[2016-07-25 20:02:41] [-] Attempted to capture Dragonite- failed.. trying again!
[2016-07-25 20:02:43] [x] Using Pokeball (chance: 3.06%)... (4 left!)
[2016-07-25 20:02:43] [-] Attempted to capture Dragonite- failed.. trying again!
[2016-07-25 20:02:45] [x] Using Pokeball (chance: 3.06%)... (3 left!)
[2016-07-25 20:02:46] [-] Attempted to capture Dragonite- failed.. trying again!
[2016-07-25 20:02:47] [x] Using Pokeball (chance: 3.06%)... (2 left!)
[2016-07-25 20:02:47] [-] Attempted to capture Dragonite- failed.. trying again!
[2016-07-25 20:02:48] [x] Using Pokeball (chance: 3.06%)... (1 left!)
[2016-07-25 20:02:49] [-] Attempted to capture Dragonite- failed.. trying again!
[2016-07-25 20:02:51] [x] Using Pokeball (chance: 3.06%)... (0 left!)
[2016-07-25 20:02:51] [-] Attempted to capture Dragonite- failed.. trying again!
[2016-07-25 20:02:52] [x] Out of pokeballs, switching to farming mode...

(ignore the fact I ran out of balls, this is just to demonstrate. When the bug originally appeared I had ultraballs in stock and eventually the pokemon ran away)
Steps to Reproduce
Have at least one normal pokeball, find a pokemon with a < 35% catch rate and have no great balls but have some ultraballs
The logic for which ball to use is pretty bad, and doesnt take into consideration a user may not have any mid range balls to catch with.

gonna fix in #908

This issue has been resolved.
/closed

authors: MikeDX TheGoldenXY earthchie


text:
Event system for logs and web socket communication

THE EVENT SYSTEM!
ATTENTION: This pull request implements the system only, but doesn't use it and the system is subject to changes before being used!
DISCLAIMER: The objective of this system is to provide an easy way to log messages (properly using the logging module, because we're grown ups) and to send these messages to 3rd party apps through a SocketIO server. Users won't be allowed to add custom code through this system.
Example usage inside bot
self.event_manager.register_event("location", parameters=['lat', 'lng'])
self.event_manager.emit(
  'location',
  sender=self,
  level='info',
  data={'lat': 1, 'lng':1}
)

NOTE: parameters presence are validated! If one is missing it will raise EventMalformedException!
Websocket Handler
When enabled and configured, it can listen to any event the bot emits. For example, if bot emits the event caught_pokemon with any given JSON-serializable data, any library listening for  caught_pokemon will receive this event and the data.
We provide a built-in websocket server that is started with the config variable websocket_server. This config variable has url format (host and port together) for the websocket  server to start, like localhost:4000.
This local websocket server can be replaced by a remote one and it will be kept simple to be easily portable to any language developers like.
Future features for websocket server
In the future the websocket handler will be also used as a remote control server for the bot!
Logging Handler
The logging handler is pretty simple. It tags the log by event sender and log level. The log message right now is event_name: data_dict. Like this:
2016-07-29 02:52:08,205 [PokemonGoBot] [ INFO] location: {'lat': 1, 'lng': 1}

I have plans to add another parameter to event_manager.emit for more beautiful log message.
Thanks to @halsafar, he started the work on this following my proposal.

This beautify instruction should be added into wiki. It's very valuable.

I still want to see that test get hooked up to travis

Should we merge this? or will be conflict again..

Have to merge this before conflict and another merge!

Missing socketIO_server socketIO_client flask eventlet in requirements.txt
And after fix it I got this:
File "pokecli.py", line 40, in
from pokemongo_bot import PokemonGoBot
File "/root/PokemonGo-Bot/pokemongo_bot/init.py", line
24, in
from pokemongo_bot.socketio_server.runner import SocketI
oRunner
File "/root/PokemonGo-Bot/pokemongo_bot/socketio_server/ru
nner.py", line 6, in
from app import app, sio
File "/root/PokemonGo-Bot/pokemongo_bot/socketio_server/ap
p.py", line 8, in
sio = socketio.Server(async_mode='eventlet', logging=log
ging.NullHandler)
AttributeError: 'module' object has no attribute 'Server'
Any idea?

B-E-A-UTIFUL.

authors: Calcyfer TheSavior douglascamata simonsmh solderzzc


text:
Corrected "Spun" to "Spinning"

Short Description:
Fixes:

Corrected "Spun" to "Spinning" syntax.

Thanks for the PR.

Why is this valid? We already have spun it. So it should be past tense

authors: TheSavior raulgbcr solderzzc


text:
L2CAP method openL2CAPChannel should be available for OSX 10.14

Describe the bug
Rx Peripheral openL2CAPChannel method should be available on OSX 10.14 and above.
Expected behavior
The CoreBluetooth method is available on 10.14 but the RxBluetoothkit version is missing the proper @available annotation.
Environment:

OS: OSX 10.14
Library version 5.1.2
Swift version 5.0

Added to version 5.3.0

repo: Polidea/RxBluetoothKit


text:
fix #207 in cholesky decomposition

Issue
Fixes #207
A precedence error in the binary block of #inject:into was causing Cholesky decomposition to fail for matrices of size more than 3.
Code before
[ sum+ (upperTriangular at: k at: i) * (upperTriangular at: k at: j) ]

where sum + (upperTriangular at: k at: i) was being calculated first
Why did tests pass before
In the tests, the matrix size was 3.
So, the value of sum was always zero, hence the precedence did not matter.
Change introduced

Parenthesis has been added to take care of the precedence order
New tests with a matrix size of more than 3 have been added

@olekscode Can you please review this when you are free?

repo: PolyMathOrg/PolyMath

license: mit


text:
Improve ab-glyph rendering use outline px_bounds to inform pixmap size

I saw there were some recent issues with oob on the pixmap when rendering using ab_glyph.
The root cause is the use of "layout" positions (font.height(), h_advance etc) to inform the actual rendering pixmap size. The sizes for laying out glyphs are not always the same as the bounds required for actually rendering the glyphs. For example, a glyph at x=0 may have an outline/render that actually includes some pixels to the left of that layout origin.
ab-glyph provides OutlinedGlyph::px_bounds which accounts for this and will always have enough space to render each pixel returned by OutlinedGlyph::draw correctly. Continuing the example where the glyph (at x=0) outline reaches out to the left of the origin, the px_bounds.min.x of that glyph would be negative.
So outlining the glyphs and using px_bounds gives the correct pixmap size. It is then important to convert the px_bounds into "pixmap space" when calculating the pixel index, since px_bounds.min.x may be non-zero. I added comments to explain this in the code.
After all that we should end up with smaller pixmaps than before and p_idx should never go oob. (The pixmaps could be even smaller actually, I padding the vertical size with the full "ascent" of the font just to make positioning of the pixmap consistent e.g. so "Tg" & "gg" would have the same height pixmap).
I replaced the log with a debug_assert, since it "should never happen" but if a bug is still there or is introduced we'd probably prefer release code to still not panic.
Please feel free to ping me directly if you have problems/questions about ab_glyph code in future.

That's awesome, thanks!

Please feel free to ping me directly if you have problems/questions about ab_glyph code in future.

Cool, I appreciate that, I never took the time to learn ab-glyph properly, so that will be helpful for sure.

authors: PolyMeilex alexheretic

repo: PolyMeilex/sctk-adwaita


text:
Fix attribute-like text rendering "$lit$"

Also gives us a chance to use a faster check when looking for bound attributes, since we're already paying for the bytes.
Fixes #854, and includes the test from #854.

/cc @ruphin, I included your test case commit in this. @googlebot needs your permission.

I grant permission.

authors: jridgewell ruphin

repo: Polymer/lit-html


text:
[0.9] on-click="kickAction()"

Why did you remove () ?
Why not on-click="kickAction()" ?
We have been using () sins 1990 :P
<template>

  <button on-click="kickAction()">Kick Me</button>

</template>

<!DOCTYPE html>

<button onclick="myFunction()">Click me</button>

A function is triggered when the button is clicked. The function outputs some text in a p element with id="demo".

I think this only makes sense when passing arguments is supported.
IMHO if arguments aren't supported in the expression, then the braces shouldn't be used.
kickAction means that we pass the function kickAction to Polymer to be called by Polymer as appropriate (with arguments if applicable), kickAction() indicates to me the expression kickAction() should be evaluated.

The code inside of onclick attribute is evaluated directly as JavaScript. This is a major security vulnerability in HTML and it's use is strongly discouraged in all circles.
Polymer doesn't evaluate code, it simply uses the attribute to map a method name to an event.

Ok fair enough I agree

authors: gertcuykens sjmiles zoechi

repo: Polymer/polymer


text:
Send object with on-click functions

It would be great to call functions directly from the HTML instead of passing only the value of the function to call with the attribute on-click (or any other event) like angular does:
<button on-click="{{ doStuff(foo, bar) }}">Do some stuff</button>

Related stack overflow question: http://stackoverflow.com/questions/25380297/send-object-with-on-click-functions-of-polymer

Closing stale issues.

authors: ebidel pikanezi


text:
Tests with syntax errors may silently pass

We've gotten a report that tests with ES6 arrow functions in IE11 silently pass, and they're not even counted as tests.

This is also happening if there is an error thrown in a setup(). These failures are not reported by WCT.

Cool, that should make it easy to test for

authors: TimvdLippe rictic

repo: Polymer/web-component-tester


text:
Rework integration tests

They now:

Pass locally
Pass on travis
Are easy to read
Are fixture-and-golden based

TODO:

They need to be much faster. I plan to fix this by also making regular runs of wct much faster.
The goldens are a bit hard to write, we should support generating them.

This PR is based largly from extracting the testing changes from #374, along with debugging a
few remaining subtleties.

[x] CHANGELOG.md has not been updated, as this change is entirely internal, and has no user-visible aspects.

Hush googlebot

Looks like a lot of variant-related things in there... are those just names?

Rebased out the merge commit that googlebot was unhappy about

Hmm, failure of one of the fixtures on node 6

The tests are still somewhat flaky, though it seems moreso on travis.

authors: azakus justinfagnani rictic


text:
Created schema2kotlin Entity generator

Summary

Unified entity generators with a common class (schema2base)
Added schema2kotlin, integrated with sigh toolchain.
Updated test particle to use generated entities.

there won't be separate files for the different schemas (aka Data.kt and Info.kt).

That shouldn't be a problem. I'll post a change after your side is ready.

repo: PolymerLabs/arcs


text:
autobot still not updating dbstats.json

art@Langley:/home/covid/covizu$ ls -lt data/*.json
-rw-rw-r-- 1 art covid 7440238 Jun 23 03:36 data/clusters.json
-rwxrwxr-x 1 art covid      52 Jun 20 13:32 data/dbstats.json
-rw-rw-r-- 1 art covid    3616 Jun 13 12:45 data/countries.json

Not sure what's going on here - permissions seem to be ok and it's in the autobot.py script...

Looks like this is working now

@ewong347  - this file is still getting updated with old info?
art@Langley:/home/covid/covizu$ cat data/dbstats.json
{
  "lastupdate": "2020-06-11",
  "noseqs": 36581
}
art@Langley:/home/covid/covizu$
art@Langley:/home/covid/covizu$ ls -l data/dbstats.json
-rwxrwxr-x 1 ewong347 ewong347 52 Jul 23 10:15 data/dbstats.json

Looking into it now, I think it might be an overwriting (permissions) issue.

I ran a stripped down version on a file in my home directory (and it worked fine), Looks like permissions is the issue again, I'll try resetting the rwx permissions on dbstats again. Crontab jobs are running under my user, so this should be a patch to get this working again. I think we should attempt to find a better solution to this problem though.

Worked when running autobot.py from command line after resetting the permissions, will check on crontab iteration tomorrow.

Changing permissions seemed to work!
ewong347@Langley:/home/covid/covizu$ head data/dbstats.json
{
  "lastupdate": "2020-07-24",
  "noseqs": 64458
}

File's gone missing on Langley..
ewong347@coreceptor:~$ ./transfer.sh
clusters.json                                 100%   27MB  27.1MB/s   00:00
timetree.nwk                                  100% 8013     7.8KB/s   00:00
scp: ../covid/covizu/data/dbstats.json: No such file or directory
beadplot.json                                 100%    0     0.0KB/s   00:00
'./clusters.json' -> '/var/www/html/covizu/data/clusters.json'
'./timetree.nwk' -> '/var/www/html/covizu/data/timetree.nwk'

Line 76 in autobot.py was looking for a since updated web element ( Browse --> Search).
Line 257 in autobot.py expects StringIO or file object, was passed string. Modified to minimap2(open(srcfile, 'r'))
Not sure when autobot broke, I'll have to dig through log files
Looks like we're back in business
ewong347@Langley:/home/covid/covizu$ head data/dbstats.json
{
  "lastupdate": "2020-11-26",
  "noseqs": 175212
}

Looks like Autobot has been broken since November 13th. This might have been when we migrated to the setup.py?
loading model 11/12/2020, 01:02:29
processing block of 2146 sequences 11/12/2020, 01:02:38
Saving Lineages
logging in
switching to Covid Homepage
navigating to CoV db
logging in
switching to Covid Homepage
navigating to CoV db
[...]

That's probably it.  We will be retiring the 'bots when we get the dedicated feed, anyhow.

repo: PoonLab/covizu


text:
Farbenwunsch: Wenn ProcDumpEx nicht als Admin ausgeführt, Meldung in roter Farbe

Wenn ProcDumpEx nicht als Admin ausgeführt wird, ist das ja ein Fehler vom Nutzer, den würde ich zur Abhebung rot einfärben, anstatt blau, da wir die Farbe nehmen, das ProcDumpEx im Idle ist. Damit man ein paar Farbcodes haben:
Blau = Hinweis
Gelb= Warnung
Rot= Fehler
Grün = Erfolg
So hatten wir es bisher gemacht. Konkret hat der Benutzer ja einen Fehler gemacht. Um diese Meldung geht es konkret:
[Helper][26.04.2023 15:09:12]: Administrator privileges are required to run ProcDumpEx. Please restart the console as administrator.

eingebaut durch #74

authors: PoppyTheDeveloPaw Zocoya

repo: PoppyTheDeveloPaw/ProcDumpEx


text:
Set up cascading writes for the article author table

Currently, the authors of articles are stored as one long string in the database. This is not optimal, and it's better to have an authors table where we document authors. (Realized while working on #99)

I'm having second thoughts about setting up a table for article authors, as there are no good ways to determine the uniqueness of the authors. For example, if John Doe wrote an Article A, and John Doe wrote an Article B, how can we determine that these people are the same?
Maybe a better way to approach this is to store the author information as a JSON field in the Articles table.

I'm closing this as wont-fix since this is not a feature that we will implement soon.

repo: PostReview/postreview-app


text:
azure auth error missing jwks_uri

PDA version
0.4.0
Python version
3.0
Steps to Reproduce

Configure login via azure
get error because metadata is missing jwks_uri

Expected Behavior
get logged in ;)
Observed Behavior
server error 500
[2023-04-06 12:00:00,518] [app.py:1449] ERROR - Exception on /azure/authorized [GET]
Traceback (most recent call last):
File "/usr/lib/python3.10/site-packages/flask/app.py", line 2073, in wsgi_app
response = self.full_dispatch_request()
File "/usr/lib/python3.10/site-packages/flask/app.py", line 1519, in full_dispatch_request
rv = self.handle_user_exception(e)
File "/usr/lib/python3.10/site-packages/flask/app.py", line 1517, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/lib/python3.10/site-packages/flask/app.py", line 1503, in dispatch_request
return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args)
File "/app/powerdnsadmin/services/azure.py", line 35, in azure_authorized
token = azure.authorize_access_token()
File "/usr/lib/python3.10/site-packages/authlib/integrations/flask_client/apps.py", line 105, in authorize_access_token
userinfo = self.parse_id_token(token, nonce=state_data['nonce'], claims_options=claims_options)
File "/usr/lib/python3.10/site-packages/authlib/integrations/base_client/sync_openid.py", line 66, in parse_id_token
claims = _jwt.decode(
File "/usr/lib/python3.10/site-packages/authlib/jose/rfc7519/jwt.py", line 96, in decode
data = self._jws.deserialize_compact(s, load_key, decode_payload)
File "/usr/lib/python3.10/site-packages/authlib/jose/rfc7515/jws.py", line 101, in deserialize_compact
algorithm, key = self._prepare_algorithm_key(jws_header, payload, key)
File "/usr/lib/python3.10/site-packages/authlib/jose/rfc7515/jws.py", line 254, in _prepare_algorithm_key
key = key(header, payload)
File "/usr/lib/python3.10/site-packages/authlib/integrations/base_client/sync_openid.py", line 38, in load_key
jwk_set = JsonWebKey.import_key_set(self.fetch_jwk_set())
File "/usr/lib/python3.10/site-packages/authlib/integrations/base_client/sync_openid.py", line 14, in fetch_jwk_set
raise RuntimeError('Missing "jwks_uri" in metadata')
RuntimeError: Missing "jwks_uri" in metadata

@chriss-de did you read the contribution guidelines before submitting this?

authors: AzorianMatt chriss-de

repo: PowerDNS-Admin/PowerDNS-Admin


text:
revert: Corrupted history fix

#1160 removed some character replacement that are needed for databases with single quotes in the history table.
Users with such entries in their history are not able to use PDA anymore. This small patch is for testing until a more robust solution is pushed.
Regards

Hello,
The comment are outdated now, if you look at the patch we opted for trying to store valid JSON in the detail history column. I think I have changed the missing calls in the current version, including the one you pointed.
There is a db migration script to apply too, to replace single quotes with double quotes. We don't have corrupted history entries that are not fixed with this.


text:
Disable printing warning logs when test-mode is enabled.

Question
As is explained in the document, test-mode is used for writing Junit-tests. When I am writing codes in other modules, the console keeps printing the following messages. Could this be avoided?
2021-01-13 16:14:11.653  [] [] [] [WARN] 16644 --- [oms-akka.actor.default-dispatcher-78] c.g.k.p.w.actors.TroubleshootingActor    TroubleshootingActor.java:23: [TroubleshootingActor] receive DeadLetter: DeadLetter(WorkerHeartbeat(workerAddress=192.168.119.113:28888, appName=service-command-communication, appId=11, heartbeatTime=1610525631633, containerInfos=[], version=3.4.0, extra=null, systemMetrics=SystemMetrics(cpuProcessors=4, cpuLoad=-1.0, jvmUsedMemory=0.2376, jvmMaxMemory=3.4863, jvmMemoryUsage=0.0681, diskUsed=174.5065, diskTotal=930.716, diskUsage=0.1875, score=7)),Actor[akka://oms/deadLetters],Actor[akka://oms/deadLetters])

2021-01-13 16:14:11.656  [] [] [] [WARN] 16644 --- [oms-akka.actor.default-dispatcher-78] c.g.k.p.w.actors.TroubleshootingActor    TroubleshootingActor.java:23: [TroubleshootingActor] receive DeadLetter: DeadLetter(WorkerHeartbeat(workerAddress=192.168.119.113:28888, appName=service-command-communication, appId=11, heartbeatTime=1610525646633, containerInfos=[], version=3.4.0, extra=null, systemMetrics=SystemMetrics(cpuProcessors=4, cpuLoad=-1.0, jvmUsedMemory=0.2411, jvmMaxMemory=3.4863, jvmMemoryUsage=0.0692, diskUsed=174.5065, diskTotal=930.716, diskUsage=0.1875, score=7)),Actor[akka://oms/deadLetters],Actor[akka://oms/deadLetters])

2021-01-13 16:14:11.658  [] [] [] [WARN] 16644 --- [oms-akka.actor.default-dispatcher-78] akka.stream.Materializer                 Slf4jLogger.scala:89: [outbound connection to [akka://oms-server@18.18.18.22:10086], message stream] Upstream failed, cause: StreamTcpException: The connection has been aborted

2021-01-13 16:14:11.659  [] [] [] [WARN] 16644 --- [oms-akka.actor.default-dispatcher-78] akka.remote.artery.Association           Slf4jLogger.scala:89: Outbound message stream to [akka://oms-server@18.18.18.22:10086] failed. Restarting it. akka.stream.StreamTcpException: The connection has been aborted

emmm, It seems can't be turn off.

emmm, It seems can't be turn off.

authors: KFCFans jjnnzb

repo: PowerJob/PowerJob


text:
Remarks around the localization of the ' PlasterRessources.psd1' file

I am localizing the PlasterRessources.psd1 file and I have some remarks about it.
PlasterResources.psd1
The key 'ManifestNotValid_F1'   is for a valid  Xml file.
the key 'ManifestNotValidXml_F1' is for a not well-formed Xml file.
Key 'UnrecognizedAttribute_F2' -> Unrecognized manifest attribute {0} on element {1}.
Unrecognized manifest attribute is managed by the XSD.
May be rename it to 'UnrecognizedContentTypeAttribute_F2'
Likewise for 'UnrecognizedParameterType_F2' -> Unrecognized parameter type '{0}' on parameter name '{1}'.
The key 'UnrecognizedContentElement_F1','UnrecognizedParametersElement_F1' are managed by the XSD ?
May be rename it to 'NotImplementedElement' ?
InvokePlaster.ps1
I know is temporary, but 'Create' is not localized :
  # TODO: Temporary - remove this when this function makes use of ProcessFile
  WriteOperationStatus 'Create' (ConvertToDestinationRelativePath $dstPath)

TestPlasterManifest.ps1
Is it possible to save the original exception ?
   Write-Error ($LocalizedData.ManifestNotValidXml_F1 -f $Path)

   #Something like this
   $Ex= (new-object System.ApplicationException(($LocalizedData.ManifestNotValidXml_F1 -f $Path),$_.Exception))
   $Er=New-Object System.Management.Automation.ErrorRecord(
         $Ex,
         "InvalidFormat",
         "InvalidData",
         ("[{0}]" -f $Path)
       )
   Write-Error -ErrorRecord $Er

PlasterManifest-v1.xsd
The following element is not yet documented (xs:documentation) :
 <xs:attribute name="store" type="ptd:StoreFormatType"/>

The following xml is valid for Test-PlasterManifest
<?xml version="1.0" encoding="utf-8"?>
<plasterManifest>
  <metadata>
    <id>string</id>
    <version>string</version>
    <description>string</description>
    <tags>string</tags>
  </metadata>
  <content/>
</plasterManifest>

Invoke-Plaster does nothing :-)
$PlasterParams = @{
    TemplatePath = "$PWD"
    DestinationPath='..\out'
}
Invoke-Plaster @PlasterParams

The key 'ManifestNotValid_F1' is for an invalid Xml file.
the key 'ManifestNotValidXml_F1' is for a not well-formed Xml file.

The first is for an invalid manifest file.  That could be because the XML is not well-formed or the manifest violates the schema.  The second is for a not well-formed XML file.   If you want to tweak the wording (English as well), go for it.

'UnrecognizedAttribute_F2'

This string could probably go away as the schema does validate the values of the type attribute.  Looks like I missed this one when integrating the schema.  But I'm having a hard time removing the default case from these.  I think we should replace the one place that uses UnrecognizedAttribute_F2 with UnrecognizedParameterType_F2.  That is the right message for the one spot using UnrecognizedAttribute_F2.  Let's leave UnrecognizedParametersElement_F1 as is. It is very unlikely to get called but the default backstop is there just in case.

Create not localized.

It is in the string table. Looks like I missed a place where I should be using $LocalizedData.OpCreate

Is it possible to save the original exception ?

Possibly but I wouldn't use ApplicationException. Use of that exception fell out of favor a long time ago.  :-)

The following element is not yet documented (xs:documentation) :

Yup, I can add that.

The following xml is valid for Test-PlasterManifest, Invoke-Plaster does nothing

Well it was even worse when it thought <foo></foo> was a valid manifest. The thing about schema is if the doc element (with the correct target namespace) isn't recognized then the schema validator says this is not a document I validate.  I have added manual check for the correct doc/root element. Looks like I need to add a manual check that the doc element has the correct target namespace.

<xs:attribute name="store" type="ptd:StoreFormatType"/>

The attribute is documented where it is declared - see line 67.

authors: LaurentDardenne rkeithhill

repo: PowerShell/Plaster


text:
Debian 10 Support

Details of the Distribution

Name of the Distribution: Debian
Version of the Distribution: 10
[x] The version of the Distribution is supported for at least one year.
[x] The version of the Distribution is not an interim release or equivalent.
[x] The version of the Distribution is supported by .NET Core.
[x] An issues has been filed to create a Docker image in https://github.com/powershell/powershell-docker

Progress - For PowerShell Team ONLY

[x] Docker image created
[x] Docker image published
[x] Distribution tested
[ ] Lifecycle updated
[ ] Documentation Updated

This would be very useful.
The stretch installer is not installing on buster or higher.
So we are unable to install PowerShell in Pengwin, which tracks testing.
But PowerShell is missing from the repo for buster.

well , it will be nice install powershell in debian 10 just adding the repo . i am just saying.

when you will support?  ps 7 preview 6?
it seems that not in ps 7 preview 4, and ps 7 preview 5.

@chuanjiao10 	This works, just hasn't been document.  You can see the status here.

@TravisEz13  ???
i not found install package in https://packages.microsoft.com/repos/microsoft-debian-buster-prod/pool/main/p/ .
en,I am not in a hurry.  wait for the ps7 with the official version of .net core 3

We are not producing a new package as the existing package works.

Docs were updated here:
https://github.com/MicrosoftDocs/PowerShell-Docs/pull/4903

repo: PowerShell/PowerShell