text:
souci avec sudo nixos-rebuild switch

bonjour j ai un laptop cg nvidia + intel quand ej fait sudo nixos-rebuild switch j ai ses erreurs
sudo] Mot de passe de tobal:
building Nix...
building the system configuration...
evaluation warning: The option `virtualisation.libvirtd.qemuPackage' defined in `/etc/nixos/glf/vm.nix' has been renamed to `virtualisation.libvirtd.qemu.package'.
stopping the following units: accounts-daemon.service, systemd-modules-load.service
activating the configuration...
setting up /etc...
reloading user units for tobal...
restarting sysinit-reactivation.target
reloading the following units: dbus.service
restarting the following units: polkit.service
starting the following units: accounts-daemon.service, systemd-modules-load.service
the following new units were started: libvirt-guests.service, libvirtd-admin.socket, libvirtd-ro.socket, libvirtd.service, libvirtd.socket, run-credentials-systemd\x2dtmpfiles\x2dresetup.service.mount, sysinit-reactivation.target, systemd-localed.service, systemd-tmpfiles-resetup.service, virt-guest-shutdown.target, virtlockd.socket, virtlogd.socket
warning: the following units failed: nvidia-powerd.service
× nvidia-powerd.service - nvidia-powerd service
     Loaded: loaded (/etc/systemd/system/nvidia-powerd.service; enabled; preset: ignored)
     Active: failed (Result: exit-code) since Sat 2024-12-21 22:42:08 CET; 490ms ago
 Invocation: aeca1e19ce4a4df6847cd76e67708c3b
    Process: 3562 ExecStart=/nix/store/rswdx3495sqz279ddaw40mjfx23846hj-nvidia-x11-565.57.01-6.12.1-bin/bin/nvidia-powerd (code=exited, status=1/FAILURE)
   Main PID: 3562 (code=exited, status=1/FAILURE)
         IP: 0B in, 0B out
         IO: 0B read, 0B written
   Mem peak: 1.8M
        CPU: 5ms

déc. 21 22:42:08 GLF-OS /nix/store/rswdx3495sqz279ddaw40mjfx23846hj-nvidia-x11-565.57.01-6.12.1-bin/bin/nvidia-powerd[3562]: nvidia-powerd version:1.0(build 1)
déc. 21 22:42:08 GLF-OS /nix/store/rswdx3495sqz279ddaw40mjfx23846hj-nvidia-x11-565.57.01-6.12.1-bin/bin/nvidia-powerd[3562]: SBIOS support not found for NVPCF GET_SUPPORTED function
déc. 21 22:42:08 GLF-OS /nix/store/rswdx3495sqz279ddaw40mjfx23846hj-nvidia-x11-565.57.01-6.12.1-bin/bin/nvidia-powerd[3562]: No matching GPU found
déc. 21 22:42:08 GLF-OS /nix/store/rswdx3495sqz279ddaw40mjfx23846hj-nvidia-x11-565.57.01-6.12.1-bin/bin/nvidia-powerd[3562]: Failed to initialize Dynamic Boost
déc. 21 22:42:08 GLF-OS /nix/store/rswdx3495sqz279ddaw40mjfx23846hj-nvidia-x11-565.57.01-6.12.1-bin/bin/nvidia-powerd[3562]: Failed to detach GPU id 256
déc. 21 22:42:08 GLF-OS /nix/store/rswdx3495sqz279ddaw40mjfx23846hj-nvidia-x11-565.57.01-6.12.1-bin/bin/nvidia-powerd[3562]: Failed to initialize Dynamic Boost
déc. 21 22:42:08 GLF-OS /nix/store/rswdx3495sqz279ddaw40mjfx23846hj-nvidia-x11-565.57.01-6.12.1-bin/bin/nvidia-powerd[3562]: Failed to detach GPU id 256
déc. 21 22:42:08 GLF-OS systemd[1]: nvidia-powerd.service: Main process exited, code=exited, status=1/FAILURE
déc. 21 22:42:08 GLF-OS systemd[1]: nvidia-powerd.service: Failed with result 'exit-code'.
déc. 21 22:42:08 GLF-OS systemd[1]: Failed to start nvidia-powerd service.
warning: error(s) occurred while switching to the new configuration

Deux remarques :

Remplaces virtualisation.libvirtd.qemuPackage par virtualisation.libvirtd.qemu.package
Tu as potentiellement un problème avec dynamicBoost, rajoute dans ta configuration :

Dans /etc/nixos/configuration.nix
hardware.nvidia.dynamicBoost.enable = lib.mkForce false;

Attention, ajoute tes configurations dans un répertoire différent de /etc/nixos/glf pour ne pas les perdre lors de la prochaine update des configurations (tous les trois jours)

repo: GLF-OS/Nixos-by-GLF


text:
RGI11: Europe's southernmost glaciers

In addition to the new inventory by Inaut (Pyrennees) and Frank (Alps), RGI6 had a few more features in the region:

Calderone in central italy (which is available in GLIMS))
Three outlines in Albania and Montenegro (points 7 and 8 on the map below) (not available in GLIMS)

Source: https://www.tandfonline.com/doi/full/10.1657/1938-4246-41.4.455 (all other points have no entries in RGI or GLIMS)
My question is: is it worth including these 4 features in RGI7? If yes, Bruce can you ingest the features in Albania and Montenegro into GLIMS?

Frank volunteered to add the outlines? TBA

(Note that Calderone is not available in its RGI version in GLIMS, only the two dislocated glaciers)

I can add these glaciers (points 7 and 8).  But are they really glaciers?
On Wed, Dec 15, 2021 at 7:25 AM Fabien Maussion @.***>
wrote:

(Note that Calderone is not available in its RGI version in GLIMS, only
the two dislocated glaciers)
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/GLIMS-RGI/rgi7_scripts/issues/27#issuecomment-994840449,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAL3IPTVJCEHBLQCIY2G6ZLURCQOTANCNFSM5KDYQQHQ
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

source: gharchive/issue

authors: bruceraup fmaussion

license_type: permissive

license_source: github-api


text:
Allow user to configure amount of allowed "gappyness"

This let's you hide columns that have a certain gappyness percentage
This is a feature implemented by wasabi (http://wasabiapp.org)  and foldmason (https://search.foldseek.com/foldmason)
It also allows you to disable the default setting that we have to hide columns that are 100% gaps. this was a feature that was requested by HIV database awhile back. They are using a fork of the codebase but it might still help people who want to remain on master. The use case was that a metadata track in stockholm file stored the reference sequence, and then the msa columns could be 100% gaps relative to that reference, which they did not want to automatically hide/collapse.

example screenshot in settings menu

arguably it would be nicer to see this setting applied without the dialog in the way but hopefully this is better than nothing

source: gharchive/pull-request

repo: GMOD/react-msaview

license: MIT


text:
Add CoordinateTransformations

Add a CoordinateTransformations util, includes transformation of vectors and 2-tensors from spherical to cartesian and vice versa, and a function to calculate the area element of a sphere.

I think I will excuse myself from reviewing this having contributed to it.

I'm adding @TaigoFr then, since I am from the same institution and I think we had a rule about that too :-)

authors: KAClough dinatraykova mirenradia

repo: GRChombo/GRChombo


text:
Move infojson loader into gss-utils

It really belongs in gss-utils and shouldn't ever be used by any external users. It's configured specifically for us.
We'll also need to bring along the CLI designed in Issue #108 if it has already been done.
In order to do this, we're going to want to bring our unit-tests across to gss-utils. gss-utils doesn't have a unit testing framework. So we'll need to introduce that into gss-utils as part of this ticket. AND make sure pytest is run as part of the Jenkins pipeline.
@mikeAdamss Have any problem with us installing pytest (or potentially some other unit testing library) in gss-utils?

sorry Rob missed the original ping for this somehow.
Broadly I don't see the harm in adding pytest though we might need a steer from Alex on his vision for gssutils. If its intended in any way as a wider use tool this kinda thing might need to be an optional dependency of some sort.
We might also need to move decoupling things/tidying up in gssutils up the priorities a bit, it has the potential to get really messy, really fast.

@ajtucker @rossbowen - if we're moving move things into gssutils (see above) I probably need a fair dose of time pretty soonish to decouple things and generally tidy up. Gonna be a lot easier to do before we starting adding.

So we had a chat with @mikeAdamss in the DM/DE catchup this morning and we agreed that given the low level of integration we want to achieve, we don't need to do any immediate refactoring of gss-utils to accommodate our desired changes.
We will almost certainly have future discussions on how to refactor and improve gss-utils in due course, but we don't need to wait for those to begin this work.

authors: mikeAdamss robons

repo: GSS-Cogs/csvwlib


text:
Merging name

Added my name Abdur Rahman

added my name Abdur Rahman


text:
Question about the back translations.

Can I not do data augmentation on unlabelled data?

We use back-translation to create paraphrases for unlabeled data and perform consistency training. You could use other ways to generate paraphrases.

So I have to create paraphrases, right? In addition, When I look at the code, I find that only the first 100,000 pieces of data in the data set have been back translated. Do I not need to perform back translation for all the datasets

It depends on the size of the unlabeled data you are going to use.  In this work, we used 100,000 unlabeled data, so we just did back translations on them, not the whole dataset.

Sorry, I'm still a little confused.
When I test with:
python ./code/train.py --gpu 0,1 --n-labeled 10 \ --data-path ./data/yahoo_answers_csv/ --batch-size 2 --batch-size-u 4 --epochs 20 --val-iteration 1000 \ --lambda-u 1 --T 0.5 --alpha 16 --mix-layers-set 7 9 12 \ --lrmain 0.000005 --lrlast 0.0005
The number of unlabeled data per class seems to be 5,000. Do they add up to exactly 100,000?

You could use up to 100,000

10,000

Anyway, the number of data you need to paraphrase only depends on the number of unlabeled data you are going to use.

Are they one-to-one correspondence？

one unlabeled data could be associated with multiple paraphrases. Please refer to the paper/codes for details.

authors: callmeYe jiaaoc

repo: GT-SALT/MixText


text:
Update your-first-plugin.md

Added the following

Preface
Setting up Visual Studio Community
Creating a C# class library project
Writing a EntryPoint class
Compiling for release

Added a hint for what a plugin is

repo: GTFO-Modding/GTDO

license: Unlicense


text:
Post-mergening cleanup + fix oops

Detrav shouldn't have been api...

yea it fails, but the problem isnt in this mod but in https://github.com/GTNewHorizons/DetravScannerMod/blob/98f1f11fc4604cbf88488cd199b62849717b9eb3/src/main/java/com/detrav/items/processing/ProcessingDetravToolProspector.java#L9

Currently working on PRs to Detrav and Coremod, should build once those are out (and deps are updated ofc)

authors: ah-OOG-ah chochem

repo: GTNewHorizons/VisualProspecting


text:
A value that can be either a primitive or a record

Is it possible to create a Dhall file that will generate the following stack.yaml?
Each item in packages could either be a primitive value (string) or a record.
packages:
- '.'
- location:
    git: git@github.com:Gabriel439/Haskell-Dhall-Library.git
    commit: aeb7d165251a0612538e0ca8f84d60b5aaac6c8d
  subdirs: []
  extra-dep: true

Or written this way, the problem shifts to location, which is either a primitive value or a record.
packages:
- location: '.'
- location:
    git: git@github.com:Gabriel439/Haskell-Dhall-Library.git
    commit: aeb7d165251a0612538e0ca8f84d60b5aaac6c8d
  subdirs: []
  extra-dep: true

My tendency is to reach for Dhall's union type, but that is not a currently supported translation:
Explanation: Only primitive values, records, ❰List❱s, and ❰Optional❱ values can be translated from Dhall to JSON

It might be helpful to allow for unions to translate to overlapping types for situations like this.
Using unions in this way is more similar to TypeScript's union type, since the explicit tag would get lost in translation.

Yeah, I like this idea!  I have a pull request up at #3 which uses your suggestion of unions with the tag stripped.  Check it out and let me know if that's what you had in mind

Yes that works great. Here's a Dhall script to generate the first stack.yaml above.
{ packages =
  [ < path = "."
    | details :
      { location :
        { git : Text
        , commit : Text
        }
      , subdirs : List Text
      , extra-dep : Bool
      }
    >
  , < details =
      { location =
        { git = "git@github.com:Gabriel439/Haskell-Dhall-Library.git"
        , commit = "aeb7d165251a0612538e0ca8f84d60b5aaac6c8d"
        }
      , subdirs = [] : List Text
      , extra-dep = True
      }
    | path : Text
    >
  ]
}

It's a bit verbose to have to specify the alternate union case when it could be inferred, but this certainly allows me to move forward in generating stack.yaml files. Thanks!

Yeah, what I usually do to cut down on the verbosity is to define or import helper functions for each constructor, like this:
    let makePath    = λ(path : Text) → < path = path | details : ... >
in  let makeDetails = λ(details : ...) → < details = details | path : ... >
in  { packages = [ makePath ".", makeDetails { ... } ] }


text:
[BUG] indev vs TR - Amount may not be negative, but it is: -2560 (AOF4 1.0.0)

Description:
The server crashed and so I grabbed the report. I thought it was the same thing we experienced the other day with dank docks, but that doesn't seem to be the case.
Steps to Reproduce:
Unfortunately I don't know what the steps are to reproduce it - luckily/unluckily for the players the server rolled back so I didn't have to remove anything.
Technical Information:

Minecraft: 1.17.1
Fabric API: 0.40.8+ 1.17
Industrial Revolution: 1.11.0-alpha.1
Modpack: AOF4 1.0.0

Logs:
https://paste.alloffabric.com/buyajawaba.yaml

Thanks for reporting, it should be fixed as of 1.11.0-alpha.2 which will be available shortly on CurseForge.

authors: GabrielOlvH irunatbullets

repo: GabrielOlvH/Industrial-Revolution


text:
qFix: Quick Fixes

qFix branch is used to apply quick fixes.

Update gSVM and gMatchedFilter dialogs according to changes made in eegData and eegOperations classes.

Removed bugs from gSVM as per above comment.

Removed bugs from gMatchedFilter as per above comment.

repo: GallVp/visualEEG


text:
GET /rooms perPage=20 return empty

perPage=20 return empty
perPage=10 return empty
perPage=2 return empty
perPage=1 才會有 result

@ricksu978 應該請前端帶0進來比較好，所以這張單子應該不會改

已由前端解決
https://github.com/Game-as-a-Service/Game-Lobby-Web/issues/287


text:
How to build other renderApi version?

I can not find the way to change to other RenderApi,It seems I have to build the project again.
By the way,why don't you design it to a dynamic render? There exist render switch requirement in a platform such as android or ios.

You can set the render backend to use through http://docs.bsframework.io/latest/structbs_1_1_s_t_a_r_t___u_p___d_e_s_c.html and pass it along to Application on start-up.
In the future please post questions on discourse.bsframework.io, we're keeping this section for bug reports and feature requests only.

repo: GameFoundry/bsf


text:
Add issues

As the maintainer of a Collaborate repo, keeping Issues up-to-date will help the student community understand what they can do to contribute. Issues should vary by the easy (update documentation) to the difficult (add a new feature). The more involved you are, the more opportunities there are to collaborate.
Recommendations:
Add issues of varying difficulty to the repo often. you must add the tag GSSoC'24, Level 1, Level2, Level 3 good first issue etc.
How we cacluclate the Scores on Leaderboard: Every PR one point
Level 1: 10 points
Level 2: 25 points
Level 3: 45 points
Try to add some documentation issues as well it would be easy for beginner contributor to explore opensource through your repo.
Generate issues even if you plan on solving them, so the repository appears as active.
Contribute/commit often to the repo so it does not go stale.
Reference https://github.com/Recode-Hive/Stackoverflow-Analysis/issues

done

repo: GameSphere-MultiPlayer/Squard-line


text:
password protection

needs implementation with password-settings

basically works, settings are missing and bugs are still persistent. See other isues.

license_source: bigquery


text:
包安装问题

您好，源码安装出现FileNotFoundError: [Errno 2] No such file or directory: 'version.py'这应该怎么解决

Traceback (most recent call last):
File "setup.py", line 10, in
with open("version.py") as f:
FileNotFoundError: [Errno 2] No such file or directory: 'version.py'


text:
turns out independent sized render targets was causing lighting artif…

…acting.

Good!

authors: Azaezel Lopuska


text:
FFP 64bit

...px

Renamed and Moved to 3.8 for disscuss.

Direct3D will set the floating-point unit to single-precision, round-to-nearest as part of initialization for the calling thread, unless the D3DCREATE_FPU_PRESERVE flag is used, in which case, the floating-point control word is untouched
Since the control word is a per-thread setting, ensuring that all of your application threads are set to single-precision mode may optimize performance.
x86-64 native code never uses the FPU, and always uses SSE instructions, so the floating-point control word issues are all specific to x86 code,  _control_fp is not valid for x64-native coding, which uses SSE exclusively instead.

this one seems to check out

authors: Azaezel LuisAntonRebollo TheDushan Winterleaf


text:
PHP Exception Namespace

Hi, I just checked out your project for use in a Symfony project I'm working on. I noticed that you're missing a backslash @line 690 to extend a native PHP Exception. Not much of a contribution I know - this is my first fork/pull-request :)

Was about to make my own fork to make this exact same pull request.

Any word on this? This bug causes a fatal error which makes the library unusable.

authors: coderich danapplegate mgb

repo: GaretJax/phpbrowscap

license: mit


text:
🛑 Mastodon is down

In ebc57be, Mastodon ($MASTODON_URL) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Mastodon is back up in 8ef3bdc.

repo: GeekCornerGH/status-page


text:
Use stdlib to cast string to bool

This PR solves the issue #42.
Please provide enough information so that others can review your pull request:
This PR only changes the way we cast environment variable DEBUG from string to boolean using the python standard library. It doesn't changes any application functionality.

Fix #42
Thanks!

hi @francescarpi , you merged before I made the changes suggested by @jbagot hehe

Yes, sorry. I wanted to create another issue for apply django-environ. Could you create a new issue, pls?
Thanks mate!

I was running out time and went straight to PR. I Apologize for not open before a issue.

authors: francescarpi fullonic

repo: GeeksCAT/anem-per-feina


text:
How to detect tab change?

As, no lifecycle method is called when tab is changed? How to detect onTabChange?

I wnat to use this.setState of one component when tab is changed.

Tried:
    <Tabs
      initialPage={0}
      tabBarPosition="bottom"
      // onChangeTab={({ i, ref, from }) => console.log(i, ref, from)}
    >

trying onChangeTab as shown above neither outputs console.log() nor changes the tab. The app freezes when doing so.

@sabbiu https://github.com/skv-headless/react-native-scrollable-tab-view#props

Turns out, console.log() was making my app freeze. Removing that and implementing actual method is working as promised.

hey could you please share a code snippet that could help  me implement onChangeTab

You must not add a console.log.
I hope this is going to be corrected
<Tabs
          tabBarUnderlineStyle={styles.tabs}
          onChangeTab={({i}) => setCurrentTab({currentTab: i})}>
          <Tab heading={'My fridge'} {...styles.tab} />
          <Tab heading={'Recipes'} {...styles.tab} />
        </Tabs>

authors: SupriyaKalghatgi r-mhjn sabbiu voold

repo: GeekyAnts/NativeBase


text:
Method Compile on class update should not warn about unused temps (3.0.79)

When you add an instance variable, class instance variable or class variable to a class...
You can get a bajillion dialogs in sequence, one for each method that is getting recompiled and has unused temps.  This is quite painful; I had to press yes on a dialog 14 times, as it turned out.
I've marked this November, but it may not actually be important in practice so it could be deferred.

That is pretty ugly although one could make a case that compile warnings should be cleaned up by the programmer.  Nonetheless, I've suppressed CompileWarning's during the method recompilation phase of the class save in Oscar 3.0.80.

authors: LisaAlmarode ericwinger

repo: GemTalk/Jadeite


text:
Configurable Debounce per field

Having a default debounce functionality is essential, but applying to all fields can slow down the app.
By example: the "isready" field only slows down page loading as "isready" is called only once.
So we have to find a way to make debounce configurable per field.
For now debounce is deactivated for "isready" : see https://github.com/GenieFramework/Stipple.jl/pull/181

Done!
isready is already without debouncing per default. other fields can now be added
@debounce myfield 0

@debounce x, y, z 10

@Eldalie please check and close if your requirement is met

Thank you !  However, I've moved on to another project since then, and unfortunately, I seem to have lost my old code. I trust that you did your best !

authors: Eldalie hhaensel


text:
close #116

Shader Pipeline creation via file or source, requires a dirpath for include directives : close #116.
Question:
Should all shader source require #shader directive to be parsed before the #include directive?
It might be useful to be able to parse some shaders as such:
foo.shader
#include "foo.frag"
#include "foo.vert"
foo.vert
#shader vertex
...
foo.frag
#shader pixel
...
Might create an issue, if it doesn't seem pointless, else will move on to other issues.

To answer your question, I think inclusions should be allowed to happen before the shader directive, as it would make things easier and tidier.

Yeah.
At some point we should probably rewrite the parser completely to be a bit nicer (I wrote the original in fairly quickly and didn't pay that much attention to code quality).
And yeah, I think parsing includes before #shader's is best.

Everything ready for a merge now?

repo: GentenStudios/quartz-engine


text:
🛑 WWWW xyz is down

In 5af10fe, WWWW xyz (https://www.crushing.xyz) was down:

HTTP code: 0
Response time: 0 ms

Resolved: WWWW xyz is back up in 5695faf.

repo: GentlemanHu/own-status


text:
🛑 WWWW xyz is down

In 7ec8f52, WWWW xyz (https://www.crushing.xyz) was down:

HTTP code: 502
Response time: 868 ms

Resolved: WWWW xyz is back up in 21db3fc after 15 minutes.


text:
Android as a second display monitor

[x] I have checked that a similar feature request does not already exist.

Is your feature request related to a problem? Please describe.
No.
Describe the solution you'd like
I would like to connect the android device to the windows pc with scrcpy (usb) & then the android device acts like a second monitor for pc.

IIUC, you want your Android device to be a "display" for your computer. Scrcpy mirroring is the other way around, so it's totally out of scope, sorry.

you want your Android device to be a "display" for your computer?

Yes.

Scrcpy mirroring is the other way around

Yeap, I know. But I was hoping it could do the reverse too. :(

Hi, you can do this with SpaceDesk, it's free  and very fast if you have a good wifi reception (dont need a good internet connexion, just a good wifi reception) or you can just plug your phone/tablet by USB cable and do an USB tethering even if you dont have any internet connexion on your phone/tablet and if you have any pc internet connexion from this USB tethering, you can go search on google how to change a network priority for you pc and put this usb tethering connexion to the lowest priority.
Sry if my english is bad and if my explanations are not clear.

& I tried other free solutions (like SD), but they didn't satisfy me enough, specially bcuz they don't support USB Adb connection. (& I don't want to use Wifi or Tethering)
scrcpy looks promising & I hope it's developers add this option as an upcoming feature. (Even if it takes so many months)

I'm also searching for this... @rayman3003 did you find any solution?

did you find any solution?

Not a promising solution:
I found an app named "TwomonUSB" that can do this; But it's not free & also it's old (for 2018) & also it's not fast enough for me. But better than nothing!

Ok, maybe just pointing out the obvious:
You can run a local (as in localhost) VNC server on your computer and a client on your android device. Then use adb reverse tunneling for the connection over usb.

another faster alternative to vnc:
https://www.angelrojasjr.com/2021/10/30/using-an-android-device-with-klipperscreen/

authors: Eloitor MrGaligram eadmaster rayman3003 rom1v xaverdh

repo: Genymobile/scrcpy


text:
Status "neu" ergänzen

Der Status "neu" wird automatisch am Baubedürfnis gesetzt, sobald dieses erzeugt wurde.

Aktuell heisst dieser Status "nicht koordiniert". Ich finde "nicht koordiniert" sprechender als "neu". Soll diese Änderung tatsächlich durchgeführt werden?

Ja.  Grundsätzlich sind alle koordiniert, deshalb stimmt "nicht koordiniert" nicht.
Bitte alle Stati noch "wait" -> wir müssen das an der Sitzung besprechen. #14,#15, #16,#17, #18

Die Stati ergeben sich aus dem Excel im Sharepoint. Ich gehe davon aus, dass dieses Ticket obsolet ist bzw. bereits umgesetzt und schliesse dieses ab.

authors: edgar-butwilowski-win morasax


text:
Adding Sandbox notebooks

This pull request will add notebooks developed for the DEA Sandbox to the general notebook repository for DEA.
Still to do:

test notebooks on GA-hosted sandbox to validate indexing
modify notebook content/formating to fit with needs of GA-hosted sandbox (e.g. dask_average_pixel_example.ipynb needs explanatory text).

Happy to take any other feedback and update as necessary! I'll leave this as a draft PR until we're ready.

This are fantastic notebooks, and are really the level of documentation we should try and include in all notebooks in dea-notebooks.
In the longer run (not necessary now):

We should probably add in the tags field we have in other notebooks (https://github.com/GeoscienceAustralia/dea-notebooks/blob/master/tags.rst) that allows them to show up in the index page on the DEA notebooks user guide (http://geoscienceaustralia.github.io/digitalearthau/genindex.html), so they're as discoverable as possible.
We also need to think about the best way to differentiate NCI notebooks from DEA Sandbox notebooks. Perhaps describing this clearly at the top of notebooks would be enough?

I'm now working on running the notebooks in the GA sandbox (https://app.sandbox.dea.ga.gov.au) before we perform this PR. This comment is to log data/package issues that I run into.
Case_Studies Notebooks:

Agriculture.ipynb: Sentinel-2 data are not available for the specified date/lat-lon range. Notebook relies on s2a/s2b_nrt_granule, which is listed as a product, but the data isn't appearing.
Coastal_Erosion.ipynb: Notebook relies on ls8_nbar_scene, which is not available. Could we update the notebook to use ga_ls8c_ard_3 instead, @robbibt?
Shipping_Lanes.ipynb: Dask client not working: OSError: Timed out trying to connect to 'tcp://dask-datacube-dask.odchub:8786' after 10 s: [Errno -2] Name or service not known. Might need to map to a different Dask client? Also need the s1_gamma0_geotif_scene product.
Water_Classification.ipynb: Need the s1_gamma0_geotif_scene product.

Code_Examples Notebooks:

dask_average_pixel_example.ipynb: Dask client not working: OSError: Timed out trying to connect to 'tcp://dask-datacube-dask.odchub:8786' after 10 s: [Errno -2] Name or service not known.

Dataset_Examples Notebooks:

WaterObservationsfromSpace_AnnualSummary.ipynb: WOfS annual summary data are not available for the specified date/lat-lon range. Notebook relies on wofs_annual_summary, which is listed as a product, but the data isn't appearing (Empty xarray after load).

Tutorial Notebooks:

02_Do_It_Yourself.ipynb: Sentinel-2 data are not available for the specified date/lat-lon range. Notebook relies on s2a_nrt_granule, which is listed as a product, but the data isn't appearing (Empty xarray after load).

High-level summary:

Need to check how s2a_nrt_granule, s2b_nrt_granule and wofs_annual_summary have been indexed and make sure data is available over the regions/times of interest for the relevant notebooks
Need to add the s1_gamma0_geotif_scene` product, as used in the DEA Sandbox: https://dashboard.dea-sandbox.test.frontiersi.io/s1_gamma0_geotif_scene
Rewrite of Coastal_Erosion.ipynb to use Collection 3 upgrade ls8 data (or index ls8_nbar_scene).
Fix the dask client issue

@alexgleith and @robbibt, could you please advise about how we should proceed to address each of these issues? Feel free to tag anyone else involved in the comments so we can keep track of what's happening.

@caitlinadams I'm as of the last few hours working on updating the Coastal_Erosion.ipynb notebook to work on the Collection 3 ga_ls8c_ard_3 because we need that notebook for a workshop next month. It should be ready soon, and work much more nicely as we'll have a full 30 years of data to play with. Only draw-back is that the current ga_ls8c_ard_3-style data is a test set scheduled for deletion soon, so there might be a short period between it being deleted and the final data being processed where the notebook breaks again

Regarding 02_Do_It_Yourself.ipynb with the missing Sentinel-2 data, I've also run into that same problem. I believe that @alexgleith has plans to index the threddsky Sentinel 2 data which comes from the NCI, which should make the entire Sentinel 2 time series available for the notebook

Hey folks
That notebook should be working with S2 NRT data... I'll check up on that.
It's much easier to get going than the Threddsky stuff :-)
On Tue, 30 Jul 2019 at 13:50, Robbi Bishop-Taylor notifications@github.com
wrote:

Regarding 02_Do_It_Yourself.ipynb with the missing Sentinel-2 data, I've
also run into that same problem. I believe that @alexgleith
https://github.com/alexgleith has plans to index the threddsky Sentinel
2 data which comes from the NCI, which should make the entire Sentinel 2
time series available for the notebook
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/GeoscienceAustralia/dea-notebooks/pull/317?email_source=notifications&email_token=AA2JIXNORGL375DDVM24LW3QB63BJA5CNFSM4IHBROT2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD3CVPYA#issuecomment-516249568,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AA2JIXJZRENOLVPKVM4OSJLQB63BJANCNFSM4IHBROTQ
.

--
Alex Leith
m: 0419189050

@alexgleith Regarding the other required datasets that look like they're missing or not indexed on the Sandbox... should we be recording this in any official place other than here? e.g. as issues on another repository, or an email to someone specific?

@robbibt There wasn't any S2 NRT data indexed on DEA Sandbox .. I have started indexing S2 NRT along with Sentinel 2 Definitive .. will update you here once the indexing is complete

The dask issue should now be resolved. The GA sandbox is configured with a different name, so the client value is different. Dask should be working now, however, the calculation in the dask_average_pixel_example.ipynb notebook is taking much longer than it does in the FrontierSI sandbox. I'm just about to try running it again in the GA Sandbox, but it would be good if someone could check this too.

I've now confirmed that the data are available for all of the notebooks. Only remaining fixes are to get dask working on the sandbox, and to update any references of the DEA Dashboard (https://dashboard.dea-sandbox.test.frontiersi.io) to the DEA Explorer (https://explorer.dea.ga.gov.au). The Explorer needs to be updated to reflect the newly added data sets before this step can happen.
Additionally, I've added explanatory text to the Code_Examples/Dask_Average_Colour_Australia.ipynb notebook (https://github.com/GeoscienceAustralia/dea-notebooks/blob/caitlinadams/DEA_sandbox/Code_Examples/Dask_Average_Colour_Australia.ipynb). It would be great if someone could review this as part of this PR.

I've now marked this as ready for review. Happy to take any feedback on text/code inside notebooks before this is merged.

Note: we've deliberately not including some dea-notebook requirements like tags and index files because this needs some longer term thinking to work out how we want these AWS notebooks to show up on the user guide. For now, I think we can relax those rules for this pull request.

@caitlinadams I'll leave my small comments here as I go through the notebooks.
In the agricultural case study, I think this line is incorrect "It takes values from -1 to 1, with high values corresponding to dense vegetation" - it should be "It takes values from -1 to 1, with high values corresponding to healthy vegetation".
In the coastal erosion case study, the hyperlink in the description at the top doesn't work - 404 error.

@CEKrause The text is actually there, the html script that colours it in the notebook is failing to appear in github. @robbibt -- I like the colour, but should it be removed so all the text can be seen in github?

Because of how Python accesses other files, they have to be contained within the folder of the script that's accessing them. This could be fixed if utility functions were included as a Python package instead, but I think that's a significant amount of development.

@CEKrause That's a really good point... I guess the sandbox might need those scripts to run the notebooks, but it will only be reading in the dea-sandox subdirectory? Agree it's not an idea situation though

@caitlinadams  I like the text too, but I think we should probably get rid of it to reduce confusion when it doesn't render

authors: CEKrause alexgleith caitlinadams harshurampur robbibt

repo: GeoscienceAustralia/dea-notebooks


text:
Retour à la rando parent

Pas de bouton retour pour revenir à la rando parent dans une randonnée par étapes après avoir cliqué sur une étape.

Oui exact, bien vu.
On est en train de faire 2 semaines de développements complémentaires et il est notamment prévu d'ajouter cette fonctionnalité : "Sur une fiche fille itinérance, afficher le nom (cliquable) de la fiche mère"

Fait dans https://github.com/GeotrekCE/Geotrek-rando-v3/pull/308

A voir sur https://geotrek-rando-v3-pi.vercel.app/trek/604-Le-Super-Chemin?parentId=501

authors: camillemonchicourt kisitocendrier


text:
Replace HTTP Signature with JWT

Follow Many and Add To Many use HTTPSig, we can now replace that with JWT (and remove it from deps)

this was already done

authors: ferhatelmas tbarbugli

repo: GetStream/stream-ruby


text:
🐛 [Bug] 로그아웃 전에 채널 나가진다는 alert 창 띄워주세요

Problem

로그아웃할 때에도 채널에 나가진다는 alert 창이 필요할 것 같습니다

Reproduction

뒤로가기 동작과 동일하게 alert 띄워준 후 로그아웃 처리되게 해주세용

Screenshot
No response
Expected Behavior
No response
Log
No response
Browser
No response

채널에서 로그아웃 못하는데용??!!!@

authors: Kimhan-nah nyeoni

repo: GhostPangPang/GhostPong


text:
Question about specific query

Hi,
I'm trying to make a specific query to the router, and it seems that the parser doesn't supports or I'm doing something wrong. Here's an example:
ip dhcp-server lease print where dynamic=no and active-address in 192.168.88.0/24

This works from the terminal or in a ssh session. The invalid bit seems to be and active-address in 192.168.88.0/24.
Is there a way to do this? I skimmed through the API documentation but I still can't figure out. Thanks in advance!

I can lab this to test it, but before I do that it would be helpful if you can give me a bit more information:

Can you show me the Java code snippet where you generate the command and call the API?
Can you show me the stack trace of the error you receive?

Hey, thanks for responding.
Sure, here's the code I'm using:
    try {
        ApiConnection con = ApiConnection.connectTLS(Config.HOST, ApiConnection.DEFAULT_TLS_PORT, Config.TIMEOUT);
        con.login(Config.USERNAME, Config.PASSWORD);

        List<Map<String, String>> rs1 = con.execute("/ip/dhcp-server/lease/getall where dynamic=no return address,comment");
        rs1.stream().forEach((r) -> {
            System.out.println(r);
        });

        /*
          Everything is ok here, a list of leases is printed
          ....
          tag=3, data={address=192.168.88.200, comment=Taller}
          tag=3, data={address=192.168.1.103}
          tag=3, data={address=192.168.1.104, comment=fire tv stick}
        */

        List<Map<String, String>> rs2 =  con.execute("/ip/dhcp-server/lease/getall where server=CMTS and address in 192.168.1.0/24");

        rs1.stream().forEach((r) -> {
            System.out.println(r);
        });

        con.close();
    } catch { ...

Here's the stacktrace:
Nov 10, 2015 8:12:47 AM com.dschulz.getleases.GenerarScript main
SEVERE: null
me.legrange.mikrotik.impl.ParseException: Expected [=, <, >, !=] but found TEXT at position 62
    at me.legrange.mikrotik.impl.Parser.expect(Parser.java:183)
    at me.legrange.mikrotik.impl.Parser.expr(Parser.java:90)
    at me.legrange.mikrotik.impl.Parser.andExpr(Parser.java:121)
    at me.legrange.mikrotik.impl.Parser.expr(Parser.java:112)
    at me.legrange.mikrotik.impl.Parser.where(Parser.java:78)
    at me.legrange.mikrotik.impl.Parser.parse(Parser.java:27)
    at me.legrange.mikrotik.impl.Parser.parse(Parser.java:17)
    at me.legrange.mikrotik.impl.ApiConnectionImpl.execute(ApiConnectionImpl.java:75)
    at com.dschulz.getleases.GenerarScript.main(GenerarScript.java:43)

@dschulz I see the command language does support 'in', so apologies for that tangent. It doesn't look (according to the documentation) as if the API language supports "in". I will do a few tests though and see if there is a way of doing it.

Hi Gideon,
Thank you for taking the time to review my question.
I had to improvise, so what I did in the end was simply querying all the leases and then do the filtering in the application. I used a IP subnet calculator class that popped up clicking "I'm feeling lucky" :-)
I think it would be cool if you find a way to use the 'in' keyword. Unfortunately I have no idea on how to achieve this. I'll keep an eye on your commits and test the library as regularly as I can.
Thanks again!

@dschulz I went back to the API "documentation" and I experimented a bit, and I think that while the command line has the "in" syntax, the underlying API does not.
I have posted a question on the Mikrotik forum to see if somebody can help me out.
I'll let you know, but I think for the moment your post-processing solution is most likely the only good option.

@dschulz I've got confirmation on the Mikrotik forum that "in" is not supported in the API. So your current solution is the only one.

authors: GideonLeGrange dschulz

repo: GideonLeGrange/mikrotik-java


text:
[design] Add icons to (UIAlert)actions

Since iOS 11.2 (I think?) the App Store has this action sheet with text + icons, and I think it looks really cool, adding some visual to an action.
Thing is, I think this API is private; it would be cool to take a look and see if we can build this as well!
Let me know what you think 😃

Bug Report Dump (Auto-generated)

Version 1.17.0 (1513546049)
Device: iPad7,3 (iOS 11.2)
TestFlight: true

Thaaaats cool. I want this api lol.
Sent with GitHawk

Apollo (Reddit) client has the same alert actions(kind of) w/ icon being left aligned and actions title on the right.

Yeah, I really wish there was a native API for this, it makes being able to choose an action at a glance so much faster, especially with a swath of actions.
I built this into my Apollo app (screenshot of an example sheet) and it wasn't overly hard to be honest, and after having built it I appreciate the level of customizability it gives you.
I'm hoping to open source it someday, but if I can share the small amount of wisdom I do possess hopefully it'll be helpful! My API essentially just looks like this:
let actionController = ActionController()

actionController.add(action: .upvote) { (action) in
    // Action block on tap
}

actionController.add(action: .downvote) { (action) in
    // Action block on tap
}

present(actionController, animated: true, completion: nil)

Where the corresponding actions can be any part of a large (hardcoded) enum, where each item in the enum has a default title and icon (which can be overridden with alternative versions of the above adding methods).
It makes calling it really simple and concise, but admittedly doesn't lend itself to wide customization super well; I just hardcode in new items as needed. Though it wouldn't be hard to make it extensible.
The UI itself is just a custom view controller, with a UITableView (constructed pretty simply from a custom cell based on the above enum's icon and title) on top of a UIButton, with a custom UIViewControllerAnimatedTransitioning animator obviously. It's really quite simple, only a few hundred lines of code, and that's including the ability to specify text actions (icon-less alternatives more similar to UIAlertController) and a bunch of other stuff.
I'm not sure the above info is of any help to you fine folk, but I've rewritten it a few times over the years due to annoyances in the API and the above is what I've come to really like, so hopefully it was worth the time it took to read at least. :)

That’s awesome, thanks for the information @christianselig.
Sent with GitHawk

This is there now

FYI @christianselig we're using this library that I open sourced.

authors: BasThomas christianselig rizwankce rnystrom

repo: GitHawkApp/GitHawk


text:
Proofread dead links and images

Currently proofreading is not implemented for v6 of the editor. But it'd be great if it not only lists english proofreading, but also meta/content proofreading such as:

Warning: This link is pointing to an invalid location
`Warning: an image in this page doesn't exist"

:+1: Link validation would be HUGE!

authors: SamyPesse nagim

repo: GitbookIO/feedback


text:
🛑 twoc is down

In 901f7cb, twoc (twoc.co.uk) was down:

HTTP code: 0
Response time: 0 ms

Resolved: twoc is back up in b87747b after 16 minutes.


text:
🛑 orkut is down

In c97570a, orkut (orkut.com.br) was down:

HTTP code: 0
Response time: 0 ms

Resolved: orkut is back up in 15779c7.


text:
🛑 letsgo is down

In 7fa1ae7, letsgo (letsgo.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: letsgo is back up in 2f4b238.


text:
🛑 carlinha is down

In 802df97, carlinha (carlinha.org) was down:

HTTP code: 0
Response time: 0 ms

Resolved: carlinha is back up in 4fc7311.


text:
🛑 carlinha is down

In 87676cb, carlinha (carlinha.org) was down:

HTTP code: 0
Response time: 0 ms

Resolved: carlinha is back up in 38aee96.


text:
🛑 orkut is down

In dee6bd6, orkut (orkut.com.br) was down:

HTTP code: 0
Response time: 0 ms

Resolved: orkut is back up in 685cd8c.


text:
🛑 orkut is down

In 67a2db3, orkut (orkut.com.br) was down:

HTTP code: 404
Response time: 97 ms

Resolved: orkut is back up in 138c2ca.


text:
🛑 orkut is down

In 580db34, orkut (orkut.com.br) was down:

HTTP code: 404
Response time: 120 ms

Resolved: orkut is back up in 6fc4ab8.


text:
🛑 orkut is down

In 13d486e, orkut (orkut.com.br) was down:

HTTP code: 403
Response time: 236 ms

Resolved: orkut is back up in e493dc1.


text:
🛑 carlinha is down

In b238dee, carlinha (carlinha.org) was down:

HTTP code: 0
Response time: 0 ms

Resolved: carlinha is back up in 6b70b1a.


text:
🛑 ojolink is down

In aeb39b7, ojolink (ojolink.fr) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Ojolink is back up in ee49190.


text:
🛑 just-elle is down

In f32d707, just-elle (just-elle.com) was down:

HTTP code: 502
Response time: 453 ms

Resolved: just-elle is back up in 4245e88.


text:
🛑 penispedia is down

In 231aa54, penispedia (penispedia.de) was down:

HTTP code: 0
Response time: 0 ms

Resolved: penispedia is back up in 7729b2a.


text:
🛑 orkut is down

In aa85687, orkut (orkut.com.br) was down:

HTTP code: 0
Response time: 0 ms

Resolved: orkut is back up in 7794d5e.


text:
🛑 ojolink is down

In e07b052, ojolink (ojolink.fr) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Ojolink is back up in e6b09bc.


text:
🛑 feest-start is down

In 257782a, feest-start (feest-start.nl) was down:

HTTP code: 0
Response time: 0 ms

Resolved: feest-start is back up in d8360de.


text:
🛑 penispedia is down

In b892fc3, penispedia (penispedia.de) was down:

HTTP code: 0
Response time: 0 ms

Resolved: penispedia is back up in 73b6267.


text:
🛑 penisdicke is down

In 6ea1a57, penisdicke (penisdicke.de) was down:

HTTP code: 0
Response time: 0 ms

Resolved: penisdicke is back up in 8fc25f0.


text:
🛑 orkut is down

In 52f7e55, orkut (orkut.com.br) was down:

HTTP code: 429
Response time: 1384 ms

Resolved: orkut is back up in 5302e85.


text:
🛑 ojolink is down

In a039b2e, ojolink (ojolink.net) was down:

HTTP code: 403
Response time: 478 ms

Resolved: Ojolink is back up in dcf48a1.


text:
🛑 ojolink is down

In 82a9282, ojolink (ojolink.net) was down:

HTTP code: 403
Response time: 507 ms

Resolved: Ojolink is back up in e858404.


text:
🛑 feest-start is down

In 47d5dd3, feest-start (feest-start.nl) was down:

HTTP code: 0
Response time: 0 ms

Resolved: feest-start is back up in 970f5ee.


text:
🛑 benjohnson is down

In a1b7a6e, benjohnson (benjohnson.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: benjohnson is back up in 0aaa9cf.


text:
🛑 ojolink is down

In 3e66c42, ojolink (ojolink.net) was down:

HTTP code: 403
Response time: 537 ms

Resolved: Ojolink is back up in d303ec8.


text:
🛑 ojolink is down

In 2d4f264, ojolink (ojolink.net) was down:

HTTP code: 403
Response time: 455 ms

Resolved: Ojolink is back up in cac8c20.


text:
🛑 orkut is down

In 11b81f8, orkut (orkut.com.br) was down:

HTTP code: 429
Response time: 1118 ms

Resolved: orkut is back up in e7c17d0.


text:
🛑 soso is down

In 8efe12e, soso (soso.com) was down:

HTTP code: 502
Response time: 1095 ms

Resolved: soso is back up in cd1966c.


text:
🛑 orkut is down

In 6233e89, orkut (orkut.com.br) was down:

HTTP code: 0
Response time: 0 ms

Resolved: orkut is back up in 66aa102.


text:
🛑 ojolink is down

In bb1f8f5, ojolink (ojolink.fr) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Ojolink is back up in 3a47884.


text:
🛑 ojolink is down

In 123638d, ojolink (ojolink.fr) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Ojolink is back up in 4d12534 after 8 minutes.


text:
🛑 ojolink is down

In 36dd094, ojolink (ojolink.fr) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Ojolink is back up in a8b9593 after 12 minutes.


text:
🛑 ojolink is down

In b812f0f, ojolink (ojolink.fr) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Ojolink is back up in 22194df after 16 minutes.


text:
🛑 hcr is down

In b639b81, hcr (hcr.co.uk) was down:

HTTP code: 429
Response time: 885 ms

Resolved: hcr is back up in 86ca15d after .


text:
🛑 orkut is down

In 10e313c, orkut (orkut.com.br) was down:

HTTP code: 0
Response time: 0 ms

Resolved: orkut is back up in 3b070a3.


text:
🛑 ojolink is down

In 6b185b8, ojolink (ojolink.fr) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Ojolink is back up in d0c67e5 after 5 minutes.


text:
🛑 ojolink is down

In 23c56ce, ojolink (ojolink.fr) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Ojolink is back up in 61480a3 after 10 minutes.


text:
🛑 orkut is down

In 505c7bd, orkut (orkut.co.in) was down:

HTTP code: 0
Response time: 0 ms

Resolved: orkut is back up in 2d15d72 after 8 minutes.


text:
🛑 orkut is down

In 84a1a52, orkut (orkut.co.in) was down:

HTTP code: 0
Response time: 0 ms

Resolved: orkut is back up in cc45fa6 after 8 minutes.


text:
🛑 orkut is down

In f4efbae, orkut (orkut.co.in) was down:

HTTP code: 0
Response time: 0 ms

Resolved: orkut is back up in 4bccf5c after 23 minutes.


text:
🛑 twoc is down

In 82738f0, twoc (twoc.co.uk) was down:

HTTP code: 0
Response time: 0 ms

Resolved: twoc is back up in ac0d7b5 after 31 minutes.


text:
🛑 Wide6 is down

In 5f0b227, Wide6 (Wide6.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: wide6 is back up in 70aa75f after 59 minutes.


text:
🛑 torrentzap is down

In aa39964, torrentzap (torrentzap.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: torrentzap is back up in 663f50a after 12 minutes.


text:
add orderBy Traceable for projects

I need sortBy Traceable projects in projects page.
@CarlosQ96 @mohammadranjbarz Can you add it?

I need sortBy Traceable projects in projects page.
@CarlosQ96 @mohammadranjbarz Can you add it?

Sure, as soon as possible we will do it

@DonnaOftadeh pls take a look and confirm

@mohammadranjbarz @CarlosQ96 move it back. ;(

@mohammadranjbarz actually if you do direction: ASC it shows them. So Ramin told me is in inverted Order. So we would need to reinvert the order or modify the orderBy just for this field.

@mohammadranjbarz actually if you do direction: ASC it shows them. So Ramin told me is in inverted Order. So we would need to reinvert the order or modify the orderBy just for this field.

Yeah you are right, it's for staging
but I still should the DB changes for production

Uploaded the PR it seems the ordering is fine, but the issue was the nulls. So I inverted the Order of where the TraceCampaignId are when sorting so it makes sense.

@CarlosQ96  can you provide more context on how to test this issue?

If filter by Trace is working fine on UI, its done.

testing on next.giveth.io
I can sort by traceable and all of the traceable projects show up at the top, but also non traceable projects show up as we continue to scroll down -

load more will continute to load more projects including ones that are not traceable
ideally similar to other sort/filter features - such as accepts GIV token we should limit this sort function to only traceable projects - moving back to in progress

I think we decided to have filter/sort behavior not only filtering.
Do only Giv also behave like first GivOnly then other projects. This is because we tell the user in UI we're gonna  only sort them.

okay but the issue is that we sort by traceable and we are shown projects that are not traceable - this should be filtering them out

This issue was created when dint have any filter/sort by trace, and its working right now.
But I agree with you that we have to decide we just filter or sort? For example: Sort by verified query is just behave like sort by trace and includes non-verified projects but after verified ones as a SORT BY query.
So I think we talked and we decide to just sort, its fine for now because we have "load more".
But if we want to revise, yeah we can add just Filter behavior for those queries: verified, accepts GIV and Trace.
Appreciate if @mohammadranjbarz    and @CarlosQ96 @mateodaza

Yeah it all came down to things we decided on the calls. It would be a sort not a filter in the case of the traceable projects.
But yeah a filter can also be added.

it really doesn't make sense if you want to sort by traceable and then non-tracable projects show up - what's the point then?
I think sorting by traceable should have the filter functionality

it really doesn't make sense if you want to sort by traceable and then non-tracable projects show up - what's the point then?
I think sorting by traceable should have the filter functionality

this is solved now

authors: CarlosQ96 MoeNick RamRamez divine-comedian mateodaza mohammadranjbarz

repo: Giveth/impact-graph


text:
On change of company increment a counter

On change of company increment a counter

@Avrahambo the PR seems to have the wrong diff. I'll close this one, and try to create the PR correctly.

authors: Avrahambo amitaibu

repo: Gizra/elm-hedley


text:
[POC] linting with pylint

Context
The goal of this ticket is to implement linting on the code. We have noticed that certain rules applied to demcompare are not applied in the files of xDEM.
Examples of errors present in the test files:

tests/test_volume.py:252:11: W0125: Using a conditional statement with a constant value (using-constant-test)
tests/test_spatialstats.py:563:12: W0612: Unused variable 'ny' (unused-variable)
tests/test_spatialstats.py:509:0: C0115: Missing class docstring (missing-class-docstring)
tests/test_spatialstats.py:547:4: R0914: Too many local variables (27/15) (too-many-locals)
tests/test_vcrs.py:22:8: C0206: Consider iterating with .items() (consider-using-dict-items)

We cannot guarantee that the same code quality is applied to all the code. Therefore, we propose to add the pylint tool to the code dependencies and correct the errors highlighted.
Tasks

[ ] Explain why pylint is in the "test" dependencies in the setup file and see if it's the most appropriate place for it
[ ] Add a .pylintrc file

[ ] Use the one from demcompare (Amaury, if you can take a look and see if you want to modify anything)

# Maximum number of characters on a single line.
- max-line-length=80
+ max-line-length=120
- # Maximum number of lines in a module.
- max-module-lines=700

[ ] Add a pylint dependency in the .pre-commit-config.yaml file (same config as demcompare)
[ ] Correct the errors returned

[ ] If possible
[ ] Otherwise, add the # ignore and list them in a document

[ ] Add pylint to CI github actions

Estimate : 2d

on the general linting, i agree to put something at the beginning to benefit from the quality wrappers for all code to be done afterwards. I think it is a must have with this too permissive python language. I would nevertheless prefer go to :

quicker ruff directly for replacement of pylint (not all but i think sufficient and growing), black, flake8, isort. only one tool easier
and mypy very important also (type checking is really important). Maybe another ticket.

See https://docs.astral.sh/ruff/faq/ and ruff is now really mature and faster. So it would be a better choice on linting i would advise
"Explain why pylint is in the "test" dependencies in the setup file and see if it's the most appropriate place for it" --> you mean use a "dev" target ? more explicit but if xdem is used with test for dev parts, go for it. No casus belli ;)
max line to 120 is a lot for my old me used of little screen but it is the dev standard so ok for me if the code is already there ;)
max-module-lines is also important for refactoring goal. 700 or 1000 max could be another issue in parallel of code structure possible refactoring

Hello, I am glad you suggested using ruff. I will revise the ticket with this solution.

Ruff seems bad as it job :
with ruff :

with pylint:

Ok see internally if it is misconfiguration of ruff and if not enough mature (it's weird nonetheless) I think we keep isort, black, flake8, pylint, mypy as a baseline.

I didn't know riff, but I think if we could reduce the number of linters to one that manages all, that would certainly make things easier.
It's seems normal that ruff does not complain in some parts while pylint does. As stated in the FAQ, ruff and pylint do not completely overlap on rules. Maybe this can be tuned a bit with configuration, but otherwise we just have to accept that no tool will perfectly catch all issues.
As for the line length, 79 is really too short when there are 2, 3, 4 indentation levels... 120 is a bit more comfortable.
For the maximum number of lines, let's try to not be too strict for the moment, as we have rather long files in geoutils/xdem at the moment 😅

Agree on all.
For ruff, I think @erikmannerfelt mentioned it about a year ago. At that time the main improvement seemed to be speed for very large projects that had to wait several minutes to perform pre-commit. This is not a problem on this repo yet, but it would be more durable to move to ruff anyways for sure, so all for it as well :slightly_smiling_face:

I finally found a great config file for Ruff, and it seems suitable for our project. I didn’t ignore any rules, so we can discuss them during development if needed.
P.S.: We can also choose the line length.

authors: adebardo adehecq duboise-cnes rhugonnet

repo: GlacioHack/xdem


text:
Possible memory leakage in v1.0.0 (related with neureka.devices.CustomDeviceCleaner )

I have started using neureka 1.0.0 in my java project recently. Thank you very much for sharing this great project. I in desperate need of your help with solving a possible memory leakage.  OutOfMemoryError will be raised as neureka functions calls grows. The following message from eclipse might help:
One instance of neureka.devices.CustomDeviceCleaner loaded by sun.misc.Launcher$AppClassLoader @ 0x3c0013e70 occupies 16,455,983,640 (99.20%) bytes. The memory is accumulated in one instance of java.lang.Object[], loaded by , which occupies 16,455,983,584 (99.20%) bytes.
Thread java.lang.Thread @ 0x430d0b2e0 Thread-10 has a local variable or reference to neureka.devices.CustomDeviceCleaner @ 0x3e03d0818 which is on the shortest path to java.lang.Object[6153400] @ 0x6e4ee2580. The thread java.lang.Thread @ 0x430d0b2e0 Thread-10 keeps local variables with total size 424 (0.00%) bytes.
Significant stack frames and local variables
neureka.devices.CustomDeviceCleaner.run()V (CustomDeviceCleaner.java:52)
neureka.devices.CustomDeviceCleaner @ 0x3e03d0818 retains 16,455,983,640 (99.20%) bytes
The stacktrace of this Thread is available. See stacktrace. See stacktrace with involved local variables.
My program was running on JDK 8 (Intel CPU, Windows 11 x64) .

Maybe I should call MutableTensor.delete() for each Tensor. My problem should be solved.

I've just found calling delete() on Tensor Object does not solve the problem. There are still a huge number of neureka.devices.ReferenceCounter, CustomDeviceCleaner$ReferenceWithCleaup object in my heap after i tried to call delete() on each Tensor used in the computing.

It seems to me that the field 'list' of CustomDeviceCleaner is not cleared when unregistering happens.
final class CustomDeviceCleaner implements DeviceCleaner, Runnable
{
private final ReferenceQueue _referenceQueue = new ReferenceQueue<>();
private final long _timeout = 60 * 1000;
private int _registered = 0;
List<Object> list = new ArrayList<>();

static class ReferenceWithCleanup<T> extends PhantomReference<T>
{
    private final Runnable _action;

    ReferenceWithCleanup(T o, Runnable action, ReferenceQueue<T> queue) {
        super( o, queue );
        _action = action;
    }
    public void cleanup() {
        _action.run();
    }
}

@Override
public void register(Object o, Runnable action) {
    synchronized ( _referenceQueue ) {
        list.add(new ReferenceWithCleanup<Object>(o, action, _referenceQueue));
        _registered++;
        if ( _registered == 1 ) new Thread( this::run ).start();
    }
}

Thank you so much for finding and reporting this issue!
I will push a fix soon.

Great! Thank you for responding so quickly

I merged a hand full of general improvements from another branch which
already includes a rewrite of the device cleaner.
Based on my testing this should not produce any memory leaks.
A similar design is used in other projects as well. So it should be ok.
But can you verify this using the latest commit hash from main and verify in your code as well?
If you are using Gradle, you can check out the snapshot like this:
allprojects {
	repositories {
		//...
		maven { url 'https://jitpack.io' }
	}
}
// ...
dependencies {
	implementation 'com.github.Gleethos:neureka:241a79873c1c1da817a792282168af3914be9d6c' //main hash
}

I want to make sure that this is really fixed before I make a full release.
So it would be of great great help if you could approve the changes.

I will try it. Thank you.
On Tue, Dec 10, 2024 at 10:07 AM Daniel Nepp @.***>
wrote:

I merged a hand full of general improvements from another branch which
already includes a rewrite of the device cleaner.
Based on my testing this should not produce any memory leaks.
A similar design is used in other projects as well. So it should be ok.
But can you verify this using the latest commit hash from main and verify
in your code as well?
If you are using Gradle, you can check out the snapshot like this:
allprojects {
repositories {
//...
maven { url 'https://jitpack.io' }
}
}
// ...
dependencies {
implementation 'com.github.Gleethos:neureka:241a79873c1c1da817a792282168af3914be9d6c' //main hash
}
I want to make sure that this is really fixed before I make a full release.
So it would be of great great help if you could approve the changes.
—
Reply to this email directly, view it on GitHub
https://github.com/Gleethos/neureka/issues/26#issuecomment-2531734731,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ADDQNAHHJLA2CZGG6YGODG32E3YQ7AVCNFSM6AAAAABS52GHZSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKMZRG4ZTINZTGE
.
You are receiving this because you modified the open/close state.Message
ID: @.***>

Confirmed. No memory leakage.  FYI, I have to use it like this:
    <dependency>
        <groupId>com.github.Gleethos</groupId>
        <artifactId>neureka</artifactId>
        <version>241a79873c1c1da817a792282168af3914be9d6c</version>
        <exclusions>
            <exclusion>
                <groupId>org.slf4j</groupId>
                <artifactId>slf4j-api</artifactId>
            </exclusion>
            <exclusion>
                <groupId>org.jetbrains.kotlin</groupId>
                <artifactId>kotlin-stdlib-jdk7</artifactId>
            </exclusion>
            <exclusion>
                <groupId>org.jetbrains.kotlin</groupId>
                <artifactId>kotlin-stdlib-jdk8</artifactId>
            </exclusion>
        </exclusions>
    </dependency>

I am using JAVA 8, I wonder if the coming release will not depend on kotlin stdl libs and a snapshot version slf4j-api.  Anyway, thank you. Great project!

Currently I have the following dependencies configured:
    implementation group: 'com.google.errorprone', name: 'error_prone_annotations', version: '2.27.0'
    implementation group: 'org.jspecify', name: 'jspecify', version: '1.0.0'
    implementation 'org.jocl:jocl:2.0.5'
    implementation group: 'org.slf4j', name: 'slf4j-api', version: '[1+, )'

This is different from before in that now the slf4j requirement is now less specific,
and as well as two annotation libraries for static analysis...
Kotlin is only used in the test suite.
I hope that is compatible with your usage sites!

You have to exclude kotlin-stdlib for it to work?
That should not be necessary. This dependency should not be part of neureka.

You have to exclude kotlin-stdlib for it to work? That should not be necessary. This dependency should not be part of neureka.

I saw kotlin-stdlib in the result of IntellijIdea's Analyze Dependencies function. It is not a big deal. I can remove it.

I dispatched the release as version 1.0.1. Thank you again for the bug reports and also
thank you for using Neureka, I hope it continues to provide value for you and
the projects you use it in.

I am using JAVA 8

Oh and just for your information, Neureka is also fully upwards compatible, so
if you are not using it in a legacy project stuck on Java 8, feel free
to use newer Java versions like 21.

repo: Gleethos/neureka


text:
HwcDisplayConfigs: switch headless display to 30Hz

When headless display mode is used in drm_hwcomposer we use scrcpy(with software encoder or v4l2 hardware one) or other capture methods.
The Pi can't keep up with 60Hz encoding for higher resolutions and even in 1024x768 switching to 30Hz significantly reduces the CPU load when VirtualDisplay is utilized for capture.

Marked as draft until I verify the patch on mainline drm_hwcomposer

Looks good.

Was the audio HAL commit added by accident?

Was the audio HAL commit added by accident?

good catch, removed it from this branch

authors: mikegapinski rsglobal

repo: GloDroidCommunity/raspberry-pi


text:
Twilight Forest materials Compat

So I realized Twilight Forest was realeased for Fabric 1.18.  and I see that there is a lot of compatablity with other mods such as better end, better nether and Oh the biomes you'll go. So I was wondering if maybe you could add twilight forest materials to the mod now? I would love to swing around 2 firesteel ninjatos!

Reopen this issue with textures for a twilight forest compatibility.


text:
it dont work

hi love your mod but having some issues. tried last two versions of fabric api for minecraft 1.16.5. using rpgdifficulty-1.0.4.jar

setting time increase from 30 to 0 causes worlds to hang on load. not big issue since you can change time factor instead.

distance simply does not work. tried setting it to 1 block and going anywhere from a hundred to ten mill blocks out. mobs are identical. time scaling works fine. not using any other mods.

Out of time reasons I only work on the latest mc version but it should be fixed in mod version 1.0.6 which is for mc 1.17
https://github.com/Globox1997/RpgDifficulty/commit/1543a1182c9346547701607f3c5bd13a5052d163

Wow awesome !!! u rock :D i cant wait to try it
none of the other rpg mods are 1.17 yet, are we able to use this new version on 1.16.5 too ??
thx for ur great work, i use so many of ur mods!

I actually don't know if you can use it on 1.16.5 but I guess you can't..
thank you and you are welcome


text:
enable OptionButton to work from vr-simulator

When trying to click on an OptionButton using the xr-simulator add-on they never popup.  This seems to be due to it receiving double clicks.
I don't know exactly what this push_event function is doing as a lot of events go through it that don't get into the UI (when not holding down the E key in the simulator), but I think it's responsible for duplicate clicks going through and immediately closing the popup.
There's something problematic happening in the implementation, as reported at: https://github.com/godotengine/godot/issues/81579#issuecomment-1729468644
(The other bug where the popup remains activated and pops up again if you had selected the option in the mode of a click release is still there after this change.)

Godot 4's new multiple window support broke a number of things around viewports and events properly being handled because a lot of the UI elements assume subviewports are presented through subviewportcontainers and are thus purely 2D.
The GUI in 3D logic has become very dodgy, see also: https://github.com/godotengine/godot/issues/77189
That said, in XR obviously you don't have a lot of input to worry about, we're using controllers that emulate mouse actions directly on screen. The simulator breaks that so there are limitations to what we can fix without breaking our primary goal, logic working in XR. As an alternative, try out the new XR simulator Meta released so you properly emulate OpenXR without needing a headset.
That all said, I'm happy to accept this fix, we're not expecting mouse input, and the mouse emulation is handled inside of the component. If filtering out mouse events takes away the pain, everyone wins. I would recommend adding a good comment in the code to explain why mouse events are being filtered out.

authors: BastiaanOlij goatchurchprime

repo: GodotVR/godot-xr-tools


text:
Реализовать систему приглашений

Увидел на Голосе предложение сделать простейшую систему приглашений, которая будет подписывать зарегистрированного пользователя на пригласителя. Подробнее здесь.
Что думаете?

[ ] продумать о создание реферальной системы по предложению @lordarhont
Ссылку регистрации должен генерировать каждый сам ЗА свои голос или гбг, и скажем не более 3 ссылок . Они активны пока кто-то по ней не зарегистрировался. Пригласивший получает скажем 3-5% с каждого поста приглашённого до тех пор пока не откажется от вознаграждения . Приглашённые , тоже получают 3-5% от постов пригласившего, пока от них не откажутся . Чтобы снова сделать рефссылку , нужно отказаться от старой .

[ ] продумать о создание многоуровневой партнерской программе по предложению @dmitrijv
1 уровень - 7%
2 уровень - 5%
3 уровень - 3%
Вы размещаете ссылку на регистрацию в программе с вашим партнерским кодом, и получаете 5% от дохода (авторских и кураторских наград, если эти 5% > 0.001 Golos/GBG), людей зарегистрировавшихся по вашей ссылке.

authors: Chiliec jevgenika

repo: GolosChain/tolstoy


text:
[GoodId]: New face-verification intro screen

Business Description
We want to implement a new onboarding flow
Design Reference

Detailed Description of Functionality
We will have a new intro screen for the face-verification. A user will be guided to this screen because it's either not whitelisted yet, or it did not do the 'upgrade goodid' flow.
What should happen when a user clicks on 'I Accept, Verify Me'
Scenario: new user or expiry date is > 3 months

user navigates to the start of the face verification

Scenario: user is whitelisted but the expiry date of its current fv registration < 3 months

user navigates to the segmentation screen

Technical Implementation

[ ] Replace the current IntroScreen of the face-verification with the new onboard screen
[ ] implement a navigation handler that will send a user to either segmentation or to the start of the face-verification. this callback will be passed down to the onboard screen
[ ] should pass down first-name if user has set one

Acceptance Criteria
Specify criteria that will be used to determine if the feature meets the requirements and functions correctly.

[ ] (Should include a list of testing points for QA how to verify design/functionality)
filled out by the development team or can contain suggestions._

removing in favor of: https://github.com/GoodDollar/GoodDAPP/issues/4254

repo: GoodDollar/GoodDAPP


text:
Make it work without native HTML Imports

We need to load a polyfills.

This is fixed. Moved back to Polymer 1.0 for now to get the polyfills in unsupported browsers.

repo: GoogleChrome/browser-bug-search


text:
Eliminate render-blocking JavaScript

This is best-practice so let's add it to <script async src="/scripts/guitartuner-core.js"></script>

I wonder whether it was really blocking the rendering? Since <script> tag is not in the <head> I would assume it's downloaded asynchronously and doesn't block the rest of the page from rendering anyway. Isn't it?

@antonmoiseev Technically yes, realistically no. So yes because it's not async, however because it's the only JS on the page and is responsible for injecting the HTML imports, not so much. All said and done I'd rather have a sample that really makes the most of async etc where I can.

I see, thank you for clarifying.

authors: antonmoiseev beaufortfrancois paullewis

repo: GoogleChrome/guitar-tuner


text:
invoking chrome extension using puppeteer

Use Case:
connect puppeteer to a page that should work with chrome extension, and make the extension work on the page.
The extension is loaded as expected after setting --load-extension and headless: false
Issue:
Some chrome api like chrome.tabCapture.capture require the extension to be invoked in order to work (i.e user should click on the extension icon).
I could find a way to automate the extension invocation using puppeteer (or any other chromium startup arguments).
Please advise.

dupe of #1215

What’s the status of this specific case? #1215 doesn’t seem to address it.

You can pass the --whitelisted-extension-id=<extension-id>flag to Puppeteer.

@s16h How are you getting an extension id when using --load-extension, like in OP's situation?

The #1215 is indeed irrelevant, my bad. The #2486 seems to be a better fit.

@mcassagnes, you're right in that it doesn't actually invoke the extension. In my case, I just wanted to be able to use chrome.tabCapture.capture and whitelisting the extension is good enough for that; no invocation required.

repo: GoogleChrome/puppeteer


text:
Updated #update-algorithm localization

Spec moved to W3C.

Thanks, @karolklp! There's a small linting error—could you resolve it, and then I'll merge?
[14:19:22] Starting 'lint'...
[14:19:24] 'lint' errored after 1.6 s
[14:19:24] ESLintError in plugin 'gulp-eslint'
Message:
    Trailing spaces not allowed.
Details:
    fileName: lib/sw-precache.js
    lineNumber: 239
npm ERR! Test failed.  See above for more details.

Done. Sorry for inattention, @jeffposnick.

authors: jeffposnick karolklp

repo: GoogleChrome/sw-precache


text:
Mapper debugging for events is emitting wrong information: methods instead of events

Observed: Event names are represented as "method"s.
Expected: Event names are represented as "event"s.

e.g. https://chromedevtools.github.io/devtools-protocol/tot/Network/#event-requestWillBeSent
cc @sadym-chromium @Lightning00Blade

It's not quite obvious to me in which file we should change method to event.

This comes from CDP and I don't think we should change it https://source.chromium.org/chromium/chromium/src/+/main:third_party/inspector_protocol/crdtp/dispatch.cc;l=368;drc=31fb07c05718d671d96c227855bfe97af9e3fb20

Ah, gotcha, I thought it was from the mapper.
If it's from CDP, given the high cost to change it, it's better to leave it alone.

authors: OrKoN thiagowfx

repo: GoogleChromeLabs/chromium-bidi


text:
TPCD Trial Token and Critical-Origin-Trial Headers not working as expected

We recently registered two domains (microsoftonline.com and live.com with subdomains enabled) for the third-party cookie deprecation extension trial and we received first-party tokens to test with. However, we haven't been able to get the tokens to work properly.
For context:

The registered domain is loaded in an embedded hidden iframe and requires 1st request access to third-party cookies.
For testing, we override the response headers for that first request, including both the Critical-Origin-Trial: Tpcd and Origin-Trial: [1P Token] headers with the correct values. We do this through a Fiddler script that intercepts and updates the response before it hits the browser.
We don't see the cookies being added to the request, nor do we see the browser retry the request.
The Chrome browser Network logs show the correct headers being included in the first 200 response, but the request cookies show up yellow (blocked)
The same requests still work on my browser if I disable #test-third-party-cookie-phaseout, so we know it's not an issue with the request

I have #tracking-protection-3pcd and #test-third-party-cookie-phaseout enabled in the Experiments/Flags page.
Is there something we're missing here?
For extra context:

We initially attempted to inject a third-party enabled token to the top-level frame with JavaScript (without the headers in the iframe). The browser showed the Origin Trial Token was recognized and working in the application tab, but the cross-origin iframe couldn't access the 3p cookies, so we shifted to the approach described above and recommended by the deprecation trial doc:

https://developers.google.com/privacy-sandbox/blog/third-party-cookie-deprecation-trial.

We didn't opt into the grace period to have access to 3p cookies without the tokens

Headers in the response:

Blocked cookies in the request:

Thanks in advance for the help!

What version of chrome are you testing in?  The #test-third-party-cookie-phaseout flag has a know issue in M120 that does not permit the deprecation trial to work.  That flag will work in M121, however.

@wanderview it is in fact 120.0.6099.218. I'll try to update my browser and update this issue, thanks!

You can also try just using #tracking-protection-3pcd without the phaseout flag in M120.  Sorry the flags are so confusing at the moment.

@wanderview thanks a lot for the help, downloaded M121 and it's working as expected!

Hey folks, re-opening with another question, hope that's okay.
The "Request additional migration time..." doc mentions the following:

The deprecation trial is provided as a persistent trial, which means that once the token has been received by the browser, the trial behavior will be applied until an iframe is loaded without a trial token present. It is recommended to send the trial token on each iframe load consistently.

However, on Chrome M121, if we load an iframe on the registered domain with the 1p token in the headers once and then stop replying with the headers, access to third-party cookies is maintained. The only way I've been able to "turn off" the origin trial is to restore chrome to default settings and turn all of the flags off (or re-install the beta).
Is this possibly a bug or am I misunderstanding the doc?

When you say you are loading an iframe from the registered domain without providing the 1P token in the response headers to disable the trial, do you mean the exact origin provided in the deprecation trial application?
If you are using a subdomain matching token, then while the trial can be enabled using any subdomain of the requested origin, in order to disable it an iframe for the requested origin itself (which is stored in the token and can be viewed here) has to be loaded without the trial token present.

@hoodjoshua thanks for clarifying, I missed that mention because of the section title. Closing again.

authors: hectormmg hoodjoshua wanderview


text:
org.apache.hadoop.hive.ql.metadata.HiveException: Unable to find column _PARTITIONDATE

I am getting below exception while reading partitioned table created from create table statement provided in docs.
Table Creation Statement
CREATE TABLE `bq_test`(
  `id` int COMMENT 'from deserializer',
  `count` int COMMENT 'from deserializer',
  `created_at` bigint COMMENT 'from deserializer',
  `post_id` int COMMENT 'from deserializer',
  `user_id` int COMMENT 'from deserializer',
  `updated_at` bigint COMMENT 'from deserializer',
  `is_auto_moderated` boolean COMMENT 'from deserializer'
STORED BY
  'com.google.cloud.hive.bigquery.connector.BigQueryStorageHandler'
TBLPROPERTIES (
  'bq.table'='{PROJECT}.bq_test',
  'bq.time.partition.type'='DAY')

Getting below exception while querying ingestion time partitioned table
select id from bq_test where `_partitiondate`='2023-06-26';

Vertex failed, vertexName=Map 1, vertexId=vertex_1687761571976_0032_3_00, diagnostics=[Task failed, taskId=task_1687761571976_0032_3_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Error while running task ( failure ) : attempt_1687761571976_0032_3_00_000000_0:java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: java.io.IOException: java.lang.RuntimeException: Unable to find column _PARTITIONDATE in columns [id, count, created_at, post_id, user_id, updated_at, is_auto_moderated, _partitiontime, _partitiondate]
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:296)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:250)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:69)
at com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.io.IOException: java.lang.RuntimeException: Unable to find column _PARTITIONDATE in columns [id, count, created_at, post_id, user_id, updated_at, is_auto_moderated, _partitiontime, _partitiondate]
at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.pushRecord(MapRecordSource.java:80)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.run(MapRecordProcessor.java:419)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:267)
... 16 more
Caused by: java.io.IOException: java.lang.RuntimeException: Unable to find column _PARTITIONDATE in columns [id, count, created_at, post_id, user_id, updated_at, is_auto_moderated, _partitiontime, _partitiondate]
at org.apache.hadoop.hive.io.HiveIOExceptionHandlerChain.handleRecordReaderNextException(HiveIOExceptionHandlerChain.java:121)
at org.apache.hadoop.hive.io.HiveIOExceptionHandlerUtil.handleRecordReaderNextException(HiveIOExceptionHandlerUtil.java:77)
at org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader.doNext(HiveContextAwareRecordReader.java:365)
at org.apache.hadoop.hive.ql.io.HiveRecordReader.doNext(HiveRecordReader.java:79)
at org.apache.hadoop.hive.ql.io.HiveRecordReader.doNext(HiveRecordReader.java:33)
at org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader.next(HiveContextAwareRecordReader.java:116)
at org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.next(TezGroupedSplitsInputFormat.java:151)
at org.apache.tez.mapreduce.lib.MRReaderMapred.next(MRReaderMapred.java:116)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.pushRecord(MapRecordSource.java:68)
... 18 more
Caused by: java.lang.RuntimeException: Unable to find column _PARTITIONDATE in columns [id, count, created_at, post_id, user_id, updated_at, is_auto_moderated, _partitiontime, _partitiondate]
at com.google.cloud.hive.bigquery.connector.input.arrow.ArrowRecordReader.serializeRow(ArrowRecordReader.java:62)
at com.google.cloud.hive.bigquery.connector.input.arrow.ArrowRecordReader.next(ArrowRecordReader.java:93)
at com.google.cloud.hive.bigquery.connector.input.arrow.ArrowRecordReader.next(ArrowRecordReader.java:35)
at org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader.doNext(HiveContextAwareRecordReader.java:360)

Fixed in #98, thanks!


text:
Update gpu/install_gpu_driver.sh to use new NVIDIA debian gpu driver

Update version from 418.87 to 440.82

/gcbrun


text:
Fix deprecated monitoring agent install script.

See https://cloud.google.com/monitoring/agent/installation#agent-install-linux for the latest installation instructions.

Superseded by #973.


text:
simplify apigeecli installation

there's a convenience function to install the latest version: https://github.com/apigee/apigeecli/blob/master/downloadLatest.sh

yeah a proposal would be to replace https://github.com/GoogleCloudPlatform/apigee-anthos-service-mesh-demo/blob/main/deploy-apigee.sh#L68-L72 with a callout to this script. Would make it easier to support different OS versions as well.


text:
NDB transaction() read_only property does not work

Expected Behavior
The NDB transaction() function has a read_only property to indicate that the transaction will only perform reads. I expect that it will start a read only transaction when I invoke it as such:  ndb.transaction(txn, read_only=True).
Actual Behavior
Sadly, this flag does not work in the current SDK. Instead, it fails with an TypeError: Unknown configuration option ('read_only') error, when you specify it (regardless whether it is True of False).
Full stack trace:
Traceback (most recent call last):
  File "/Users/tijmen/dev/ndb-read-only/readonly_test.py", line 22, in test_readonly_transaction
    ndb.transaction(txn, read_only=False)  # Does not work
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/tijmen/dev/ndb-read-only/lib/google/appengine/ext/ndb/utils.py", line 182, in positional_wrapper
    return wrapped(*args, **kwds)
           ^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/tijmen/dev/ndb-read-only/lib/google/appengine/ext/ndb/model.py", line 3902, in transaction
    return fut.get_result()
           ^^^^^^^^^^^^^^^^
  File "/Users/tijmen/dev/ndb-read-only/lib/google/appengine/ext/ndb/tasklets.py", line 397, in get_result
    self.check_success()
  File "/Users/tijmen/dev/ndb-read-only/lib/google/appengine/ext/ndb/tasklets.py", line 394, in check_success
    six.reraise(self._exception.__class__, self._exception, self._traceback)
  File "/Users/tijmen/dev/ndb-read-only/lib/six.py", line 719, in reraise
    raise value
  File "/Users/tijmen/dev/ndb-read-only/lib/google/appengine/ext/ndb/tasklets.py", line 444, in _help_tasklet_along
    value = gen.send(val)
            ^^^^^^^^^^^^^
  File "/Users/tijmen/dev/ndb-read-only/lib/google/appengine/ext/ndb/context.py", line 976, in transaction
    options = _make_ctx_options(ctx_options, TransactionOptions)
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/tijmen/dev/ndb-read-only/lib/google/appengine/ext/ndb/context.py", line 145, in _make_ctx_options
    return config_cls(**ctx_options)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/tijmen/dev/ndb-read-only/lib/google/appengine/datastore/datastore_rpc.py", line 392, in __new__
    raise TypeError('Unknown configuration option (%s)' % err)
TypeError: Unknown configuration option ('read_only')

Steps to Reproduce the Problem
Run the following test:
import unittest
from google.appengine.ext import testbed
from google.appengine.ext import ndb

class ExampleModel(ndb.Model):
    pass

class LoggingTest(unittest.TestCase):
    def setUp(self):
        self.testbed = testbed.Testbed()
        self.testbed.setup_env()
        self.testbed.activate()
        self.testbed.init_memcache_stub()
        self.testbed.init_datastore_v3_stub()

    def tearDown(self):
        self.testbed.deactivate()

    def test_readonly_transaction(self):
        def txn():
            model = ExampleModel.get_by_id("test")
        ndb.transaction(txn, read_only=True)  # Does not work

    def test_normal_transaction(self):
        def txn():
            model = ExampleModel.get_by_id("test")
        ndb.transaction(txn)  # Works.

if __name__ == '__main__':
    unittest.main()

Specifications
Version: appengine-python-standard 1.1.6

The problem is in google/appengine/ext/ndb/context.py:976 where the kwargs **ctx_options is passed to the _make_ctx_options function . This function parses the options but does not accept the read_only keyword argument. This argument  is used separately a few lines later to set the correct TransactionMode.
  @tasklets.tasklet
  def transaction(self, callback, **ctx_options):

    options = _make_ctx_options(ctx_options, TransactionOptions)
    propagation = TransactionOptions.propagation(options)
    if propagation is None:
      propagation = TransactionOptions.NESTED

    mode = datastore_rpc.TransactionMode.READ_WRITE
    if ctx_options.get('read_only', False):
      mode = datastore_rpc.TransactionMode.READ_ONLY
``

Swapping the order around and removing the `read_only` key already fixes the issue:

@tasklets.tasklet
def transaction(self, callback, **ctx_options):
mode = datastore_rpc.TransactionMode.READ_WRITE
if ctx_options.get('read_only', False):
  mode = datastore_rpc.TransactionMode.READ_ONLY
ctx_options.pop('read_only')

options = _make_ctx_options(ctx_options, TransactionOptions)
propagation = TransactionOptions.propagation(options)
if propagation is None:
  propagation = TransactionOptions.NESTED

``


text:
Name conflict in HTCondor config object name

Describe the bug
When both Central manager and Access point MIG template are changed in the same plan, there is a risk that Access point config object is deleted after being overwritten.
Steps to reproduce
Steps to reproduce the behavior:

Deploy HTCondor
Change the configuration of the central manager and the access point, like the disk size

Expected behavior
After deployment, the config object should be in the bucket
Actual behavior

The AP config object is marked for deletion because the CM IP is "known after apply".
CM is redeployed with the new configuration, but the IP is reused.
The new AP config object is deployed using the same name as the previous one because the config is actually the same (because the IP has not changed after all).
AP template is updated
The previous AP config object is deleted, but as it is the same name as the newer AP config object, it is also the new AP config object.

Version (gcluster --version)
1.36
According to the code within main branch, it should also affects the latest version (1.42 as of today).
Additional context
I can see multiple ways to solve the issue:

Allocate IPs outside of the MIG defintion to make them stable upon reconfiguration
Remove the IP from the computation of the hash
Add a null_resource that would be recreated when config changes, and use its ID instead of the hash of the config

I think the easiest and more robust way would be the null_resource, but I would be glad to have your opinion on the subject.
I can definitely implement the fix as soon as we agree on how to solve it.

Hi, Thank you for the detailed context. This is currently being discussed internally around the root cause and potential fix. We will have update soon.

repo: GoogleCloudPlatform/cluster-toolkit


text:
Autostart Jupyter on node restart

Per https://github.com/GoogleCloudPlatform/dataproc-initialization-actions/issues/108
For testing this, is the following the right strategy?

Edit jupyter.sh to point at my branch
Push jupyter.sh to GCS
Run gcloud dataproc clusters create

Ah sorry, this should be better documented. What you describe should work, but more commonly the outermost jupyter.sh doesn't need to be edited at all, in which case you should just use metadata variables to point at your github fork and branch that you're developing against. For example, in https://github.com/GoogleCloudPlatform/dataproc-initialization-actions/pull/103 I tested against the pull request's source with:
gcloud dataproc clusters create dhuo-jupyter-fixed \
    --initialization-actions gs://dataproc-initialization-actions/jupyter/jupyter.sh \
    --metadata "INIT_ACTIONS_REPO=https://github.com/bomboradata/dataproc-initialization-actions.git,INIT_ACTIONS_BRANCH=fix-jupyter-5.0.0-config-and-launch"

Tested with:
gcloud dataproc clusters create sgmc-jupyter
--initialization-actions gs://dataproc-initialization-actions/jupyter/jupyter.sh
--metadata "INIT_ACTIONS_REPO=https://github.com/sammcveety/dataproc-initialization-actions.git,INIT_ACTIONS_BRANCH=add_jupyter_autostart"
--zone us-central1-b

Thanks, LGTM!

authors: dennishuo sammcveety


text:
Update tracking api clients

I've also removed the category from the tracking API since it's global for a given plugin.

@etanshaul

FYI, it is and has been that  the category value (or externalPluginName currently) is same for the both account and cloud-tools plugins. Going forward, the value we will use is "gcloud-intellij" (previously "com.google.cloud.tools"). I think using the same name containing "intellij" makes sense, because if the account plugin used its own plugin name, we would not be able to distinguish pings from the account plugin in AS and the one in IntelliJ (unless we use different names).

@chanseokoh I think you're right that it's ok for the account plugin to report the same client.  I will want the android studio install to differentiate itself when we get there. Will file a bug.

I tested it with the latest commit. Working fine. :ship:

Thanks chanseok.

authors: chanseokoh patflynn

repo: GoogleCloudPlatform/gcloud-intellij


text:
the acl add doesn't work

the acl does not work. When I display the myFile, It does not object reference to myFile.acl.add
var myFile = bucket.file(filename);

console.log(myFile);

myFile.acl.update({
  scope: 'allUsers',
  permission: storage.acl.READER_ROLE
}, function(err, aclObject) {

  console.log('**** error ****');

  console.log(err);
  console.log(aclObject);
});

Hey @khmereshop sorry for the delay. I'm sorry but I don't really understand the issue here. Can you take a look at the system tests here where we are testing our acl.add method. That might help you make sense of what acl.add is meant to do. Your sample code given seems to also be using acl.update and not acl.add so if you could clarify why and what your code is supposed to show, that'd be great!

@khmereshop are you still having an issue?

Please re-open if you are still experiencing this :)

authors: khmereshop ryanseys stephenplusplus

repo: GoogleCloudPlatform/gcloud-node


text:
File upload to Storage fails silently

Hello, I'm trying to upload a file to Storage from a Compute instance.
Following the example in the docs:
from gcloud import storage
client = storage.Client()
bucket = client.get_bucket('my-bucket-name')
blob = bucket.blob('my-test-file.txt')
blob.upload_from_string('this is test content!')

Nothing happens. No error message, no file created/uploaded in the bucket, blob.exists() returns False.
I don't think it's an access control/permissions thing as the bucket has default settings and I'm able to modify existing blobs.
Any leads on how to debug this?
Also, I think it would make sense to throw an exception or give some sort of indication/explanation that it failed.

It should fail with an exception if the upload failed. The blob.exists() being False may be due to eventual consistency.

Thanks for the report!  I'm guessing that bucket.exists() returns False:  if so, then you need to call bucket.create() before blob.upload_from_string().  I was able to reproduce your report that way:  the error is that the 404 from the back-end (due to the non-existent bucket) is being dropped on the floor.

> /home/tseaver/projects/agendaless/Google/src/gcloud-python/gcloud/streaming/http_wrapper.py(355)_make_api_request_no_retry()
-> if info is None:
(Pdb) pp info
{'alt-svc': 'quic=":443"; ma=2592000; v="32,31,30,29,28,27,26,25"',
 'alternate-protocol': '443:quic',
 'content-length': '165',
 'content-type': 'application/json; charset=UTF-8',
 'date': 'Mon, 11 Apr 2016 18:55:56 GMT',
 'server': 'UploadServer',
 'status': '404',
 'vary': 'Origin, X-Origin',
 'x-guploader-uploadid': 'AEnB2UqUUnsXbGr_B5UC4iut3KXc-TKQUbER1ffezwzKXKatM5ZRBetpJfJM90_-9p7yVZNK747V9Nm0ypPTIdy9U83mh8BUfg'}
(Pdb) pp content
'{\n "error": {\n  "errors": [\n   {\n    "domain": "global",\n    "reason": "notFound",\n    "message": "Not Found"\n   }\n  ],\n  "code": 404,\n  "message": "Not Found"\n }\n}\n'

Thanks for the quick reply!
@dhermes file doesn't show up ever, checked on the web viewer as well.
@tseaver  bucket.exists() returns True.
On an existing file in the same bucket, everything works as expected (make_public, delete, etc...)

We do have a bug that the upload code drops 40x errors (other than 429 "Too Many Requests") on the floor.

Blerg! Thanks for finding that @tseaver. @craigcitro Any idea why that snippet exists? @tseaver Link to bug?

This is that bug. )

Ha gotcha.

@craigcitro the issue goes back to the original apitools codebase.  I don't know why 40x response codes would be skipped.

@thobrla for the error question -- Travis, do you remember this offhand? (If not, I'll take a look soon.)

I think the default CheckResponse function in http_wrapper only intends to process retryable errors.  Non-retryable errors like 400, 403, 404, etc. are returned to the client who can interpret them depending on the application logic.

Thanks @thobrla!

Just guessing:  is there a notion that a 404 is a "retriable" error in a general case?  I can see how it would be for some cases (e.g., DELETE on a resource 404s due to eventual consistency), but that can't be a good overall rule.  In general, 40x errors are "user errors", and should just be raised.

400 Bad Request (raise)
401 Unauthorized (raise)
403 Forbidden (raise)
404 Not Found (raise unless app policy says retry after backoff)
405 Method Not Allowed (raise)
406 Not Acceptable (raise)
408 Request Timeout (retriable after backoff?)
409 Conflict (maybe retriable after backoff?)
410 Gone (raise)
411 Length Required (raise)
412 Precondition Failed (raise)
413 Request Entity Too Large (raise)
414 Request-URI Too Long (raise)
415 Unsupported Media Type (raise)
416 Requested Range Not Satisfiable (raise unless app policy says retry after backoff)
417 Expectation Failed (raise)

The 50x "Server Error" codes are also a mixed bag:

500 Internal Server Error (maybe retriable after backoff?)
501 Not Implemented (raise)
502 Bad Gateway (retriable after backoff)
503 Service Unavailable (retriable after backoff)
504 Gateway Timeout (retriable after backoff)
505 HTTP Version Not Supported (raise)

@tseaver Just to confirm -- apitools does not retry the 4xx requests, but we do retry the 5xx ones. The only exception should be 429, basically because some services use that as a retryable code.
Are you seeing something different?

Outside of 429, all of the 400's would only be retriable in very application-specific scenarios.  So I think sending the response to the client is appropriate.
500 is retriable after backoff.
I agree that 501/505 are unlikely to succeed with retries.  Right we aren't bitten by that because the services simply don't return those error codes (and we're using supported HTTP versions).

@craigcitro nope:  somehow the knowledge of that didn't transfer, and so we were dropping the errors on the floor.  #1717 adds code to the caller of our (forked) apitools to handle error responses.

@tseaver Have you been able to verify that this fixes the issue here? I tried it and can't get the original snippet to fail (get_bucket() would fail if the bucket didn't exist, and the upload would never occur).

@dhermes I was never able to reproduce with an already-existing bucket.  I did verify that the code now raises a NotFound:
>>> from gcloud.storage import Client
>>> client = Client()
>>> bucket = client.bucket('1712-tseaver-no-such-bucket')
>>> bucket.exists()
False
>>> blob = bucket.blob('my-blob-name')
>>> blob.upload_from_string('this is test content!')
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "gcloud/storage/blob.py", line 548, in upload_from_string
    client=client)
  File "gcloud/storage/blob.py", line 469, in upload_from_file
    self._check_response_error(request, http_response)
  File "gcloud/storage/blob.py", line 359, in _check_response_error
    error_info=request.url)
gcloud.exceptions.NotFound: 404 Not Found (https://www.googleapis.com/upload/storage/v1/b/1712-tseaver-no-such-bucket/o?uploadType=media&name=my-blob-name)

I confirmed as well. Thanks for the snippet.

authors: craigcitro dhermes liorsbg thobrla tseaver

repo: GoogleCloudPlatform/gcloud-python