text:
some data cleaning, plus multilingual translations and inspire alignments added

vocabularies/*ttl files updated with:

Data cleaning
1.1 Changed identifier from http://resource.geosciml.org/classifierScheme/cgi/2016.01/simplelithology to http://resource.geosciml.org/classifierscheme/cgi/2016.01/simplelithology  (note lower case c)
1.2 Trailing whitespace removed from a couple of instances of https://linked.data.gov.au/org/cgi-gtwg sdo:name

Addition of multilingual labels where available, using dataset previously generated in 2018 from semi-automated alignments of English labels in CGI vocabularies with English labels in digitised version of CGI Multilingual Thesaurus of Geosciences and Asian Multilingual Thesaurus of Geosciences. Note that some encoding errors in the digitised multilingual thesauri source data are carried through to these triples.

Addition of skos:exactMatch alignments to Inspire codelists added, using data for a few vocabularies that had been previously generated and reviewed by Stephen Richard, Marcus Sen and James Passmore and were stored in an Oracle database at BGS

Addition of new skos:exactMatch alignments to Inspire codelists, using a script to compare terms in paired vocabularies based on Levenshtein similarity, and then manual review to remove a few false matches.

Data was loaded to a triplestore and exported from there, meaning the order of the items in the ttl serialisation differs.
Additional manual cleaning to remove secondary preflabels that has crept in, in order to pass vocpub validation, and fix encodings of accented letters

Extra commit added to remove a redundant file that was causing a validation violation

repo: GeoscienceAustralia/cgi-vocabs


text:
Virtual products notebook

Proposed changes

Add example virtual products notebook to Frequently_used_code

Notes

Apologies as I could not figure out how to break this into self-contained little pieces
The datacube-core version can be updated in the Sandbox by cloning it and running pip install --user .
Native English speakers feel free to suggest grammar/flow changes

Checklist (replace [ ] with [x] to check off)

[X] Notebook created using the DEA-notebooks template
[X] Remove any unused Python packages from Load packages
[X] Remove any unused/empty code cells
[X] Remove any guidance cells (e.g. General advice)
[X] Ensure that all code cells follow the PEP8 standard for code. The jupyterlab_code_formatter tool can be used to format code cells to a consistent style: select each code cell, then click Edit and then one of the Apply X Formatter options (YAPF or Black are recommended).
[X] Include relevant tags in the final notebook cell (refer to the DEA Tags Index, and re-use tags if possible)
[X] Clear all outputs, run notebook from start to finish, and save the notebook in the state where all cells have been sequentially evaluated
[X] Test notebook on both the NCI and DEA Sandbox (flag if not working as part of PR and ask for help to solve if needed)
[X] If applicable, update the Notebook currently compatible with the NCI|DEA Sandbox environment only line below the notebook title to reflect the environments the notebook is compatible with

Superseded by PR #409

source: gharchive/pull-request

repo: GeoscienceAustralia/dea-notebooks

license_type: permissive

license_source: github-api


text:
Migrate JupterLab from 2.x to 3.x

JupyterLab 3.x comes with many inbuilt features - https://blog.jupyter.org/jupyterlab-3-0-is-out-4f58385e25bb
JupyterLab releases prebuilt extensions and available to PyPI - reduce step to install JupyterLab extensions and rebuild  JupyterLab

This PR requires extended testing before updating sandbox environment and not ready to merge :)

Is it possible to roll this out in parallel with the existing version 2.x?
It'd be great to be able to test without potentially breaking things for everyone.

Do you mean we maintain two different image builds, @omad? If so, then I'm not sure that it's a good idea to maintain two environments, as we struggle enough maintaining one!
We have got this image deployed in parallel, though, so they can both be tested.

Do you mean we maintain two different image builds, @omad? If so, then I'm not sure that it's a good idea to maintain two environments, as we struggle enough maintaining one!

Nhooo, definitely do not want that.

We have got this image deployed in parallel, though, so they can both be tested.

Awesome, that's what I was hoping for, and is what's needed for testing and approving this kind of change. :D

Hey @NikitaGandhi, a silly question: where can I actually test this? Is it deployed on a Sandbox somewhere?

Something weird I'm noticing...when I first open a notebook and use "restart kernel and run all cells", some of the cells in the middle of the notebook are skipped (not evaluated). If I clear the kernel and do it again, it works fine.

we still have this hacky memory counter in the bottom left of the window, I think we should remove it given we now have the graphic in the top-left corner

Can we ensure that the French language pack is install by default. so user can readily access the language through JupyterLab settings without pip installing it?

we still have this hacky memory counter in the bottom left of the window, I think we should remove it given we now have the graphic in the top-left corner

Updated top-bar extention to include CPU usage, Memory usage, Logout button and theme-toggle button and removed jupyterlab-topbar-text ("Hi there" text on topbar):

Not able to remove/disable memory usage metrics from bottom as this settings comes from jupyter-resource-usage extension as default and also required by top-bar jupyterlab-system-monitor extension. But the bottom status-bar is enable/disable from menu view -> Show status bar by user as an option.

Can we ensure that the French language pack is install by default. so user can readily access the language through JupyterLab settings without pip installing it? the latest version is 100% translated. Tested on dev through pip install and it is working.

added

authors: NikitaGandhi alexgleith cbur24 cedricump omad robbibt

repo: GeoscienceAustralia/dea-sandbox


text:
add support hex color

i just join on be server and see it nex gradient in chat and nicknames, how to create support this feature?

I would need to see the pack to confirm but I am fairly sure this is just using emoji. See https://wiki.bedrock.dev/concepts/emojis.html.

I would need to see the pack to confirm but I am fairly sure this is just using emoji. See https://wiki.bedrock.dev/concepts/emojis.html.

oh really. you were right...

I would need to see the pack to confirm but I am fairly sure this is just using emoji. See https://wiki.bedrock.dev/concepts/emojis.html.

well, here is the texture pack, look, no, it seems to me that there should still be support for the white text soul.zip

that server clearly stole some of HIVE resources 😂

Seeing as this is not true hex colors, I am closing.

source: gharchive/issue

authors: Camotoy Kas-tle TOWUK TypicalShavonne

repo: GeyserMC/GeyserOptionalPack

license: MIT


text:
这个项目的用途？

这个项目具体是用来做什么的？

记录自己个人收集的网站


text:
🛑 Gigadrive CDN (Legacy) is down

In b4015ba, Gigadrive CDN (Legacy) (https://cdn.gigadrivegroup.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Gigadrive CDN (Legacy) is back up in 38fc03b.


text:
Nickname not present anymore

According to #190, @JaapAntwerp posted:
The only thing still missing (which was there in the previous versions) is the "nickname" of the contact  added to the body (as I have an extended family, sometimes in the "nickname" I have put information who is who. eg. "daughter of ...". or "son of .....")
If this was working in the past, we should reenable it.

Could it be linked to this:
(line 401 and further):
googleContact.givenName,  // Nickname ?????
try {
self.contactId = googleContact.resourceName;
// Contact identification data.
self.data.merge(new ContactDataDC(
  googleContact.names[0].displayName,  // Name.
  googleContact.givenName,  // Nickname.
  null                          // Profile image URL.
));

Yes, it probably has to do with this line or at least it is a good starting point to debug.
If you (or anybody else) want(s), you can look into this issue and create a PR. I am here to answer questions.
If you don't want to I'll probably only find time over the holidays to look into this issue.

Dear Michael,
I have absolutely no knowledge about IT
Even the implementation of the script is every time a struggle for me.
So I hope that you (or one of the other monitors) can find a solution to
these problems.
Best regards
Jaap
Antwerp - Belgium
Op di 6 dec. 2022 07:37 schreef Michael Plainer @.***>:

Yes, it probably has to do with this line or at least it is a good
starting point to debug.
If you (or anybody else) want(s), you can look into this issue and create
a PR. I am here to answer questions.
If you don't want to I'll probably only find time over the holidays to
look into this issue.
—
Reply to this email directly, view it on GitHub
https://github.com/GioBonvi/GoogleContactsEventsNotifier/issues/192#issuecomment-1338859619,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AKBW323PPTU6WCDUQPLUOV3WL3NJHANCNFSM6AAAAAASP322EI
.
You are receiving this because you were mentioned.Message ID:
@.***>

Hey @JaapAntwerp no worries, we are already grateful that you bring this to our attention.
But since I am currently the only maintainer and do this in my spare time I cannot guarantee you when I find the time to fix it. But be assured that it is on my to-do list.

Thanks!!!
Have a good New year!!
Op do 29 dec. 2022 12:16 schreef Michael Plainer @.***>:

Hey @JaapAntwerp https://github.com/JaapAntwerp no worries, we are
already grateful that you bring this to our attention.
But since I am currently the only maintainer and do this in my spare time
I cannot guarantee you when I find the time to fix it. But be assured that
it is on my to-do list.
—
Reply to this email directly, view it on GitHub
https://github.com/GioBonvi/GoogleContactsEventsNotifier/issues/192#issuecomment-1367248639,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AKBW327BUJUOQPZPKZ2NYWTWPVXI5ANCNFSM6AAAAAASP322EI
.
You are receiving this because you were mentioned.Message ID:
@.***>

Hi Michael,
Something else....
Is there a way how to see which script has sent which email?
I have now various scripts (some of them the sale version), but find it
difficult to see which result (email) comes from which script.
Is there a code that gives (e.g.) the script name?
Same question (more or less), is there a way to see which scripts are
actually active and which ones are on hold?
Thanks
Have a great Silvester evening
Jaap
Op do 29 dec. 2022 12:16 schreef Michael Plainer @.***>:

Hey @JaapAntwerp https://github.com/JaapAntwerp no worries, we are
already grateful that you bring this to our attention.
But since I am currently the only maintainer and do this in my spare time
I cannot guarantee you when I find the time to fix it. But be assured that
it is on my to-do list.
—
Reply to this email directly, view it on GitHub
https://github.com/GioBonvi/GoogleContactsEventsNotifier/issues/192#issuecomment-1367248639,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AKBW327BUJUOQPZPKZ2NYWTWPVXI5ANCNFSM6AAAAAASP322EI
.
You are receiving this because you were mentioned.Message ID:
@.***>

I don't think that we will add support for this.
But the easiest way for you is to add one of these lines in the script
https://github.com/GioBonvi/GoogleContactsEventsNotifier/blob/7e657a9e606f449fef22feae68d448d11083122b/code.gs#L2440-L2444
For example you can change 'Google Contacts Events Notifier' to 'Google Contacts Events Notifier (Google Account1)'. If you use a different language, just change a string in your language settings.
For example if you use German use something here:
https://github.com/GioBonvi/GoogleContactsEventsNotifier/blob/7e657a9e606f449fef22feae68d448d11083122b/code.gs#L1359-L1389

Thanks Michael.
I will try that 👍
And indeed it was not my intention to get a script change. But it was to
learn something myself and to get organised myself
Thanks again for your suggestions
I will try them
Jaap
Op za 31 dec. 2022 12:13 schreef Michael Plainer @.***>:

I don't think that we will add support for this.
But the easiest way for you is to add one of these lines in the script
https://github.com/GioBonvi/GoogleContactsEventsNotifier/blob/7e657a9e606f449fef22feae68d448d11083122b/code.gs#L2440-L2444
For example you can change 'Google Contacts Events Notifier' to 'Google
Contacts Events Notifier (Google Account1)'. If you use a different
language, just change a string in your language settings.
For example if you use German use something here:
https://github.com/GioBonvi/GoogleContactsEventsNotifier/blob/7e657a9e606f449fef22feae68d448d11083122b/code.gs#L1359-L1389
—
Reply to this email directly, view it on GitHub
https://github.com/GioBonvi/GoogleContactsEventsNotifier/issues/192#issuecomment-1368201859,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AKBW325TKIIVYI4Y3M27YRTWQAIONANCNFSM6AAAAAASP322EI
.
You are receiving this because you were mentioned.Message ID:
@.***>

hi Michael,
Is there a way I can contact you privately (so I show you some results with
private details)
Obviously I don't want these private details on the GitHub website ;-)
Groeten,
Jaap
Op wo 30 nov. 2022 om 18:19 schreef Michael Plainer <
@.***>:

According to #190
https://github.com/GioBonvi/GoogleContactsEventsNotifier/issues/190,
@JaapAntwerp https://github.com/JaapAntwerp posted:
The only thing still missing (which was there in the previous versions) is
the "nickname" of the contact added to the body (as I have an extended
family, sometimes in the "nickname" I have put information who is who. eg.
"daughter of ...". or "son of .....")
If this was working in the past, we should reenable it.
—
Reply to this email directly, view it on GitHub
https://github.com/GioBonvi/GoogleContactsEventsNotifier/issues/192, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AKBW32ZGFBHSJFUUFZXQKNLWK6EC3ANCNFSM6AAAAAASP322EI
.
You are receiving this because you were mentioned.Message ID:
@.***>

What I don't understand is that I took an old verssion (5.0.1, which was
still with nicknames, etc.) which works fine for my general account.
But then I do copy-paste to the gmail script accounts for the various
branches of my families, change the "googleEmail", "notificationEmail" and
the "emailSenderName" and in some of the accounts it works again fine, but
in some accounts it fails to calculate the age and leaves out again the
nickname.
I have double checked and in all accounts I have activated the API service
Calendar and People:
[image: image.png]
Why would it work in one account and not in another????
Groeten,
Jaap
Op wo 4 jan. 2023 om 11:10 schreef Jaap Antwerp @.***>:

hi Michael,
Is there a way I can contact you privately (so I show you some results
with private details)
Obviously I don't want these private details on the GitHub website ;-)
Groeten,
Jaap
Op wo 30 nov. 2022 om 18:19 schreef Michael Plainer <
@.***>:

According to #190
https://github.com/GioBonvi/GoogleContactsEventsNotifier/issues/190,
@JaapAntwerp https://github.com/JaapAntwerp posted:
The only thing still missing (which was there in the previous versions)
is the "nickname" of the contact added to the body (as I have an extended
family, sometimes in the "nickname" I have put information who is who. eg.
"daughter of ...". or "son of .....")
If this was working in the past, we should reenable it.
—
Reply to this email directly, view it on GitHub
https://github.com/GioBonvi/GoogleContactsEventsNotifier/issues/192,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AKBW32ZGFBHSJFUUFZXQKNLWK6EC3ANCNFSM6AAAAAASP322EI
.
You are receiving this because you were mentioned.Message ID:
@.***>

I see 3 errors in the 5.1.4 version:

the "nickname" is no longer presented in the body

the "Anniversaries" are not shown in a separate group anymore, but in "custom events"

the "notificationBlacklist" events are no longer filtered out, but shown anyway (the "notificationBlacklist" doesn't work anymore)

authors: JaapAntwerp plainerman

repo: GioBonvi/GoogleContactsEventsNotifier

license: mit

license_source: bigquery


text:
Fixed issue where blank line was causing reading of cache failure

Description
Fixed issue where blank line was causing reading of cache failure
/!\ Need to be tested on windows without WSL /!\
Related Issue

Type of Change

[ ] 📚 Examples / docs / tutorials / dependencies update
[x] 🔧 Bug fix (non-breaking change which fixes an issue)
[ ] 🥂 Improvement (non-breaking change which improves an existing feature)
[ ] 🚀 New feature (non-breaking change which adds functionality)
[ ] 💥 Breaking change (fix or feature that would cause existing functionality to change)
[ ] 🔐 Security fix

Checklist

[ ] I've read the CODE_OF_CONDUCT.md document.
[ ] I've read the CONTRIBUTING.md guide.
[ ] I've updated the code style using make codestyle.
[ ] I've written tests for all new methods and classes that I created.
[ ] I've written the docstring in Google format for all the methods and classes that I used.

Closed by #1335

authors: kevinmessiaen mattbit

repo: Giskard-AI/giskard


text:
doc(pre-commit): add description to hooks

Description will appear in pre-commit hook page https://pre-commit.com/hooks.html

Codecov Report

Merging #153 (04e5331) into main (23b6402) will decrease coverage by 0.38%.
The diff coverage is n/a.

:exclamation: Current head 04e5331 differs from pull request most recent head 3d4dd80. Consider uploading reports for the commit 3d4dd80 to get more accurate results

@@            Coverage Diff             @@
##             main     #153      +/-   ##
==========================================
- Coverage   91.93%   91.55%   -0.39%
==========================================
  Files          29       29
  Lines        1575     1575
==========================================
- Hits         1448     1442       -6
- Misses        127      133       +6

Flag
Coverage Δ

unittests
91.55% <ø> (-0.39%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

ggshield/utils.py
96.45% <0.00%> (-2.13%)
:arrow_down:

ggshield/docker.py
96.66% <0.00%> (-1.67%)
:arrow_down:

ggshield/output/text/message.py
94.85% <0.00%> (-1.48%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4ac156b...3d4dd80. Read the comment docs.

authors: SofienM codecov-commenter

repo: GitGuardian/ggshield


text:
I hate genrate a git commit record for each save in gitbook-editor

This will be too many commit record in git repo. I hope controll commit manually. could use git add  instead of git commit while save?

Does anybody agree with me?

repo: GitbookIO/editor-legacy


text:
🛑 fc2 is down

In 313c857, fc2 (fc2.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: fc2 is back up in c3aae7f after 9 minutes.


text:
🛑 orkut is down

In 84a975e, orkut (orkut.com.br) was down:

HTTP code: 0
Response time: 0 ms

Resolved: orkut is back up in 2c2dec5.


text:
🛑 gadgethouse is down

In 2ba03d3, gadgethouse (gadgethouse.nl) was down:

HTTP code: 0
Response time: 0 ms

Resolved: gadgethouse is back up in 51a5e36 after 36 minutes.


text:
🛑 orkut is down

In ea884b7, orkut (orkut.com.br) was down:

HTTP code: 403
Response time: 265 ms

Resolved: orkut is back up in ffc8df9.


text:
🛑 orkut is down

In b95c4f8, orkut (orkut.com.br) was down:

HTTP code: 403
Response time: 392 ms

Resolved: orkut is back up in 73ac2ff.


text:
🛑 orkut is down

In 0090a0d, orkut (orkut.com.br) was down:

HTTP code: 403
Response time: 246 ms

Resolved: orkut is back up in 966c0e2.


text:
🛑 orkut is down

In bc1255f, orkut (orkut.com.br) was down:

HTTP code: 403
Response time: 249 ms

Resolved: orkut is back up in 915e572.


text:
🛑 orkut is down

In c5369b6, orkut (orkut.com.br) was down:

HTTP code: 0
Response time: 0 ms

Resolved: orkut is back up in 071aa70.


text:
🛑 ojolink is down

In 4fcc8ef, ojolink (ojolink.fr) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Ojolink is back up in 5b73fc3.


text:
🛑 orkut is down

In 48b7fb4, orkut (orkut.com.br) was down:

HTTP code: 0
Response time: 0 ms

Resolved: orkut is back up in 299c4b2.


text:
🛑 penispedia is down

In 7436c1a, penispedia (penispedia.de) was down:

HTTP code: 0
Response time: 0 ms

Resolved: penispedia is back up in 475b97f.


text:
🛑 orkut is down

In a3b3938, orkut (orkut.com.br) was down:

HTTP code: 0
Response time: 0 ms

Resolved: orkut is back up in 3d61fde.


text:
🛑 sohu is down

In 890f17c, sohu (sohu.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: sohu is back up in f4564dd.


text:
🛑 ojolink is down

In 383a89f, ojolink (ojolink.net) was down:

HTTP code: 403
Response time: 466 ms

Resolved: Ojolink is back up in 22e1a07.


text:
🛑 ojolink is down

In e8c80cc, ojolink (ojolink.net) was down:

HTTP code: 403
Response time: 461 ms

Resolved: Ojolink is back up in 26117f4.


text:
🛑 orkut is down

In 9b63355, orkut (orkut.com.br) was down:

HTTP code: 429
Response time: 908 ms

Resolved: orkut is back up in ea3b1a0.


text:
🛑 sohu is down

In 5afcffb, sohu (sohu.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: sohu is back up in da3d501.


text:
🛑 inkcityusa is down

In fda9fbe, inkcityusa (inkcityusa.com) was down:

HTTP code: 502
Response time: 476 ms

Resolved: inkcityusa is back up in 5fa0449.


text:
🛑 ojolink is down

In 6133e47, ojolink (ojolink.net) was down:

HTTP code: 403
Response time: 425 ms

Resolved: Ojolink is back up in 53913fb.


text:
🛑 163 is down

In 35db4df, 163 (163.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: 163 is back up in 81f87c1.


text:
🛑 orkut is down

In ee528d8, orkut (orkut.com.br) was down:

HTTP code: 429
Response time: 839 ms

Resolved: orkut is back up in 2f8ebf6.


text:
🛑 isai is down

In b99cbb0, isai (isai.in) was down:

HTTP code: 0
Response time: 0 ms

Resolved: isai is back up in 3e9eb01.


text:
🛑 ojolink is down

In 7d51582, ojolink (ojolink.net) was down:

HTTP code: 403
Response time: 499 ms

Resolved: Ojolink is back up in 1531791.


text:
🛑 orkut is down

In 71998e8, orkut (orkut.com.br) was down:

HTTP code: 429
Response time: 874 ms

Resolved: orkut is back up in 65f3ee0.


text:
🛑 ojolink is down

In 25f9c60, ojolink (ojolink.net) was down:

HTTP code: 403
Response time: 513 ms

Resolved: Ojolink is back up in 1562555.


text:
🛑 benjohnson is down

In 3b34d96, benjohnson (benjohnson.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: benjohnson is back up in fa14e4c.


text:
🛑 benjohnson is down

In 4a2b4da, benjohnson (benjohnson.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: benjohnson is back up in 5f19123.


text:
🛑 orkut is down

In ae62a44, orkut (orkut.com.br) was down:

HTTP code: 0
Response time: 0 ms

Resolved: orkut is back up in df183ec.


text:
🛑 mynewsize is down

In 00eecec, mynewsize (mynewsize.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: mynewsize is back up in 5caad78.


text:
🛑 ojolink is down

In 87ec3e6, ojolink (ojolink.fr) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Ojolink is back up in 31153b8.


text:
🛑 ojolink is down

In 60f6c91, ojolink (ojolink.fr) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Ojolink is back up in 63a0a6c.


text:
🛑 ojolink is down

In 559e7cb, ojolink (ojolink.fr) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Ojolink is back up in 2c4e045.


text:
🛑 ojolink is down

In ac0011a, ojolink (ojolink.fr) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Ojolink is back up in ad51553.


text:
🛑 orkut is down

In bb70d02, orkut (orkut.com.br) was down:

HTTP code: 0
Response time: 0 ms

Resolved: orkut is back up in 80c35fa.


text:
🛑 vkontakte is down

In 000d102, vkontakte (vkontakte.ru) was down:

HTTP code: 0
Response time: 0 ms

Resolved: vkontakte is back up in ec0289d.


text:
🛑 ojolink is down

In f20958c, ojolink (ojolink.fr) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Ojolink is back up in f1ee921.


text:
🛑 ojolink is down

In ad1cb4f, ojolink (ojolink.fr) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Ojolink is back up in a078c91.


text:
🛑 ojolink is down

In 1434199, ojolink (ojolink.fr) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Ojolink is back up in a0e68b5.


text:
🛑 ojolink is down

In 68e12f1, ojolink (ojolink.fr) was down:

HTTP code: 0
Response time: 0 ms

Resolved: ojolink is back up in fac5450.


text:
🛑 youku is down

In 954b641, youku (youku.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: youku is back up in bab8562 after 3 days, 22 hours, 5 minutes.


text:
🛑 asgreenas is down

In 825bbd8, asgreenas (asgreenas.com) was down:

HTTP code: 403
Response time: 1147 ms

Resolved: asgreenas is back up in 6f0a6ef after 1 hour, 7 minutes.


text:
🛑 orkut is down

In c19082a, orkut (orkut.com.br) was down:

HTTP code: 0
Response time: 0 ms

Resolved: orkut is back up in 31d0743.


text:
🛑 ojolink is down

In 7941f95, ojolink (ojolink.fr) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Ojolink is back up in d2729a5 after 9 minutes.


text:
🛑 ojolink is down

In 43b3036, ojolink (ojolink.fr) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Ojolink is back up in 85187ad after 29 minutes.


text:
🛑 torrentzap is down

In 84f9576, torrentzap (torrentzap.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: torrentzap is back up in e109dac after 19 minutes.


text:
🛑 ojolink is down

In 11959c8, ojolink (ojolink.fr) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Ojolink is back up in e5aa179 after 18 minutes.


text:
🛑 orkut is down

In 4b94326, orkut (orkut.com.br) was down:

HTTP code: 0
Response time: 0 ms

Resolved: orkut is back up in 8eba709.


text:
🛑 ojolink is down

In 5a96b2b, ojolink (ojolink.fr) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Ojolink is back up in 87cf5fb after 19 minutes.


text:
🛑 orkut is down

In 3e7a8b9, orkut (orkut.co.in) was down:

HTTP code: 0
Response time: 0 ms

Resolved: orkut is back up in 635dda3 after 5 minutes.


text:
🛑 ojolink is down

In 4a9d975, ojolink (ojolink.fr) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Ojolink is back up in 0f1be78 after 9 minutes.


text:
🛑 orkut is down

In 43ae2e2, orkut (orkut.co.in) was down:

HTTP code: 0
Response time: 0 ms

Resolved: orkut is back up in 6e6c8ad after 1 hour, 2 minutes.


text:
🛑 orkut is down

In 2dfa6c7, orkut (orkut.co.in) was down:

HTTP code: 0
Response time: 0 ms

Resolved: orkut is back up in 0fb87a5 after 12 minutes.


text:
🛑 orkut is down

In 16c3157, orkut (orkut.co.in) was down:

HTTP code: 0
Response time: 0 ms

Resolved: orkut is back up in 618b10e after 14 minutes.


text:
🛑 uzboys is down

In 52c21bc, uzboys (uzboys.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: uzboys is back up in f6b3354 after 19 minutes.


text:
Pending Donations (Potential Blockscout Issue)

Hey team (CC @MoeNick),
My last few donations have been stuck on pending on the Giveth dapp, and I'm not sure what the issue is.
For some of them, the transaction appears fine on Gnosis Scan, but doesn't appear on Blockscout.
For example this one:
https://blockscout.com/xdai/mainnet/tx/0xc607d2d50e8dbe6928e586ca4912cf7370d19e0dc3a88f614a31d6e08202f7f9 (doesn't show)
https://gnosisscan.io/tx/0xc607d2d50e8dbe6928e586ca4912cf7370d19e0dc3a88f614a31d6e08202f7f9 (does show)
I don't know all the details of how we're verifying donations technically, but could it be that we're verifying them on Blockscout and if so, should we switch to verifying them on Gnosis Scan? I don't know any of the technical details or tradeoffs, but just a suggestion.

It's done by https://github.com/Giveth/impact-graph/pull/892

authors: ahmadabugosh aminlatifi

repo: Giveth/impact-graph


text:
Could not find 'php-cs-fixer'. The program may not be installed.

Description
I get an error message when trying to run atom-beautify
"Could not find 'php-cs-fixer'. The program may not be installed."
php-cs-fixer is installed and I have uninstalled it and atom-beautifiy and then installed both again. I get the same error.
Debug
Here is a link to the debug.md Gist:
Checklist
I have:

[ ] Tried uninstalling and reinstalling Atom Beautify to ensure it installed properly
[ ] Reloaded (or restarted) Atom to ensure it is not a caching issue
[ ] Searched through existing Atom Beautify Issues at https://github.com/Glavin001/atom-beautify/issues
so I know this is not a duplicate issue
[ ] Filled out the Input, Expected, and Actual sections above or have edited/removed them in a way that fully describes the issue.
[ ] Generated debugging information by executing Atom Beautify: Help Debug Editor command in Atom and added link for debug.md Gist to this issue

Please make sure you've updated Atom Beautify's settings under Executables -> PHP-CS-Fixer to put the path to the binary/script.


text:
Add ESLint beautifier

Hey guys,
This is an implementation for the ESLint fixer for Javascript.
Let me know if there is any improvement that must be done before it gets merged. I have been using it for a couple of weeks and it's great.
Thanks,

You will need to get the travis.ci tests to pass before Glavion will merge this.  You will probably also have to create test units.
Have you checked to see which of the currently supported options are applicable to ESLint and applied then in the necessary configuration?

I just fixed a couple of lint errors but the travis job still does not pass, but I believe it is nothing related to the ESLint beautifier.
Regarding the configuration, I think that ESLint doesn't make much sense without it's own configuration so I went with an approach similar to the JSCS and other beautifiers which doesn't not support any configuration.

Since this is not a default beautifier for JavaScript, it will not be a breaking change to users. I don't mind merging this and letting users test this out for themselves.
Thank you for contributing, @taylon !

Published to v0.29.18

authors: Glavin001 prettydiff taylon


text:
Memory increase using asp.net webforms

We deployed glimpse last week to production and have had nothing but memory issues ever since. Normally run about 2gb in memory, with glimpse it would creap up to our max of 6gb very quickly. We had to turn glimpse off in prod.
If we had:
<glimpse defaultRuntimePolicy="On" endpointBaseUri="~/Glimpse.axd">

but only allowed admins to have it actually on we ramped up memory within 20 min.
If we had:
<glimpse defaultRuntimePolicy="Off" endpointBaseUri="~/Glimpse.axd">

we ramped up memory within an hour.
With glimpse out of the web.config all together we are sitting at our normal 2gb usage pretty steady all day.
The memory dumps I'm seeing haven't really given me much info on something blatant. One thing I did notice in the performance counters is the Large Object Heap is much much smaller than what it was before took glimpse out. Not sure if that has anything to do with it.

We're on 1.8.1 and we might be having this problem. I will be removing Glimpse from the Web.config tonight and I'll report back if this reduced the memory footprint

I have version 1.8.6 and experience this memory leak as well. I usually sit around 350-550MB for my application, but with glimpse turned on, I reach 2GB in < 10 requests. If I go to /glimpse.axd and "Turn Glimpse Off", the issue subsides. I have a attached my tabs that I have enabled.
I'd be willing to help out with testing this problem so it can get resolved, as I see comments surrounding this issue since 2013. Would like to see this get fixed so Glimpse is usable again.

I have version v1.8.6 and experiencing the same issue.
We have a big,old  webforms application and glimpse is not usable.
When memory profiling the application I saw strange things that I have not been able to understand.
The test have been done on a developper machine with only one user connected. The memory usage was steady until I set the cookies to on  and hit refresh on the page (red marker). The page refresh was very slow and the memory is consumed and freed in a strange pattern indefinitely from that moment even without activity on the website.

After additional tests, I found that the request : /Glimpse.axd?n=glimpse_request&requestId=ace0fbc3-1be7-4a66-b041-864ec6a20586&hash=5d23d7f3&callback=glimpse.data.initData HTTP/1.1
is usually getting a few hundreds kilobytes but a few hundreds megabytes when cache tab is active.

authors: Fienix LodewijkSioen cperriot lemkepf

repo: Glimpse/Glimpse


text:
Provide upgrade script

In GitLab by @kwanzknoel on Sep 9, 2021, 02:38
Provide upgrade script to allow users to easily upgrade glow to latest stable version.
Extracted from the relevant sections in glow-install.
Users can just run:
curl -L https://glow-lang.org/install/glow-upgrade | sh

Closed. After investigation, the install script works as an update script as well.
curl -L https://glow-lang.org/install/glow-upgrade | sh

repo: Glow-Lang/glow


text:
Update Readme.md and add License

Hi Eddie, thanks for your code sharing. I add some improvements to Readme.md file, you can check it here: https://github.com/ktaranov/SQLCover

Thanks for this :)
Ed

authors: GoEddie ktaranov

repo: GoEddie/SQLCover


text:
Task 86/orthographic camera

Still need to find strange bug in vulkan api on window resizing. It appears random.

Approve

Adding quaternion rotation and mesh SQT support, so review must be after WIP tag remove

authors: Warezovvv ilia-glushchenko

repo: Godlike/Unicorn


text:
Missing ButtonEvent for trigger touching (button 16)

A very strange bug: I have a debug display which displays the state of all buttons. It shows a state change for button 16 when I touch the trigger with my index finger, but the button_pressed event isn't firing. All other buttons/touches and corresponding events seem to work so far, except for this mysterious number 16.
Windows, Godot 3.4 stable, OpenXR installed from assetlib, Oculus Quest PCVR over AirLink

Also there seems to be no button value for the little thumb rest touch area of the controller (e.g. to the right of XY)

@BastiaanOlij any ideas?

Sorry missed this issue, too many notifications on github, gets lost easily.
No idea off the top of my head, sounds like an issue on the Godot side, will have to investigate to see where it traps this, might just be checking the first 16 buttons only as that was once a limit in Godot.

@BastiaanOlij
I cannot confirm that as none of the other VR button IDs are higher than 15, but just looking at GlobalScope there's constants that are higher so it'd be weird if it was an engine bug, it's definitely a possibility though.

Closing as not using it anymore.

authors: BastiaanOlij balintbarna balintmaci


text:
Remove simple controller and move oculus touch forward

This is a changed as a result of a discussion with Rune, one of the XR engineers at Valve. Seems we're not the only ones with issues here but this change works around it (Unreal has this issue too, Unity doesn't but we think this is because Unity does what we're about to do or something similar).
On SteamVR there is logic that when a controller becomes active that is not defined in the suggested bindings (in this particular test case, a controller for an HTC Cosmos), SteamVR would fall back on the touch controller bindings, and if that doesn't exist, falls back on the simple controller.
More often than not the simple controller was the one being selected, but this definition rarely suffices.
We believe that the most likely cause is that there is a timing issue between Godot (/Unreal) submitting the bindings, and SteamVR consuming them and at the time of processing the controller only the touch definition hasn't been submitted yet.
We can even see this with known controllers as they are bound to the simple controller bindings but then change to a matching binding once that is submitted. Obviously this does not seem to be desired behavior and Valve is looking into whether this is an issue that needs changes on their side, but this PR will provide us with a solution in the meanwhile.
First is that we remove the simple controller definition, there really are very few situations where falling back on this controller definition makes sense, most games won't work with these bindings anyway.
Second is that we make the touch controller the first definition we submit.

First is that we remove the simple controller definition, there really are very few situations where falling back on this controller definition makes sense, most games won't work with these bindings anyway.

Wouldn't switching the order of submission be enough to resolve the issue?
There are potential use-cases where (non-mainstream) OpenXR runtimes may end up relying on the simple controller definition for their own scenarios, especially given that OpenXR is not limited to just games.

Wouldn't switching the order of submission be enough to resolve the issue?
There are potential use-cases where (non-mainstream) OpenXR runtimes may end up relying on the simple controller definition for their own scenarios, especially given that OpenXR is not limited to just games.

The question is, what sort of controllers are you thinking about? There aren't many that really apply here.
That said, its definitely worth testing out moving it to the end. Though with the cosmos mappings introduced I think we once again cover all major brands anyway.

The question is, what sort of controllers are you thinking about? There aren't many that really apply here. That said, its definitely worth testing out moving it to the end. Though with the cosmos mappings introduced I think we once again cover all major brands anyway.

It's definitely not suited for games, but the profile provides enough component paths to support app interaction (e.g: XR stylus).

@m4gr3d this is one of my griefs with OpenXR I think, on paper OpenXR should cater for devices you as a developer are unaware off by mapping one of the suggested bindings to new inputs, but in practice so far this promise has hardly been full filled.
SteamVR and Monado are the only platforms that support a multitude of devices and have some of this logic embedded in their runtime but so far each time it seems the only way to really make this work better, is to recompile the plugin against the latest OpenXR source so you can enable the required extension and add in the needed default bindings. That while really the new bindings entry should be enough and shouldn't require compiling against new extensions as they're just strings sent to the runtime.
I hope this improves with time.
That rant over, I'm thinking of closing this PR, it was half a work around and with us now including the Cosmos in our mappings one that has less importance then before.

@m4gr3d this is one of my griefs with OpenXR I think, on paper OpenXR should cater for devices you as a developer are unaware off by mapping one of the suggested bindings to new inputs, but in practice so far this promise has hardly been full filled.
SteamVR and Monado are the only platforms that support a multitude of devices and have some of this logic embedded in their runtime but so far each time it seems the only way to really make this work better, is to recompile the plugin against the latest OpenXR source so you can enable the required extension and add in the needed default bindings. That while really the new bindings entry should be enough and shouldn't require compiling against new extensions as they're just strings sent to the runtime.
I hope this improves with time.
That rant over, I'm thinking of closing this PR, it was half a work around and with us now including the Cosmos in our mappings one that has less importance then before.

@BastiaanOlij Ping on this PR! Should we close it?

Hey @m4gr3d,
Yeah I think so, with the addition of the other profiles it seems to be selecting the correct one.
Once I'm done with porting and completing the action map GUI for Godot 4 I am planning to experiment a little more with the timing of what we're doing. Discussing with Rune we are preparing the action map right after the session is created but before the session is started. Even though this seems to be correct (and indeed I moved it here after having issues on the Quest) we are theorizing that it is better to perform this action before the session is created. SteamVR may start processing the action map while we're still suggesting bindings and that could also effect what we were seeing here (not to mention a sporadic crash that has all the signs of being a threading/mutex issue).


text:
Ограничить высоту , добавить прокрутку "scroll-y"

когда редактируешь длинный пост - неудобно выходит, что окошко редактирования скролится - в нём всё рядом. а окошко предварительного просмотра тупо имеет высоту своего контента. и получается когда редактируешь длинную телегу - то чтобы посмотреть превьюшку изменений - надо скролить экран - а потом скролить обратно в редактор.
предложение - ограничить высоту окошку предпросмотра, типа например так - max-height: 20em; ну и сделать его scrollable

Дико напрягает, ага+

а меня наоборот напрягает узкое окно редактирования комментария, если коммент большой

Поле редактирования увеличино

repo: GolosChain/tolstoy


text:
[Auto] Create auto cases according to Topbar changes

According to #1051 ticket topbar have changes. There are 2 new icons & pages there.
Need to create automation cases.
Needed test cases can be found here: link
lines 82-84
The changes are done in the Dev env (ver0.13.0)

See PR
https://github.com/GoodDollar/GoodDAPP/pull/1196

authors: AnastasiiaOdnoshevna AndrewLebowski

repo: GoodDollar/GoodDAPP


text:
Ability to Ignore Files

I'm running into issues with Prettier formatting my Templater template files. In particular, it's replacing <%* with <%\*, which breaks the template.
I think the easiest solution to this problem would be to be able to ignore certain files when running Prettier via a .prettierignore file. I'd love if that could be added to this plugin.
Thank you!

Thanks for your suggestion, this feature has been added in version 1.1.0.
https://github.com/GoodbyeNJN/obsidian-plugin-prettier/compare/1.0.3...1.1.0

Thank you!

authors: GoodbyeNJN LandonSchropp

repo: GoodbyeNJN/obsidian-plugin-prettier


text:
aaaa

aaaa

close


text:
page.addScriptTag not working

Steps to reproduce
Tell us about your environment:

Puppeteer version: ^0.12.0
Platform / OS version: https://try-puppeteer.appspot.com
URLs (if applicable): https://example.com

What steps will reproduce the problem?
Please include code that reproduces the issue.
const browser = await puppeteer.launch();

const page = await browser.newPage();
await page.goto('https://example.com');
const scriptHandle = await page.addScriptTag({ content: "window.__injected = 35;" });
console.log(scriptHandle); // undefined
console.log(scriptHandle.asElement());
const res = await page.evaluate(() => __injected);
console.log(res);
console.log(await page.content());
await page.screenshot({path: 'screenshot.png'});

await browser.close();

What is the expected result?
https://github.com/GoogleChrome/puppeteer/blob/7d18275fb981e01cec4a4fbac61a9c66e46947bc/test/test.js#L2504
What happens instead?
await page.addScriptTag return undefined, and It seems like window.__injected = 35; did not add to the page

page.addScriptTag() resolves to ElementHandle in the v0.13.0-alpha. Compare v0.12.0 doc.
You can upgrade with npm install https://github.com/GoogleChrome/puppeteer/.

authors: Runjuu vsemozhetbyt

repo: GoogleChrome/puppeteer


text:
Page.metrics() returns mutated data after refresh/redirect

Steps to reproduce
Tell us about your environment:

Puppeteer version: 1.2.0
Platform / OS version: Mac
Node.js version: v9.11

What steps will reproduce the problem?
Please include code that reproduces the issue.

call page.metrics();
reload page
call page.metrics();

What is the expected result?
Values presented inside page.metrics() object are sums of all actions performed inside single page object. For example after reload, page.metrics() will return sum of LayoutCounts for initial page load, and LayoutCounts for page load after reload. In such case, every next redirect/reload will mutate performance data, and we can't gather performance data for different subdomains. We need to recreate page object, or calculate that manually. Is there any possibility to reset that values in performance data object?
What happens instead?
I would assume that after every redirect/refresh, performance object is cleared. Other trade-off is possibility to clear that object manually. What do you think about that?

Anyone found any work arounds for this?


text:
fix: Change networkidle2 to networkidle0

Switch example to networkidle0 to solve inconsistency of console messages
Fixes #2587

I signed it!

This might make the race less bad, but it doesn't fix it.
Instead, we should await the event from the page, and then close the browser.
Feel free to send a separate PR for this.

@aslushnikov  i didn't understand your point ,i think we are awaiting the event and afterwards browser is closing. Please correct me , if i understood it wrong

@YogeshSinghChouhan The solution that waits for networkidle0 might mostly work but gives no guarantees: how's network idleness related to app-ready event?
The inconsistency happens because we sometimes close the browser before the app-ready event is dispatched. To fix the race condition the right way, we should wait for the app-ready event explicitly and then close the browser.
On a second thought, it doesn't hurt to land this CL since it makes things better without much effort, so I'll just merge it in.

authors: YogeshSinghChouhan aslushnikov


text:
[Web Bluetooth] Add Read descriptors sample

Here's a more advanced sample for reading Bluetooth GATT descriptors.
R: @scheib
You can try it live at:
https://beaufortfrancois.github.io/samples/web-bluetooth/read-descriptors.html
https://beaufortfrancois.github.io/samples/web-bluetooth/read-descriptors-async-await.html
https://beaufortfrancois.github.io/samples/web-bluetooth/index.html

@scheib WDYT?

For info, I've just submitted a PR at https://github.com/jneen/rouge/pull/619 to make ES6 Binary literals and Octal literals highlighting works.

Links giving me nothing but 404 pages someone give me a BLE Bluetooth link or download access please

authors: beaufortfrancois tri-cloud

repo: GoogleChrome/samples


text:
LCP reporting depends on how early getFCP was called

If getLCP is called after the user input has happened the callback function is not exucuted until the next user input. If user leaves the page without any additional input I suppose the tracking doesn't occur at all. If the cwv tracking code is loaded as an asynchronous external js, whether the tracking occurs is dependent on whether the getLCP is called before the last user input or after.
Test page to reproduce that. Each second a new getLCP call happens. If you click on the red square the previous getLCP calls yeild callbacks and corresponding messages are displayed. Yet all the getLCP calls that happen after the click won't yield callbacks until the next click happens.
https://jsfiddle.net/rbe9fhyo/

If getLCP is called after the user input has happened the callback function is not exucuted until the next user input.

Yes, this is expected. Waiting to report LCP until user input has no effect on what the LCP value is, it just dictates how soon it can be reported.

If user leaves the page without any additional input I suppose the tracking doesn't occur at all.

LCP is always reported either at user input or when the page is backgrounded or unloaded, so it doesn't matter if the user never interacts with the page after getLCP() is called. It also doesn't matter when getLCP() is called, the same LCP value will always be reported for that page.

If the cwv tracking code is loaded as an asynchronous external js, whether the tracking occurs is dependent on whether the getLCP is called before the last user input or after.

Again, it doesn't matter when the library is loaded or when getLCP() is called, the same LCP value will always be reported for the current page.

Test page to reproduce that.

This test page confirms what I said above. And as you can see, if you switch tabs or navigate away from the page, all of the LCP callbacks that haven't yet fired, will fire. And the exact same LCP value is logged in each case.

authors: dmitriyshashkin philipwalton

repo: GoogleChrome/web-vitals


text:
is there  a way to precaching the files after install

Library Affected:
workbox-precaching.
Browser & Platform:
all browsers
Issue or Feature Request Description:
i want to use workbox to speed up the application with prercaching; but my project is a Micro Front-end, the sub project are independent, that means I can’t get the manifest json config when i build the project, so in service worker's install period, the precache list is not reachable;  the fileLists come from the perrmission API after user login,  it there a way to solve my situation?

You don't like the option of run-time caching in this case? it seems to me that those assets getting back from permission API are not precache assets anymore. Is there a specific reason why runtime wouldn't be a solution for you?

You don't like the option of run-time caching in this case? it seems to me that those assets getting back from permission API are not precache assets anymore. Is there a specific reason why runtime wouldn't be a solution for you?

runtime cache is like when you went into a shop.. the sales ask what size shoes you wear, and the next time you got in she don't sak；but precache， it a feel like you got into the shop, the sales is already prepare a shoes for you;
am i right to understanding the defference between precache  and runcaching；
i just want give the user what they want before he ask, because i already know what he want after he login

You have a few options.
One would be to call navigator.serviceWorker.register() only after the user has logged in. If you delay registration until after whatever conditions are met, then the install event will also be delayed, and presumably it will succeed if it takes place after login.
Another option would be to register the service worker immediately, but ensure that the install event fails when the user isn't logged in. This might be because you precache a URL that will, e.g., return an HTTP 403 error prior to login. If the install event fails, then it will be retried the next time there's a navigation to a new URL under the service worker's scope, and eventually  the  install event will succeed (assuming the user logs in).

authors: closertb jeffposnick novaknole

repo: GoogleChrome/workbox


text:
Minify build output

Clients embedding the mapper should get an optimized bundle.

Duplicate of #89

authors: mathiasbynens sadym-chromium

repo: GoogleChromeLabs/chromium-bidi


text:
Remove, hide or demote stalled PWAs.

We should Remove, hide or demote stalled PWAs, we have some that had a good score and are not reachable anymore.

My suggestion is that if updating a PWA fails 3 consecutive times, we can mark is as deleted. We can eventually try updating again after a month or so and reinstate if it becomes responsive again.

authors: andreban juliantoledo

repo: GoogleChromeLabs/gulliver


text:
Add Puppeteer to SSR section

Would be worth listing puppeteer for SSR, as described here:
https://developers.google.com/web/tools/puppeteer/articles/ssr

@ebidel suggested the same :)
And yep, should definitely be in!

Landed with #4 👍

authors: housseindjirdeh martinschierle

repo: GoogleChromeLabs/progressive-tooling


text:
[Feature Request] Support for jpegli

Is your feature request related to a problem? Please describe.
Support for the jpegli encoder for jpgs
Describe the solution you'd like
Integration of https://github.com/libjxl/libjxl/tree/main/lib/jpegli
Does other service/app have this feature?
Not yet
Additional context
See https://opensource.googleblog.com/2024/04/introducing-jpegli-new-jpeg-coding-library.html

The announcement made it to Android Contrail & a few forums.   Seems like it is poised as a replacement for MozJPEG, rather than a new format like JPEGXL.  It just seems to use different colorspace shifting  & does math calculations in floats like JPEGXL.
I don't see any new features like background transparency.  Though I'm sure @jakearchibald would be interested to see how the 'progressive' image reveal works out?

JPEG XL team at Google has built yet another JPEG encoder, jpegli, which is both faster and better than even mozjpeg. It is based on lessons learned from guetzli and libjxl, and offers a very attractive trade-off: it is very fast, compresses better than WebP and even high-speed AVIF, while still producing good old JPEG files that are supported everywhere.
At [high quality], mozjpeg no longer beats WebP, though jpegli still does
Decode speed: Sequential JPEG is unbeatable in terms of decode speed... Progressive JPEG (e.g. as produced by mozjpeg and default jpegli) is somewhat slower to decode, but still fast enough to load any reasonably-sized image in the blink of an eye. JPEG XL is somewhere in between those two.
things look quite [with Larger, camera-sized] images. WebP, mozjpeg, and AVIF are worse than libjpeg-turbo (for these images, at this quality point). HEIC brings significant savings over libjpeg-turbo, though so does jpegli, at a much better speed. JPEG XL is the clear winner,

https://cloudinary.com/blog/jpeg-xl-and-the-pareto-front

Afaiu (please correct me if I'm wrong!) it is a new format, but partly backwards compatible. Meaning, every jepgli file can be decoded by a jpeg decoder, but you lose some data there. e.g. a legacy decoder won't spit out a 10-bit image, while a jepgli decoder would.

Afaiu (please correct me if I'm wrong!) it is a new format

The announcement blog post says it’s a new encoder for the existing traditional JPEG format:

All the new methods have been carefully crafted to use the traditional 8-bit JPEG formalism, so newly compressed images are compatible with existing JPEG viewers such as browsers, image processing software, and others.

Jpegli is both a new encoder and a new decoder.
They can be used traditionally as drop in replacements of MozJPEG and libjpeg-turbo. When done so, they will give ~35 % quality improvement in the high end and 10-20 % in the more usual quality.
You can choose to use only the encoder, or only the decoder.
With both, you can choose to use the traditional 8-bit framebuffer interface, or an extension of a 16-bit framebuffer. Using the 16-bit framebuffer does not lead extension metadata to be added to the stream, the additional bits are carefully encoded into the stream. Every high quality encoding and decoding decision benefits from using the 16-bit framebuffer interface, even if the encoding or the decoding was done then in 8 bits, the quality will be slightly better.
16-bit decoding is especially attractive for HDR uses, where 8-bit striping can be more disruptive.
Jpegli encoding allows for XYB ICC v4 color profile to be emitted. This makes the resulting JPEG less compatible with legacy systems and will cause false colors (usually green) to be rendered when the decoder does not know how to interpret ICC v4 (defined in 2012). Many such systems exists, especially for thumbnailers and for image uploading in social media web services. Where appropriate -- considering the legacy compatibility issues -- XYB can give an additional ~10 % more compression density or quality.
Jpegli achieves most of the savings by psychovisually derived (based on butteraugli!) spatially variable dead-zone quantization and by more careful computation and less intermediate quantization at each stage of processing.

All the major Web browsers support ICCv4 on desktop and mobile, correct?

Jpegli encoding allows for XYB ICC v4 color profile to be emitted. This makes the resulting JPEG less compatible with legacy systems and will cause false colors (usually green) to be rendered when the decoder does not know how to interpret ICC v4 (defined in 2012). Many such systems exists, especially for thumbnailers and for image uploading in social media web services. Where appropriate -- considering the legacy compatibility issues -- XYB can give an additional ~10 % more compression density or quality.

This greatly explains why I saw greenish colours somewhere especially with thumbnails. Unfortunately it would be more difficult to ask those softwares (even Finder of macOS and Painter of Windows) to correctly apply with ICC v4.

Squoosh = Google
Jpegli = Google
Squoosh + Jpegli = 2026?😿

We really need Jpegli support.

authors: Bustycat QINGCHARLES Stanzilla YuushaExa jyrkialakuijala mathiasbynens surma tomByrer

repo: GoogleChromeLabs/squoosh


text:
Error when Running on Docker

I am trying to run Iperf within a Docker container as specified in
(https://github.com/GoogleCloudPlatform/PerfKitBenchmarker/wiki/Running-on-Docker)

The command I am using is:
$ ./pkb.py --project= --benchmarks=iperf --os_type=ubuntu_container

I have Docker installed on my machine (can use "docker run hello-world) but I am getting a error:
RemoteCommandError: Got non-zero return code (1) executing sudo docker exec None bash -c 'sudo rm -r /var/lib/apt/lists/*'
(which is followed later by)
STDOUT: STDERR: sudo: docker: command not found

Not sure why I am getting the error. Any ideas? Would appreciate it very much thanks!

Can you share your complete log?

authors: dlott eelisgit

repo: GoogleCloudPlatform/PerfKitBenchmarker


text:
Add script to automagically drive a new release for PKB

In the beginning it'll ask you for your github credentials and verify them. It'll use them to push as well as to use the github REST API.
After that, some manual intervention is still required at the following points:

After side-by-side tests (human has to squint at results)
After PR is created (human still has to merge it)

This PR is almost a year old and it looks like we lost track of it. Is this still valid? If so, please reply and somebody will review in the next couple of weeks.

If I had to guess the release process has probably changed and this is invalid by now.

authors: s-deitz tedsta


text:
Fix yum proxy bug

This removes unnecessary quotation marks and semicolon. Before that Perfkit fails with yum error
Options error: Error parsing "proxy = '\'"http://10.10.10.1:8080";\''": URL must be http, ftp, https, socks4, socks4a, socks5 or socks5h not ""

We don't need those quotation marks and a semicolon at the end in /etc/yum.conf

I have used wrong e-mail in commits, let me fix that.


text:
Rackspace: change default machine type to single-core.

Other cloud providers have been using single-core machines as the
default machine type, so this keeps things more consistent if run
without explicit machine type. Users can (and should) explicitly
set --machine_type=... if they want to test other combinations.

@meteorfox - is this ok with you?

@klausw Sounds good. :+1:
The reason I chose general1-4 over general1-1 was mainly for capacity so most benchmarks have plenty of head room. Benchmarks like cassandra_stress, run very constrained on 1 CPU and 1 GB RAM (CPU is completely saturated, RAM at 70% util for the cassandra process).

LGTM

authors: ehankland klausw meteorfox


text:
Remove the mongodb benchmark.

Deprecated in favor of mongodb_ycsb.
See #294.

LGTM

LGTM ... though you can remove the mongodb_ycsb from the google_set as commented.

authors: cmccoy ehankland voellm


text:
Support S3 Signature Version 4

Supply a '--region' flag to 'aws s3 rm' and 'aws s3 rb', which make it
use signature version 4, which is required for certain S3 regions.

@yuyantingzero @stfeng @skschneider @ehankland please take a look.

LGTM

authors: noahl skschneider


text:
Use functional parameters in Controller creation

The constructor for Controller in controller.go is becoming unwieldy and has the potential to be error-prone as more parameters are added.
Go makes use of functional parameters in a similar way that some other languages use Builders. We should consider doing so as well to help readability as more developers start working on the project.

Any objections to me closing this issue? Looks like the pattern we have now solves this for the moment?

Going to close this, sounds like it's not an issue anymore.
Please re-open as needed.

authors: dzlier-gcp markmandel

repo: GoogleCloudPlatform/agones


text:
remove useless warning

See the thread at http://stackoverflow.com/questions/36484232/gae-java-flexible-environment-jsp-warning

The class com.google.apphosting.vmruntime.jetty9.InstanceManagerImpl exists neither in master nor async branch?   I'm guessing it is an implementation of JSPs org.apache.tomcat.InstanceManager ?

@ludoch is this coming from some jsp precompilation step perhaps?

yes, this is coming from the internal code supporting the (ancient now) java7/jetty9.2 image.
We do not need this instanceManagerImpl in  github and we reuse the default impl of the instancemanager.
We can close this bug, as it cannot be fixed in github.

authors: gregw janbartel ludoch


text:
Tests for GoogleHadoopFSInputStream

seek illegal argument,
read,
available,

Code formated with google-java-format ;)

@medb everything is solved.

repo: GoogleCloudPlatform/bigdata-interop


text:
1.6.x minimize shaded jars fix

Shaded jars difference with previous connectors release (1.6.3/0.10.4):

BQ connector - https://www.diffchecker.com/e6hKs5HR
GCS connector - https://www.diffchecker.com/oRIE4hoH

@AngusDavis Added shaded jars diffs to description, PTAL


text:
feat: v2 --quota-project to support changing the api request quotas

Creates the beginning of an implementation for the v2 --quota-project flag
replacing the v1 -quota_project flag. This flag allows the user to set
the google project that
This PR depends on changes to the cloudsqlconn project, which needs
to support a quota-project dialer option.

After discussion with Kurtis, we will land this change with the pinned commit sha version of the cloud-sql-go-connector. Then, before the next release, we will update to the release version of the cloud-sql-go-connector.

repo: GoogleCloudPlatform/cloudsql-proxy


text:
Clear immutable attr from 70-persistent-net.rules before deleting.

We've seen failed imports when the user sets 70-persistent-net.rules to immutable. This change clears the attribute prior to deleting the file.

Observed error message: `rm_f: /etc/udev/rules.d/70-persistent-net.rules: Operation not permitted
Previous related change: #1151

/retest

/lgtm

authors: EricEdens hopkiw zmarano

repo: GoogleCloudPlatform/compute-image-tools


text:
Deprecate hellonode, add hello-app sample

cc: @jeffmendoza

Thanks. Will merge.
@broady copying you for Go review, if you have comments feel free to leave them, I'll address in a separate PR.


text:
unable to access and modify the response data in google endpoint api in python

I want to manipulate the query method response of google endpoint model api in python. i am unable to format the response field i tried format in array and json also but it shows internal server error.
i want it in array object format. or apend the query response in array and print array in response.

Sorry, can you provide some code / an error stacktrace? (It seems this question may be more appropriate for StackOverflow.)

their is no other error than "internal server error" .
i want only that proper way of send the query response to other api and access the response in that api in different format like array key.

their is no other error than "internal server error" .

There must be some stacktrace from failed code. I was also asking for a snippet of code from your app.

ok
@Gadget.query_method(path='gadgets', name='gadget.list', query_fields=('ownerID', 'category', 'locationCity','pageToken'))
def GadgetList(self, query):
json_obj = json.load(query)
y = query
obj = {
'uploadURL': query
}
self.response.out.write(json.dumps(query))
n = json.dumps(query.to_dict())
address_to_use1 = query
return query
qry = Gadget.query() # Create a query
arr = []
q = json.load(query)
for val in q:
arr.append(val)
q = query.keys()
self.response.headers['Content-Type'] = 'application/json'
self.response.out.write(query)
return query

are i already tried please let me other solution.

ok
@Gadget.query_method(path='gadgets', name='gadget.list', query_fields=('ownerID', 'category', 'locationCity','pageToken'))
def GadgetList(self, query):
return query
i already tried but give whole json responnse i want to modify them

Sorry this still isn't nearly enough to offer any help. I need much more context to even understand what problem you're having.

authors: bharat-bhushan-canopus dhermes


text:
Dataproc module

Hi,
I wrote a python package called Dataproctor which wraps Dataproc's API and creates python objects which represent the API response, similarly to how this package works compared to the standard python client library.
When I wrote that I didn't know about this and since this doesn't yet work with Dataproc, if I ported this over to fit this project's guidelines, is this PR you'all would potentially accept?
Thanks

/cc @jgeewax

@tshauck : Wow -- that'd be fantastic. Definitely. And let me know if you need someone from the Dataproc team to help out with anything and I can connect you!

@jgeewax Alright, great, thanks.  I'll get started and reach out and I'll reach out if (when 😄) I run into issues.
/cc @daspecster

authors: daspecster jgeewax tshauck

repo: GoogleCloudPlatform/gcloud-python


text:
Blob.upload_from_file doesn't work for file-like objects without size parameter

When using StringIO, io.BytesIO or other file-like objects (such as Flask/werkzeug's file upload object), trying to upload via Blob.upload_from_file doesn't work because it attempts to find the size of the object using os.stat throwing a AttributeError: StringIO instance has no attribute 'fileno'. Passing in the size manually fixes this, but imo this inconsistency shouldn't burden the user as there are other ways than fileno to determine the size of a StringIO or io.BytesIO instance (seek, tell).
At any rate, the error message could be more helpful.

Can you give a stacktrace of the error message?
The offending line is
        # Get the basic stats about the file.
        total_bytes = size or os.fstat(file_obj.fileno()).st_size

which as @jonparrott points out, assumes the file-like object is a file (from the stdlib).

Traceback (most recent call last):
  File "/Users/jonwayne/workspace/getting-started-python/env/lib/python2.7/site-packages/flask/app.py", line 1836, in __call__
    return self.wsgi_app(environ, start_response)
  File "/Users/jonwayne/workspace/getting-started-python/env/lib/python2.7/site-packages/flask/app.py", line 1820, in wsgi_app
    response = self.make_response(self.handle_exception(e))
  File "/Users/jonwayne/workspace/getting-started-python/env/lib/python2.7/site-packages/flask/app.py", line 1403, in handle_exception
    reraise(exc_type, exc_value, tb)
  File "/Users/jonwayne/workspace/getting-started-python/env/lib/python2.7/site-packages/flask/app.py", line 1817, in wsgi_app
    response = self.full_dispatch_request()
  File "/Users/jonwayne/workspace/getting-started-python/env/lib/python2.7/site-packages/flask/app.py", line 1477, in full_dispatch_request
    rv = self.handle_user_exception(e)
  File "/Users/jonwayne/workspace/getting-started-python/env/lib/python2.7/site-packages/flask/app.py", line 1381, in handle_user_exception
    reraise(exc_type, exc_value, tb)
  File "/Users/jonwayne/workspace/getting-started-python/env/lib/python2.7/site-packages/flask/app.py", line 1475, in full_dispatch_request
    rv = self.dispatch_request()
  File "/Users/jonwayne/workspace/getting-started-python/env/lib/python2.7/site-packages/flask/app.py", line 1461, in dispatch_request
    return self.view_functions[rule.endpoint](**req.view_args)
  File "/Users/jonwayne/workspace/getting-started-python/oauth2/__init__.py", line 33, in decr
    return f(*args, **kwargs)
  File "/Users/jonwayne/workspace/getting-started-python/bookshelf/crud.py", line 57, in add
    image_url = upload_image_file(request.files.get('image'))
  File "/Users/jonwayne/workspace/getting-started-python/bookshelf/crud.py", line 25, in upload_image_file
    current_app.config['ALLOWED_EXTENSIONS']
  File "/Users/jonwayne/workspace/getting-started-python/storage/__init__.py", line 52, in upload_file
    blob.upload_from_file(file)
  File "/Users/jonwayne/workspace/getting-started-python/env/src/gcloud/gcloud/storage/blob.py", line 395, in upload_from_file
    total_bytes = size or os.fstat(file_obj.fileno()).st_size
UnsupportedOperation: fileno

Ha, ok. Doesn't provide anything we didn't know.

Heh, let me know if there's anything else I can provide to help here. The file-like object is a flask file upload (werkzeug.FileStorage). It fails likewise when using blob.upload_from_file(file) and blob.upload_from_file(file.stream).

authors: dhermes jonparrott


text:
Cloud Tasks sample

Opening this early to get some feedback. The queue and task creation works flawlessly, but I ran into issues when attempting to convert Queue and Task classes into strings.
At runtime, the natively built image would fail complaining about getters not being found, both within the class in question and the builder, for example Queue$Builder.  This is, presumably, because the way gRPC classes are converted to strings requires reflective access. For example, the Task object is printed like this:
name: "projects/xxxxxxxx/locations/us-central1/queues/graal-test-queue-6685/tasks/56217623861818533241"
http_request {
  url: "https://google.com/"
  http_method: GET
  headers {
    key: "User-Agent"
    value: "Google-Cloud-Tasks"
  }
}
schedule_time {
  seconds: 1613187863
  nanos: 685055000
}
create_time {
  seconds: 1613187863
}
dispatch_deadline {
  seconds: 600
}
view: BASIC

As you can see, it also prints some timestamps and durations. Because it uses com.google.protobuf.Duration and com.google.protobuf.Timestamp classes to represent those values, I also got a runtime crash complaining that the getters for those classes were not available within the corresponding static Builders.
This is why I changed the GrpcNettyFeature to include both and register the whole hierarchy in order to include their static Builder classes.
If you feel that this falls outside the scope of creating a Cloud Tasks sample, let me know. I think it might be worthwhile attempting to print out more of the classes in the other samples and see if same issues apply. Alternatively, if you don't wish to support toString() conversions for the classes, I could take this out entirely and just focus on the Tasks sample.

@kostacasa -- Hey thanks for the contribution! Will take a look at this shortly.

/gcb_run

/gcbrun

Thanks @kostacasa -- This is really great! I added some polish changes, will merge in when the build passes.
I see you had to registerPackageForReflection(access, "com.google.cloud.tasks.v2"); because printing the protos required reflection. I'll do some research see if we can come up with a reduced filter for what classes need to be registered there (maybe we might be able to limit it to only classes where the TextFormat.print is called or something similar).

I want to say I didn't use UUID because I got an error that the name is too long or something of the sort, but we'll find out once the tests run! :)

Ohh gotcha, yeah let's see if it is an issue.

/gcbrun

I see you had to registerPackageForReflection(access, "com.google.cloud.tasks.v2"); because printing the protos required reflection. I'll do some research see if we can come up with a reduced filter for what classes need to be registered there (maybe we might be able to limit it to only classes where the TextFormat.print is called or something similar).

That's right, it was a bit of a sledgehammer approach in fairness. I agree it would be more desirable to be specific to keep the resulting artifacts as lightweight as possible. If there is a better approach, it would be worthwhile investigating since all the libraries would benefit from this capability.

That's right, it was a bit of a sledgehammer approach in fairness. I agree it would be more desirable to be specific to keep the resulting artifacts as lightweight as possible. If there is a better approach, it would be worthwhile investigating since all the libraries would benefit from this capability.

No worries, I think this is a good start. I have some ideas for how to improve on this which I'll followup with next week.
Thank you again for your time on this!

authors: dzou kostacasa


text:
Include mock globals

Closes: https://github.com/GoogleCloudPlatform/google-cloud-php/issues/654
@stanley-cheung, please let me know if this resolves the issue for you! :)

Touched base with Stanley offline, this is good to merge.

Verified the fix. Thanks!

authors: dwsupplee stanley-cheung

repo: GoogleCloudPlatform/google-cloud-php


text:
Simplify the creation of a new Windows Server 2012 VM

in glcoud:
gcloud compute instances create example-instance --image windows-2012-r2
The only thing I have to know is the image name windows-2012-r2, and then to pass the name
in PowerShell cmdlets:
$images = Get-GceImage -Project "windows-cloud"�
$winimage = ($images[$images.length-1]).selfLink
$config = New-GceInstanceConfig -DiskImage $winimage -Name Yann-machine -MachineType n1-standard-1
Add-GceInstance -Instance $config�
I have to know the image selflink (equivalent to the windows-2012-r2, although likely way harder to remember and type from memory), and the machine type
Suggestions
Add-GceInstance -name Yann-machine -image https://www.googleapis.com/compute/v1/projects/windows-cloud/global/images/windows-server-2012-r2-dc-v20160623� with default n1-standard-1. Might write into the standard output to tell the user about the default the command assumed implicitely.

As it stands now.
1 is solved.
2. The instance config half is solved. The image object half is a design decision I am hesitant to change. Getting the image means knowing it is there before making the instance.
3. Fixed.
4. Fixed. Now named -InstanceConfig.

authors: ILMTitan YnR


text:
[Monitoring] cannot be used with Python 3.7 (Pandas)

Pandas/Cython doesn't currently support 3.7. Once it does we need to enable 3.7 testing on Monitoring.
Collecting pandas>=0.17.1 (from google-cloud-monitoring==0.29.0)
Using cached https://files.pythonhosted.org/packages/08/01/803834bc8a4e708aedebb133095a88a4dad9f45bbaf5ad777d2bea543c7e/pandas-0.22.0.tar.gz
Could not find a version that satisfies the requirement Cython (from versions: )
No matching distribution found for Cython

Pandas 0.23.3 claims (working) support for Python 3.7.
The release page also notes Pandas will be dropping Python 2.7 support for new feature releases as of 2019-01-01.

authors: crwilcox tseaver

repo: GoogleCloudPlatform/google-cloud-python


text:
NeedIndexError on a single property (Google AppEngine + Firestore)

I'm cross-posting this from https://stackoverflow.com/questions/50634212/needindexerror-on-a-single-property-google-appengine-firestore
If you can provide us with as much of the following information as possible it
will help us identify the cause of your issue more quickly.

Specify the API at the beginning of the title (for example, "BigQuery: ...")
General, Core, and Other are also allowed as types

Not sure.

OS type and version

$ sw_vers
ProductName:	Mac OS X
ProductVersion:	10.13.4
BuildVersion:	17E202

Python version and virtual environment information python --version

$ python --version
Python 2.7.12

google-cloud-python version pip show google-cloud, pip show google-<service> or pip freeze

pip show google-cloud shows no results.
$ gcloud version
Google Cloud SDK 203.0.0
alpha 2018.05.25
app-engine-python 1.9.70
beta 2018.05.25
bq 2.0.34
core 2018.05.25
gsutil 4.31

$ dpkg -l "google-cloud-sdk*"
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name                               Version                Architecture           Description
+++-==================================-======================-======================-=========================================================================
ii  google-cloud-sdk                   203.0.0-0              all                    Utilities for the Google Cloud Platform
un  google-cloud-sdk-app-engine-java   <none>                 <none>                 (no description available)
ii  google-cloud-sdk-app-engine-python 203.0.0-0              all                    Python runtime for Google App Engine
un  google-cloud-sdk-bigtable-emulator <none>                 <none>                 (no description available)
un  google-cloud-sdk-datastore-emulato <none>                 <none>                 (no description available)
un  google-cloud-sdk-pubsub-emulator   <none>                 <none>                 (no description available)

Stacktrace if available

logMessage:  "An error occurred during a request.
Traceback (most recent call last):
  File "/base/data/home/apps/s~events-12275/20180531t165330.410118595690745694/lib/flask/app.py", line 1982, in wsgi_app
    response = self.full_dispatch_request()
  File "/base/data/home/apps/s~events-12275/20180531t165330.410118595690745694/lib/flask/app.py", line 1614, in full_dispatch_request
    rv = self.handle_user_exception(e)
  File "/base/data/home/apps/s~events-12275/20180531t165330.410118595690745694/lib/flask_cors/extension.py", line 161, in wrapped_function
    return cors_after_request(app.make_response(f(*args, **kwargs)))
  File "/base/data/home/apps/s~events-12275/20180531t165330.410118595690745694/lib/flask/app.py", line 1517, in handle_user_exception
    reraise(exc_type, exc_value, tb)
  File "/base/data/home/apps/s~events-12275/20180531t165330.410118595690745694/lib/flask/app.py", line 1612, in full_dispatch_request
    rv = self.dispatch_request()
  File "/base/data/home/apps/s~events-12275/20180531t165330.410118595690745694/lib/flask/app.py", line 1598, in dispatch_request
    return self.view_functions[rule.endpoint](**req.view_args)
  File "/base/data/home/apps/s~events-12275/20180531t165330.410118595690745694/auth.py", line 42, in wrapper
    return api_function(*args, **kwargs)
  File "/base/data/home/apps/s~events-12275/20180531t165330.410118595690745694/users.py", line 51, in api_list_users
    users = User.query_users()
  File "/base/data/home/apps/s~events-12275/20180531t165330.410118595690745694/model.py", line 35, in query_users
    db_objects = query.fetch()
  File "/base/alloc/tmpfs/dynamic_runtimes/python27/277b61042b697c7a_unzipped/python27_lib/versions/1/google/appengine/ext/ndb/utils.py", line 160, in positional_wrapper
    return wrapped(*args, **kwds)
  File "/base/alloc/tmpfs/dynamic_runtimes/python27/277b61042b697c7a_unzipped/python27_lib/versions/1/google/appengine/ext/ndb/query.py", line 1218, in fetch
    return self.fetch_async(limit, **q_options).get_result()
  File "/base/alloc/tmpfs/dynamic_runtimes/python27/277b61042b697c7a_unzipped/python27_lib/versions/1/google/appengine/ext/ndb/tasklets.py", line 383, in get_result
    self.check_success()
  File "/base/alloc/tmpfs/dynamic_runtimes/python27/277b61042b697c7a_unzipped/python27_lib/versions/1/google/appengine/ext/ndb/tasklets.py", line 427, in _help_tasklet_along
    value = gen.throw(exc.__class__, exc, tb)
  File "/base/alloc/tmpfs/dynamic_runtimes/python27/277b61042b697c7a_unzipped/python27_lib/versions/1/google/appengine/ext/ndb/query.py", line 995, in _run_to_list
    batch = yield rpc
  File "/base/alloc/tmpfs/dynamic_runtimes/python27/277b61042b697c7a_unzipped/python27_lib/versions/1/google/appengine/ext/ndb/tasklets.py", line 513, in _on_rpc_completion
    result = rpc.get_result()
  File "/base/alloc/tmpfs/dynamic_runtimes/python27/277b61042b697c7a_unzipped/python27_lib/versions/1/google/appengine/api/apiproxy_stub_map.py", line 613, in get_result
    return self.__get_result_hook(self)
  File "/base/alloc/tmpfs/dynamic_runtimes/python27/277b61042b697c7a_unzipped/python27_lib/versions/1/google/appengine/datastore/datastore_query.py", line 2921, in __query_result_hook
    yaml_index=yaml, xml_index=xml)
NeedIndexError: no matching index found.
The suggested index for this query is:
- kind: User
  properties:
  - name: displayName"
    severity:  "ERROR"

Steps to reproduce

Please see the linked stack overflow post above.  (Let me know if this is insufficient.)

Code example

Please see the linked stack overflow post above.  (Let me know if this is insufficient.)
Any ideas?  Should this be possible?  i.e. to use GCP on GAE with Firestore indexes?

Hmm, maybe this issue should be moved to https://github.com/GoogleCloudPlatform/datastore-ndb-python/issues instead ...

@RohanTalip yes, indeed, this is an NDB issue.

authors: RohanTalip tseaver


text:
Add vision label detection

Based off of #2236.
I was able to DRY up the requests code for the EntityAnnotation based detection types.
✅ Waiting for #2236 before rebasing.

@tseaver LMKWYT!

@tseaver anything else?

LGTM pending Travis.

Squashed...going to wait for travis one more time.

authors: daspecster tseaver


text:
Update 'filter' -> 'filter_' in logging examples.

Closes: #2278.

LGTM

authors: dhermes tseaver


text:
Broken links in Dialogflow docs

While releasing Dialogflow I discovered that the URL used for the product (https://cloud.google.com/dialogflow) appears to be incorrect or outdated. The current URL is https://cloud.google.com/dialogflow-enterprise.
While https://cloud.google.com/dialogflow forwards to https://cloud.google.com/dialogflow-enterprise, https://cloud.google.com/dialogflow/docs does not forward to https://cloud.google.com/dialogflow-enterprise/docs, resulting in broken links. I used the correct URL in the top-level README, but there are similar links in source code docs comments that still need to be fixed.
I also found a broken console link in the README that I fixed.  It would probably be a good idea to test all links to the product in this package.

Addressed in #2055

authors: jbolinger quartzmo

repo: GoogleCloudPlatform/google-cloud-ruby


text:
Install compatible protobuf for older Python

The protobuf library is heavily used by other Google Cloud libraries. We can use the Ansible fact for the Python 3 package version to ensure that we are installing a compatible release of protobuf on systems with out-of-date Python (e.g. CentOS 7 and the "HPC VM Image").
Resolves #368
Submission Checklist

[X] Have you installed and run this change against pre-commit? (pre-commit install)
[X] Are all tests passing? (make tests)
[X] Have you written unit tests to cover this change?
[X] Is unit test coverage still above 80%?
[X] Have you updated all applicable documentation?
[X] Have you followed the guidelines in our Contributing document?

Approved, but pending the integration test passes.

authors: heyealex tpdownes

repo: GoogleCloudPlatform/hpc-toolkit


text:
eliminate duplicate git clone for firewall module

Submission Checklist

[x] Have you installed and run this change against pre-commit? (pre-commit install)
[x] Are all tests passing? (make tests)
[x] Have you written unit tests to cover this change?
[x] Is unit test coverage still above 80%?
[x] Have you updated all applicable documentation?
[x] Have you followed the guidelines in our Contributing document?

This PR moves the firewall configs under the VPC module to streamline the modules and reduce the number of git clone operations performed during a make tests run.
The gains are small (17%), but I still think it's worthwhile change.
Count of clones per repo when running make tests:
On main branch, before the change (total of 88 git clone):
     18 "git::https://github.com/terraform-google-modules/terraform-google-address?ref=v3.1.1"
     18 "git::https://github.com/terraform-google-modules/terraform-google-cloud-router?ref=v2.0.0"
     36 "git::https://github.com/terraform-google-modules/terraform-google-network?ref=v5.1.0"
      3 "git::https://github.com/terraform-google-modules/terraform-google-project-factory?ref=v11.3.1"
      2 "git::https://github.com/terraform-google-modules/terraform-google-pubsub?ref=v3.2.0"
      4 "git::https://github.com/terraform-google-modules/terraform-google-service-accounts?ref=v4.1.1"
      7 "git::https://github.com/terraform-google-modules/terraform-google-vm?ref=v7.8.0"

On vpc-module-downloads branch, after the change (total of 73 git clone):
     19 "git::https://github.com/terraform-google-modules/terraform-google-address?ref=v3.1.1"
     19 "git::https://github.com/terraform-google-modules/terraform-google-cloud-router?ref=v2.0.0"
     19 "git::https://github.com/terraform-google-modules/terraform-google-network?ref=v5.1.0"
      3 "git::https://github.com/terraform-google-modules/terraform-google-project-factory?ref=v11.3.1"
      2 "git::https://github.com/terraform-google-modules/terraform-google-pubsub?ref=v3.2.0"
      4 "git::https://github.com/terraform-google-modules/terraform-google-service-accounts?ref=v4.1.1"
      7 "git::https://github.com/terraform-google-modules/terraform-google-vm?ref=v7.8.0"

I deployed a couple of test projects using main and reconfigured them using the updated manifest in vpc-module-downloads and they all reconfigured without issues.
A few seconds of traffic disruptions might occur due to a short lapse of time when there is no allow fw rule.

/gcbrun

@kkr16 I'm not sure why these checks are blocking the merge. I'll raise at tomorrow's scrum.

Rebased against develop - sorry for the numerous commits - I was having issues with ghost changes appearing under Files changed

Can you please squash the commits?
https://makandracards.com/makandra/527-squashing-several-git-commits-into-a-single-commit
You'd want to do something like git rebase -i develop and then have it look like
pick XXX
squash YYY
squash ZZZ
...
squash FFF

Can you please squash the commits?
https://makandracards.com/makandra/527-squashing-several-git-commits-into-a-single-commit
You'd want to do something like git rebase -i develop and then have it look like
pick XXX
squash YYY
squash ZZZ
...
squash FFF

Done. Thanks!

/gcbrun


text:
TraceLoggingEnhancer.setCurrentTraceId is not in correctly formatted.

The class  RequestContextScope.java class  is not formatting the traceId correctly.  According to the javadoc the TraceLoggingEnhancer.setCurrentTraceId expects  projects/[PROJECT_ID]/traces/[TRACE_ID], while we are just supplying [TRACE_ID]  within https://github.com/GoogleCloudPlatform/jetty-runtime/blob/master/jetty9-base/src/main/java/com/google/cloud/runtimes/jetty9/RequestContextScope.java
This was changed in the logging library with this pull request:
https://github.com/googleapis/google-cloud-java/pull/3301
For more information see this blog post: https://cloud.google.com/blog/products/gcp/viewing-trace-spans-and-request-logs-in-multi-project-deployments
Thanks

PR #244 has been merged, can this issue be closed?

authors: bmenasha joakime

repo: GoogleCloudPlatform/jetty-runtime


text:
RBD defencing issue

Appear to have an issue when tearing down a RBD volume, a stack trace below; The rbd unmap works fine, the volume is removed successfully, but the unlocking throws an exception
Aug 10 14:07:20 core101 hyperkube[3665]: W0810 14:07:20.383951    3665 kubelet.go:1355] Orphaned volume "cad31130-3f67-11e5-a5bb-06baeabbce11/data" found, tearing down volume
Aug 10 14:07:20 core101 hyperkube[3665]: W0810 14:07:20.384023    3665 kubelet.go:1355] Orphaned volume "cad31130-3f67-11e5-a5bb-06baeabbce11/logs" found, tearing down volume
Aug 10 14:07:20 core101 sudo[11723]:     root : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/sbin/lsmod
Aug 10 14:07:20 core101 hyperkube[3665]: E0810 14:07:20.665110    3665 util.go:68] Recovered from panic: "integer divide by zero" (runtime error: integer divide by zero)
Aug 10 14:07:20 core101 hyperkube[3665]: /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/pkg/util/util.go:62
Aug 10 14:07:20 core101 hyperkube[3665]: /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/pkg/util/util.go:53
Aug 10 14:07:20 core101 hyperkube[3665]: /usr/src/go/src/runtime/asm_amd64.s:401
Aug 10 14:07:20 core101 hyperkube[3665]: /usr/src/go/src/runtime/panic.go:387
Aug 10 14:07:20 core101 hyperkube[3665]: /usr/src/go/src/runtime/panic.go:24
Aug 10 14:07:20 core101 hyperkube[3665]: /usr/src/go/src/runtime/sigpanic_unix.go:33
Aug 10 14:07:20 core101 hyperkube[3665]: /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/pkg/volume/rbd/rbd_util.go:82
Aug 10 14:07:20 core101 hyperkube[3665]: /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/pkg/volume/rbd/rbd_util.go:176
Aug 10 14:07:20 core101 hyperkube[3665]: /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/pkg/volume/rbd/rbd_util.go:267
Aug 10 14:07:20 core101 hyperkube[3665]: /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/pkg/volume/rbd/disk_manager.go:100
Aug 10 14:07:20 core101 hyperkube[3665]: /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/pkg/volume/rbd/rbd.go:230
Aug 10 14:07:20 core101 hyperkube[3665]: /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/pkg/volume/rbd/rbd.go:226
Aug 10 14:07:20 core101 hyperkube[3665]: /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/pkg/kubelet/kubelet.go:1359
Aug 10 14:07:20 core101 hyperkube[3665]: /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/pkg/kubelet/kubelet.go:1491
Aug 10 14:07:20 core101 hyperkube[3665]: /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/pkg/kubelet/kubelet.go:1784
Aug 10 14:07:20 core101 hyperkube[3665]: /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/pkg/kubelet/kubelet.go:1739
Aug 10 14:07:20 core101 hyperkube[3665]: /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/pkg/kubelet/kubelet.go:741
Aug 10 14:07:20 core101 hyperkube[3665]: /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubelet/app/server.go:670
Aug 10 14:07:20 core101 hyperkube[3665]: /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/pkg/util/util.go:111
Aug 10 14:07:20 core101 hyperkube[3665]: /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/pkg/util/util.go:112
Aug 10 14:07:20 core101 hyperkube[3665]: /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/pkg/util/util.go:93
Aug 10 14:07:20 core101 hyperkube[3665]: /usr/src/go/src/runtime/asm_amd64.s:2232

The code throws a "divide by zero" exception in the following line;
// construct lock id using host name and a magic prefix
lock_id := "kubelet_lock_magic_" + node.GetHostname("")

l := len(b.Mon)
// avoid mount storm, pick a host randomly
start := rand.Int() % l  <--- HERE .. the size of the monitor array
// iterate all hosts until mount succeeds.
for i := start; i < start+l; i++ {

This structure is read in from the persisted rbd.json file
ip-10-50-2-93 rbd-image-gitlab-data # pwd
/var/lib/kubelet/plugins/kubernetes.io/rbd/rbd/rbd-image-gitlab-data
ip-10-50-2-93 rbd-image-gitlab-data # cat rbd.json
{"Pool":"rbd","Image":"gitlab-data","ReadOnly":false,"Mon":["10.50.10.100:6789","10.50.11.100:6789","10.50.12.100:6789"],"Id":"admin","Keyring":"/etc/ceph/keyring","Secret":"A KEY"}

Which appears to be valid; I'm guessing the file is incorrectly decoded and the []Mon is empty causing a INT % 0 and thus exception. A few things to note; as the rbd fencing code is not yet merged into a release (lives only in master branch) this kubenetes binaries i'm using (for testing :-) ) are built out of master ..
[jest@starfury kube]$ kubectl version
Client Version: version.Info{Major:"0", Minor:"20+", GitVersion:"v0.20.2-448-g73cb04ad6b49c9-dirty", GitCommit:"73cb04ad6b49c9dad641c2f69fa2e9725e766f72", GitTreeState:"dirty"}
Server Version: version.Info{Major:"1", Minor:"1+", GitVersion:"v1.1.0-alpha.0.1464+2bfa9a1f98147c-dirty", GitCommit:"2bfa9a1f98147cfdc2e9f4cf50e2c430518d91eb", GitTreeState:"dirty"}

@rootfs @markturansky

@a-robinson yes, the wrong struct is the problem. LGTM, thanks!

authors: a-robinson gambol99 rootfs

repo: GoogleCloudPlatform/kubernetes


text:
Hide POD container from end users

Fix #3433
This is last PR to close #3433.

LGTM


text:
describe: Support resource type/name syntax

This makes kubectl describe resource syntax consistent with kubectl delete

@kargakis: Can you post a snippet of the new output?

@kargakis: Can you post a snippet of the new output?

Sure.
[vagrant@openshiftdev sample-app]$ openshift kubectl describe service docker-registry
Name:			docker-registry
Labels:			docker-registry=default
Selector:		docker-registry=default
IP:			172.30.17.149
Port:			5000
Endpoints:		<none>
Session Affinity:	None
No events.
[vagrant@openshiftdev sample-app]$ openshift kubectl describe service/docker-registry
Name:			docker-registry
Labels:			docker-registry=default
Selector:		docker-registry=default
IP:			172.30.17.149
Port:			5000
Endpoints:		<none>
Session Affinity:	None
No events.

LGTM

authors: kargakis vishh


text:
Debian 12 arm64 packages

Describe the bug
After #1294, bookworm images are available for amd64, but not arm64. Thus I cannot install the agent on T2A instances.
To Reproduce
Steps to reproduce the behavior:

Start a T2A GCE VM with Debian 12 arm64 image
Try to follow the installation instructions from https://cloud.google.com/stackdriver/docs/solutions/agents/ops-agent/installation#install-latest-version
The package is not found
https://packages.cloud.google.com/apt/dists/google-cloud-ops-agent-bookworm-all/main/binary-arm64/Packages is empty

Expected behavior
The agent should be available for arm64 platforms for use on T2A instances.
Environment (please complete the following information):

VM distro / OS: Debian 12 arm64

Bookworm packages for ARM are not ready yet. We are working on it.

Thank you!

repo: GoogleCloudPlatform/ops-agent


text:
fix: match exact test on e2e test matrix

This fixes two issues:

TEST_RUN takes in a regular expression. After the recent refactoring, this no longer works. This is because we create a kind cluster with a name based off of the TEST_RUN. If there any special characters (e.g. from regular expressions), this fails.
If we add a new text that's a prefix or suffix of the same test, that test will be ran twice on GitHub. For example, if we have TestA and TestAVariant, then when GitHub runs TestA, it will run both tests within that runner and then it will run TestAVariant again in a separate runner. This is because Go takes in a regular expression when filtering tests and TestA matches both tests. We fix this by adding symbols for start and end of string, e.g. we run TestA with ^TestA$ to ensure it only runs TestA.

Thanks! To be fair, it used to be supported before the e2e test refactor. The fact that it is not anymore can be considered a regression.

repo: GoogleCloudPlatform/prometheus-engine


text:
Spark Operator Installation Verification

Hi,
I'm trying to use the spark operator on a k8s local cluster. I'm running MiniKF, a Kubeflow local deployment that's running k8s 1.14; how can I verify if the spark operator is installed or not?
I tried to go with the Installation in the Quick Start Guide here: (https://github.com/GoogleCloudPlatform/spark-on-k8s-operator/blob/master/docs/quick-start-guide.md), but I get this error: create: failed to create: namespaces "spark-operator" not found.
Also tried to execute a sample spark job, I get error: unable to recognize "spark_test.yaml": no matches for kind "SparkApplication" in version "sparkoperator.k8s.io/v1beta1"
Can you please guide me here? Thanks a lot.

I was able to install, had to manually create the k8s namespace: "kubectl create namespace spark-operator" before the helm install command.
I was also able to submit a job using "kubectl apply -f ./spark-pi.yaml" getting sparkapplication.sparkoperator.k8s.io/pyspark-pi created.
Could you please advice on how to monitor and get info about the submitted jobs? Thanks.

You can run kubectl get sparkapplication <app name> -o=yaml or kubectl describe sparkapplication <app name> to check a submitted job.


text:
(job-exec) Terracurl limitations

Hello,
I find the use of Terracurl a little limiting. I have a case where I need to wait for the job to fully complete its work before creating another resource.
So instead I use the gcloud module like this (with --wait):
module "gcloud" {
  source  = "terraform-google-modules/gcloud/google"
  version = "~> 3.4"

  platform = "linux"

  create_cmd_entrypoint  = "gcloud"
  create_cmd_body        = "run jobs execute --project=<project_id> --region=<location> <job_name> --wait"

  depends_on = [ module.cloud_run_job ]
}

Is there any particular reason to use a direct HTTP request rather than the gcloud module, which seems to be better in terms of functionality and code simplicity?
Would you be interested in a merge request?

Hi @tanguynicolas  terracurl was specifically chosen as we didn't want to take dependency on gcloud being installed in the system that is executing TF

authors: bharathkkb tanguynicolas


text:
refactor(egen): Refactored the Autosxs check alignment against human preference data code as per template guidelines

Refactored all the cells according to the template notebook

List of updates:

Steps are re-organized based on the new template.
Renamed REGION as LOCATION
Included --quite argument in the pip install dependencies.
Removed IS_TESTING env variable
Included colab enterprise link and generalized code for "colab only" cells

REQUIRED: Fill out the below checklists or remove if irrelevant

If you are opening a PR for Official Notebooks under the notebooks/official folder, follow this mandatory checklist:

[x] Use the notebook template as a starting point.
[x] Follow the style and grammar rules outlined in the above notebook template.
[x] Verify the notebook runs successfully in Colab since the automated tests cannot guarantee this even when it passes.
[x] Passes all the required automated checks. You can locally test for formatting and linting with these instructions.
[ ] You have consulted with a tech writer to see if tech writer review is necessary. If so, the notebook has been reviewed by a tech writer, and they have approved it.
[ ] This notebook has been added to the CODEOWNERS file under the Official Notebooks section, pointing to the author or the author's team.
[x] The Jupyter notebook cleans up any artifacts it has created (datasets, ML models, endpoints, etc) so as not to eat up unnecessary resources.

/gcbrun

authors: gericdong rohith-egen

repo: GoogleCloudPlatform/vertex-ai-samples