text:
Config options for strong pullup on the ds248?

In the setup process for the ds248 there is no ability to set the config bit to use a strong pullup:
d.confReg = 0xe1 // standard-speed, no strong pullup, no powerdown, active pull-up
if opts.PassivePullup {
	d.confReg ^= 0x11
}

Is there a reason this does not exist or could I implement it as an exported option and make a PR?

The strong pull-up is not something that gets configured but something that gets turned on when it is needed. From the datasheet (ds2483 p.8):

The SPU bit is used to activate the strong pullup function
prior to a 1-Wire Write Byte or 1-Wire Single Bit
command. Strong pullup is commonly used with 1-Wire
EEPROM devices when copying scratchpad data to the
main memory or when performing a SHA computation
and with parasitically powered temperature sensors or
A/D converters.

See https://github.com/google/periph/blob/master/devices/ds248x/dev.go#L51-L57

Ah ok, I think I understand. Then is the issue in the DS18B20 code and its
inability to let me specify what pull-up type is sent to the DS248 one-wire
interface?
I’m trying to power that temperature sensor via parasitic power and without
a strong pull-up it will spew errors on temperature reads until, I assume,
it’s internal capacitor is full enough to do a conversion.
On Sat, Sep 23, 2017 at 8:56 AM Thorsten von Eicken <
notifications@github.com> wrote:

The strong pull-up is not something that gets configured but something
that gets turned on when it is needed. From the datasheet (ds2483 p.8):
The SPU bit is used to activate the strong pullup function
prior to a 1-Wire Write Byte or 1-Wire Single Bit
command. Strong pullup is commonly used with 1-Wire
EEPROM devices when copying scratchpad data to the
main memory or when performing a SHA computation
and with parasitically powered temperature sensors or
A/D converters.
See
https://github.com/google/periph/blob/master/devices/ds248x/dev.go#L51-L57
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/google/periph/issues/163#issuecomment-331640877, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAFev1WMu7r35Zwenc2xN-qF09gElBsZks5slRwxgaJpZM4PhcIx
.

The DS18B20 driver uses the strong pull-up: https://github.com/google/periph/blob/master/devices/ds18b20/ds18b20.go#L82-L84 and https://github.com/google/periph/blob/master/devices/ds18b20/ds18b20.go#L108
I have 14 parasitically powered DS18B20 on one DS2483 and they have been running fine with a read-out every second for over a year.

I'm not familiar with this device, is there any action item left here?

Closing due to inactivity. Please reopen if there's still an action item.

authors: justonia maruel tve

repo: google/periph


text:
Feature/mimetype

Fix for #1946

Thanks for the feedback @TheModMaker
I have made the requested changes

source: gharchive/pull-request

repo: google/shaka-player

license_type: permissive

license_source: github-api


text:
Consider not clobbering System

Would it be possible to add a conditional check when writing to global.System, and only writing to it only if it does not already exist?

Can you say more about your circumstances?
We install traceur by defining a boot-loading System then we call System.register() to load our own modules and finally load a root module to execute the modules.   During the execute phase we overwrite System depending on the platform.  What part do you want to take over?

SystemJS imports Traceur when needed via System.import('traceur'). The result of this call is that the System global is reassigned, which means special wrapper code like https://github.com/systemjs/systemjs/blob/master/lib/extension-es6.js#L95 has to be written to revert the System global.
Happy to provide a PR if it is worth considering.

I prefer to avoid hogging System, but I'm not sure there is a simple fix.

I agree that we should fix this.
Can we could conditionally override System if it does not have the methods we need?

I believe the only code that affects @guybedford now is
global.System = {
    register: ModuleStore.register.bind(ModuleStore),
    registerModule: ModuleStore.registerModule.bind(ModuleStore),
    get: ModuleStore.get,
    set: ModuleStore.set,
    normalize: ModuleStore.normalize,
  };

But I also guess that he is not planning to load traceur into SystemJS?  That is, he doesn't implement regsiterModule() (and we can't compile to register()).  So if we skip the above assignment if System exists, then traceur does not load.
One solution is to change traceur's bootloader name to eg ModuleStore.  We would generate code to ModuleStore.registerModule() and ModuleStore.get(). That much is ok since the boot strap is all internal anyway. But then we have to generate different code for bootstrap and regular, working against the self-hosting goal.
If we could compile with instantitate then systemjs would be able to load traceur and we could have ModuleStore not overwrite System.

Thanks for considering this. If it's possible to change the System references to be locally scoped to Traceur's implementation of System, which may or may not be assigned to the global, then there'd be nothing wrong with self-hosting on System.
Compiling to instantiate would also work though, although may not be preferable as it imposes its naming assumtions in the loader registry.

I've just hit up against this again as part of separating Traceur loading in SystemJS out into a plugin.
The bootstrap module output of Traceur seems to look like:
(function(global)
// ...
global.System = { registerModule: ... }
})(...);
System.registerModule('x', ...)
// ...

I can deal with the overwriting of global.System by reverting the global after execution, but the other problem then is that the System reference is SystemJS instead of the Traceur registration object.
Ideally a bootstrap build that is self-contained should contain self-contained references I think (in the same way SystemJS builds distinguish between bundles and sfx builds).
For example, if the output looked like:
(function(global)
// ...
global.System = { registerModule: ... }
})(...)
(function(System) {
System.registerModule('x', ...)
// ...
})(global.System);

then the references would work out fine. Let me know if that makes sense.

I'm on a slow path to making the runtime smaller and one thing I want to do is to pull out System from the runtime (or at least make it configurable).
Your refactoring seems like an improvement because then you could change global.System afterwards without affecting Traceur's bootstrap. But on the other hand the bootstrap should only happen once so changing global.System afterwards should not be a problem?

The specific issue is that when bundling in SystemJS we wrap the code in a System closure on execution, so that the bare System.registerModule will then always be referenced to SystemJS. That's why just ensuring it is properly scoped would fix this with a wrapper like the suggestion above.
I'm open to suggestions though. $traceurRuntime.System.registerModule would work too for example I believe.
Let me know your thoughts and I can look into a PR along these lines.

@arv just to bump this, is there any path forward here you can suggest? I would really like to be able to provide a Traceur plugin for SystemJS.

We could just replace System with $traceurRuntime.  I'll look at that after I get the 'no-modules' version working.

@guybedford Supporting SystemJS is high priority for us and we'll make sure things work for you.
I think we should provide a version of Traceur that does not provide its own System or loader since that is not needed when SystemJS is present.
One way to do that is to improve the --modules=inline output of Traceur and make that default for SystemJS builds.

@arv @johnjbarton sounds great, thank you so much.

source: gharchive/issue

authors: arv guybedford johnjbarton

repo: google/traceur-compiler

license_source: bigquery


text:
Add unit tests for notify.py

Description of the change
Adds unit tests for notify.py as it lacks any unit tests.
Applicable issues
None
Checklist

[x] All tests were successful.
[x] Unit tests added.

Nice, always glad to see more tests :).  Is this ready for review?

Nice, always glad to see more tests :). Is this ready for review?

I forgot about this PR, yes, let's review. I'll assign.

authors: aarontp hacktobeer

repo: google/turbinia


text:
Add features needed to support ring

This issue tracks work which will need to land before ring can take a dependency on zerocopy. See this comment for context.
I put up a prototype: https://github.com/briansmith/ring/pull/1693

[x] https://github.com/google/zerocopy/pull/434

This is needed to support the BitXorAssign trait, currently implemented here

[x] https://github.com/google/zerocopy/pull/183

transmute_ref! is needed to support reference transmutations between array types such as &[U32<BigEndian>; 4]  -> &[u8; 16], which are currently supported in ring with the ArrayEncoding::as_byte_array method

[ ] Determine whether zerocopy meet's ring's bar for performance and constant time guarantees (briansmith/ring#1693 (comment))
[ ] https://github.com/google/zerocopy/issues/438

Note that this is a breaking change; as of this writing, the most recent published version is 0.7.6, so I expect this will be released in 0.8.0

Previously, we tracked #254, but this comment implies we don't need it.
cc @briansmith

Add aligned byteorder types #254

This might be a blocker if the fact that byteorder types currently have no alignment requirement results in a performance regression

In ring, usually (ideally always) we already have a wrapper type like Nonce or Counter where we could do the alignment if we really need it. Ultimately we want everything to be aligned so that we can do 128-bit or 256-bit or 512-bit vector operations on the bytes, without any performance penalty, even on small chips like RISC-V. I don't think that aligning to 4 bytes for u32s or 8 bytes for u64s gets us to there.

Would it be practical to factor out the safe transmutation aspect of zerocopy from the rest of it? My understanding is that zerocopy is trying to do many things at once: (a) implementing safe transmutation by modeling what transmutations are safe within the type system, (b) zero-copy parsing of unaligned multi-byte data structures, (c) endian conversion and convenience methods on top of that. The recent endianness work was at least partly motivated by ring but what ring really needs is really (a). We don't do (b) at all and it looks like we'll have to do (c) ourselves eventually as zerocopy (reasonably) won't make the free-from-compiler-introduced-side-channel guarantees that we're aiming for. In some sense (c) is actually kind of a hazard that we'd need to guard against in ring.
(For webpki (X.509 certificate processing) we don't need any of this as X.509 uses ASN.1 which doesn't use fixed-length data structures that could be modeled by (b). For TLS (a) isn't needed but potentially (b) is useful at the record layer, which does use fixed-length structures very much like TCP/IP.)

Would it be practical to factor out the safe transmutation aspect of zerocopy from the rest of it? My understanding is that zerocopy is trying to do many things at once: (a) implementing safe transmutation by modeling what transmutations are safe within the type system, (b) zero-copy parsing of unaligned multi-byte data structures, (c) endian conversion and convenience methods on top of that. The recent endianness work was at least partly motivated by ring but what ring really needs is really (a). We don't do (b) at all and it looks like we'll have to do (c) ourselves eventually as zerocopy (reasonably) won't make the free-from-compiler-introduced-side-channel guarantees that we're aiming for. In some sense (c) is actually kind of a hazard that we'd need to guard against in ring.
(For webpki (X.509 certificate processing) we don't need any of this as X.509 uses ASN.1 which doesn't use fixed-length data structures that could be modeled by (b). For TLS (a) isn't needed but potentially (b) is useful at the record layer, which does use fixed-length structures very much like TCP/IP.)

Yeah I think this is a fairly accurate taxonomy of what zerocopy provides. The way it breaks down in my head is similar:

Analysis of types (ie, the custom derives provided by zerocopy-derive)
Various unsafe utilities that build on top of this analysis (the various methods in our unsafe traits, the Ref type, etc)
Nice-to-have utilities which don't require any unsafe

The former two buckets definitely belong in zerocopy, but the latter (which includes the byteorder module) might not.
For your purposes, perhaps you could fork the byteorder module? The advantage of having it in zerocopy is that you can use it without enabling the derive feature, and thus keep your crate dependencies small. If you were to fork it, you'd have to depend on zerocopy with the derive feature enabled. But if it's important to you to have your dependency on zerocopy be minimal in terms of how much heavy lifting it's doing for you, that'd be a viable approach.
The byteorder module is a bit convoluted because of its use of macros, but roughly speaking the core just looks like this:
#[derive(FromZeroes, FromBytes, AsBytes, Unaligned)]
#[repr(transparent)]
pub struct U32<O>([u8; 4], PhantomData<O>);

That's obviously something you could just do in ring (either be fully forking byteorder or just be reimplementing the bits you need by hand).

With recent refactorings to ring (one currently in progress) we should reevaluate what, if anything, needs to be added to zerocopy after we found that the endian stuff in ring could mostly be deleted. I think we may need to do more experiments in ring to see how we can statically guarantee panic-free-ness and safety with the help of zerocopy.

I think we may need to do more experiments in ring to see how we can statically guarantee panic-free-ness and safety with the help of zerocopy.

Can you say a bit more about which code paths you're referring to here? We've been exploring panic freedom, so I'd be curious to learn about new use cases.

authors: briansmith joshlf

repo: google/zerocopy


text:
Brotli OptimizeHuffmanForRle

Zopfli has the function OptimizeHuffmanForRle which is used to improve the compression of huffman trees. Brotli has an improved, but compatible version.
How to copy this function in zopfli?

I tried with libzopfli – works well. Size improvement is minimal, and about 2% speed improvement.
Apply this patch after replacement of OptimizeHuffmanForRle with OptimizeHuffmanCountsForRle.
diff -Naur zopfli/Makefile brotli/Makefile
--- zopfli/Makefile
+++ brotli/Makefile
@@ -1,7 +1,7 @@
 CC = gcc
 CXX = g++

-CFLAGS = -W -Wall -Wextra -ansi -pedantic -lm -O2
+CFLAGS = -W -Wall -Wextra -ansi -pedantic -lm -O2 -std=c99
 CXXFLAGS = -W -Wall -Wextra -ansi -pedantic -O2

 ZOPFLILIB_SRC = src/zopfli/blocksplitter.c src/zopfli/cache.c\
diff -Naur zopfli/src/zopfli/deflate.c brotli/src/zopfli/deflate.c
--- zopfli/src/zopfli/deflate.c
+++ brotli/src/zopfli/deflate.c
@@ -396,13 +396,13 @@
 compression, especially its rle-part will be more likely to compress this data
 more efficiently. length containts the size of the histogram.
 */
-bool OptimizeHuffmanCountsForRle(size_t length, uint32_t* counts) {
+unsigned OptimizeHuffmanForRle(size_t length, size_t* counts) {
   size_t nonzero_count = 0;
   size_t stride;
   size_t limit;
   size_t sum;
   const size_t streak_limit = 1240;
-  uint8_t* good_for_rle;
+  unsigned char* good_for_rle;
   // Let's make the Huffman code more compatible with rle encoding.
   size_t i;
   for (i = 0; i < length; i++) {
@@ -422,7 +422,7 @@
   // Now counts[0..length - 1] does not have trailing zeros.
   {
     size_t nonzeros = 0;
-    uint32_t smallest_nonzero = 1 << 30;
+    size_t smallest_nonzero = 1 << 30;
     for (i = 0; i < length; ++i) {
       if (counts[i] != 0) {
         ++nonzeros;
@@ -451,7 +451,7 @@
   }
   // 2) Let's mark all population counts that already can be encoded
   // with an rle code.
-  good_for_rle = (uint8_t*)calloc(length, 1);
+  good_for_rle = (unsigned char*)calloc(length, 1);
   if (good_for_rle == NULL) {
     return 0;
   }
@@ -459,7 +459,7 @@
     // Let's not spoil any of the existing good rle codes.
     // Mark any seq of 0's that is longer as 5 as a good_for_rle.
     // Mark any seq of non-0's that is longer as 7 as a good_for_rle.
-    uint32_t symbol = counts[0];
+    size_t symbol = counts[0];
     size_t step = 0;
     for (i = 0; i <= length; ++i) {
       if (i == length || counts[i] != symbol) {
@@ -502,7 +502,7 @@
         for (k = 0; k < stride; ++k) {
           // We don't want to change value at counts[i],
           // that is already belonging to the next stride. Thus - 1.
-          counts[i - k - 1] = static_cast<uint32_t>(count);
+          counts[i - k - 1] = count;
         }
       }
       stride = 0;

Good afternoon!
I thank for the help. You couldn't send the ready zopfli version with a patch. At me it is impossible to apply it.

@lorents17 You may test https://github.com/MegaByte/zopfli/tree/brotli_huffman

thank you very much!

authors: MegaByte lorents17 pdknsk

repo: google/zopfli


text:
ReportDownloadE rror.ERROR_WRITING_REPORT_TO_FILE

Hi ,
We suddenly are getting the below error:
HTTP Response Code: 500, Trigger: Unable to create report, Type: ReportDownloadE
rror.ERROR_WRITING_REPORT_TO_FILE

Hi,
Based on the error you mentioned, this appears to be an issue with the AdWords API. Since this issues list is for a different API (the Google Ads API) and it does not appear to be a problem with the library, please post your question to the AdWords API Forum instead:
https://groups.google.com/forum/#!forum/adwords-api
Thanks,
Josh, Google Ads API Team

authors: jradcliff mofa

repo: googleads/google-ads-java


text:
remove the hash from the ignoreUrls in docs

Hello, the docs for ignoreUrls have a mysterious hash that me and my team think may be a mistake in the docs. I have updated it to prevent others from having the same discussion.
... or maybe is has some mysterious power we can't figure out?

I signed it!

repo: googleapis/cloud-trace-nodejs


text:
Synthesis failed for AdSense

Hello! Autosynth couldn't regenerate AdSense. :broken_heart:
Here's the output from running synth.py:
 failed to remove deps/parse_trans/ebin/parse_trans.app: Permission denied
warning: failed to remove deps/parse_trans/ebin/parse_trans_mod.beam: Permission denied
warning: failed to remove deps/parse_trans/ebin/parse_trans_codegen.beam: Permission denied
warning: failed to remove deps/parse_trans/ebin/ct_expand.beam: Permission denied
warning: failed to remove deps/parse_trans/ebin/parse_trans.beam: Permission denied
warning: failed to remove deps/parse_trans/ebin/exprecs.beam: Permission denied
warning: failed to remove deps/parse_trans/ebin/parse_trans_pp.beam: Permission denied
warning: failed to remove deps/parse_trans/.rebar3/erlcinfo: Permission denied
warning: failed to remove deps/parse_trans/hex_metadata.config: Permission denied
warning: failed to remove deps/parse_trans/README.md: Permission denied
warning: failed to remove deps/parse_trans/rebar.config: Permission denied
warning: failed to remove deps/parse_trans/include/codegen.hrl: Permission denied
warning: failed to remove deps/parse_trans/include/exprecs.hrl: Permission denied
warning: failed to remove deps/parse_trans/.fetch: Permission denied
warning: failed to remove deps/parse_trans/.hex: Permission denied
warning: failed to remove deps/idna/LICENSE: Permission denied
warning: failed to remove deps/idna/rebar.lock: Permission denied
warning: failed to remove deps/idna/src/idna.erl: Permission denied
warning: failed to remove deps/idna/src/idna_logger.hrl: Permission denied
warning: failed to remove deps/idna/src/idna_ucs.erl: Permission denied
warning: failed to remove deps/idna/src/punycode.erl: Permission denied
warning: failed to remove deps/idna/src/idna_table.erl: Permission denied
warning: failed to remove deps/idna/src/idna_context.erl: Permission denied
warning: failed to remove deps/idna/src/idna.app.src: Permission denied
warning: failed to remove deps/idna/src/idna_mapping.erl: Permission denied
warning: failed to remove deps/idna/src/idna_data.erl: Permission denied
warning: failed to remove deps/idna/src/idna_bidi.erl: Permission denied
warning: failed to remove deps/idna/ebin/idna_mapping.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna_context.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna_bidi.beam: Permission denied
warning: failed to remove deps/idna/ebin/punycode.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna_table.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna_data.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna_ucs.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna.app: Permission denied
warning: failed to remove deps/idna/ebin/idna.beam: Permission denied
warning: failed to remove deps/idna/.rebar3/erlcinfo: Permission denied
warning: failed to remove deps/idna/hex_metadata.config: Permission denied
warning: failed to remove deps/idna/README.md: Permission denied
warning: failed to remove deps/idna/rebar.config: Permission denied
warning: failed to remove deps/idna/.fetch: Permission denied
warning: failed to remove deps/idna/rebar.config.script: Permission denied
warning: failed to remove deps/idna/.hex: Permission denied
warning: failed to remove deps/hackney/MAINTAINERS: Permission denied
warning: failed to remove deps/hackney/LICENSE: Permission denied
warning: failed to remove deps/hackney/rebar.lock: Permission denied
warning: failed to remove deps/hackney/src/hackney_ssl.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_response.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_tcp.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_http.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_cookie.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_url.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_headers.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney.app.src: Permission denied
warning: failed to remove deps/hackney/src/hackney_pool_handler.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_trace.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_multipart.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_headers_new.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_http_connect.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_util.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_socks5.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_request.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_app.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_internal.hrl: Permission denied
warning: failed to remove deps/hackney/src/hackney_date.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_manager.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_connect.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_bstr.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_sup.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_local_tcp.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_stream.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_pool.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_metrics.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_methods.hrl: Permission denied
warning: failed to remove deps/hackney/NOTICE: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_pool.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_trace.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_pool_handler.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_headers.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_url.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_manager.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_metrics.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_stream.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_sup.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_multipart.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_http.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_socks5.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_app.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_http_connect.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_response.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney.app: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_headers_new.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_cookie.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_request.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_util.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_connect.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_date.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_ssl.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_bstr.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_tcp.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_local_tcp.beam: Permission denied
warning: failed to remove deps/hackney/.rebar3/erlcinfo: Permission denied
warning: failed to remove deps/hackney/hex_metadata.config: Permission denied
warning: failed to remove deps/hackney/README.md: Permission denied
warning: failed to remove deps/hackney/rebar.config: Permission denied
warning: failed to remove deps/hackney/include/hackney.hrl: Permission denied
warning: failed to remove deps/hackney/include/hackney_lib.hrl: Permission denied
warning: failed to remove deps/hackney/.fetch: Permission denied
warning: failed to remove deps/hackney/.hex: Permission denied
warning: failed to remove deps/hackney/NEWS.md: Permission denied
Removing __pycache__/
Removing specifications/gdd/AdSense-v1.4.json
Traceback (most recent call last):
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 559, in _inner_main
    sys.exit(EXIT_CODE_SKIPPED)
SystemExit: 28

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 615, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 476, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 611, in _inner_main
    executor.check_call(["git", "clean", "-fdx"], cwd=working_repo_path)
  File "/tmpfs/src/github/synthtool/autosynth/executor.py", line 29, in check_call
    subprocess.check_call(command, **args)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 311, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['git', 'clean', '-fdx']' returned non-zero exit status 1.

Google internal developers can see the full log here.

Autosynth is still having trouble generating AdSense. :sob:
Here's the output from running synth.py:
 failed to remove deps/parse_trans/ebin/parse_trans.app: Permission denied
warning: failed to remove deps/parse_trans/ebin/parse_trans_mod.beam: Permission denied
warning: failed to remove deps/parse_trans/ebin/parse_trans_codegen.beam: Permission denied
warning: failed to remove deps/parse_trans/ebin/ct_expand.beam: Permission denied
warning: failed to remove deps/parse_trans/ebin/parse_trans.beam: Permission denied
warning: failed to remove deps/parse_trans/ebin/exprecs.beam: Permission denied
warning: failed to remove deps/parse_trans/ebin/parse_trans_pp.beam: Permission denied
warning: failed to remove deps/parse_trans/.rebar3/erlcinfo: Permission denied
warning: failed to remove deps/parse_trans/hex_metadata.config: Permission denied
warning: failed to remove deps/parse_trans/README.md: Permission denied
warning: failed to remove deps/parse_trans/rebar.config: Permission denied
warning: failed to remove deps/parse_trans/include/codegen.hrl: Permission denied
warning: failed to remove deps/parse_trans/include/exprecs.hrl: Permission denied
warning: failed to remove deps/parse_trans/.fetch: Permission denied
warning: failed to remove deps/parse_trans/.hex: Permission denied
warning: failed to remove deps/idna/LICENSE: Permission denied
warning: failed to remove deps/idna/rebar.lock: Permission denied
warning: failed to remove deps/idna/src/idna.erl: Permission denied
warning: failed to remove deps/idna/src/idna_logger.hrl: Permission denied
warning: failed to remove deps/idna/src/idna_ucs.erl: Permission denied
warning: failed to remove deps/idna/src/punycode.erl: Permission denied
warning: failed to remove deps/idna/src/idna_table.erl: Permission denied
warning: failed to remove deps/idna/src/idna_context.erl: Permission denied
warning: failed to remove deps/idna/src/idna.app.src: Permission denied
warning: failed to remove deps/idna/src/idna_mapping.erl: Permission denied
warning: failed to remove deps/idna/src/idna_data.erl: Permission denied
warning: failed to remove deps/idna/src/idna_bidi.erl: Permission denied
warning: failed to remove deps/idna/ebin/idna_mapping.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna_context.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna_bidi.beam: Permission denied
warning: failed to remove deps/idna/ebin/punycode.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna_table.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna_data.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna_ucs.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna.app: Permission denied
warning: failed to remove deps/idna/ebin/idna.beam: Permission denied
warning: failed to remove deps/idna/.rebar3/erlcinfo: Permission denied
warning: failed to remove deps/idna/hex_metadata.config: Permission denied
warning: failed to remove deps/idna/README.md: Permission denied
warning: failed to remove deps/idna/rebar.config: Permission denied
warning: failed to remove deps/idna/.fetch: Permission denied
warning: failed to remove deps/idna/rebar.config.script: Permission denied
warning: failed to remove deps/idna/.hex: Permission denied
warning: failed to remove deps/hackney/MAINTAINERS: Permission denied
warning: failed to remove deps/hackney/LICENSE: Permission denied
warning: failed to remove deps/hackney/rebar.lock: Permission denied
warning: failed to remove deps/hackney/src/hackney_ssl.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_response.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_tcp.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_http.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_cookie.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_url.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_headers.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney.app.src: Permission denied
warning: failed to remove deps/hackney/src/hackney_pool_handler.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_trace.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_multipart.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_headers_new.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_http_connect.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_util.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_socks5.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_request.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_app.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_internal.hrl: Permission denied
warning: failed to remove deps/hackney/src/hackney_date.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_manager.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_connect.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_bstr.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_sup.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_local_tcp.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_stream.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_pool.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_metrics.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_methods.hrl: Permission denied
warning: failed to remove deps/hackney/NOTICE: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_pool.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_trace.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_pool_handler.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_headers.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_url.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_manager.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_metrics.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_stream.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_sup.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_multipart.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_http.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_socks5.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_app.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_http_connect.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_response.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney.app: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_headers_new.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_cookie.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_request.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_util.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_connect.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_date.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_ssl.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_bstr.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_tcp.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_local_tcp.beam: Permission denied
warning: failed to remove deps/hackney/.rebar3/erlcinfo: Permission denied
warning: failed to remove deps/hackney/hex_metadata.config: Permission denied
warning: failed to remove deps/hackney/README.md: Permission denied
warning: failed to remove deps/hackney/rebar.config: Permission denied
warning: failed to remove deps/hackney/include/hackney.hrl: Permission denied
warning: failed to remove deps/hackney/include/hackney_lib.hrl: Permission denied
warning: failed to remove deps/hackney/.fetch: Permission denied
warning: failed to remove deps/hackney/.hex: Permission denied
warning: failed to remove deps/hackney/NEWS.md: Permission denied
Removing __pycache__/
Removing specifications/gdd/AdSense-v1.4.json
Traceback (most recent call last):
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 559, in _inner_main
    sys.exit(EXIT_CODE_SKIPPED)
SystemExit: 28

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 615, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 476, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 611, in _inner_main
    executor.check_call(["git", "clean", "-fdx"], cwd=working_repo_path)
  File "/tmpfs/src/github/synthtool/autosynth/executor.py", line 29, in check_call
    subprocess.check_call(command, **args)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 311, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['git', 'clean', '-fdx']' returned non-zero exit status 1.

Google internal developers can see the full log here.

Autosynth is still having trouble generating AdSense. :sob:
Here's the output from running synth.py:
 failed to remove deps/parse_trans/ebin/parse_trans.app: Permission denied
warning: failed to remove deps/parse_trans/ebin/parse_trans_mod.beam: Permission denied
warning: failed to remove deps/parse_trans/ebin/parse_trans_codegen.beam: Permission denied
warning: failed to remove deps/parse_trans/ebin/ct_expand.beam: Permission denied
warning: failed to remove deps/parse_trans/ebin/parse_trans.beam: Permission denied
warning: failed to remove deps/parse_trans/ebin/exprecs.beam: Permission denied
warning: failed to remove deps/parse_trans/ebin/parse_trans_pp.beam: Permission denied
warning: failed to remove deps/parse_trans/.rebar3/erlcinfo: Permission denied
warning: failed to remove deps/parse_trans/hex_metadata.config: Permission denied
warning: failed to remove deps/parse_trans/README.md: Permission denied
warning: failed to remove deps/parse_trans/rebar.config: Permission denied
warning: failed to remove deps/parse_trans/include/codegen.hrl: Permission denied
warning: failed to remove deps/parse_trans/include/exprecs.hrl: Permission denied
warning: failed to remove deps/parse_trans/.fetch: Permission denied
warning: failed to remove deps/parse_trans/.hex: Permission denied
warning: failed to remove deps/idna/LICENSE: Permission denied
warning: failed to remove deps/idna/rebar.lock: Permission denied
warning: failed to remove deps/idna/src/idna.erl: Permission denied
warning: failed to remove deps/idna/src/idna_logger.hrl: Permission denied
warning: failed to remove deps/idna/src/idna_ucs.erl: Permission denied
warning: failed to remove deps/idna/src/punycode.erl: Permission denied
warning: failed to remove deps/idna/src/idna_table.erl: Permission denied
warning: failed to remove deps/idna/src/idna_context.erl: Permission denied
warning: failed to remove deps/idna/src/idna.app.src: Permission denied
warning: failed to remove deps/idna/src/idna_mapping.erl: Permission denied
warning: failed to remove deps/idna/src/idna_data.erl: Permission denied
warning: failed to remove deps/idna/src/idna_bidi.erl: Permission denied
warning: failed to remove deps/idna/ebin/idna_mapping.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna_context.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna_bidi.beam: Permission denied
warning: failed to remove deps/idna/ebin/punycode.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna_table.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna_data.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna_ucs.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna.app: Permission denied
warning: failed to remove deps/idna/ebin/idna.beam: Permission denied
warning: failed to remove deps/idna/.rebar3/erlcinfo: Permission denied
warning: failed to remove deps/idna/hex_metadata.config: Permission denied
warning: failed to remove deps/idna/README.md: Permission denied
warning: failed to remove deps/idna/rebar.config: Permission denied
warning: failed to remove deps/idna/.fetch: Permission denied
warning: failed to remove deps/idna/rebar.config.script: Permission denied
warning: failed to remove deps/idna/.hex: Permission denied
warning: failed to remove deps/hackney/MAINTAINERS: Permission denied
warning: failed to remove deps/hackney/LICENSE: Permission denied
warning: failed to remove deps/hackney/rebar.lock: Permission denied
warning: failed to remove deps/hackney/src/hackney_ssl.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_response.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_tcp.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_http.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_cookie.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_url.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_headers.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney.app.src: Permission denied
warning: failed to remove deps/hackney/src/hackney_pool_handler.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_trace.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_multipart.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_headers_new.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_http_connect.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_util.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_socks5.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_request.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_app.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_internal.hrl: Permission denied
warning: failed to remove deps/hackney/src/hackney_date.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_manager.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_connect.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_bstr.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_sup.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_local_tcp.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_stream.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_pool.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_metrics.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_methods.hrl: Permission denied
warning: failed to remove deps/hackney/NOTICE: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_pool.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_trace.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_pool_handler.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_headers.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_url.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_manager.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_metrics.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_stream.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_sup.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_multipart.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_http.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_socks5.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_app.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_http_connect.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_response.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney.app: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_headers_new.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_cookie.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_request.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_util.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_connect.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_date.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_ssl.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_bstr.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_tcp.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_local_tcp.beam: Permission denied
warning: failed to remove deps/hackney/.rebar3/erlcinfo: Permission denied
warning: failed to remove deps/hackney/hex_metadata.config: Permission denied
warning: failed to remove deps/hackney/README.md: Permission denied
warning: failed to remove deps/hackney/rebar.config: Permission denied
warning: failed to remove deps/hackney/include/hackney.hrl: Permission denied
warning: failed to remove deps/hackney/include/hackney_lib.hrl: Permission denied
warning: failed to remove deps/hackney/.fetch: Permission denied
warning: failed to remove deps/hackney/.hex: Permission denied
warning: failed to remove deps/hackney/NEWS.md: Permission denied
Removing __pycache__/
Removing specifications/gdd/AdSense-v1.4.json
Traceback (most recent call last):
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 559, in _inner_main
    sys.exit(EXIT_CODE_SKIPPED)
SystemExit: 28

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 615, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 476, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 611, in _inner_main
    executor.check_call(["git", "clean", "-fdx"], cwd=working_repo_path)
  File "/tmpfs/src/github/synthtool/autosynth/executor.py", line 29, in check_call
    subprocess.check_call(command, **args)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 311, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['git', 'clean', '-fdx']' returned non-zero exit status 1.

Google internal developers can see the full log here.

Autosynth is still having trouble generating AdSense. :sob:
Here's the output from running synth.py:
 failed to remove deps/parse_trans/ebin/parse_trans.app: Permission denied
warning: failed to remove deps/parse_trans/ebin/parse_trans_mod.beam: Permission denied
warning: failed to remove deps/parse_trans/ebin/parse_trans_codegen.beam: Permission denied
warning: failed to remove deps/parse_trans/ebin/ct_expand.beam: Permission denied
warning: failed to remove deps/parse_trans/ebin/parse_trans.beam: Permission denied
warning: failed to remove deps/parse_trans/ebin/exprecs.beam: Permission denied
warning: failed to remove deps/parse_trans/ebin/parse_trans_pp.beam: Permission denied
warning: failed to remove deps/parse_trans/.rebar3/erlcinfo: Permission denied
warning: failed to remove deps/parse_trans/hex_metadata.config: Permission denied
warning: failed to remove deps/parse_trans/README.md: Permission denied
warning: failed to remove deps/parse_trans/rebar.config: Permission denied
warning: failed to remove deps/parse_trans/include/codegen.hrl: Permission denied
warning: failed to remove deps/parse_trans/include/exprecs.hrl: Permission denied
warning: failed to remove deps/parse_trans/.fetch: Permission denied
warning: failed to remove deps/parse_trans/.hex: Permission denied
warning: failed to remove deps/idna/LICENSE: Permission denied
warning: failed to remove deps/idna/rebar.lock: Permission denied
warning: failed to remove deps/idna/src/idna.erl: Permission denied
warning: failed to remove deps/idna/src/idna_logger.hrl: Permission denied
warning: failed to remove deps/idna/src/idna_ucs.erl: Permission denied
warning: failed to remove deps/idna/src/punycode.erl: Permission denied
warning: failed to remove deps/idna/src/idna_table.erl: Permission denied
warning: failed to remove deps/idna/src/idna_context.erl: Permission denied
warning: failed to remove deps/idna/src/idna.app.src: Permission denied
warning: failed to remove deps/idna/src/idna_mapping.erl: Permission denied
warning: failed to remove deps/idna/src/idna_data.erl: Permission denied
warning: failed to remove deps/idna/src/idna_bidi.erl: Permission denied
warning: failed to remove deps/idna/ebin/idna_mapping.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna_context.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna_bidi.beam: Permission denied
warning: failed to remove deps/idna/ebin/punycode.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna_table.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna_data.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna_ucs.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna.app: Permission denied
warning: failed to remove deps/idna/ebin/idna.beam: Permission denied
warning: failed to remove deps/idna/.rebar3/erlcinfo: Permission denied
warning: failed to remove deps/idna/hex_metadata.config: Permission denied
warning: failed to remove deps/idna/README.md: Permission denied
warning: failed to remove deps/idna/rebar.config: Permission denied
warning: failed to remove deps/idna/.fetch: Permission denied
warning: failed to remove deps/idna/rebar.config.script: Permission denied
warning: failed to remove deps/idna/.hex: Permission denied
warning: failed to remove deps/hackney/MAINTAINERS: Permission denied
warning: failed to remove deps/hackney/LICENSE: Permission denied
warning: failed to remove deps/hackney/rebar.lock: Permission denied
warning: failed to remove deps/hackney/src/hackney_ssl.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_response.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_tcp.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_http.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_cookie.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_url.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_headers.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney.app.src: Permission denied
warning: failed to remove deps/hackney/src/hackney_pool_handler.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_trace.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_multipart.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_headers_new.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_http_connect.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_util.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_socks5.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_request.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_app.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_internal.hrl: Permission denied
warning: failed to remove deps/hackney/src/hackney_date.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_manager.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_connect.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_bstr.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_sup.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_local_tcp.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_stream.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_pool.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_metrics.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_methods.hrl: Permission denied
warning: failed to remove deps/hackney/NOTICE: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_pool.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_trace.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_pool_handler.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_headers.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_url.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_manager.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_metrics.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_stream.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_sup.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_multipart.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_http.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_socks5.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_app.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_http_connect.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_response.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney.app: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_headers_new.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_cookie.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_request.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_util.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_connect.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_date.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_ssl.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_bstr.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_tcp.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_local_tcp.beam: Permission denied
warning: failed to remove deps/hackney/.rebar3/erlcinfo: Permission denied
warning: failed to remove deps/hackney/hex_metadata.config: Permission denied
warning: failed to remove deps/hackney/README.md: Permission denied
warning: failed to remove deps/hackney/rebar.config: Permission denied
warning: failed to remove deps/hackney/include/hackney.hrl: Permission denied
warning: failed to remove deps/hackney/include/hackney_lib.hrl: Permission denied
warning: failed to remove deps/hackney/.fetch: Permission denied
warning: failed to remove deps/hackney/.hex: Permission denied
warning: failed to remove deps/hackney/NEWS.md: Permission denied
Removing __pycache__/
Removing specifications/gdd/AdSense-v1.4.json
Traceback (most recent call last):
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 559, in _inner_main
    sys.exit(EXIT_CODE_SKIPPED)
SystemExit: 28

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 615, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 476, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 611, in _inner_main
    executor.check_call(["git", "clean", "-fdx"], cwd=working_repo_path)
  File "/tmpfs/src/github/synthtool/autosynth/executor.py", line 29, in check_call
    subprocess.check_call(command, **args)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 311, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['git', 'clean', '-fdx']' returned non-zero exit status 1.

Google internal developers can see the full log here.

Autosynth is still having trouble generating AdSense. :sob:
Here's the output from running synth.py:
 failed to remove deps/parse_trans/ebin/parse_trans.app: Permission denied
warning: failed to remove deps/parse_trans/ebin/parse_trans_mod.beam: Permission denied
warning: failed to remove deps/parse_trans/ebin/parse_trans_codegen.beam: Permission denied
warning: failed to remove deps/parse_trans/ebin/ct_expand.beam: Permission denied
warning: failed to remove deps/parse_trans/ebin/parse_trans.beam: Permission denied
warning: failed to remove deps/parse_trans/ebin/exprecs.beam: Permission denied
warning: failed to remove deps/parse_trans/ebin/parse_trans_pp.beam: Permission denied
warning: failed to remove deps/parse_trans/.rebar3/erlcinfo: Permission denied
warning: failed to remove deps/parse_trans/hex_metadata.config: Permission denied
warning: failed to remove deps/parse_trans/README.md: Permission denied
warning: failed to remove deps/parse_trans/rebar.config: Permission denied
warning: failed to remove deps/parse_trans/include/codegen.hrl: Permission denied
warning: failed to remove deps/parse_trans/include/exprecs.hrl: Permission denied
warning: failed to remove deps/parse_trans/.fetch: Permission denied
warning: failed to remove deps/parse_trans/.hex: Permission denied
warning: failed to remove deps/idna/LICENSE: Permission denied
warning: failed to remove deps/idna/rebar.lock: Permission denied
warning: failed to remove deps/idna/src/idna.erl: Permission denied
warning: failed to remove deps/idna/src/idna_logger.hrl: Permission denied
warning: failed to remove deps/idna/src/idna_ucs.erl: Permission denied
warning: failed to remove deps/idna/src/punycode.erl: Permission denied
warning: failed to remove deps/idna/src/idna_table.erl: Permission denied
warning: failed to remove deps/idna/src/idna_context.erl: Permission denied
warning: failed to remove deps/idna/src/idna.app.src: Permission denied
warning: failed to remove deps/idna/src/idna_mapping.erl: Permission denied
warning: failed to remove deps/idna/src/idna_data.erl: Permission denied
warning: failed to remove deps/idna/src/idna_bidi.erl: Permission denied
warning: failed to remove deps/idna/ebin/idna_mapping.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna_context.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna_bidi.beam: Permission denied
warning: failed to remove deps/idna/ebin/punycode.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna_table.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna_data.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna_ucs.beam: Permission denied
warning: failed to remove deps/idna/ebin/idna.app: Permission denied
warning: failed to remove deps/idna/ebin/idna.beam: Permission denied
warning: failed to remove deps/idna/.rebar3/erlcinfo: Permission denied
warning: failed to remove deps/idna/hex_metadata.config: Permission denied
warning: failed to remove deps/idna/README.md: Permission denied
warning: failed to remove deps/idna/rebar.config: Permission denied
warning: failed to remove deps/idna/.fetch: Permission denied
warning: failed to remove deps/idna/rebar.config.script: Permission denied
warning: failed to remove deps/idna/.hex: Permission denied
warning: failed to remove deps/hackney/MAINTAINERS: Permission denied
warning: failed to remove deps/hackney/LICENSE: Permission denied
warning: failed to remove deps/hackney/rebar.lock: Permission denied
warning: failed to remove deps/hackney/src/hackney_ssl.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_response.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_tcp.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_http.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_cookie.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_url.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_headers.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney.app.src: Permission denied
warning: failed to remove deps/hackney/src/hackney_pool_handler.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_trace.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_multipart.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_headers_new.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_http_connect.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_util.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_socks5.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_request.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_app.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_internal.hrl: Permission denied
warning: failed to remove deps/hackney/src/hackney_date.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_manager.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_connect.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_bstr.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_sup.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_local_tcp.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_stream.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_pool.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_metrics.erl: Permission denied
warning: failed to remove deps/hackney/src/hackney_methods.hrl: Permission denied
warning: failed to remove deps/hackney/NOTICE: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_pool.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_trace.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_pool_handler.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_headers.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_url.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_manager.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_metrics.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_stream.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_sup.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_multipart.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_http.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_socks5.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_app.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_http_connect.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_response.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney.app: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_headers_new.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_cookie.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_request.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_util.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_connect.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_date.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_ssl.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_bstr.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_tcp.beam: Permission denied
warning: failed to remove deps/hackney/ebin/hackney_local_tcp.beam: Permission denied
warning: failed to remove deps/hackney/.rebar3/erlcinfo: Permission denied
warning: failed to remove deps/hackney/hex_metadata.config: Permission denied
warning: failed to remove deps/hackney/README.md: Permission denied
warning: failed to remove deps/hackney/rebar.config: Permission denied
warning: failed to remove deps/hackney/include/hackney.hrl: Permission denied
warning: failed to remove deps/hackney/include/hackney_lib.hrl: Permission denied
warning: failed to remove deps/hackney/.fetch: Permission denied
warning: failed to remove deps/hackney/.hex: Permission denied
warning: failed to remove deps/hackney/NEWS.md: Permission denied
Removing __pycache__/
Removing specifications/gdd/AdSense-v1.4.json
Traceback (most recent call last):
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 559, in _inner_main
    sys.exit(EXIT_CODE_SKIPPED)
SystemExit: 28

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 615, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 476, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 611, in _inner_main
    executor.check_call(["git", "clean", "-fdx"], cwd=working_repo_path)
  File "/tmpfs/src/github/synthtool/autosynth/executor.py", line 29, in check_call
    subprocess.check_call(command, **args)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 311, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['git', 'clean', '-fdx']' returned non-zero exit status 1.

Google internal developers can see the full log here.

Autosynth passed, closing! :green_heart:

repo: googleapis/elixir-google-api


text:
Fix surface issues based on Java review.

Mark observer asyncCall private
Add boolean parameter for whether auto close channel
Return this from setGeneratedHeader/setClientLibHeader
Use Duration instead of long

PTAL

LGTM.

authors: garrettjonesgoogle shinfan

repo: googleapis/gax-java


text:
feat(bigquery): add migration service

Fixes #10021

This change is

PTAL

repo: googleapis/google-cloud-cpp


text:
chore(storage): fixed ctype=CORD workarounds url

Minor change to fix the urls pointing to the workaround.

This change is

/gcbrun

Thanks!

authors: coryan dbolduc sachinpro


text:
Release Google.Cloud.DiscoveryEngine.V1Beta version 1.0.0-beta08

Changes in this release:
New features

Supported bring your own embedding feature (commit d6f6676)
Added more options for search extractive content support (commit d6f6676)
Added more skip reasons and details for search summarization (commit d6f6676)
Added query expansion details in search response (commit d6f6676)
Updated summarization interface for multi-turn search (commit d6f6676)
Allow uri in user events (commit d6f6676)

Documentation improvements

Keep the API doc up-to-date with recent changes (commit d6f6676)

Created release for Google.Cloud.DiscoveryEngine.V1Beta-1.0.0-beta08

authors: jskeet yoshi-automation

repo: googleapis/google-cloud-dotnet


text:
Regenerate compute client

This PR was generated using Autosynth. :rainbow:
Here's the log from Synthtool:
synthtool > Executing /tmpfs/src/git/autosynth/working_repo/google-cloud-clients/google-cloud-compute/synth.py.
synthtool > Cloning discovery-artifact-manager.
synthtool > Running generator for gapic/google/compute/artman_compute.yaml.
synthtool > Ensuring dependencies.
synthtool > Pulling artman image.
latest: Pulling from googleapis/artman
Digest: sha256:9aed6bbde54e26d2fcde7aa86d9f64c0278f741e58808c46573e488cbf6098f0
Status: Image is up to date for googleapis/artman:latest
synthtool > Generated code into /home/kbuilder/.cache/synthtool/discovery-artifact-manager/artman-genfiles/java.
synthtool > Running java formatter on 1456 files
synthtool > Cleaned up 0 temporary directories.
synthtool > Wrote metadata to synth.metadata.

Combined into a single pull request #5850

repo: googleapis/google-cloud-java


text:
chore: builds with 4 threads

Fixes #<issue_number_goes_here> (it's a good idea to open an issue first for context and/or discussion)

pull request 7895 and Fusion 1394f5293ab74b75680155836fb792aac79d904e
Took 29:03 minutes


text:
chore: Migrate container synth.py to bazel

The changes in grpc stubs are caused by the gRPC upgrade from 1.10 (more than a year old) to 1.27 (same version which is used as runtime dependency)

@chingor13 PTAL

repo: googleapis/java-container


text:
Não é possível utilizar juntamente com o Firestore no Android

Tenho um app que utiliza da biblioteca do Firestore e também precisa utilizar a do DialogFlow, até o momento estou utilizando a biblioteca V1 e não enfrento quaisquer problemas, porém, como a V1 do DialogFlow vai ser encerrada em breve, preciso migrar para a V2. Em minhas tentativas de utilizar esta biblioteca juntamente com o Firestore, enfrento problemas de duplicação de classes.
O problema deve-se a que esta lib usa de  protobuf-java e a do firestore, protobuf-lite, ambas fornecem as mesmas classes com implementações diferentes
Já verifiquei esse tópico que fala sobre, mas implementando a solução sugerida
configurations.all {           exclude group:'com.google.api.grpc',module:'proto-google-common-protos'           exclude group: 'com.google.protobuf', module: 'protobuf-java'           exclude group: 'com.google.guava',module: 'guava-jdk5'       }
Tenho o seguinte erro
Supertypes of the following classes cannot be resolved. Please make sure you have the required dependencies in the classpath:
    class com.google.cloud.dialogflow.v2beta1.QueryInput, unresolved supertypes: com.google.protobuf.GeneratedMessageV3
    class com.google.cloud.dialogflow.v2beta1.QueryInputOrBuilder, unresolved supertypes: com.google.protobuf.MessageOrBuilder
    class com.google.cloud.dialogflow.v2beta1.TextInput, unresolved supertypes: com.google.protobuf.GeneratedMessageV3
    class com.google.cloud.dialogflow.v2beta1.TextInputOrBuilder, unresolved supertypes: com.google.protobuf.MessageOrBuilder
    class com.google.cloud.dialogflow.v2beta1.TextInput.Builder, unresolved supertypes: com.google.protobuf.GeneratedMessageV3.Builder
    class com.google.cloud.dialogflow.v2beta1.QueryInput.Builder, unresolved supertypes: com.google.protobuf.GeneratedMessageV3.Builder
    class com.google.cloud.dialogflow.v2beta1.DetectIntentResponse, unresolved supertypes: com.google.protobuf.GeneratedMessageV3
    class com.google.cloud.dialogflow.v2beta1.DetectIntentResponseOrBuilder, unresolved supertypes: com.google.protobuf.MessageOrBuilder

Existe alguma solução para isso?

Here's a great workaround for those who can't wait for an official fix:
https://github.com/protocolbuffers/protobuf/issues/7094#issuecomment-586532060
The idea behind it is to 'fatjar' the proto artifacts in a sequence that overwrites classes that do not work well with firesbase firestore or inappmessaging.

This issue may no longer be relevant so I am closing it.

repo: googleapis/java-dialogflow


text:
chore: Temporarily disable gapic generation for gameservices

There are no plans to regenerate new versions of gameservices-v1alpha, that is why it was removed from synth.py. When v1 version is available, it will be added to synth.py (using bazel generation).

@chingor13 PTAL

repo: googleapis/java-gameservices


text:
Add a clearer explanation on utilizing Storage Write API

The Storage Write API usage for default streams is very unclear.
There are autogenerated examples and manually written ones in the repository such as this one, however it's unclear on how it's managed and barely got it to work using Typescript.
The Type class extracted from protobufjs is missing its declarations and inferencing when imported into a Typescript project, forcing to write it off as any as the method Type.fromDescriptor doesn't exist according to type declarations.
Later on, the streaming and request typings for sending the appended rows isn't clear either. There's barely any third-party resources out there that explain how to consume this API unless we're talking Python, Java or Go.
Could this (or someone willing) explain this better on how it works if possible? I know this pull request would change things and I'll be following it through.
I would provide my solution of using this API on Typescript once I actually make it work 😝

Closing as #366 has been merged, thanks!

repo: googleapis/nodejs-bigquery-storage


text:
[Question] Querying a subset of an embedded entity properties.

Let's say you save this entity:
  await datastore.save([{
    key: datastore.key(['TEST']);
    data: {
      emb: {
        name: 'first',
        value: 1,
      },
    },
  }]);

You can they run a query to retrieve that entity:
const [entities] = await datastore.createQuery('TEST').run();

// returns
[{
    emb: {
      name: 'first',
      value: 1,
    },
},]

That is expected.
Now if you select only some properties, the output format would be different:
const [entities] = await datastore.createQuery('TEST').select('emb.name').run();

// returns
[{
    "emb.name": 'first',
},]

I have not found any documentation about querying embedded entities so I am not sure if this is expected ?
Do you think it would be worth expanding the response to a partial object in the second case, ie
[{
    emb: {name": 'first'},
},]

This would make the client code consistent whether or not the query selects only a subset of the embedded property.
Note: this would have to be done on the client side.
When there is no select clause, the server returns:
Value Proto {
  meaning: ...,
  excludeFromIndexes: ...,
  entityValue: {
    properties: { name: [Object], value: [Object] },
    key: null
  },
  valueType: 'entityValue',
  propertyName: 'emb'
}

but when there is select, the server would return
Value Proto {
  meaning: 18,
  excludeFromIndexes: false,
  stringValue: 'first',
  valueType: 'stringValue',
  propertyName: 'emb.name'
}

Do you think it would be worth expanding the response to a partial object in the second case, ie
[{
    emb: {name": 'first'},
},]

This would make the client code consistent whether or not the query selects only a subset of the embedded property.

Sorry, I don't quite follow. It seems you are wondering if we should make a, likely breaking, change, to the way results are returned?

I think the current API is inconsistent:
const [entities] = await datastore.createQuery('TEST').run();

// returns
[{
    emb: {
       name": 'first',
       value: 1,
    },
},]

vs

const [entities] = await datastore.createQuery('TEST').select('emb.name').run();

// returns
[{
    "emb.name": 'first',
},]

That is the shape of the result depends on whether you have or not a select clause.
I can imagine multiple solution for it not to be a breaking change.

Add one option to return partial objects instead of path to the properties when there is a select clause.

Returns both form, i.e.

const [entities] = await datastore.createQuery('TEST').select('emb.name').run();

// *would* return
[{
    "emb.name": 'first',
    emb: {name: "first"},
},]

Okay, I think I understand. Going to restate to be sure though :)
Select, when selecting the mentioned field, returns the key as the select statement. In this case "emb.name".
You would prefer if the returned object was still nested as it is in the full object, even though it is a single field. And you are proposing that we could return it in both forms in the dict to allow users to use the existing way, as well as an additional way that would match the structure of the object without a select query.

Yep that is what I meant.

even though it is a single field

You can select multiple fields too in which case there will be {"emb.field1": value1, ..., "emb.fieldN": valueN}

I think this is a reasonable request. I did a quick compare with how this works in Python
Query projection: [<Entity('test', 'test_id') {'integer_column': 200}>]
Keys: dict_keys(['integer_column'])
Query no projection: [<Entity('test', 'test_id') {'integer_column': 200, 'field': 'field_value'}>]
Keys: dict_keys(['integer_column', 'field'])

It seems we keep it consistent there which points to there being a precedence for this. I think if we can do this in a non-breaking way I could be okay with this.
@bcoe can you weigh in from a more seasoned node perspective?

Hello! Has there been any movement on this issue?
I havent found a way to perform a projection query that returns an entire nested object yet. It becomes a quite tedious having to map a large deeply nested object from the selected fields back into the desired format.
If .select('emb') could return the entire object that could help and wouldnt be breaking. Im not sure if thats supported by Datastores API though.

authors: DustinJSilk crwilcox vicb

repo: googleapis/nodejs-datastore


text:
Updating the spec protos

Pulls in the latest file from https://github.com/GoogleCloudPlatform/google-cloud-common/blob/30710c621b2b2b1fdcb1d352ebb0b8cc63507260/testing/firestore/testdata/tests.binprotos

Out of curiosity, could we use a JSON representation of the protos or something for sane diagnosability of failures, etc.?

Out of curiosity, could we use a JSON representation of the protos or something for sane diagnosability of failures, etc.?

The original tests in Go use text-based Protos which are not natively supported by ProtobufJS. I tried to make them work but eventually gave up when I ran into encoding issues. Instead, these tests print the JSON representation to the console at the beginning of each run.

authors: mikelehen schmidt-sebastian

repo: googleapis/nodejs-firestore


text:
chore: update minor typo in documentation link

Thank you for opening a Pull Request! Before submitting your PR, there are a few things you can do to make sure it goes smoothly:

[x] Make sure to open an issue as a bug/issue before writing your code!  That way we can discuss the change, evaluate designs, and agree on the general idea
[x] Ensure the tests and linter pass
[x] Code coverage does not decrease (if any source code was changed)
[x] Appropriate docs were updated (if necessary)

Fixes #52  🦕

@googlebot I signed it!

repo: googleapis/python-functions