text:
chore(master): Release 0.27.2

:robot: I have created a release beep boop
aztec-package: 0.27.2
0.27.2 (2024-03-13)
Miscellaneous

aztec-package: Synchronize aztec-packages versions

barretenberg.js: 0.27.2
0.27.2 (2024-03-13)
Miscellaneous

barretenberg.js: Synchronize aztec-packages versions

aztec-cli: 0.27.2
0.27.2 (2024-03-13)
Miscellaneous

aztec-cli: Synchronize aztec-packages versions

aztec-packages: 0.27.2
0.27.2 (2024-03-13)
Features

Check initialization arguments in constructors (#5144) (d003bd6)
Multithreaded prover folding (#5147) (94922fc)
Run tests in parallel in nargo test  (https://github.com/noir-lang/noir/pull/4484) (58e15ed)
Track stack frames and their variables in the debugger (https://github.com/noir-lang/noir/pull/4188) (58e15ed)

Bug Fixes

acir_gen: More granular element sizes array check (https://github.com/noir-lang/noir/pull/4528) (58e15ed)
Add follow_bindings to follow Type::Alias links (https://github.com/noir-lang/noir/pull/4521) (58e15ed)
Allow type aliases in main (https://github.com/noir-lang/noir/pull/4505) (58e15ed)
Constant gen (#5172) (394a0e0)
docs: Update quickstart.md (#5021) (be9f8a1)
Dynamic assert messages in brillig (https://github.com/noir-lang/noir/pull/4531) (58e15ed)
Fix brillig slowdown when assigning arrays in loops (https://github.com/noir-lang/noir/pull/4472) (58e15ed)
Fix deployments (#5183) (596253b)
Force src impl for == on slices (https://github.com/noir-lang/noir/pull/4507) (58e15ed)
Handling of gh deps in noir_wasm (https://github.com/noir-lang/noir/pull/4499) (58e15ed)
Intermittent invert 0 in Goblin (#5174) (3e68b49)
Iterative flattening pass (https://github.com/noir-lang/noir/pull/4492) (58e15ed)
Noir mirror merge strat (#5166) (74fa8d6)
ssa: Handle mergers of slices returned from calls (https://github.com/noir-lang/noir/pull/4496) (58e15ed)

Miscellaneous

Add ModuleDeclaration struct (https://github.com/noir-lang/noir/pull/4512) (58e15ed)
Add HashMap docs (https://github.com/noir-lang/noir/pull/4457) (58e15ed)
Add regression test for issue 4449 (https://github.com/noir-lang/noir/pull/4503) (58e15ed)
Better output in ci_deploy_contracts.sh (#5171) (8d73f8a)
Bump bb to 0.26.3 (https://github.com/noir-lang/noir/pull/4488) (58e15ed)
ci: Fix JS publishing workflow checking out inconsistent commits (https://github.com/noir-lang/noir/pull/4493) (58e15ed)
Custom hash for eddsa (https://github.com/noir-lang/noir/pull/4440) (58e15ed)
Deterministic mode (#5155) (e68b56a)
Document big integers (https://github.com/noir-lang/noir/pull/4487) (58e15ed)
Generalise FunctionVisibility to ItemVisibility (https://github.com/noir-lang/noir/pull/4495) (58e15ed)
Interaction for a mock first circuit handled inside the EccOpQueue (#4854) (d9cbdc8)
Move check_method_signatures to type checking phase (https://github.com/noir-lang/noir/pull/4516) (58e15ed)
Move templated code for assert_message into the stdlib (https://github.com/noir-lang/noir/pull/4475) (58e15ed)
Organize the blackbox_solver crate (https://github.com/noir-lang/noir/pull/4519) (58e15ed)
Pass import_directive by reference (https://github.com/noir-lang/noir/pull/4511) (58e15ed)
Pass macro processors by reference (https://github.com/noir-lang/noir/pull/4501) (58e15ed)
Pull out separate function for compiling and running a test (58e15ed)
Release Noir(0.25.0) (https://github.com/noir-lang/noir/pull/4352) (58e15ed)
Update cargo deny config (https://github.com/noir-lang/noir/pull/4486) (58e15ed)
Update various dependencies (https://github.com/noir-lang/noir/pull/4513) (58e15ed)

barretenberg: 0.27.2
0.27.2 (2024-03-13)
Features

Multithreaded prover folding (#5147) (94922fc)

Bug Fixes

Intermittent invert 0 in Goblin (#5174) (3e68b49)

Miscellaneous

Interaction for a mock first circuit handled inside the EccOpQueue (#4854) (d9cbdc8)

This PR was generated with Release Please. See documentation.

Benchmark results
Metrics with a significant change:

note_history_trial_decrypting_time_in_ms (5): 138 (+106%)
note_trial_decrypting_time_in_ms (32): 100 (+114%)

Detailed results
All benchmarks are run on txs on the Benchmarking contract on the repository. Each tx consists of a batch call  to create_note and increment_balance, which guarantees that each tx has a private call, a nested private call, a public call, and a nested public call, as well as an emitted private note, an unencrypted log, and public storage read and write.
This benchmark source data is available in JSON format on S3 here.
Values are compared against data from master at commit 58e15edf and shown if the difference exceeds 1%.
L2 block published to L1
Each column represents the number of txs on an L2 block published to L1.

Metric
8 txs
32 txs
64 txs

l1_rollup_calldata_size_in_bytes
5,668
18,820
36,356

l1_rollup_calldata_gas
66,028
238,204
469,496

l1_rollup_execution_gas
666,660
953,065
1,336,804

l2_block_processing_time_in_ms
1,291 (-1%)
4,781 (-1%)
9,394 (+4%)

note_successful_decrypting_time_in_ms
147 (+5%)
487 (-9%)
997 (+4%)

note_trial_decrypting_time_in_ms
52.1 (+19%)
:warning: 100 (+114%)
130 (+47%)

l2_block_building_time_in_ms
16,890 (-1%)
68,554 (+1%)
135,541

l2_block_rollup_simulation_time_in_ms
6,954 (-2%)
27,893 (-1%)
56,004

l2_block_public_tx_process_time_in_ms
9,910 (-1%)
40,531 (+2%)
79,436

L2 chain processing
Each column represents the number of blocks on the L2 chain where each block has 16 txs.

Metric
5 blocks
10 blocks

node_history_sync_time_in_ms
13,806 (-1%)
27,468 (+5%)

note_history_successful_decrypting_time_in_ms
1,285 (+8%)
2,532 (+5%)

note_history_trial_decrypting_time_in_ms
:warning: 138 (+106%)
194 (+59%)

node_database_size_in_bytes
19,046,480
35,655,760

pxe_database_size_in_bytes
29,859
59,414

Circuits stats
Stats on running time and I/O sizes collected for every circuit run across all benchmarks.

Circuit
circuit_simulation_time_in_ms
circuit_input_size_in_bytes
circuit_output_size_in_bytes

private-kernel-init
281 (+1%)
44,338
27,700

private-kernel-ordering
217
52,324
14,326

base-rollup
636
177,083
925

root-rollup
68.2 (-1%)
4,176
789

private-kernel-inner
639 (+1%)
73,197
27,700

public-kernel-app-logic
439
35,198
28,215

public-kernel-tail
177
40,926
28,215

merge-rollup
8.28
2,696
925

Tree insertion stats
The duration to insert a fixed batch of leaves into each tree type.

Metric
1 leaves
16 leaves
64 leaves
128 leaves
512 leaves
1024 leaves
2048 leaves
4096 leaves
32 leaves

batch_insert_into_append_only_tree_16_depth_ms
9.95 (-1%)
16.1 (+1%)
N/A
N/A
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_16_depth_hash_count
16.8
31.6
N/A
N/A
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_16_depth_hash_ms
0.581 (-1%)
0.498 (+1%)
N/A
N/A
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_32_depth_ms
N/A
N/A
45.9
74.2 (+3%)
229
446 (+1%)
887 (+2%)
1,718
N/A

batch_insert_into_append_only_tree_32_depth_hash_count
N/A
N/A
96.0
159
543
1,055
2,079
4,127
N/A

batch_insert_into_append_only_tree_32_depth_hash_ms
N/A
N/A
0.472
0.459 (+3%)
0.419
0.416
0.423 (+2%)
0.412
N/A

batch_insert_into_indexed_tree_20_depth_ms
N/A
N/A
53.4
111 (+5%)
336 (+1%)
657
1,311
2,614
N/A

batch_insert_into_indexed_tree_20_depth_hash_count
N/A
N/A
104
207
691
1,363
2,707
5,395
N/A

batch_insert_into_indexed_tree_20_depth_hash_ms
N/A
N/A
0.476
0.500 (+4%)
0.457
0.452
0.455
0.454
N/A

batch_insert_into_indexed_tree_40_depth_ms
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
60.8

batch_insert_into_indexed_tree_40_depth_hash_count
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
109

batch_insert_into_indexed_tree_40_depth_hash_ms
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
0.533 (-1%)

Miscellaneous
Transaction sizes based on how many contract classes are registered in the tx.

Metric
0 registered classes

tx_size_in_bytes
22,014

Transaction processing duration by data writes.

Metric
0 new note hashes
1 new note hashes

tx_pxe_processing_time_ms
4,075 (+2%)
1,743 (+1%)

Metric
0 public data writes
1 public data writes

tx_sequencer_processing_time_ms
12.9 (-1%)
1,234

:robot: Release is at https://github.com/AztecProtocol/aztec-packages/releases/tag/aztec-packages-v0.27.2 :sunflower:

:robot: Release is at https://github.com/AztecProtocol/aztec-packages/releases/tag/aztec-cli-v0.27.2 :sunflower:

:robot: Release is at https://github.com/AztecProtocol/aztec-packages/releases/tag/aztec-package-v0.27.2 :sunflower:

:robot: Release is at https://github.com/AztecProtocol/aztec-packages/releases/tag/barretenberg.js-v0.27.2 :sunflower:

:robot: Release is at https://github.com/AztecProtocol/aztec-packages/releases/tag/barretenberg-v0.27.2 :sunflower:

source: gharchive/pull-request

license_type: permissive

license_source: github-api


text:
feat: Changing finite field arithmetic in wasm to 29 bits for multiplications (second try, disabled AVM build in wasm)

Now when we compile for wasm we use 9 29-bit limbs to perform all multiplications. In wasmtime this results in -10% for multiplication benchmark and -35% in squaring. This makes a -7% impact on wasm client_ivc.
Other changes:

Most of the changes are just additions to tests to handle the new montgomery form, because we have a lot of hardcoded internal representations. If we get a new one, we should rewrite those to use non-montgomery form. Also we need to recompute all parameters.
Added squarings to univariate and used in some relations
Added a script to run wasmer instead of wasmtime on the benchmark (but you need to change arguments slightly to add "--")
For some reason wasm build has become really slow (especially on relations and protogalaxy).
Added docs

Benchmark results
Metrics with a significant change:

batch_insert_into_append_only_tree_32_depth_ms (1024): 598 (+19%)
node_history_sync_time_in_ms (10): 34,506 (+16%)
note_trial_decrypting_time_in_ms (64): 121 (+410%)

Detailed results
All benchmarks are run on txs on the Benchmarking contract on the repository. Each tx consists of a batch call  to create_note and increment_balance, which guarantees that each tx has a private call, a nested private call, a public call, and a nested public call, as well as an emitted private note, an unencrypted log, and public storage read and write.
This benchmark source data is available in JSON format on S3 here.
L2 block published to L1
Each column represents the number of txs on an L2 block published to L1.

Metric
8 txs
32 txs
64 txs

l1_rollup_calldata_size_in_bytes
772
772
772

l1_rollup_calldata_gas
6,820
6,832
6,820

l1_rollup_execution_gas
587,301
587,313
587,301

l2_block_processing_time_in_ms
1,408 (-3%)
5,122 (-2%)
10,157 (-2%)

note_successful_decrypting_time_in_ms
151 (-24%)
523 (+1%)
1,110 (+4%)

note_trial_decrypting_time_in_ms
40.8 (-52%)
20.8 (+11%)
:warning: 121 (+410%)

l2_block_building_time_in_ms
18,693
73,037 (-1%)
145,697

l2_block_rollup_simulation_time_in_ms
18,485
72,281 (-1%)
144,108

l2_block_public_tx_process_time_in_ms
8,448
33,117 (-1%)
65,860 (-1%)

L2 chain processing
Each column represents the number of blocks on the L2 chain where each block has 16 txs.

Metric
5 blocks
10 blocks

node_history_sync_time_in_ms
15,911 (+2%)
:warning: 34,506 (+16%)

note_history_successful_decrypting_time_in_ms
1,320 (-6%)
2,566 (-5%)

note_history_trial_decrypting_time_in_ms
74.2 (-34%)
113 (+5%)

node_database_size_in_bytes
20,709,456 (+8%)
37,646,416 (+5%)

pxe_database_size_in_bytes
29,868
59,425

Circuits stats
Stats on running time and I/O sizes collected for every circuit run across all benchmarks.

Circuit
circuit_simulation_time_in_ms
circuit_input_size_in_bytes
circuit_output_size_in_bytes

private-kernel-init
167 (+6%)
47,763
31,978

private-kernel-inner
189 (+7%)
80,794
31,978

private-kernel-ordering
148 (+8%)
57,732
49,313 (-1%)

base-parity
9.61 (+2%)
128
265

root-parity
67.4 (-10%)
1,244
265

base-rollup
12,045
110,926
957

root-rollup
51.1 (+3%)
4,551
821

public-kernel-app-logic
1,579 (+1%)
62,017
26,202

public-kernel-tail
4,407 (+4%)
168,566
3,812

merge-rollup
3,254 (+1%)
2,760
957

public-kernel-teardown
122 (+3%)
62,017
34,711

public-kernel-setup
133
62,017
34,711

Tree insertion stats
The duration to insert a fixed batch of leaves into each tree type.

Metric
1 leaves
16 leaves
64 leaves
128 leaves
512 leaves
1024 leaves
2048 leaves
4096 leaves
32 leaves

batch_insert_into_append_only_tree_16_depth_ms
10.5 (-6%)
17.4 (-1%)
N/A
N/A
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_16_depth_hash_count
16.7
31.8
N/A
N/A
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_16_depth_hash_ms
0.611 (-5%)
0.535 (-2%)
N/A
N/A
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_32_depth_ms
N/A
N/A
50.8 (-1%)
74.9 (-7%)
243 (-6%)
:warning: 598 (+19%)
921 (-6%)
1,816 (-6%)
N/A

batch_insert_into_append_only_tree_32_depth_hash_count
N/A
N/A
95.9
159
543
1,055
2,079
4,127
N/A

batch_insert_into_append_only_tree_32_depth_hash_ms
N/A
N/A
0.519 (-1%)
0.462 (-7%)
0.442 (-7%)
0.560 (+19%)
0.436 (-7%)
0.433 (-6%)
N/A

batch_insert_into_indexed_tree_20_depth_ms
N/A
N/A
59.5 (-2%)
112 (-6%)
350 (-6%)
808 (+9%)
1,372 (-6%)
2,734 (-6%)
N/A

batch_insert_into_indexed_tree_20_depth_hash_count
N/A
N/A
105
208
692
1,363
2,707
5,395
N/A

batch_insert_into_indexed_tree_20_depth_hash_ms
N/A
N/A
0.524 (-2%)
0.502 (-6%)
0.475 (-7%)
0.555 (+9%)
0.473 (-7%)
0.475 (-6%)
N/A

batch_insert_into_indexed_tree_40_depth_ms
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
65.4 (-3%)

batch_insert_into_indexed_tree_40_depth_hash_count
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
108 (-1%)

batch_insert_into_indexed_tree_40_depth_hash_ms
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
0.574 (-2%)

Miscellaneous
Transaction sizes based on how many contract classes are registered in the tx.

Metric
0 registered classes
1 registered classes

tx_size_in_bytes
51,411
536,920 (-1%)

Transaction size based on fee payment method

Metric
native fee payment method
fpc_public fee payment method
fpc_private fee payment method

tx_with_fee_size_in_bytes
897
1,145
1,345

Transaction processing duration by data writes.

Metric
0 new note hashes
1 new note hashes
2 new note hashes

tx_pxe_processing_time_ms
1,231 (-1%)
922 (+6%)
3,503 (-1%)

Metric
1 public data writes
2 public data writes
3 public data writes
4 public data writes
5 public data writes
8 public data writes

tx_sequencer_processing_time_ms
887 (+6%)
765 (-1%)
1,360
907 (-1%)
2,077 (-1%)
1,090 (-1%)

repo: AztecProtocol/aztec-packages


text:
[resource manager] add template deployment sample

copy from:

https://github.com/Azure-Samples/azure-sdk-for-go-samples/blob/master/_quickstarts/deployments.go
https://github.com/Azure-Samples/resource-manager-go-template-deployment/blob/master/example.go

to: https://github.com/Azure-Samples/azure-sdk-for-go-samples/tree/master/resources

Fixed in

source: gharchive/issue

authors: joshgav mcardosos

repo: Azure-Samples/azure-sdk-for-go-samples

license: MIT


text:
ClickOnce deployment --> missing dlls

Describe the bug
When deploying a C# application using the Microsoft.CognitiveServices.Speech NuGet, only the Microsoft.CognitiveServices.Speech.csharp.dll is sent to the output
To Reproduce
Steps to reproduce the behavior:

Create a new C# console (.NET Framework) project
Add Microsoft.CognitiveServices.Speech NuGet to the project
Build
Check the output directory --> All references are present
Publish
Check the publish directory --> Only the ***.Speech.csharp.dll is present

Expected behavior
This list of dlls should be present in the publish directory:

Microsoft.CognitiveServices.Speech.core.dll
Microsoft.CognitiveServices.Speech.csharp.dll
Microsoft.CognitiveServices.Speech.extension.audio.sys.dll
Microsoft.CognitiveServices.Speech.extension.codec.dll
Microsoft.CognitiveServices.Speech.extension.kws.dll
Microsoft.CognitiveServices.Speech.extension.lu.dll
Microsoft.CognitiveServices.Speech.extension.mas.dll

Version of the Cognitive Services Speech SDK
1.20.0 (same issue ith 1.19.0)
Platform, Operating System, and Programming Language

OS: Windows 11 Pro
Programming language: C#, VS2022, .NET Framework 4.7.2

Additional context

When trying to use the cognitive services from a client using ClickOnce deployment and checking the output using the Remote Tools for VS, you can see that the application can't find the ***.Speech.core.dll and so you can't start a speech recognition

Thanks for trying the Microsoft Cognitive Services Speech SDK. Including native dependencies from Nuget packages when using ClickOnce to publish an application seems to be a general pain point.
The workaround is to explicitly add the native dependencies to your project as "Content", at which point the publish step will pick up those file. Specifically, open up your project file (.csrpoj) in your text editor of choice and can add the following just before the closing </Project> at the end:
  <ItemGroup>
    <Content Visible="false" Include="$(SpeechNativeDllDir)\Microsoft.CognitiveServices.Speech.core.dll" />
    <Content Visible="false" Include="$(SpeechNativeDllDir)\Microsoft.CognitiveServices.Speech.extension.audio.sys.dll" />
    <Content Visible="false" Include="$(SpeechNativeDllDir)\Microsoft.CognitiveServices.Speech.extension.lu.dll" />
    <Content Visible="false" Include="$(SpeechNativeDllDir)\Microsoft.CognitiveServices.Speech.extension.kws.dll" />
    <Content Visible="false" Include="$(SpeechNativeDllDir)\Microsoft.CognitiveServices.Speech.extension.codec.dll" />
    <Content Visible="false" Include="$(SpeechNativeDllDir)\Microsoft.CognitiveServices.Speech.extension.mas.dll" />
  </ItemGroup>

After this, you the needed native DLLs will start showing up in the list of files to publish:

Thanks a lot @ralph-msft . Your suggestion resolved this issue. 👍


text:
Add batch synthesis sample code

Purpose

Add C# sample code for TTS batch synthesis API.

Pull Request Type
What kind of change does this Pull Request introduce?

[ ] Bugfix
[ ] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Documentation content changes
[x] Other... Please describe: Add sample code

@Ling-Cao @dargilco - Should the folder be named "batchsynthesis" or "batch-synthesis" instead of "batchSynthesis"?

@Ling-Cao @dargilco - Should the folder be named "batchsynthesis" or "batch-synthesis" instead of "batchSynthesis"? @yulin-li created batch-synthesis which seems good.

@Ling-Cao @dargilco - Should the folder be named "batchsynthesis" or "batch-synthesis" instead of "batchSynthesis"? @yulin-li created batch-synthesis which seems good.

I refined the folder name and structure to align with Python sample code which looks good for me.

close, see #1730

authors: Ling-Cao eric-urban yulin-li


text:
Update Calling SDK in the quickstart samples to the latest version

Purpose
Updated to the latest calling SDK to fix a WebRTC standard change affecting Chrome, Edge, and Safari.
https://azure.microsoft.com/en-us/updates/upgrade-to-azure-communication-services-calling-javascript-sdk-110-by-31-july-2021/
Does this introduce a breaking change?

- [ ] Yes
- [x] No

Pull Request Type
What kind of change does this Pull Request introduce?

[x] Bugfix
[ ] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Documentation content changes
[ ] Other... Please describe:

How to Test

Follow the instructions to run the code in READMEs. (Typically just npm i and  npx webpack-dev-server --entry ./client.js --output bundle.js --debug --devtool inline-source-map)

What to Check

Make sure calls are working.

@akania @cwhil2492 @alkwa-msft can some of you please review & merge? thanks :)

Hi @petrsvihlik, good to merge?

Go for it.
On Tue, Aug 10, 2021, 20:47 Chris Whilar @.***> wrote:

Hi @petrsvihlik https://github.com/petrsvihlik, good to merge?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/Azure-Samples/communication-services-javascript-quickstarts/pull/16#issuecomment-896230067,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ACK3FQKGB3WHKBHHAY3WRYTT4FX4TANCNFSM5BIBM66Q
.


text:
How to periodically refresh tokens?

get_token() will only be called once when the app starts. What's the best way to periodically refresh tokens?
I see a line that suggests writing a django middleware. Is there an example available? https://github.com/Azure-Samples/msdocs-django-web-app-managed-identity/blob/c6ca188c2b6c93e0852dae5e9f8112852b2aebcf/azureproject/get_token.py#L5

@pamelafox Would you consider commenting on this issue? Thank you!

I actually just implemented that today! Here's how I did it for Django:
https://github.com/pamelafox/django-quiz-app/pull/53/files#diff-349d3196c8f51b935294f476e30a9ba340b7e1256c9de27e108247bb0c079c28
I need to check my deploy in 24 hours and confirm it's still working, however.

authors: bobtabor-msft nikhilweee pamelafox


text:
add prom metrics to frontend

What this PR does
Before this PR:
Frontend has no monitoring
After this PR:
Added prometheus metrics collector and init
Jira: https://issues.redhat.com/browse/ARO-6284
Special notes for your reviewer
curling /metrics shows this:
curl -X GET 0.0.0.0:8443/metrics
# HELP frontend_count
# TYPE frontend_count counter
frontend_count{api_version="",code="200",route="/healthz/ready",verb="GET"} 1
frontend_count{api_version="",code="200",route="/metrics",verb="GET"} 2
# HELP frontend_duration
# TYPE frontend_duration gauge
frontend_duration{api_version="",code="200",route="/healthz/ready",verb="GET"} 0
frontend_duration{api_version="",code="200",route="/metrics",verb="GET"} 0
# HELP frontend_health
# TYPE frontend_health gauge
frontend_health{endpoint="/healthz/ready"} 1

Checklist
This checklist is not enforcing, but it's a reminder of items that could be relevant to every PR.
Approvers are expected to review this list.

[ ] PR: The PR description is expressive enough and will help future contributors
[ ] Code: Write code that humans can understand and Keep it simple
[ ] Refactor: You have left the code cleaner than you found it (Boy Scout Rule)
[ ] Upgrade: Impact of this change on upgrade flows was considered and addressed if required
[ ] Deployment: The deployment process was considered and addressed if required
[ ] Testing: New code requires new unit tests.
[ ] Documentation: Is the documentation updated? Either in the doc located in focus area, in the README or in the code itself.
[ ] Customers: Is this change affecting customers? Is the release plan considered?

It looks like you addressed all of @AldoFusterTurpin's requested changes, so I'm going to dismiss his review in order to unblock this.

repo: Azure/ARO-HCP


text:
Adding error counters for statd clients

Adding statsd clients for cosmos, k8s, and azure client libraries.
Fixes https://github.com/Azure/ARO-RP/issues/130

Updated to fix import groups in test file.

Failing on the assert library.  Will update.
	imports github.com/stretchr/testify/assert: cannot find package "github.com/stretchr/testify/assert" in any of:

@mjudeikis @jim-minter  PTAL, thanks.

repo: Azure/ARO-RP


text:
refactor: cleanup docker SKUs build stage

What type of PR is this?

What this PR does / why we need it:
This PR fixes a bug introduced by a previous refactoring, cleans up the docker SKUs from build stage so that yaml parsing does not fail.
https://msazure.visualstudio.com/CloudNativeCompute/_build/results?buildId=72106935&view=results
^ Sample run.
Which issue(s) this PR fixes:

Fixes #
Requirements:

[ ] uses conventional commit messages

[ ] includes documentation
[ ] adds unit tests
[ ] tested upgrade from previous version

Special notes for your reviewer:
Release note:
none

Pull Request Test Coverage Report for Build 4767039378

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 61.866%

Totals

Change from base Build 4764739283:
0%

Covered Lines:
2526

Relevant Lines:
4083

💛  - Coveralls

repo: Azure/AgentBaker


text:
Upgrading CNI and CNS to v1.5.5, and dropgz to v0.0.7

What type of PR is this?
Upgrades Azure CNI and Azure CNS to v1.5.5 to support same 'overlay' conflist, and CNS to generate 'overlay' conflist for Azure CNI
Also upgrading dropgz to v.0.0.7

What this PR does / why we need it:
Which issue(s) this PR fixes:

Fixes #
Requirements:

[x] uses conventional commit messages

[x] includes documentation
[x] adds unit tests
[x] tested upgrade from previous version

Special notes for your reviewer:
Release note:
<Will update with release link when release is finished, just drafting for now>

Pull Request Test Coverage Report for Build 5258518150

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall First build on paujohns/update-cni-cns-dropgz at 61.615%

Totals

Change from base Build 5250806316:
61.6%

Covered Lines:
2541

Relevant Lines:
4124

💛  - Coveralls


text:
Allowed container images regex field, examples and syntax validation required.

Describe the bug
Allowed container images regex field, examples and syntax validation required.
The help for this field shows
"The RegEx rule used to match allowed container images in a Kubernetes cluster. For example, to allow any Azure Container Registry image by matching partial path: ^.+azurecr.io/.+$"
but is not considering the right syntax for multiple items, what would be a good example to multiple items, which is a good separator to be used?
To Reproduce
Steps to reproduce the behavior:
1 from azure portal , search for security center
2 from the left column click on security policy
3 select the subscription
4 click on view effective policy button
5 from top of next page , select ASC default.... the policy with hyperlinked text.
6 On next screen select Parameters.
Expected behavior
A clear and concise description of the syntax, a validation check for the syntax that explains the format expected to be entered in the field.
Screenshots
If applicable, add screenshots to help explain your problem.
Desktop (please complete the following information if applicable):

OS: [e.g. iOS]
Browser [e.g. chrome, safari]
Version [e.g. 22]

Hi @porrascarlos802018
your issue seems to be related to Azure Security Center, not to an automation artifact within this repository. Unfortunately, we cannot provide product support for Azure Security Center in GitHub. If you feel this is a bug, please file an Azure Security Center support ticket or join the Azure Security Center TechCommunity for community support.

Closing this issue as it is not related to a Github artifact.

repo: Azure/Azure-Security-Center


text:
Created new workbook to monitor Microsoft Copilot for Security

Created new workbook to monitor Microsoft Copilot for Security

@v-prasadboke & @v-atulyadav - Thank you for the approval and merge.

repo: Azure/Azure-Sentinel


text:
Creating Azure Purview Solution. Added Workbook, Data Connector, and …

…Analytic Rules. Uploaded Sample Data
Fixes #
Proposed Changes

@aprakash13 Please review analytic rules. Thanks.

Hi @rheabansal , Can you please provide sample data in .csv or .json format.

Hi @NikTripathi Updated the file to be a .csv

hey @aprakash13 @NikTripathi ! Would you be able to help with the Validation failures in both the Detections and Data Connector?
Thank you for all the help so far!

authors: NikTripathi rheabansal


text:
update solution cisco asa with data connector

Required items, please complete
Change(s):

See guidance below

Reason for Change(s):

See guidance below

Version Updated:

Required only for Detections/Analytic Rule templates
See guidance below

Testing Completed:

See guidance below

Checked that the validations are passing and have addressed any issues that are present:

See guidance below

Guidance <- remove section before submitting

Before submitting this PR please ensure that you have read the following sections and filled out the changes, reason for change and testing complete sections:
Thank you for your contribution to the Microsoft Sentinel Github repo.

Details of the code changes in your submitted PR.  Providing descriptions for pull requests ensures there is context to changes being made and greatly enhances the code review process.  Providing associated Issues that this resolves also easily connects the reason.

Change(s):

Updated syntax for XYZ.yaml

Reason for Change(s):

New schema used for XYZ.yaml
Resolves ISSUE #1234

Version updated:

Yes
Detections/Analytic Rule templates are required to have the version updated

The code should have been tested in a Microsoft Sentinel environment that does not have any custom parsers, functions or tables, so that you validate no incorrect syntax and execution functions properly.  If your submission requires a custom parser or function, it must be submitted with the PR.

Testing Completed:

Yes/No/Need Help

Note: If updating a detection, you must update the version field.

Before the submission has been made, please look at running the KQL and Yaml Validation Checks locally.
https://github.com/Azure/Azure-Sentinel#run-kql-validation-locally

Checked that the validations are passing and have addressed any issues that are present:

Yes/No/Need Help

Note: Let us know if you have tried fixing the validation error and need help.

References:

Guidance for Detection checks
General contribution guidance
PR validation troubleshooting

Please update Azure Sentinal to Microsoft Sentinel. there is miss spell of Sentinal

Please update spelling mistake as shown below in playbook file and maintemplate file

authors: v-amolpatil v-laanjana


text:
Added optional Host to DaprConnectionString

This PR adds an optional Host to DaprConnectionString like "DaprConnectionString=PubSubComponent=pubsub;GrpcPort=6011;Host=10.1.1.1".
Will fix #2235

Many thanks for the contribution @Haeavar

/azp run

/azp run

/azp run

authors: Haeavar marcschier

repo: Azure/Industrial-IoT


text:
VSCode designer - unable to select subscription for gateway with sql connector

Describe the Bug with repro steps
We are unable to add a sql connection to our logic app via the VSCode designer as the Subscription dropdown is not populated.

Create new Logic App project with new workflow via Logic Apps Standard plugin.
Right click on workflow and choose Use Connections From Azure.
Open workflow in designer and dd a trigger.
Add a sql action like Execute SQL Stored procedure.
Enter the connection details.
Under the gateway section, the subscription dropdown is empty, so we can't choose the subscription. The gateway selection box remains disabled.
Click Create New without entering the gateway info results in an Unexpected error,

Workflow JSON
No response
Screenshots or Videos

Browser
n/a
Additional context
VSCode version 1.77.3
Windows 10
Azure Logic Apps (Standard) plugin version v2.2.1 (2023-04-13)

@rllyy97

repo: Azure/LogicAppsUX


text:
serviceBus action won't work if the connection string is being pulled from the Key Vault secrets

Describe the Bug with repro steps
{
"code": "ServiceProviderActionFailed",
"message": "The service provider action failed with error code 'ServiceOperationRequiredParameterMissing' and error message 'The required parameter 'connectionString or fullyQualifiedNamespace' for the service provider '/serviceProviders/serviceBus' operation 'sendMessages' is missing.'."
}
What type of Logic App Is this happening in?
Standard (Portal)
Are you using Preview Designer or GA Designer
Preview
Workflow JSON
No response
Screenshots or Videos
No response
Browser
Chrome
Additional context
No response

This never worked in old designer as well. @hartra344 - This is the issue where we have an email thread to discuss on how to handle this in backend.

Note: It's the same with "AzureWebJobsStorage" and "WEBSITE_CONTENTAZUREFILECONNECTIONSTRING" app setting keys. We can't keep connection strings in the app configuration


text:
Update inputs, outputs & readme

Change
Update

inputs
outputs
readme

Type of Change
Please delete options that are not relevant.

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[x] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update (Wiki)

@ahmadabdalla done

repo: Azure/ResourceModules


text:
enable user-configurable Azure CNI URL

What this PR does / why we need it: Enables user-configurable Azure CNI URL. Linux implementation is code-sane, but doesn't actually do anything, as that'll require more work integrating w/ VHD. Because Windows is the desired initial use-case, I'm advocating we take this as-is (once we prove Windows functionality) and leave remaining Linux implementation to be done when desired.
Which issue this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close that issue when PR gets merged): fixes #
Special notes for your reviewer:
If applicable:

[ ] documentation
[ ] unit tests
[ ] tested backward compatibility (ie. deploy with previous version, upgrade with this branch)

Release note:

enable user-configurable Azure CNI URL

fixes: https://github.com/Azure/acs-engine/issues/4007

/lgtm

reference back to epic #3851 for tracking

authors: jackfrancis jsturtevant tariq1890

repo: Azure/acs-engine

license: mit

license_source: bigquery


text:
gMSA v2 support on Windows AKS-HCI

Current version of gMSA will require the nodes to be in a domain. gMSAv2 is not required domain joined.

We have release this feature last month.
See this blog https://techcommunity.microsoft.com/t5/containers/announcing-active-directory-identity-improvement-on-aks-on-azure/ba-p/2374198.
We also has a video to guide customer: https://www.youtube.com/watch?v=33UFlvtutqw.

repo: Azure/aks-hci


text:
Enable override for Cluster CIDR and Pod CIDR when creating management cluster or target cluster

Several customers have workloads in the cloud in AKS or other clouds and extend their on-premises networks into the cloud. This can lead to address conflicts in the rather large ranges of 10.96.0.0/12 and 10.244.0.0/16.
Customers are asking us to allow them to change these values to smaller ranges matching their target cluster needs.
High Level goals:
Add podCIDR and serviceCIDR to the New-AksHciNetworkSettings and New-AksHciClusterNetwork commands
Apply these settings during the kubadm join phase in cloud-init and cloudbase-init for Linux and Windows respectively
Non Goals:
Allow to change the CIDR after deployment of a cluster

Vote UP...
It is an important core function/configuration that is needed. The network cannot be restructured.
As a temporary measure, 100.60.0.0/10 /16 can be specified in the source deployment instead of 10.244.0.0/16
This network is usually only used by ISPs for routing purposes

repo: Azure/aksArc


text:
How to handle key vault integration in named parameters for multiple environments

Hi there,
I'm not seeing a way to allow for handling key vault integration in the named parameters in the configuration..yaml between environments.  For example, it looks like the only properties available to set on named parameters in the config file are:
name:
displayName:
value:
If you have your named value tied to a key vault there are a few different properties that need to be available:
keyVault (object): {secretIdentifier:}
secret (bool?):
Is this something that could be added to your backlog?
Thanks!

https://github.com/Azure/apiops/issues/62
Thanks for bringing this up. We would be tracking this as part of the above enhancement to ensure keyvault identifiers are included in config.yaml as well.

authors: anotherRedbeard rishabhsaha

repo: Azure/apiops


text:
Removed contact information from ApiCreateOrUpdateProperties.

This causes the API name to be set to the contact name when publishing the api. The contact information is still contained in the openapi spec files and is set correctly on apim when publishing.
fixes #213
It looks to me the microsoft.apimanagement/service gets very confused with a json tag named "name" and uses that as the API display name despite there being a displayname value and the "name" tag being inside a contact node. The real fix might actually be in that base management API instead of in this extractor/importer logic.
Also this might not be the best way to go about it. The serialize call on the apimodel is only used for writing the api information as far as I see, but if this gets reused elsewhere contact info might be wanted over there.
But right now omitting the contact info from the apiInformation.json file fixes the issue where contact name gets used as display name for the API.

Duplicate of #268

authors: benblokcegeka waelkdouh


text:
Node.js 16 actions are deprecated

A warning is displayed when using the Action:

Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: azure/login@v1, azure/arm-deploy@v1. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.

@anthony-c-martin @bearmannl - any news on when we can expect a new version to be released?

I've just released v2

authors: Jarod1662 anthony-c-martin gabrielweyer

repo: Azure/arm-deploy


text:
[Question] ARMM-TTK & AzSK ARM template checker?

ARM-TTK
Issue Details
Azure Secure DevOps Kit (aka AzSK) maintained by DSRE team at MSFT has an ARM template checker component
The AzSK ARM template checker is json driven policy engine, though it strives to serve a similar purpose in maintaining ARM template hygiene.
Is it possible for future integration between the two or the ARM-TTK will be developed separately?

@DexterPOSH fyi - we are looking into this...

authors: DexterPOSH bmoore-msft

repo: Azure/arm-ttk


text:
ResourceID Ambiguity Tests.

Fixing #140 & Fixing #159
Must accept PR for RegEx engine changes first.

From the conversation... we need to match the resourceId in the function with a resource in the template and may need additional parsing in the engine.  Scenarios
parameter
    storageC (some existing storage account name passed in to the template)

resources
    storageA
    storageB+condtion
    ...

    resourceId(Microsoft.Storage/storageAccounts, parameter(storageC)) - error because not defined in the template and no rgName param
    resourceId(storageC-rgName, Microsoft.Storage/storageAccounts, parameter(storageC)) - correct

    resourceId(Microsoft.Storage/storageAccounts, parameter(storageB)) - error because there is a condtion on B (and no rgName)

    resourceId(Microsoft.Storage/storageAccounts/blob, parameter(storageA), blobname) - no error, defined in the template and no condition

/subs/rg/{name}Microsoft.Storage/storageAccounts/parameters(storageA)/blob/blobname

type: Microsoft.Storage/storageAccounts/blob
name: concat(parameter(A), /, blobName)
name: literal/blob
name: format({0}/{1}, paramter(A), blobName)

Could also be a nested child resource
type: blob
name: blobname

We won't worry about the scope property for now since it's only used on extension resources atm

authors: StartAutomating bmoore-msft


text:
Expected payload of IfMatch Etag

For example, there is a method:
public virtual async Task<Response<User>> SmokeTestAsync(int id, string foo, RequestConditions requestConditions = null, CancellationToken cancellationToken = default)
{
    ...
    Response response = await SmokeTestAsync(id, foo, requestConditions, context).ConfigureAwait(false);
    return Response.FromValue(User.FromResponse(response), response);
}

internal HttpMessage CreateSmokeTestRequest(int id, string foo, RequestConditions requestConditions, RequestContext context)
{
    ...
    if (requestConditions != null)
    {
        request.Headers.Add(requestConditions, "O");
    }
    return message;
}

If I call this method by setting IfMatch as new ETag("valid"), what should be expected payload for IfMatch header?
User response = await new TraitsClient(host, null).SmokeTestAsync(1, "123", new RequestConditions() { IfMatch = new ETag("valid"), IfNoneMatch = new ETag("invalid"), IfUnmodifiedSince = DateTimeOffset.Parse("Fri, 26 Aug 2022 14:38:00 GMT"), IfModifiedSince = DateTimeOffset.Parse("Thu, 26 Aug 2021 14:38:00 GMT") });

Actual: \"valid\", we will add a quote string to its actual value.
If this is expected, how should we call to have valid string without quote.

ETAGs must have quotes unless they are * or can be prepended for weak reference with W/.
https://www.rfc-editor.org/rfc/rfc9110.html#section-8.8.3-5


text:
Git difference

Avocado can detect difference between source and target branch and report only new errors.

adding @billytrend as he implemented something similar for the hub

Examples:

unmodified specs (no errors): https://dev.azure.com/azure-sdk/public/_build/results?buildId=15510
altered specs (with unreferenced files): https://dev.azure.com/azure-sdk/public/_build/results?buildId=15517

authors: sergey-shandar vladbarosan

repo: Azure/avocado


text:
Add Azure App Configuration template

Please fill out this template! There are three different types of contributions, feel free to delete the checklists that are not applicable to your contribution type.
If you are submitting a new azd template to the gallery
Fill this out if you want your template to be added to the awesome-azd gallery!
Your template repository
Place your template repository link here: https://github.com/Azure-Samples/azure-appconfig-aks

[ ] Added an entry to https://github.com/Azure/awesome-azd/blob/main/website/src/data/users.tsx that includes:

[x] Template title - A short title that reflects the local application stack that someone could use to get their application on Azure (e.g. "Containerized React Web App with Java API and MongoDB")

[x] Description - 1-2 sentence description of the architecture (e.g. Azure services) or solution that is defined by the template.

[x] Architecture Diagram or Application Screenshot - The image should include all services and their connections (example). You should add the image to the website/src/data/images/.

[x] Link to Author's GitHub or other relevant website - Used for attribution

[x] Author's Name -  Name to credit on the gallery card

[x] Link to template source - Link to the template GitHub repo

[x] Tags - Specify tags to represent the template. If you don't see a relevant tag for your template? Feel free to add one!
Required tags:

[x] Tag your template as Micrsoft-authored ("msft") or Community-authored ("community")
[x] Tag the IaC provider ("bicep" or "terraform")
[x] At least 1 tag for programming language used
[x] At least 1 tag for Azure services integrated
[x] Add the "new" tag for any newly authored templates

[x] In the PR comment, if you can also add a link to the PR where you made your repo azd compatible this will allow us to provide feedback on your template and speed up the review process.

If you are submitting a resource to be added to the awesome-azd README: (Not applicable)

[ ] Name of resource
[ ] Resource author - who created this resource? (so we can credit them!)
[ ] What section should this resource be included in? -Is the resource an article? A video? Something else?

@v-xuto Could you test this template please?

Got it, we will start testing in the next two days.

Any update?

repo: Azure/awesome-azd


text:
install nv_peer_mem kernel for GPUDirect RDMA

A customer on the Alma 8.7 image has run into
src/comm/transports/common/transport_ib_common.cpp:58: NULL value mem registration failed
src/comm/transports/ibrc/ibrc.cpp:486: non-zero status: 2 Unable to register memory handle.src/mem/mem.cpp:349: non-zero status: 7 transport get memhandle failed
src/mem/mem.cpp:604: non-zero status: 7 register heap handle failed
src/mem/mem.cpp:622: non-zero status: 7 add physical memory failed
src/comm/device/proxy_device.cu:701: NULL value failed allocating proxy_channel_g_bufchannel creation failed

with NVSHMEM and noticed that the nv_peer_mem kernel is missing.
$ lsmod | grep nv
nvidia_uvm           1376256  0
nvidia_drm             69632  0
nvidia_modeset       1245184  1 nvidia_drm
nvidia              56467456  106 nvidia_uvm,gdrdrv,nvidia_modeset
drm_kms_helper        176128  1 nvidia_drm
libnvdimm             200704  1 nfit
drm                   565248  4 drm_kms_helper,nvidia,nvidia_drm

See the docs https://docs.nvidia.com/nvshmem/api/faq.html
Would it make sense to add nv_peer_memory to the azhpc image?
https://github.com/Mellanox/nv_peer_memory
Anything we would need to watch out for?
mentioning also @xpillons

Yes, nv_peer_mem should be added to Alma image as well. This can be fixed in the March release.

I've tried this with the latest HPC AlmaLinux 8.7 image on an NDv4 VM, and nvidia_peermem is installed with the Mellanox driver and enabled.

What version of the HPC AlmaLinux 8.7 image are you using and on which SKU?

Interesting, thanks for checking!
This was using the azhop image 2023.0705.1612, which derives from almalinux:almalinux-hpc:8_7-hpc-gen2:8.7.2023060101
@xpillons According to the azhop docs, this is the latest base image for which azhop images are available. Perhaps worth looking into upgrading this?
Mentioning @matt-chan, @adam-grofe for info

@ltalirz building new azhop image right now

Closing as we're installing nvidia_peermem with the NVIDIA drivers on the current images

authors: LiquidPT jithinjosepkl ltalirz xpillons

repo: Azure/azhpc-images


text:
Error listing workflows

This is autogenerated. Please review and update as needed.
Describe the bug
Command Name
az logic workflow list Extension Name: logic. Version: 0.1.6.
Errors:
The command failed with an unexpected error. Here is the traceback:
Unable to deserialize to object: type, KeyError: 'OpenAuthenticationAccessPolicies'
Traceback (most recent call last):
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\msrest/serialization.py", line 1442, in _deserialize
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\msrest/serialization.py", line 1620, in deserialize_data
KeyError: 'OpenAuthenticationAccessPolicies'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\knack/cli.py", line 231, in invoke
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 663, in execute
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 726, in _run_jobs_serially
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 710, in _run_job
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/core/paging.py", line 129, in __next__
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/core/paging.py", line 84, in __next__
  File "C:\Users\mtmentella\.azure\cliextensions\logic\azext_logic\vendored_sdks\logic\operations\_workflow_operations.py", line 96, in extract_data
    deserialized = self._deserialize('WorkflowListResult', pipeline_response)
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\msrest/serialization.py", line 1368, in __call__
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\msrest/serialization.py", line 1442, in _deserialize
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\msrest/serialization.py", line 1618, in deserialize_data
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\msrest/serialization.py", line 1649, in deserialize_iter
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\msrest/serialization.py", line 1649, in <listcomp>
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\msrest/serialization.py", line 1631, in deserialize_data
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\msrest/serialization.py", line 1442, in _deserialize
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\msrest/serialization.py", line 1631, in deserialize_data
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\msrest/serialization.py", line 1442, in _deserialize
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\msrest/serialization.py", line 1631, in deserialize_data
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\msrest/serialization.py", line 1446, in _deserialize
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\msrest/exceptions.py", line 51, in raise_with_traceback
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\msrest/serialization.py", line 1442, in _deserialize
  File "D:\a\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\msrest/serialization.py", line 1620, in deserialize_data
msrest.exceptions.DeserializationError: Unable to deserialize to object: type, KeyError: 'OpenAuthenticationAccessPolicies'

To Reproduce:
Steps to reproduce the behavior. Note that argument values have been redacted, as they may contain sensitive information.

Put any pre-requisite steps here...
az logic workflow list

Expected Behavior
Environment Summary
Windows-10-10.0.19044-SP0
Python 3.10.4
Installer: MSI

azure-cli 2.37.0

Extensions:
account 0.2.3
logic 0.1.6
resource-graph 2.1.0

Dependencies:
msal 1.18.0b1
azure-mgmt-resource 21.1.0b1

Additional Context

logic

@mmentella We are unable to reproduce this issue with latest version of azure cli 2.38.0. Can you please upgrade and try again?

authors: RakeshMohanMSFT mmentella yonzhan

repo: Azure/azure-cli-extensions


text:
ContainerApp connection creation fails for PostgreSQL when default output is not json

Describe the bug
If the default output type for AZCLI is not JSON (defined in az cli config file), creating Container App connections for PostgreSQL flexible server fails.
Related command
az containerapp connection create postgres-flexible \
            --connection postgresql  \
            --name ca-pi-test-006 \
            --resource-group rg-pi-test-006 \
            --target-resource-group rg-pi-test-006 \
            --server pg-pi-test-006 \
            --database pi_development \
            --client-type ruby \
            --system-identity \
            --container ca-pi-test-006\
            --customized-keys AZURE_POSTGRESQL_CONNECTIONSTRING=DATABASE_URL

Errors
Unexpected error:
The installed extension 'serviceconnector-passwordless' is in preview.
The command failed with an unexpected error. Here is the traceback:
'bytes' object has no attribute 'get'
Traceback (most recent call last):
  File "/usr/lib64/az/lib/python3.9/site-packages/knack/cli.py", line 233, in invoke
    cmd_result = self.invocation.execute(args)
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 663, in execute
    raise ex
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 726, in _run_jobs_serially
    results.append(self._run_job(expanded_arg, cmd_copy))
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 697, in _run_job
    result = cmd_copy(params)
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 333, in __call__
    return self.handler(*args, **kwargs)
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/command_operation.py", line 121, in handler
    return op(**command_args)
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/command_modules/serviceconnector/custom.py", line 317, in connection_create
    return azext_custom.connection_create_ext(cmd, client, connection_name, client_type,
  File "/home/dominique/.azure/cliextensions/serviceconnector-passwordless/azext_serviceconnector_passwordless/custom.py", line 31, in connection_create_ext
    return connection_create_func(cmd, client, connection_name, client_type,
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/command_modules/serviceconnector/custom.py", line 462, in connection_create_func
    new_auth_info = enable_mi_for_db_linker(
  File "/home/dominique/.azure/cliextensions/serviceconnector-passwordless/azext_serviceconnector_passwordless/_credential_free.py", line 62, in enable_mi_for_db_linker
    target_handler = getTargetHandler(
  File "/home/dominique/.azure/cliextensions/serviceconnector-passwordless/azext_serviceconnector_passwordless/_credential_free.py", line 157, in getTargetHandler
    return PostgresFlexHandler(cmd, target_id, target_type, auth_info, connection_name, skip_prompt)
  File "/home/dominique/.azure/cliextensions/serviceconnector-passwordless/azext_serviceconnector_passwordless/_credential_free.py", line 632, in __init__
    super().__init__(cmd, target_id, target_type,
  File "/home/dominique/.azure/cliextensions/serviceconnector-passwordless/azext_serviceconnector_passwordless/_credential_free.py", line 176, in __init__
    self.login_username = run_cli_cmd(
AttributeError: 'bytes' object has no attribute 'get'

Issue script & Debug output
Not necessary as the stack is clear about the issue.
Expected behavior
It should work even if the user set a different output type in his config.
It works when removing the configuration from ~/.azure/config
Environment Summary
Tested in Cloud Shell:
azure-cli                         2.55.0

core                              2.55.0
telemetry                          1.1.0

Extensions:
ai-examples                        0.2.5
ml                                2.22.0
serviceconnector-passwordless              0.3.13
ssh                                2.0.2

Dependencies:
msal                            1.24.0b2
azure-mgmt-resource             23.1.0b2

Python location '/usr/bin/python3.9'
Extensions directory '/home/dominique/.azure/cliextensions'
Extensions system directory '/usr/lib/python3.9/site-packages/azure-cli-extensions'

Python (Linux) 3.9.14 (main, Oct 12 2023, 19:48:32)
[GCC 11.2.0]

Additional context
Seems that the issue is comes from lines like:
self.login_username = run_cli_cmd(`az account show').get("user")

run_cli_cmd will try to parse the command's output as JSON and revert to returning the bytes if it fails.

Thank you for opening this issue, we will look into it.

authors: dbroeglin yonzhan


text:
[Azure Load Testing] Updating ARM endpoint based on cloud

Changes made in this PR -

Adding support for "az load test" in AzureUSGovernment cloud by setting the ARM endpoint based on the cloud.

This checklist is used to make sure that common guidelines for a pull request are followed.
Related command

General Guidelines

[ ] Have you run azdev style <YOUR_EXT> locally? (pip install azdev required)
[ ] Have you run python scripts/ci/test_index.py -q locally? (pip install wheel==0.30.0 required)
[x] My extension version conforms to the Extension version schema

For new extensions:

[ ] My extension description/summary conforms to the Extension Summary Guidelines.

About Extension Publish
There is a pipeline to automatically build, upload and publish extension wheels.
Once your pull request is merged into main branch, a new pull request will be created to update src/index.json automatically.
You only need to update the version information in file setup.py and historical information in file HISTORY.rst in your PR but do not modify src/index.json.

Azure Load Testing


text:
{AKS} Update the minimum required cli core version to 2.61.0.

This checklist is used to make sure that common guidelines for a pull request are followed.
{AKS} Update the minimum required cli core version to 2.61.0.
Related command

General Guidelines

[ ] Have you run azdev style <YOUR_EXT> locally? (pip install azdev required)
[ ] Have you run python scripts/ci/test_index.py -q locally? (pip install wheel==0.30.0 required)
[ ] My extension version conforms to the Extension version schema

For new extensions:

[ ] My extension description/summary conforms to the Extension Summary Guidelines.

About Extension Publish
There is a pipeline to automatically build, upload and publish extension wheels.
Once your pull request is merged into main branch, a new pull request will be created to update src/index.json automatically.
You only need to update the version information in file setup.py and historical information in file HISTORY.rst in your PR but do not modify src/index.json.

AKS

authors: FumingZhang yonzhan


text:
Mounting storage to webapp with invalid key returns success

This is autogenerated. Please review and update as needed.
Describe the bug
Command Name
az webapp config storage-account update
Errors:
Returns a success response when provided with an invalid access-key. The response is the same regardless of whether the access-key is correct or not. This falsely led me to believe that the storage account was added to the webapp when it actually had failed.
To Reproduce:
Steps to reproduce the behavior. Note that argument values have been redacted, as they may contain sensitive information.
The issue seems to happen both for the add and update commands:

az webapp config storage-account add --resource-group {} --name {} --custom-id {} --storage-type {} --share-name {} --account-name {} --mount-path {} --access-key {}
az webapp config storage-account update --resource-group {} --name {} --custom-id {} --storage-type {} --share-name {} --account-name {} --mount-path {} --access-key {}

Expected Behavior
I expect the command to return an error if the access-key is invalid.
Environment Summary
Linux-4.15.0-1098-azure-x86_64-with-debian-stretch-sid (Cloud Shell)
Python 3.6.10
Installer: DEB

azure-cli 2.14.0 *

Extensions:
ai-examples 0.2.4

Additional Context
I ran into this issue when on a call with an Azure support engineer where they pasted in their access key, received a success message after running the command, and were surprised when the storage account was not available to the webapp. We were only able to solve it after guessing that the access key needed to be in quotes. So I don't think I'm the only one that has an issue.
If this is the wrong place to report the issue please let me know where I should report it instead.

webapp

@freastro in general we don't validate access to other resources. the same is true for connection strings.
This is by-design

authors: btardif freastro yonzhan

repo: Azure/azure-cli


text:
Az namespace exists returns inconsistent error message

az feedback auto-generates most of the information requested below, as of CLI version 2.0.62

Describe the bug
I'm trying to verify if a namespace is currently in use. I think it is still available, though I can't create a resource with that name.
The error message is different

To Reproduce
az servicebus namespace exists --name usl-osupd-servicebus-fus-test
az servicebus namespace exists --name service-bus-namespace // or any other sb namespace that exists

Expected behavior
Expected result for both cases
{
  "message": "The specified name is not available. For more information visit https://aka.ms/eventhubsarmexceptions.",
  "nameAvailable": false,
  "reason": "NameInUse"
}

Also, is there a way to find out which subscription has used a resource name?

@ashinzekene - Can you confirm if the same issue is happening in latest CLI module? I tried with CLI version 2.34.1 and am unable to reproduce the behavior.

We can close this

authors: Saglodha ashinzekene


text:
webapp:Unable to set WebApp Slot logging using az webapp log config --ids [webapp slot id]

az feedback auto-generates most of the information requested below, as of CLI version 2.0.62

Describe the bug
The command "az webapp log config" when used with the parameter "--ids [appServiceSlotID]" configure the main AppService instead of the specified AppService Slot.
To Reproduce

Create a Resource Group, say "resourceGroupName".
Create an AppService in the newly created Resource Group, say "appServiceName".
Add an AppService Slot to the newly created AppService, say "appServiceSlotName".
Run the following command:

az webapp log config \
--docker-container-logging "filesystem" \
--ids "/subscriptions/[subscriptionID]/resourceGroups/[resourceGroupName]/providers/Microsoft.Web/sites/[appServiceName]/slots/[appServiceSlotName]"

Expected behavior
The specified AppService Slot/AppService Logs is enabled with the following default parameters:

Application Logging: filesystem
Quota (MB): 100
Retention Period (Days): 3

Observed behavior
The AppService/AppService Logs is enabled with the following default parameters:

Application Logging: filesystem
Quota (MB): 100
Retention Period (Days): 3

Environment summary
Install Method: apt
CLI version: 2.27.
OS version : Ubuntu 20.04.2 LTS
Shell Type: bash
Additional context
The following equivalent command works as expected:
az webapp log config \
--docker-container-logging "filesystem" \
--resouce-group [resourceGroupName] \
--name [appServiceName] \
--slot [appServiceSlotName]

route to service team

I am unable to repro the issue. please share the --debug log to analysis further

I think I misunderstood the use of the --ids parameters. I guess since the az webapp log config command is at the webapp level, the --ids parameter ignores the slot name when specified. Thus we have to explicitly specify the slot name using the --slot parameter.
RIGHT:
az webapp log config \
    --docker-container-logging "filesystem" \
    --ids "/subscriptions/${subscription}/resourceGroups/${resource_group}/providers/Microsoft.Web/sites/${app_service_name}" \
    --slot "${app_service_slot_name}"

WRONG:
az webapp log config \
    --docker-container-logging "filesystem" \
    --ids "/subscriptions/${subscription}/resourceGroups/${resource_group}/providers/Microsoft.Web/sites/${app_service_name}/slots/[app_service_slot_name}"

Given the above, it would be nice if the az webapp log config command - and those alike - could give a warning in such circumstances.

This is the problem with all the commands when using --ids parameter  for slot. We will look in to it.
@panchagnula - FYI.

--ids argument will work only for the webapp. to work with slots we must pass --slot argument. This is the common behavior across all the cli  commands.

As mentionned on Sept 10th, I now understand that. My point is that - based on the command documentation on the [--ids] parameter - "It should be a complete resource ID containing all information of 'Resource Id' arguments. You should provide either --ids or other 'Resource Id' arguments." make me (and probably some other people) believe that we can either provide a full resource ID (an App Service Slot has a Resource ID) or the other resource Id arguments which are namely the [--subscription], the [--resource-group], the App Service [--name], and the [--slot] name. In other words, we should not mix [--Ids] and [--slot] parameters.
A meaningfull warning or error message would have been appreciated. That's all.

@PatrickMessierGoC Agree with your suggestion. But this is not the problem with only webapp this is the same behavior with all the other azure resources too. So we will take it into CLI core team to handle this at root level instead of individual module level.

authors: Kotasudhakarreddy PatrickMessierGoC ramya894 yonzhan


text:
WAM-integration & PIM

Describe the bug
When az is setup with allow_broker=true and PIM is used to activate an eligible assignment, it's not possible to gain access to the resources protected by the activated eligible assignment (even if az logout or az account clear is used). Also tried deleting both msal_http_cache.bin and msal_token_cache.bin after calling az account clear, still doesn't work.
When az is setup with allow_broker=false and PIM is used to active an eligible assignment, az logout and then az login allows accessing the newly available resources after an eligible assignment is activated.
Related command
az storage blob list --account-name  -c  --auth-mode login --debug
Errors
You do not have the required permissions needed to perform this operation.
Depending on your operation, you may need to be assigned one of the following roles:
"Storage Blob Data Owner"
"Storage Blob Data Contributor"
"Storage Blob Data Reader"
"Storage Queue Data Contributor"
"Storage Queue Data Reader"
"Storage Table Data Contributor"
"Storage Table Data Reader"
If you want to use the old authentication method and allow querying for the right account key, please use the "--auth-mode" parameter and "key" value.
Issue script & Debug output
az storage blob list --account-name  -c  --auth-mode login --debug
cli.knack.cli: Command arguments: ['storage', 'blob', 'list', '--account-name', '', '-c', '', '--auth-mode', 'login', '--debug']
cli.knack.cli: init debug log:
Enable color in terminal.
cli.knack.cli: Event: Cli.PreExecute []
cli.knack.cli: Event: CommandParser.OnGlobalArgumentsCreate [<function CLILogging.on_global_arguments at 0x020B92B0>, <function OutputProducer.on_global_arguments at 0x02187A48>, <function CLIQuery.on_global_arguments at 0x021A76A0>]
cli.knack.cli: Event: CommandInvoker.OnPreCommandTableCreate []
cli.azure.cli.core: Modules found from index for 'storage': ['azure.cli.command_modules.storage']
cli.azure.cli.core: Loading command modules:
cli.azure.cli.core: Name                  Load Time    Groups  Commands
cli.azure.cli.core: storage                   0.048        58       272
cli.azure.cli.core: Total (1)                 0.048        58       272
cli.azure.cli.core: These extensions are not installed and will be skipped: ['azext_ai_examples', 'azext_next']
cli.azure.cli.core: Loading extensions:
cli.azure.cli.core: Name                  Load Time    Groups  Commands  Directory
cli.azure.cli.core: Total (0)                 0.000         0         0
cli.azure.cli.core: Loaded 58 groups, 272 commands.
cli.azure.cli.core: Found a match in the command table.
cli.azure.cli.core: Raw command  : storage blob list
cli.azure.cli.core: Command table: storage blob list
cli.knack.cli: Event: CommandInvoker.OnPreCommandTableTruncate [<function AzCliLogging.init_command_file_logging at 0x044BA1D8>]
cli.azure.cli.core.azlogging: metadata file logging enabled - writing logs to 'C:\Users<redacted>.azure\commands\2023-05-31.08-04-13.storage_blob_list.41728.log'.
az_command_data_logger: command args: storage blob list --account-name {} -c {} --auth-mode {} --debug
cli.knack.cli: Event: CommandInvoker.OnPreArgumentLoad [<function register_global_subscription_argument..add_subscription_parameter at 0x044E12F8>]
cli.azure.cli.core.profiles._shared: Traceback (most recent call last):
File "D:\a_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/profiles/_shared.py", line 655, in _get_attr
AttributeError: module 'azure.mgmt.storage.v2022_09_01.models' has no attribute 'ActiveDirectoryPropertiesAccountType'
cli.azure.cli.core.profiles._shared: Traceback (most recent call last):
File "D:\a_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/profiles/_shared.py", line 655, in _get_attr
AttributeError: module 'azure.mgmt.storage.v2022_09_01.models' has no attribute 'ListKeyExpand'
cli.azure.cli.core.profiles._shared: Traceback (most recent call last):
File "D:\a_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/profiles/_shared.py", line 655, in _get_attr
AttributeError: module 'azure.mgmt.storage.v2022_09_01.models' has no attribute 'CorsRuleAllowedMethodsItem'
cli.knack.cli: Event: CommandInvoker.OnPostArgumentLoad []
cli.knack.cli: Event: CommandInvoker.OnPostCommandTableCreate [<function register_ids_argument..add_ids_arguments at 0x044F3220>, <function register_cache_arguments..add_cache_arguments at 0x044F3418>]
cli.knack.cli: Event: CommandInvoker.OnCommandTableLoaded []
cli.knack.cli: Event: CommandInvoker.OnPreParseArgs []
cli.knack.cli: Event: CommandInvoker.OnPostParseArgs [<function OutputProducer.handle_output_argument at 0x02187A90>, <function CLIQuery.handle_query_parameter at 0x021A76E8>, <function register_ids_argument..parse_ids_arguments at 0x044F33D0>]
cli.azure.cli.core.auth.persistence: build_persistence: location='C:\Users\\.azure\msal_token_cache.bin', encrypt=True
cli.azure.cli.core.auth.binary_cache: load: C:\Users<redacted>.azure\msal_http_cache.bin
urllib3.util.retry: Converted retries value: 1 -> Retry(total=1, connect=None, read=None, redirect=None, status=None)
msal.authority: openid_config = {'token_endpoint': 'https://login.microsoftonline.com//oauth2/v2.0/token', 'token_endpoint_auth_methods_supported': ['client_secret_post', 'private_key_jwt', 'client_secret_basic'], 'jwks_uri': 'https://login.microsoftonline.com//discovery/v2.0/keys', 'response_modes_supported': ['query', 'fragment', 'form_post'], 'subject_types_supported': ['pairwise'], 'id_token_signing_alg_values_supported': ['RS256'], 'response_types_supported': ['code', 'id_token', 'code id_token', 'id_token token'], 'scopes_supported': ['openid', 'profile', 'email', 'offline_access'], 'issuer': 'https://login.microsoftonline.com//v2.0', 'request_uri_parameter_supported': False, 'userinfo_endpoint': 'https://graph.microsoft.com/oidc/userinfo', 'authorization_endpoint': 'https://login.microsoftonline.com//oauth2/v2.0/authorize', 'device_authorization_endpoint': 'https://login.microsoftonline.com//oauth2/v2.0/devicecode', 'http_logout_supported': True, 'frontchannel_logout_supported': True, 'end_session_endpoint': 'https://login.microsoftonline.com//oauth2/v2.0/logout', 'claims_supported': ['sub', 'iss', 'cloud_instance_name', 'cloud_instance_host_name', 'cloud_graph_host_name', 'msgraph_host', 'aud', 'exp', 'iat', 'auth_time', 'acr', 'nonce', 'preferred_username', 'name', 'tid', 'ver', 'at_hash', 'c_hash', 'email'], 'kerberos_endpoint': 'https://login.microsoftonline.com//kerberos', 'tenant_region_scope': 'NA', 'cloud_instance_name': 'microsoftonline.com', 'cloud_graph_host_name': 'graph.windows.net', 'msgraph_host': 'graph.microsoft.com', 'rbac_url': 'https://pas.windows.net'}
msal.application: Broker enabled? True
cli.azure.cli.core.auth.credential_adaptor: CredentialAdaptor.get_token: scopes=('https://storage.azure.com/.default',), kwargs={}
cli.azure.cli.core.auth.msal_authentication: UserCredential.get_token: scopes=('https://storage.azure.com/.default',), claims=None, kwargs={}
msal.application: Cache hit an AT
msal.telemetry: Generate or reuse correlation_id: f5eb7d8f-0708-4ec2-ba6e-d2b09c3a815c
urllib3.connectionpool: Starting new HTTPS connection (1): .blob.core.windows.net:443
urllib3.connectionpool: https://.blob.core.windows.net:443 "GET /?restype=container&comp=list&maxresults=5000 HTTP/1.1" 403 279
cli.azure.cli.core.azclierror: Traceback (most recent call last):
File "D:\a_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\knack/cli.py", line 233, in invoke
File "D:\a_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/init.py", line 663, in execute
File "D:\a_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/init.py", line 726, in _run_jobs_serially
File "D:\a_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/init.py", line 718, in _run_job
File "D:\a_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/command_modules/storage/init.py", line 419, in new_handler
File "D:\a_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/command_modules/storage/init.py", line 418, in new_handler
File "D:\a_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/init.py", line 697, in _run_job
File "D:\a_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/init.py", line 333, in call
File "D:\a_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/command_operation.py", line 121, in handler
File "D:\a_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/command_modules/storage/operations/blob.py", line 186, in list_blobs
File "D:\a_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/command_modules/storage/track2_util.py", line 74, in list_generator
File "D:\a_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/core/paging.py", line 76, in next
File "D:\a_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/multiapi/storagev2/blob/v2021_06_08/_list_blobs_helper.py", line 83, in _get_next_cb
File "D:\a_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/multiapi/storagev2/blob/v2021_06_08/_shared/response_handlers.py", line 181, in process_storage_error
File "", line 1, in
azure.core.exceptions.HttpResponseError:
You do not have the required permissions needed to perform this operation.
Depending on your operation, you may need to be assigned one of the following roles:
"Storage Blob Data Owner"
"Storage Blob Data Contributor"
"Storage Blob Data Reader"
"Storage Queue Data Contributor"
"Storage Queue Data Reader"
"Storage Table Data Contributor"
"Storage Table Data Reader"
If you want to use the old authentication method and allow querying for the right account key, please use the "--auth-mode" parameter and "key" value.
Content: AuthorizationPermissionMismatchThis request is not authorized to perform this operation using this permission.
RequestId:4e011e77-901e-001e-4eb8-938626000000
Time:2023-05-31T12:04:14.9281861Z
cli.azure.cli.core.azclierror:
You do not have the required permissions needed to perform this operation.
Depending on your operation, you may need to be assigned one of the following roles:
"Storage Blob Data Owner"
"Storage Blob Data Contributor"
"Storage Blob Data Reader"
"Storage Queue Data Contributor"
"Storage Queue Data Reader"
"Storage Table Data Contributor"
"Storage Table Data Reader"
If you want to use the old authentication method and allow querying for the right account key, please use the "--auth-mode" parameter and "key" value.
az_command_data_logger:
You do not have the required permissions needed to perform this operation.
Depending on your operation, you may need to be assigned one of the following roles:
"Storage Blob Data Owner"
"Storage Blob Data Contributor"
"Storage Blob Data Reader"
"Storage Queue Data Contributor"
"Storage Queue Data Reader"
"Storage Table Data Contributor"
"Storage Table Data Reader"
If you want to use the old authentication method and allow querying for the right account key, please use the "--auth-mode" parameter and "key" value.
cli.knack.cli: Event: Cli.PostExecute [<function AzCliLogging.deinit_cmd_metadata_logging at 0x044BA2F8>]
az_command_data_logger: exit code: 1
cli.main: Command ran in 1.119 seconds (init: 0.306, invoke: 0.814)
telemetry.main: Begin splitting cli events and extra events, total events: 1
telemetry.client: Accumulated 0 events. Flush the clients.
telemetry.main: Finish splitting cli events and extra events, cli events: 1
telemetry.save: Save telemetry record of length 3973 in cache
telemetry.check: Negative: The C:\Users<redacted>.azure\telemetry.txt was modified at 2023-05-31 08:01:26.899769, which in less than 600.000000 s
Expected behavior
Ideally, activating an eligible assignment wouldn't require a re-login, but az logout && az login would be enough to allow access the resources.
Environment Summary
azure-cli                         2.49.0
core                              2.49.0
telemetry                          1.0.8
Extensions:
azure-devops                      0.26.0
containerapp                      0.3.32
Dependencies:
msal                              1.20.0
azure-mgmt-resource               22.0.0
Python location 'C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\python.exe'
Extensions directory 'C:\Users<redacted>.azure\cliextensions'
Python (Windows) 3.10.10 (tags/v3.10.10:aad5f6a, Feb  7 2023, 17:05:00) [MSC v.1929 32 bit (Intel)]
Legal docs and information: aka.ms/AzureCliLegal
Your CLI is up-to-date.
Additional context
No response

Thank you for opening this issue, we will look into it.

authors: scabana yonzhan


text:
Wrong structure for azure-cli-nspkg

azure-cli-nspkg has some issues:

Since it's a sub-package of "azure-nspkg", it should have it in dependency
the file "azure/init.py" must be absent (will be provided by the "azure-nspkg" dependency)

See azure-mgmt-nspkg for instance
This is not an issue about the content of "azure/cli/init.py", that should be without declare_namespace or not. So you can release a first version with this fixed, and then a second version without declare_namespace, if you think you're not ready to do both at the same time.
@derekbekoe @johanste

Thanks, @lmazuel. Yes, we also observed this as part of the declare_namespace changes.

@johanste is there any action required here?

This has been addressed.

authors: derekbekoe johanste lmazuel


text:
Homebrew Installed Azure CLI not working - /usr/local/bin/az: line 6: python3: command not found

installed azure-cli via homebrew , no matter what az command I run , I get this error.
eg.
/usr/local/bin/az: line 6: python3: command not found

some more info :
azure-cli: stable 2.0.30 (bottled), HEAD
Microsoft Azure CLI 2.0
https://docs.microsoft.com/cli/azure/overview
/usr/local/Cellar/azure-cli/2.0.30 (11,302 files, 56.6MB) *
  Poured from bottle on 2018-04-02 at 11:35:12
From: https://github.com/Homebrew/homebrew-core/blob/master/Formula/azure-cli.rb
==> Dependencies
Required: openssl ✔, python ✔
==> Options
--HEAD
	Install HEAD version
==> Caveats
Bash completion has been installed to:
  /usr/local/etc/bash_completion.d

Is python3 available on the machine?
Try brew doctor to check brew.
Also, possibly you may need to do brew link python if python3 still isn't found.

Thanks for the direction.
managed to solve it with brew uninstall --ignore-dependencies python and then brew update && brew install python

authors: derekbekoe slootzky


text:
Lock six version to ~=1.12

Temporarily lock six version to ~=1.12 until next Sprint due to upgrade of package six from ~1.12.0 to 1.13.0 in Nov 6, 2019 breaks dependency, which failed Travis CI
Related PR:  #11051

This checklist is used to make sure that common guidelines for a pull request are followed.

[ ] The PR has modified HISTORY.rst describing any customer-facing, functional changes. Note that this does not include changes only to help content. (see Modifying change log).

[ ] I adhere to the Command Guidelines.

Astroid issue: https://github.com/PyCQA/astroid/issues/718

authors: haroldrandom jiasli


text:
{Network} Bump azure-mgmt-network from 19.3.0 to 20.0.0

Related command

Description

Bullet points:

Removed "live_only" mentioned in: https://github.com/Azure/azure-cli/pull/22485;
Fixed "content_type" introduced by 2017-10-01;
Temporarily bypass several rdbms tests (@DaeunYim for awareness):

test_mysql_flexible_server_georestore_mgmt;
test_mysql_flexible_server_restore_mgmt;
test_mysql_flexible_server_vnet_mgmt_supplied_subnetid;
test_mysql_flexible_server_vnet_mgmt_supplied_subnet_id_in_different_rg;
test_mysql_flexible_server_vnet_mgmt_supplied_vname_and_subnetname;
test_postgres_flexible_server_vnet_mgmt_supplied_vname_and_subnetname;
test_postgres_flexible_server_restore_mgmt;
test_mysql_flexible_server_existing_private_dns_zone;
test_mysql_flexible_server_new_private_dns_zone;

Testing Guide

History Notes

[Component Name 1] BREAKING CHANGE: az command a: Make some customer-facing breaking change
[Component Name 2] az command b: Add some customer-facing feature

This checklist is used to make sure that common guidelines for a pull request are followed.

[ ] The PR title and description has followed the guideline in Submitting Pull Requests.

[ ] I adhere to the Command Guidelines.

[ ] I adhere to the Error Handling Guidelines.

Network

I saw azure_mgmt_network-20.0.0-py3-none-any.whl is smaller than azure_mgmt_network-19.3.0-py2.py3-none-any.whl:
https://pypi.org/project/azure-mgmt-network/20.0.0/#files

https://pypi.org/project/azure-mgmt-network/19.3.0/#files

This is a good sign for package size!

authors: jiasli necusjz yonzhan


text:
[ACR] az acr --help: Update registry and webhook example names to be lowercase

Related command
Description
Registry names must be lowercase when using them in CLI commands. In the --help file, all uses of 'MyRegistry' were capitalized, which led to confusion among users and unnecessary errors. To be consistent with the examples used in documentation, also changed the 'MyWebhook' examples to be lowercase (https://learn.microsoft.com/en-us/azure/container-registry/container-registry-webhook).
Testing Guide

History Notes
[ACR] az acr [subgroup] [command] --help: Update registry and webhook example names to be lowercase

This checklist is used to make sure that common guidelines for a pull request are followed.

[x ] The PR title and description has followed the guideline in Submitting Pull Requests.

[x ] I adhere to the Command Guidelines.

[ x] I adhere to the Error Handling Guidelines.

ACR

authors: SakoPak yonzhan


text:
[Storage] Fix #28356: az storage account or-policy update: Fix -p @policy.json to allow passing in json files

Related command

Description

Fix #28356 az storage account or-policy update: Fix -p @policy.json not parsing json files before
Testing Guide

History Notes

[Storage] Fix #28356: az storage account or-policy update: Fix -p @policy.json to allow passing in json files

This checklist is used to make sure that common guidelines for a pull request are followed.

[ ] The PR title and description has followed the guideline in Submitting Pull Requests.

[ ] I adhere to the Command Guidelines.

[ ] I adhere to the Error Handling Guidelines.

Storage

authors: calvinhzy yonzhan


text:
Introduce adls python sdk version 0.0.17

This checklist is used to make sure that common guidelines for a pull request are followed.
General Guidelines

[ ] The PR has modified HISTORY.rst describing any customer-facing, functional changes. Note that this does not include changes only to help content. (see Modifying change log).

Command Guidelines

[ ] Each command and parameter has a meaningful description.
[ ] Each new command has a test.

(see Authoring Command Modules)

@chdevala,
Thanks for your contribution as a Microsoft full-time employee or intern. You do not need to sign a CLA.
Thanks,
Microsoft Pull Request Bot

authors: chdevala msftclas


text:
[DO NOT MERGE] Test msrestazure exception parsing fix

Testing fix of https://github.com/Azure/msrestazure-for-python/issues/54

Still hit by "mock" used in a way that are too sensitive to tiny change in Autorest... Will fix the tests, and rebase this PR.


text:
test: update test_sql_db_operation_mgmt test recording

Was not able to record as the az sql db op cancel command always failed for service side errors, but they no longer occur
This checklist is used to make sure that common guidelines for a pull request are followed.
General Guidelines

[na] The PR has modified HISTORY.rst describing any customer-facing, functional changes. Note that this does not include changes only to help content. (see Modifying change log).

Command Guidelines

[na] Each command and parameter has a meaningful description.
[na] Each new command has a test.

(see Authoring Command Modules)

View a preview at https://prompt.ws/r/Azure/azure-cli/5062
This is an experimental preview for @microsoft.com users.
(It may take a minute or two for your instance to be ready)
Email feedback to 'azfeedback' with subject 'Prompt Feedback'.

@tjprescott @derekbekoe : do we need to sync up with the latest dev to get CI clean? This PR failed on version check around azure-cli-core and azure-cli
Verified READMEs of all modules successfully.
Verify package versions
Version 2.0.22 of azure-cli-core is already available on PyPI! Update the version.
Error(s) on azure-cli-core
Version 2.0.22 of azure-cli is already available on PyPI! Update the version.
Error(s) on azure-cli
The following modules have invalid versions:
azure-cli-core
azure-cli
See above for the full warning/errors

Yes we should honor the version check stuff.

authors: azuresdkci tjprescott yugangw-msft


text:
[Storage] Temp fix to allow idempotent storage account creates

ICM ticket: https://icm.ad.msft.net/imp/v3/incidents/details/83117490/home
Once a proper new sdk is released, I will undo this fix.

One an issue to track the real problem.

authors: troydai williexu


text:
check doc generation for all the profiles.

This checklist is used to make sure that common guidelines for a pull request are followed.

[ ] The PR has modified HISTORY.rst describing any customer-facing, functional changes. Note that this does not include changes only to help content. (see Modifying change log).

[ ] I adhere to the Command Guidelines.

@williexu

CI failed.

@daxianji007 can you address the CI failure?

Where are we now?

I'm closing this PR for lack of activity.

authors: daxianji007 troydai williexu


text:
Disabling dual stack e2e tests

Disable dual stack e2e tests as its currently not supported by AKS

Reason for Change:

Issue Fixed:

Requirements:

[ ] uses conventional commit messages

[ ] includes documentation
[ ] adds unit tests

Notes:

/azp run

relevant tests passed, merging to take the CI improvement ASAP

authors: aegal rbtr

repo: Azure/azure-container-networking


text:
Docker client installation instructions

@squillace, here:
http://azure.microsoft.com/en-us/documentation/articles/virtual-machines-docker-with-xplat-cli/

Follow the Docker installation instructions to install Docker locally on your computer. For most operating systems and distributions, this means typing apt-get install docker.io. Confirm that the Docker version is at 1.0 or greater.

docker.io package is not maintained by Docker and usually falls behind newer versions.
We must suggest users to follow the commands here https://docs.docker.com/installation/ubuntulinux/

@ahmetalpbalkan Thank you for the suggestion.  Since you are a MSFT employee, we ask that you use the GitHub capability to contribute to the article by submitting a change and a pull request through the process.  If you need guidance on how this works, please see the contributors guide here: https://github.com/Azure/azure-content-pr/blob/master/contributor-guide/contributor-guide-index.md

@squillace can do better than I can, English is not really my native language. :-)

@squillace Can you please assist on this issue?  Looks like @ahmetalpbalkan has deferred to you on this one.

Hey cats--just landed. @ahmetalpbalkan @dehena ill get to this today or tomorrow morning.

Reviewing this now. Seems that docker has changed their tunes about docker.io, which was previously precisely their description about how to get the client on Ubuntu (as there used to be a debian package called, precisely "docker" so they had to call out the docker.io part). Now it might read:

Follow the Docker installation instructions to install Docker locally on your computer.

and I'll just remove the part about docker.io -- as docker has documented that. Note, however, that debian still has the docker.io requirement. :-) https://docs.docker.com/installation/debian/

@squillace the general installation command curl https://get.docker.com | sh  just works fine on debian too.
If users want to use docker.io pkg they must add jessie-backports apt repo to their debian setup (as documented). It might be smart to just redirect users to the docs.docker.com for that.

@ahmetalpbalkan back from vacation; time to fix this.

fixed. email offline.

@ahmetalpbalkan Thanks again for raising the issue.  The issue appears resolved now.  Please comment if the issue remains a problem and we'll reopen this issue.

authors: ahmetalpbalkan deneha squillace

repo: Azure/azure-content


text:
[Hackadoc] Submitting new article

How to connect Web/Worker roles to a custom domain using the Custom AD
Domain Extension

Hi Varun -
This article needs some updates....

Remove the in-topic navigation. This week, an automated in-topic navigation will be added to the site. All H2 headings will render in the in-topic navigation, which will appear to the right of the page in wide views or inline in the topic in narrow screen views.

As coded, this article won't have a right navigation because it's currently coded with an H1 (#) heading and all the rest are H3 headings (###). The right navigation uses only H2 headings, so I would change all the H3s to H2s (##) so you get the in-topic nav.

Replace the bold first sentence with a meaningful H2 (##) that will be the first line in the in-topic navigation.

There are some sentence fragments in the "Provision" section.

Thanks,
Tyson

authors: tysonn varunmaker


text:
Typo fix on active-directory-how-to-integrate.md

s/assigning/assign/

Hi @AustinCWells, I'm your friendly neighborhood Azure Pull Request Bot (You can call me AZPRBOT). Thanks for your contribution!

This seems like a small (but important) contribution, so no contribution license agreement is required at this point. Real humans will now evaluate your PR.

TTYL, AZPRBOT;

@AustinCWells - Thank you for the fix!

authors: AustinCWells azurecla tysonn


text:
OFFSET LIMIT with WHERE clause with equality use indexes instead of loading documents from beginning

Is your feature request related to a problem? Please describe.
I was playing around with Cosmos DB and noticed that a query using OFFSET LIMIT with a WHERE clause with equality doesn't use the index to fetch the data at a given offset. This is also documented here
Say my item's data structure is something like:
{
      "a": 1
      "b": 2
      "c": 3
      "id": some_guid
}

Assume there are 10000 such items with "a" = 1. The partition key is "a". Also this is with default indexing policy where we have
{
    "indexingMode": "consistent",
    "automatic": true,
    "includedPaths": [
        {
            "path": "/*"
        }
    ],
    "excludedPaths": [
        {
            "path": "/\"_etag\"/?"
        }
    ]
}

When I run a query like:
SELECT * from c WHERE c.a = 1 OFFSET 1000 LIMIT 50
In the Query Stats I see "Retrieved document count" as 1050. This is most probably because the code is doing a skip. However since there is an index on c.a, which is an inverted index (according to this), can't it use that inverted index's item id list to find the required items for OFFSET 1000, instead of loading all items from beginning?
Maybe in the above query, we need an ORDER BY for it to use the inverted index list's order - so the query becomes
SELECT * from c WHERE c.a = 1 ORDER BY c.a DESC OFFSET 1000 LIMIT 50
Overall - the criteria to meet is - the WHERE clause uses columns that are indexed and has equality operator, at which point OFFSET queries should ideally be able to use the index's inverted index item Ids list.
Describe the solution you'd like
Ideally, when the WHERE clause has equality on column, I'd like Cosmos query engine to directly use the index to fetch the item Ids at the given OFFSET instead of loading all the items from beginning. So a query like
SELECT * from c WHERE c.a = 1 ORDER BY c.a DESC OFFSET 1000 LIMIT 50
should still only load 50 items (and not 1050), which would reduce RUs considerably.
Similarly with compound index on say "a asc" and "b asc", a query like:
SELECT * from c WHERE c.a = 1 AND c.b = 2 ORDER BY c.a ASC, c.b ASC OFFSET 1000 LIMIT 50
should also just use the index.
Describe alternatives you've considered
One of the potential alternatives is to use range queries. But it's not always possible to have a column which enables that capability
Please let me know if you need any additional information. I'm guessing it is currently implemented this way for a reason? If so, I'd like to know what that reason may be. For example, if there's no WHERE clause, yes, OFFSET has no choice but to load items from beginning. But WHERE clause can provide hints to optimize :)

oops wrong place to create this as this is the SDK.


text:
LINQ-constructed document queries ignore Json annotations based on type constraint

Describe the bug
When using LINQ to create document queries in a generic function with a constraint on the document's type parameter, the query generator ignores annotations on the concrete type. Specifically, the generator ignores Json serialization annotations on the properties, leading to incorrect queries.
To Reproduce
using System;
using System.Linq;
using Microsoft.Azure.Documents;
using Microsoft.Azure.Documents.Client;
using Newtonsoft.Json;

namespace ConsoleApp
{
    interface ITest
    {
        string Id { get; set; }
    }

    class Test : ITest
    {
        [JsonProperty("id")]
        public string Id { get; set; }
    }

    class Program
    {
        static void Main(string[] args)
        {
            var client = new DocumentClient(new Uri("https://test.documents.azure.com:443/"), "");
            InterfaceConstraint<Test>(client);
            ClassConstraint<Test>(client);
        }

        private static void InterfaceConstraint<T>(IDocumentClient client)
        where T :  ITest
        {
            Console.WriteLine($"InterfaceConstraint Query for T = \"{typeof(T)}\": {client.CreateDocumentQuery<T>(new Uri("https://x.y.z")).Select(doc => doc.Id).ToString()}");
        }

        private static void ClassConstraint<T>(IDocumentClient client)
            where T :  Test
        {
            Console.WriteLine($"ClassConstraint Query for T = \"{typeof(T)}\": {client.CreateDocumentQuery<T>(new Uri("https://x.y.z")).Select(doc => doc.Id).ToString()}");
        }
    }
}

Expected behavior
Query generator should consider annotation on Test class. Expected output:
InterfaceConstraint Query for T = "ConsoleApp.Test": {"query":"SELECT VALUE root[\"id\"] FROM root "}
ClassConstraint Query for T = "ConsoleApp.Test": {"query":"SELECT VALUE root[\"id\"] FROM root "}

Actual behavior
Query generator ignores annotation on Test class. Actual output:
InterfaceConstraint Query for T = "ConsoleApp.Test": {"query":"SELECT VALUE root[\"Id\"] FROM root "}
ClassConstraint Query for T = "ConsoleApp.Test": {"query":"SELECT VALUE root[\"id\"] FROM root "}

Environment summary
SDK Version: Microsoft.Azure.WebJobs.Extensions.CosmosDB 3.0.3, .NET Core 2.2
OS Version: Windows 10,

The examples you provided are for v2 SDK. This seems to be a duplicate of https://github.com/Azure/azure-cosmos-dotnet-v2/issues/700. If it's not a duplicate please create a new issue under the v2 SDK repo.
I believe this is still an issue for v3 SDK, Please create a new issue with a v3 SDK samples.


text:
Move postpackage to predeploy hooks for staticwebapp

Move postpackage to predeploy hooks for staticwebapp ToDo templates
This allows the env-config.js to be correctly generated when observing the environment state from azd. This is the current intended integration for staticwebapp to observe environment state that also works when invoked through azd up.

Repoman Generation Results
Repoman pushed changes to remotes for the following projects:
Project: todo-csharp-sql-swa-func
Remote: azure-samples-staging
Branch: pr/1856
You can initialize this project with:
azd init -t Azure-Samples/todo-csharp-sql-swa-func -b pr/1856

View Changes | Compare Changes

Project: todo-nodejs-mongo-swa-func
Remote: azure-samples-staging
Branch: pr/1856
You can initialize this project with:
azd init -t Azure-Samples/todo-nodejs-mongo-swa-func -b pr/1856

View Changes | Compare Changes

Project: todo-python-mongo-swa-func
Remote: azure-samples-staging
Branch: pr/1856
You can initialize this project with:
azd init -t Azure-Samples/todo-python-mongo-swa-func -b pr/1856

View Changes | Compare Changes

authors: azure-sdk weikanglim

repo: Azure/azure-dev