text:
removed duplicated settings

Overview/Summary
removes duplicate lines from policy definition
This PR fixes/adds/changes/removes
Lines 173-176 are removed
                    {
                      "category": "AppServiceHTTPLogs",
                      "enabled": "[parameters('logsEnabled')]"
                    },

from file
infra-as-code/bicep/modules/policy/definitions/lib/policy_definitions/policy_definition_es_Deploy-Diagnostics-Website.json
Breaking Changes
no breaking changes
Testing Evidence
screenshots attached

As part of this Pull Request I have

[x ]  Associated with https://dev.azure.com/CSUSolEng/Azure Landing Zones/_workitems/edit/25022
[x ] Ensured my code/branch is up-to-date with the latest changes in the main branch
[ x] Performed testing and provided evidence.

Hey @prjelesi can you make this change in the upstream ESLZ repo as all policies are pulled from there.
As documented here: https://github.com/Azure/ALZ-Bicep/wiki/PolicyDeepDive

repo: Azure/ALZ-Bicep


text:
Added newer linter-rules

Overview/Summary
Newer bicep releases adds more linter rules.
This PR adds the missing rules from the example linter-config.
If the rules should be error/warning/off...etc. might be changed...
This could potentially be a breaking change.
This PR fixes/adds/changes/removes

Adds more linter rules with default level from the example on ms-docs

Breaking Changes
Could potentially break deployments of customer custom-module
~Could potentially break deployments of internal bicep files~
No error on any .bicep in ALZ-Bicep repo found, fixes for new warnings in #827
Testing Evidence
Linter in VSCode reports no errors. Warnings is fixed in PR #827
As part of this Pull Request I have

[x] Read the Contribution Guide and ensured this PR is compliant with the guide
[ ] Ensured the resource API versions in .bicep file/s I am adding/editing are using the latest API version possible
[x] Checked for duplicate Pull Requests
[ ] Associated it with relevant GitHub Issues
[ ] (ALZ Bicep Core Team Only) Associated it with relevant ADO Items
[x] Ensured my code/branch is up-to-date with the latest changes in the main branch
[ ] Performed testing and provided evidence.
[ ] Updated one or more of the following tests (if required)

Unit
Linting
E2E (End-To-End)
ValidateAzCloud (Base validation in Azure Cloud)
ValidateMcCloud (Base validation in Azure China Cloud)

[ ] Updated relevant and associated documentation (e.g. Contribution Guide, Module READMEs, Wiki Docs etc.)
[ ] If relevant, created or updated Code Tours here

Tests fails on the link checker... 💀

/azp run validateazcloud

/azp run validateazcloud

source: gharchive/pull-request

authors: oZakari picccard

license: MIT

license_type: permissive

license_source: github-api


text:
Emit cluster version metrics

This pulls in Olga's changes to the context and emits desired and actual version from the cluster.

I'm hoping this is now ready for a final review & merge.

pushed with rebase and unit test.

Thanks @jim-minter. I was struggling with the unit test and can now see how it was expected to be done for future.

authors: jim-minter sjkingo

repo: Azure/ARO-RP


text:
Add ARG query for Azure VM disk encryption

Overview/Summary

Add ARG query for Azure VM disk encryption recommendation (f0a97179-133a-6e4f-8a49-8a44da73ffce) :

Related Issues/Work Items

Breaking Changes
None
As part of this pull request I have

[x] Read the Contribution Guide and ensured this PR is compliant with the guide
[x] Checked for duplicate Pull Requests
[ ] Associated it with relevant GitHub Issues or ADO Work Items (Internal Only)
[x] Ensured my code/branch is up-to-date with the latest changes in the main branch
[ ] Ensured PR tests are passing
[x] Performed testing and provided evidence (e.g. screenshot of output) for any changes associated to ARG queries
[ ] Updated relevant and associated documentation (e.g. Contribution Guide, Docs etc.)

Thank you @jdmsoss for contributing to APRL.
I think it is better that VM centric results because this recommendation is for virtual machines. Like as the following:

name
id
tags
param1
param2
param3

vm1
vm1-id
vm1-tags
diskName:vm1-osdisk
EncryptionAtHost: Disabled
DiskEncryption: Disabled

vm1
vm1-id
vm1-tags
diskName:vm1-datadisk1
EncryptionAtHost: Disabled
DiskEncryption: Disabled

vm1
vm1-id
vm1-tags
diskName:vm1-datadisk2
EncryptionAtHost: Disabled
DiskEncryption: Disabled

vm2
vm2-id
vm2-tags
diskName:vm2-osdisk
EncryptionAtHost: Disabled
DiskEncryption: Disabled

Similar cases:

Enable Accelerated Networking (AccelNet)

The actual settings on network interfaces, but the result is VM centric.

VMs should not have a Public IP directly associated

Public IP address settings are on network interfaces, but the result is VM centric.

What do you think?

Indeed, it makes sense @tksh164 !
I will update the code this week to produce a result per VM and not per disk. Thank you!

@jdmsoss please read the following Contributor License Agreement(CLA). If you agree with the CLA, please reply with the following information.
@microsoft-github-policy-service agree [company="{your company}"]

Options:

(default - no company specified) I have sole ownership of intellectual property rights to my Submissions and I am not making Submissions in the course of work for my employer.

@microsoft-github-policy-service agree

(when company given) I am making Submissions in the course of work for my employer (or my employer has intellectual property rights in my Submissions by contract or applicable law). I have permission from my employer to make Submissions and enter into this Agreement on behalf of my employer. By signing below, the defined term “You” includes me and my employer.

@microsoft-github-policy-service agree company="Microsoft"

Contributor License Agreement

@microsoft-github-policy-service agree company="Microsoft"

It's seems this PR was automatically updated with two commits from my fork. I didn't find a clean way to remove one of these commit (05bcc65) from this PR for now. What simple method would you suggest for removing this commit from here?
In the meantime, we can keep commit bd2afe1 which takes into account @tksh164 suggestion 😉
Thank you!

@jdmsoss I think that the most effortless way is to close this PR then re-create a new one.


text:
[SailPoint IdentityNow] Unable to get the generate redirect URL for new API client to create credential

Describe the bug
Unable to get the generate redirect URL for new API client to create credential
To Reproduce
Steps to reproduce the behavior:

Redirect URL requires me to input

I went to this page (see the screenshot), but I got 5 error logos after trying to save the custom connector.

Would you mind advising on how to resolve this issue?

Hi @williamtwar . I had success deploying the new content solution from scratch.
Seems now you don't need that callback anymore, the triggered function now is doing all GET events from their API. Following instructions from the content catalog, I'm using PAT (Personal Access Token) instead of the API Management client secret from the previous solution.

Since we have not received a response in the last 5 days, we are closing your issue https://github.com/Azure/Azure-Sentinel/issues/6287 as per our standard operating procedures. If you still need support for this issue, feel free to re-open at any time. Thank you for your co-operation.

source: gharchive/issue

authors: dneto82 v-rbajaj williamtwar

repo: Azure/Azure-Sentinel


text:
fix sapcon-sentinel-kickstart.sh user

Required items, please complete
Change(s):

See guidance below

Reason for Change(s):

See guidance below

Version Updated:

Required only for Detections/Analytic Rule templates
See guidance below

Testing Completed:

See guidance below

Checked that the validations are passing and have addressed any issues that are present:

See guidance below

Guidance <- remove section before submitting

Before submitting this PR please ensure that you have read the following sections and filled out the changes, reason for change and testing complete sections:
Thank you for your contribution to the Microsoft Sentinel Github repo.

Details of the code changes in your submitted PR.  Providing descriptions for pull requests ensures there is context to changes being made and greatly enhances the code review process.  Providing associated Issues that this resolves also easily connects the reason.

Change(s):

Updated syntax for XYZ.yaml

Reason for Change(s):

New schema used for XYZ.yaml
Resolves ISSUE #1234

Version updated:

Yes
Detections/Analytic Rule templates are required to have the version updated

The code should have been tested in a Microsoft Sentinel environment that does not have any custom parsers, functions or tables, so that you validate no incorrect syntax and execution functions properly.  If your submission requires a custom parser or function, it must be submitted with the PR.

Testing Completed:

Yes/No/Need Help

Note: If updating a detection, you must update the version field.

Before the submission has been made, please look at running the KQL and Yaml Validation Checks locally.
https://github.com/Azure/Azure-Sentinel#run-kql-validation-locally

Checked that the validations are passing and have addressed any issues that are present:

Yes/No/Need Help

Note: Let us know if you have tried fixing the validation error and need help.

References:

Guidance for Detection checks
General contribution guidance
PR validation troubleshooting

Hi @dvir-ms,
Thank you for raising Pull Request with us! We will review it and get back to you by shortly.

Hi @dvir-ms, Thank you for raising Pull Request with us! We will review it and get back to you by shortly.

A colleague of mine reviewed it but she has no permission to approve

Hi @dvir-ms,
Just ask him/her to comment over here like looking good so we can take it further for merging. If necessary, you can do the same with your other PRs.
Thanks

looks good!

authors: dvir-ms oferInbar v-atulyadav v-rusraut


text:
Check for previous/existing GitHub issues/module proposals

[X] I have checked for previous/existing GitHub issues/module proposals.

Check this module doesn't already exist in the module indexes

[X] I have checked for that this module doesn't already exist in the module indexes; or I'm proposing the module to be migrated from CARML/TFVM.

Bicep or Terraform?
Terraform
Module Classification?
Resource Module
Module Name
terraform-azurerm-avm-res-hpc-azure-cyclecloud
Module Details
The module will allow users to deploy Azure CycleCloud utilizing Log Analytics.
Do you want to be the owner of this module?
Yes
Module Owner's GitHub Username (handle)
bsantacruzms
(Optional) Secondary Module Owner's GitHub Username (handle)
No response

@bsantacruzms thank you for the module proposal, could I please ask you to review the resource and pattern  naming convention and confirm the naming of the module and whether it would be a resource or pattern module

@bsantacruzms thank you for the module proposal, could I please ask you to review the resource and pattern  naming convention and confirm the naming of the module and whether it would be a resource or pattern module

@bsantacruzms sending a kind reminder on the above

Closing as @bsantacruzms won't be proceeding forward on this for now and will re-open later as and when needed.

authors: bsantacruzms mbilalamjad

repo: Azure/Azure-Verified-Modules


text:
Fix typos and misspelling

This PR fixes some typos and misspellings found on the toc.md file that are different from the ones pointed in the other Open PRs (#3 and #4 )
Also I wanted to thank for this page which was really useful for me.

@DhruvKumar @msftclas @azurecla @azurecompliance3 @swan-am-i
Can you double check this PR whenever you can?

repo: Azure/AzureDatabricksBestPractices


text:
Diagnostic policy for VWAN s2s VPN gateway

Overview/Summary
This PR add policy that will
enable diagnostic configuration for VWAN s2s VPN gateway
https://dev.azure.com/CSUSolEng/Azure Landing Zones/_workitems/edit/23793/
and remove duplicated category based on
https://github.com/Azure/Enterprise-Scale/issues/1190
This PR fixes/adds/changes/removes

Add new policy to configure diagnostic configuration
add policy to existing initiatives for azure public, China and US
remove duplicated settings from "Deploy Diagnostic Settings for VPN Gateway to Log Analytics workspace" policy

Breaking Changes
no breaking changes
Testing Evidence
Please provide any testing evidence to show that your Pull Request works/fixes as described and planned (include screenshots, if appropriate).

Testing URLs
The below URLs can be updated where the placeholders are, look for {YOUR GITHUB BRANCH NAME HERE - Remove Curly Brackets Also} & {YOUR GITHUB BRANCH NAME HERE - Remove Curly Brackets Also}, to allow you to test your portal deployment experience.

Please also replace the curly brackets on the placeholders {}

Azure Public

Azure US Gov (Fairfax)

As part of this Pull Request I have

[x] Checked for duplicate Pull Requests
[x] Associated it with relevant issues, for tracking and closure.
[x] Ensured my code/branch is up-to-date with the latest changes in the main branch
[x] Performed testing and provided evidence.
[x] Ensured contribution guidance is followed.
[ ] Updated relevant and associated documentation.
[ ] Updated the "What's New?" wiki page (located: /docs/wiki/whats-new.md)

Deployed new definition fine,

Will manually cleanup due to bug #1199

repo: Azure/Enterprise-Scale


text:
Fit & Finish of New Token Picker

### Fit and Finish Tasks
- [ ] Only show 4 tokens/functions by default (today’s experience) together with View x more buttons to allow makers to View All if needed. (Post BUILD)
- [ ] Datatype notation on dynamic items in picker (BUILD)
- [ ] Datatype and Connector icon for tokens (Post Build)
- [ ] Remove icons next to functions intellisense list.
- [ ] Add ability to copy code representation of a dynamic item token

My general assumption is that if there are user studies on PA that show it would be useful then it would also be useful in LA. Generally speaking, we can assume that LA users are a little more technical and likely more developer oriented and therefore able to make better use of this info than those users that would more typically use PA.
I’m generally of the mind to show the information if it’ll be useful to anyone and if it can be displayed in a way that doesn’t obstruct.

repo: Azure/LogicAppsUX


text:
feat(vsts-ci.yaml): Scaffolding to support VHD image building in vsts

This just provides a basic .vsts-ci.yaml file which will be used to produce vhd images in vsts.

/lgtm

authors: CecileRobertMichon jchauncey

repo: Azure/acs-engine

license: mit

license_source: bigquery


text:
Fix the issue that the VMSS upgrading doesn't work if the topology do…

…esn't have master nodes

What this PR does / why we need it:
Which issue this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close that issue when PR gets merged): fixes #
Special notes for your reviewer:
If applicable:

[ ] documentation
[ ] unit tests
[ ] tested backward compatibility (ie. deploy with previous version, upgrade with this branch)

Release note:

/lgtm pending vmss upgrade tests (out of band)


text:
[BUG] New API creation with product not working

Release version
v6.0.1-rc1
Describe the bug
I am trying to create a new API with product as a code first approach. It is failing while creating a new product. It was working fine in older version.
Expected behavior
Product should be created and It should be associated with correct API.
Actual behavior
I checked in azure api portal. The product is not created.
Below are logs.
info: RunPublisher[0]
Found 15 files in scope for publisher.
info: ProductPublisher[0]
Putting product dibyakafka-integration...
info: VersionSetPublisher[0]
Putting version set 66a759b10b90a8ea1fcd02e9...
info: ApiPublisher[0]
Putting API kafkaproject-dibya-testing...
crit: Program[0]
Publisher failed with error HTTP request to URI https://management.azure.com/subscriptions//resourceGroups//providers/Microsoft.ApiManagement/service//products/dibyakafka-integration?api-version=2022-08-01 failed with status code 400. Content is '{"error":{"code":"ValidationError","message":"One or more fields contain incorrect values:","details":[{"code":"ValidationError","target":"name","message":"Product with the same name already exists"}]}}'.
System.Net.Http.HttpRequestException: HTTP request to URI https://management.azure.com/subscriptions//resourceGroups//providers/Microsoft.ApiManagement/service//products/dibyakafka-integration?api-version=2022-08-01 failed with status code 400. Content is '{"error":{"code":"ValidationError","message":"One or more fields contain incorrect values:","details":[{"code":"ValidationError","target":"name","message":"Product with the same name already exists"}]}}'.
at common.HttpPipelineExtensions.<>c__DisplayClass8_0.b__0(Response response) in /home/runner/work/apiops/apiops/tools/code/common/Http.cs:line 157
at LanguageExt.ClassInstances.MEither2.Match[C](Either2 choice, Func2 Left, Func2 Right, Func1 Bottom)          at LanguageExt.Choice.ifLeft[CHOICE,CH,A,B](CH ma, Func2 leftMap)
at LanguageExt.Either2.IfLeft(Func2 leftMap)
at common.HttpPipelineExtensions.PutContent(HttpPipeline pipeline, Uri uri, BinaryData content, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/Http.cs:line 157
at common.ProductModule.PutDto(ProductUri uri, ProductDto dto, HttpPipeline pipeline, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/Product.cs:line 202
at publisher.FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__PutProductInApimHandler.Handle(ProductName name, ProductDto dto, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 165
at publisher.FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__PutProductHandler.<>c__DisplayClass5_0.<b__0>d.MoveNext() in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 134
--- End of stack trace from previous location ---
at common.OptionExtensions.IterTask[T](Option1 option, Func3 action, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/Option.cs:line 22
at common.OptionExtensions.IterTask[T](Option1 option, Func2 action) in /home/runner/work/apiops/apiops/tools/code/common/Option.cs:line 16
at publisher.FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__PutProductHandler.Put(ProductName name, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 134
at publisher.FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__ProductSemaphore.Run(ProductName name, Func3 action, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 80          at publisher.<Product>FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__PutProductHandler.Handle(ProductName name, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 129          at publisher.<ProductApi>F3[411](https://github.com/JLLT-Apps/jllt-apim-deployment/actions/runs/10162048019/job/28102562974#step:7:412)BD3ACF30793D2902BE8879140D7F59EA40968D7EA37366ADE042B568E055__PutProductApiHandler.Put(ApiName name, ProductApiDto dto, ProductName productName, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/ProductApi.cs:line 135          at publisher.<ProductApi>F3411BD3ACF30793D2902BE8879140D7F59EA40968D7EA37366ADE042B568E055__PutProductApiHandler.<>c__DisplayClass7_0.<<Put>b__0>d.MoveNext() in /home/runner/work/apiops/apiops/tools/code/publisher/ProductApi.cs:line 130       --- End of stack trace from previous location ---          at common.OptionExtensions.IterTask[T](Option1 option, Func3 action, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/Option.cs:line 22          at common.OptionExtensions.IterTask[T](Option1 option, Func2 action) in /home/runner/work/apiops/apiops/tools/code/common/Option.cs:line 16          at publisher.<ProductApi>F3411BD3ACF30793D2902BE8879140D7F59EA40968D7EA37366ADE042B568E055__PutProductApiHandler.Put(ApiName name, ProductName productName, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/ProductApi.cs:line 130          at publisher.<ProductApi>F3411BD3ACF30793D2902BE8879140D7F59EA40968D7EA37366ADE042B568E055__ProductApiSemaphore.Run(ApiName name, ProductName productName, Func4 action, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/ProductApi.cs:line 76
at publisher.F3411BD3ACF30793D2902BE8879140D7F59EA40968D7EA37366ADE042B568E055__PutProductApiHandler.Handle(ApiName name, ProductName productName, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/ProductApi.cs:line 125
at publisher.F3411BD3ACF30793D2902BE8879140D7F59EA40968D7EA37366ADE042B568E055__ProcessProductApiHandler.HandleInner(ApiName name, ProductName productName, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/ProductApi.cs:line 95
at publisher.F3411BD3ACF30793D2902BE8879140D7F59EA40968D7EA37366ADE042B568E055__ProductApiSemaphore.Run(ApiName name, ProductName productName, Func4 action, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/ProductApi.cs:line 76          at publisher.<ProductApi>F3411BD3ACF30793D2902BE8879140D7F59EA40968D7EA37366ADE042B568E055__ProcessProductApiHandler.Handle(ApiName name, ProductName productName, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/ProductApi.cs:line 89          at publisher.<ProductApi>F3411BD3ACF30793D2902BE8879140D7F59EA40968D7EA37366ADE042B568E055__FindProductApiActionHandler.<>c__DisplayClass4_0.<<GetAction>b__0>d.MoveNext() in /home/runner/work/apiops/apiops/tools/code/publisher/ProductApi.cs:line 41       --- End of stack trace from previous location ---          at publisher.<App>F715C33012C7543DFB1F8BAA455522A0D1D2CAD6A1577017B69DB81B1DEEB900F__PublishFileHandler.<>c__DisplayClass19_0.<<Handle>b__0>d.MoveNext() in /home/runner/work/apiops/apiops/tools/code/publisher/App.cs:line 78       --- End of stack trace from previous location ---          at common.OptionExtensions.IterTask[T](Option1 option, Func3 action, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/Option.cs:line 22          at common.OptionExtensions.IterTask[T](Option1 option, Func2 action) in /home/runner/work/apiops/apiops/tools/code/common/Option.cs:line 16          at publisher.<App>F715C33012C7543DFB1F8BAA455522A0D1D2CAD6A1577017B69DB81B1DEEB900F__PublishFileHandler.Handle(FileInfo file, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/App.cs:line 78          at System.Threading.Tasks.Parallel.<>c__531.<b__53_0>d.MoveNext()
--- End of stack trace from previous location ---
at common.IEnumerableExtensions.IterParallel[T](IEnumerable1 enumerable, Func3 action, Int32 maxDegreeOfParallelism, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/Enumerable.cs:line 34
at common.IEnumerableExtensions.IterParallel[T](IEnumerable1 enumerable, Func3 action, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/Enumerable.cs:line 24
at publisher.F715C33012C7543DFB1F8BAA455522A0D1D2CAD6A1577017B69DB81B1DEEB900F__RunPublisherHandler.ProcessPublisherFiles(CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/App.cs:line 51
at publisher.F715C33012C7543DFB1F8BAA455522A0D1D2CAD6A1577017B69DB81B1DEEB900F__RunPublisherHandler.Handle(CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/App.cs:line 34
at publisher.Program.RunPublisher(IHost host) in /home/runner/work/apiops/apiops/tools/code/publisher/Program.cs:line 49
info: Microsoft.Hosting.Lifetime[0]
Application is shutting down...
Unhandled exception. System.Net.Http.HttpRequestException: HTTP request to URI https://management.azure.com/subscriptions//resourceGroups//providers/Microsoft.ApiManagement/service/***/products/dibyakafka-integration?api-version=2022-08-01 failed with status code 400. Content is '{"error":{"code":"ValidationError","message":"One or more fields contain incorrect values:","details":[{"code":"ValidationError","target":"name","message":"Product with the same name already exists"}]}}'.
at common.HttpPipelineExtensions.<>c__DisplayClass8_0.b__0(Response response) in /home/runner/work/apiops/apiops/tools/code/common/Http.cs:line 157
at LanguageExt.ClassInstances.MEither2.Match[C](Either2 choice, Func2 Left, Func2 Right, Func1 Bottom)    at LanguageExt.Choice.ifLeft[CHOICE,CH,A,B](CH ma, Func2 leftMap)
at LanguageExt.Either2.IfLeft(Func2 leftMap)
at common.HttpPipelineExtensions.PutContent(HttpPipeline pipeline, Uri uri, BinaryData content, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/Http.cs:line 157
at common.ProductModule.PutDto(ProductUri uri, ProductDto dto, HttpPipeline pipeline, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/Product.cs:line 202
at publisher.FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__PutProductInApimHandler.Handle(ProductName name, ProductDto dto, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 165
at publisher.FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__PutProductHandler.<>c__DisplayClass5_0.<b__0>d.MoveNext() in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 134
--- End of stack trace from previous location ---
at common.OptionExtensions.IterTask[T](Option1 option, Func3 action, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/Option.cs:line 22
at common.OptionExtensions.IterTask[T](Option1 option, Func2 action) in /home/runner/work/apiops/apiops/tools/code/common/Option.cs:line 16
at publisher.FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__PutProductHandler.Put(ProductName name, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 134
at publisher.FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__ProductSemaphore.Run(ProductName name, Func3 action, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 80    at publisher.<Product>FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__PutProductHandler.Handle(ProductName name, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 129    at publisher.<ProductApi>F3411BD3ACF30793D2902BE8879140D7F59EA40968D7EA37366ADE042B568E055__PutProductApiHandler.Put(ApiName name, ProductApiDto dto, ProductName productName, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/ProductApi.cs:line 135    at publisher.<ProductApi>F3411BD3ACF30793D2902BE8879140D7F59EA40968D7EA37366ADE042B568E055__PutProductApiHandler.<>c__DisplayClass7_0.<<Put>b__0>d.MoveNext() in /home/runner/work/apiops/apiops/tools/code/publisher/ProductApi.cs:line 130 --- End of stack trace from previous location ---    at common.OptionExtensions.IterTask[T](Option1 option, Func3 action, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/Option.cs:line 22    at common.OptionExtensions.IterTask[T](Option1 option, Func2 action) in /home/runner/work/apiops/apiops/tools/code/common/Option.cs:line 16    at publisher.<ProductApi>F3411BD3ACF30793D2902BE8879140D7F59EA40968D7EA37366ADE042B568E055__PutProductApiHandler.Put(ApiName name, ProductName productName, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/ProductApi.cs:line 130    at publisher.<ProductApi>F3411BD3ACF30793D2902BE8879140D7F59EA40968D7EA37366ADE042B568E055__ProductApiSemaphore.Run(ApiName name, ProductName productName, Func4 action, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/ProductApi.cs:line 76
at publisher.F3411BD3ACF30793D2902BE8879140D7F59EA40968D7EA37366ADE042B568E055__PutProductApiHandler.Handle(ApiName name, ProductName productName, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/ProductApi.cs:line 125
at publisher.F3411BD3ACF30793D2902BE8879140D7F59EA40968D7EA37366ADE042B568E055__ProcessProductApiHandler.HandleInner(ApiName name, ProductName productName, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/ProductApi.cs:line 95
at publisher.F3411BD3ACF30793D2902BE8879140D7F59EA40968D7EA37366ADE042B568E055__ProductApiSemaphore.Run(ApiName name, ProductName productName, Func4 action, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/ProductApi.cs:line 76    at publisher.<ProductApi>F3411BD3ACF30793D2902BE8879140D7F59EA40968D7EA37366ADE042B568E055__ProcessProductApiHandler.Handle(ApiName name, ProductName productName, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/ProductApi.cs:line 89    at publisher.<ProductApi>F3411BD3ACF30793D2902BE8879140D7F59EA40968D7EA37366ADE042B568E055__FindProductApiActionHandler.<>c__DisplayClass4_0.<<GetAction>b__0>d.MoveNext() in /home/runner/work/apiops/apiops/tools/code/publisher/ProductApi.cs:line 41 --- End of stack trace from previous location ---    at publisher.<App>F715C33012C7543DFB1F8BAA455522A0D1D2CAD6A1577017B69DB81B1DEEB900F__PublishFileHandler.<>c__DisplayClass19_0.<<Handle>b__0>d.MoveNext() in /home/runner/work/apiops/apiops/tools/code/publisher/App.cs:line 78 --- End of stack trace from previous location ---    at common.OptionExtensions.IterTask[T](Option1 option, Func3 action, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/Option.cs:line 22    at common.OptionExtensions.IterTask[T](Option1 option, Func2 action) in /home/runner/work/apiops/apiops/tools/code/common/Option.cs:line 16    at publisher.<App>F715C33012C7543DFB1F8BAA455522A0D1D2CAD6A1577017B69DB81B1DEEB900F__PublishFileHandler.Handle(FileInfo file, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/App.cs:line 78    at System.Threading.Tasks.Parallel.<>c__531.<b__53_0>d.MoveNext()
--- End of stack trace from previous location ---
at common.IEnumerableExtensions.IterParallel[T](IEnumerable1 enumerable, Func3 action, Int32 maxDegreeOfParallelism, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/Enumerable.cs:line 34
at common.IEnumerableExtensions.IterParallel[T](IEnumerable1 enumerable, Func3 action, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/Enumerable.cs:line 24
at publisher.F715C33012C7543DFB1F8BAA455522A0D1D2CAD6A1577017B69DB81B1DEEB900F__RunPublisherHandler.ProcessPublisherFiles(CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/App.cs:line 51
at publisher.F715C33012C7543DFB1F8BAA455522A0D1D2CAD6A1577017B69DB81B1DEEB900F__RunPublisherHandler.Handle(CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/App.cs:line 34
at publisher.Program.RunPublisher(IHost host) in /home/runner/work/apiops/apiops/tools/code/publisher/Program.cs:line 49
at publisher.Program.Main(String[] arguments) in /home/runner/work/apiops/apiops/tools/code/publisher/Program.cs:line 21
at publisher.Program.(String[] arguments)
Reproduction Steps

Create API folder with all data.
create products folder as per the new structure.
product folder
-- apis
-- API id folder name
-- groups folder
-- api.json
-- groiup.json
-- productInformation.json

The error message says that a product with the same name already exists. Names and display names have to be unique. Check that none of these is true:

In your products folder, you have two different products where productInformation.json has properties.displayName with the same name.
You already have a different product in your target APIM instance using the display name set in properties.displayName in your productInformation.json.

We have changed the folder structure recently in preparation for workspaces support. I would advise to run the extractor manually and look at the new folder structure and then switch back to using coat first.

I found the root cause that is displayname. Now I am getting a different error and It is trying to delete product groups settings.
info: Microsoft.Hosting.Lifetime[0]
Application started. Press Ctrl+C to shut down.
info: Microsoft.Hosting.Lifetime[0]
Hosting environment: Production
info: Microsoft.Hosting.Lifetime[0]
Content root path: /home/runner/work/jllt-apim-deployment/jllt-apim-deployment
info: RunPublisher[0]
Found 1 files in scope for publisher.
info: ProductPublisher[0]
Putting product dibyakafka-integration...
warn: ProductPublisher[0]
Removing automatically added administrators from product dibyakafka-integration...
crit: Program[0]
Publisher failed with error HTTP request to URI https://management.azure.com/subscriptions//resourceGroups//providers/Microsoft.ApiManagement/service//products/dibyakafka-integration/groups/administrators?api-version=2022-08-01 failed with status code 409. Content is '{"error":{"code":"ScopeLocked","message":"The scope '/subscriptions//resourceGroups//providers/Microsoft.ApiManagement/service//products/dibyakafka-integration/groups/administrators' cannot perform delete operation because following scope(s) are locked: '/subscriptions//resourceGroups/'. Please remove the lock and try again."}}'.
System.Net.Http.HttpRequestException: HTTP request to URI https://management.azure.com/subscriptions//resourceGroups//providers/Microsoft.ApiManagement/service//products/dibyakafka-integration/groups/administrators?api-version=2022-08-01 failed with status code 409. Content is '{"error":{"code":"ScopeLocked","message":"The scope '/subscriptions//resourceGroups//providers/Microsoft.ApiManagement/service//products/dibyakafka-integration/groups/administrators' cannot perform delete operation because following scope(s) are locked: '/subscriptions//resourceGroups/'. Please remove the lock and try again."}}'.
Unhandled exception. System.Net.Http.HttpRequestException: HTTP request to URI https://management.azure.com/subscriptions//resourceGroups//providers/Microsoft.ApiManagement/service//products/dibyakafka-integration/groups/administrators?api-version=2022-08-01 failed with status code 409. Content is '{"error":{"code":"ScopeLocked","message":"The scope '/subscriptions//resourceGroups//providers/Microsoft.ApiManagement/service//products/dibyakafka-integration/groups/administrators' cannot perform delete operation because following scope(s) are locked: '/subscriptions//resourceGroups/'. Please remove the lock and try again."}}'.
at common.HttpPipelineExtensions.<>c__DisplayClass6_0.b__0(Response response) in /home/runner/work/apiops/apiops/tools/code/common/Http.cs:line 112
at common.HttpPipelineExtensions.<>c__DisplayClass6_0.b__0(Response response) in /home/runner/work/apiops/apiops/tools/code/common/Http.cs:line 112
at LanguageExt.Choice.<>c__DisplayClass12_04.<ifLeft>b__0(A a)    at LanguageExt.ClassInstances.MEither2.Match[C](Either2 choice, Func2 Left, Func2 Right, Func1 Bottom)
at LanguageExt.Choice.ifLeft[CHOICE,CH,A,B](CH ma, Action1 Left)    at LanguageExt.Either2.IfLeft(Action1 Left)    at common.HttpPipelineExtensions.DeleteResource(HttpPipeline pipeline, Uri uri, Boolean waitForCompletion, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/Http.cs:line 106    at common.ProductGroupModule.Delete(ProductGroupUri uri, HttpPipeline pipeline, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/ProductGroup.cs:line 135    at publisher.<Product>FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__PutProductInApimHandler.<>c__DisplayClass6_0.<<DeleteAutomaticallyCreatedProductGroups>b__1>d.MoveNext() in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 185 --- End of stack trace from previous location ---    at common.IAsyncEnumerableExtensions.<>c__DisplayClass5_01.<b__0>d.MoveNext() in /home/runner/work/apiops/apiops/tools/code/common/Enumerable.cs:line 97
--- End of stack trace from previous location ---
at System.Threading.Tasks.Parallel.<>c__571.<<ForEachAsync>b__57_0>d.MoveNext() --- End of stack trace from previous location ---    at common.IAsyncEnumerableExtensions.IterParallel[T](IAsyncEnumerable1 enumerable, Func3 action, Int32 maxDegreeOfParallelism, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/Enumerable.cs:line 110    at common.IAsyncEnumerableExtensions.IterParallel[T](IAsyncEnumerable1 enumerable, Func2 action, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/Enumerable.cs:line 97    at publisher.<Product>FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__PutProductInApimHandler.DeleteAutomaticallyCreatedProductGroups(ProductName productName, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 182    at publisher.<Product>FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__PutProductInApimHandler.Handle(ProductName name, ProductDto dto, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 1[70](https://github.com/JLLT-Apps/jllt-apim-deployment/actions/runs/10163978904/job/28108250983#step:7:71)    at publisher.<Product>FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB[71](https://github.com/JLLT-Apps/jllt-apim-deployment/actions/runs/10163978904/job/28108250983#step:7:72)A3B67B624__PutProductHandler.<>c__DisplayClass5_0.<<Put>b__0>d.MoveNext() in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 134 --- End of stack trace from previous location ---    at common.OptionExtensions.IterTask[T](Option1 option, Func3 action, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/Option.cs:line 22    at common.OptionExtensions.IterTask[T](Option1 option, Func2 action) in /home/runner/work/apiops/apiops/tools/code/common/Option.cs:line 16    at publisher.<Product>FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4[72](https://github.com/JLLT-Apps/jllt-apim-deployment/actions/runs/10163978904/job/28108250983#step:7:73)7E3EF480CB71A3B67B624__PutProductHandler.Put(ProductName name, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 134    at publisher.<Product>FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__ProductSemaphore.Run(ProductName name, Func3 action, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 80
at publisher.FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__PutProductHandler.Handle(ProductName name, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 129
at publisher.FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__ProcessProductHandler.HandleInner(ProductName name, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 99
at publisher.FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__ProductSemaphore.Run(ProductName name, Func3 action, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 80    at publisher.<Product>FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__ProcessProductHandler.Handle(ProductName name, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 93    at publisher.<Product>FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__FindProductActionHandler.<>c__DisplayClass4_0.<<GetAction>b__0>d.MoveNext() in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 45 --- End of stack trace from previous location ---    at publisher.<App>F715C33012C[75](https://github.com/JLLT-Apps/jllt-apim-deployment/actions/runs/10163978904/job/28108250983#step:7:76)43DFB1F8BAA455522A0D1D2CAD6A1577017B69DB81B1DEEB900F__PublishFileHandler.<>c__DisplayClass19_0.<<Handle>b__0>d.MoveNext() in /home/runner/work/apiops/apiops/tools/code/publisher/App.cs:line 78 --- End of stack trace from previous location ---    at common.OptionExtensions.IterTask[T](Option1 option, Func3 action, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/Option.cs:line 22    at common.OptionExtensions.IterTask[T](Option1 option, Func2 action) in /home/runner/work/apiops/apiops/tools/code/common/Option.cs:line 16    at publisher.<App>F715C33012C7543DFB1F8BAA455522A0D1D2CAD6A15[77](https://github.com/JLLT-Apps/jllt-apim-deployment/actions/runs/10163978904/job/28108250983#step:7:78)017B69DB81B1DEEB900F__PublishFileHandler.Handle(FileInfo file, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/App.cs:line [78](https://github.com/JLLT-Apps/jllt-apim-deployment/actions/runs/10163978904/job/28108250983#step:7:79)    at System.Threading.Tasks.Parallel.<>c__531.<b__53_0>d.MoveNext()
--- End of stack trace from previous location ---
at common.IEnumerableExtensions.IterParallel[T](IEnumerable1 enumerable, Func3 action, Int32 maxDegreeOfParallelism, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/Enumerable.cs:line 34
at common.IEnumerableExtensions.IterParallel[T](IEnumerable1 enumerable, Func3 action, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/Enumerable.cs:line 24
at publisher.F715C33012C7543DFB1F8BAA455522A0D1D2CAD6A1577017B69DB81B1DEEB900F__RunPublisherHandler.ProcessPublisherFiles(CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/App.cs:line 51
at publisher.F715C33012C7543DFB1F8BAA455522A0D1D2CAD6A1577017B69DB81B1DEEB900F__RunPublisherHandler.Handle(CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/App.cs:line 34
at publisher.Program.RunPublisher(IHost host) in /home/runner/work/apiops/apiops/tools/code/publisher/Program.cs:line 49
at publisher.Program.Main(String[] arguments) in /home/runner/work/apiops/apiops/tools/code/publisher/Program.cs:line 21
at publisher.Program.(String[] arguments)
at LanguageExt.Choice.<>c__DisplayClass12_04.<ifLeft>b__0(A a)          at LanguageExt.ClassInstances.MEither2.Match[C](Either2 choice, Func2 Left, Func2 Right, Func1 Bottom)
at LanguageExt.Choice.ifLeft[CHOICE,CH,A,B](CH ma, Action1 Left)          at LanguageExt.Either2.IfLeft(Action1 Left)          at common.HttpPipelineExtensions.DeleteResource(HttpPipeline pipeline, Uri uri, Boolean waitForCompletion, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/Http.cs:line 106          at common.ProductGroupModule.Delete(ProductGroupUri uri, HttpPipeline pipeline, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/ProductGroup.cs:line 135          at publisher.<Product>FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF4[80](https://github.com/JLLT-Apps/jllt-apim-deployment/actions/runs/10163978904/job/28108250983#step:7:81)CB71A3B67B624__PutProductInApimHandler.<>c__DisplayClass6_0.<<DeleteAutomaticallyCreatedProductGroups>b__1>d.MoveNext() in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 185       --- End of stack trace from previous location ---          at common.IAsyncEnumerableExtensions.<>c__DisplayClass5_01.<b__0>d.MoveNext() in /home/runner/work/apiops/apiops/tools/code/common/Enumerable.cs:line 97
--- End of stack trace from previous location ---
at System.Threading.Tasks.Parallel.<>c__571.<<ForEachAsync>b__57_0>d.MoveNext()       --- End of stack trace from previous location ---          at common.IAsyncEnumerableExtensions.IterParallel[T](IAsyncEnumerable1 enumerable, Func3 action, Int32 maxDegreeOfParallelism, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/Enumerable.cs:line 110          at common.IAsyncEnumerableExtensions.IterParallel[T](IAsyncEnumerable1 enumerable, Func2 action, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/Enumerable.cs:line 97          at publisher.<Product>FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__PutProductInApimHandler.DeleteAutomaticallyCreatedProductGroups(ProductName productName, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 182          at publisher.<Product>FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__PutProductInApimHandler.Handle(ProductName name, ProductDto dto, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 170          at publisher.<Product>FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__PutProductHandler.<>c__DisplayClass5_0.<<Put>b__0>d.MoveNext() in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 134       --- End of stack trace from previous location ---          at common.OptionExtensions.IterTask[T](Option1 option, Func3 action, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/Option.cs:line 22          at common.OptionExtensions.IterTask[T](Option1 option, Func2 action) in /home/runner/work/apiops/apiops/tools/code/common/Option.cs:line 16          at publisher.<Product>FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__PutProductHandler.Put(ProductName name, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 134          at publisher.<Product>FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__ProductSemaphore.Run(ProductName name, Func3 action, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 80
at publisher.FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__PutProductHandler.Handle(ProductName name, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 129
at publisher.FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__ProcessProductHandler.HandleInner(ProductName name, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 99
at publisher.FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__ProductSemaphore.Run(ProductName name, Func3 action, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 80          at publisher.<Product>FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__ProcessProductHandler.Handle(ProductName name, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 93          at publisher.<Product>FBA64563D1F5F5496D6EB519F9557EF11C46E3E1F4727E3EF480CB71A3B67B624__FindProductActionHandler.<>c__DisplayClass4_0.<<GetAction>b__0>d.MoveNext() in /home/runner/work/apiops/apiops/tools/code/publisher/Product.cs:line 45       --- End of stack trace from previous location ---          at publisher.<App>F715C33012C7543DFB1F8BAA455522A0D1D2CAD6A1577017B69DB[81](https://github.com/JLLT-Apps/jllt-apim-deployment/actions/runs/10163978904/job/28108250983#step:7:82)B1DEEB900F__PublishFileHandler.<>c__DisplayClass19_0.<<Handle>b__0>d.MoveNext() in /home/runner/work/apiops/apiops/tools/code/publisher/App.cs:line 78       --- End of stack trace from previous location ---          at common.OptionExtensions.IterTask[T](Option1 option, Func3 action, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/Option.cs:line 22          at common.OptionExtensions.IterTask[T](Option1 option, Func2 action) in /home/runner/work/apiops/apiops/tools/code/common/Option.cs:line 16          at publisher.<App>F715C33012C7543DFB1F8BAA455522A0D1D2CAD6A1577017B69DB81B1DEEB900F__PublishFileHandler.Handle(FileInfo file, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/App.cs:line 78          at System.Threading.Tasks.Parallel.<>c__531.<b__53_0>d.MoveNext()
--- End of stack trace from previous location ---
at common.IEnumerableExtensions.IterParallel[T](IEnumerable1 enumerable, Func3 action, Int32 maxDegreeOfParallelism, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/Enumerable.cs:line 34
at common.IEnumerableExtensions.IterParallel[T](IEnumerable1 enumerable, Func3 action, CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/common/Enumerable.cs:line 24
at publisher.F715C33012C7543DFB1F8BAA455522A0D1D2CAD6A1577017B69DB81B1DEEB900F__RunPublisherHandler.ProcessPublisherFiles(CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/App.cs:line 51
at publisher.F715C33012C7543DFB1F8BAA455522A0D1D2CAD6A1577017B69DB81B1DEEB900F__RunPublisherHandler.Handle(CancellationToken cancellationToken) in /home/runner/work/apiops/apiops/tools/code/publisher/App.cs:line 34
at publisher.Program.RunPublisher(IHost host) in /home/runner/work/apiops/apiops/tools/code/publisher/Program.cs:line 49
Exception: /home/runner/work/_temp/06c58a82-0a9e-4822-86cd-92a10fe6670d.ps1:41
Line |
41 |  if ($LASTEXITCODE -ne 0) { throw "Running publisher failed."}
|                             ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
| Running publisher failed.
Error: Process completed with exit code 1.

@guythetechie  could you provide some fix for this issue ?

It's not an issue, works as expected.
When you create a brand new product, APIM automatically a product group association with the built-in administrators group.
With ApiOps though, we want Git to be the source of truth. The product group association should only happen if it's been defined in Git. So, for brand new products, we remove the automatically created product group association. If the product has been associated with a group in Git, ApiOps will do the association.
You can see that behavior in your logs here:
Found 1 files in scope for publisher.
Putting product dibyakafka-integration...
WARN: Removing automatically added administrators from product dibyakafka-integration...

So what is the solution here ? Do you want us to remove the Azure lock? I am still not fully convinced that It is triggering a delete event. I have copied an existing product that I got from the extractor pipeline which has existing product groups. I just copied the folder structures with a different name. It was working fine in the previous versions. Let me the solution for this as this is a blocker for us.

@guythetechie, @waelkdouh  any comment on the above points ?

@DibyaRanjan1 - this is a community-driven, open-source project. @waelkdouh and I have full-time jobs and personal responsibilities. We work on ApiOps in our spare time. Please do not post every few hours asking for updates; we'll get to your issue when we can.
To your question above, the fix is to temporarily remove the APIM resource lock. The default product group association only gets deleted when the publisher creates the product. If the product already exists when the publisher runs, it should not try to delete the group association. If you're experiencing different behavior, let us know; it's a bug and should be addressed.
Also, deletes are a major component of ApiOps. If somebody deletes a resource in Git, ApiOps will try to delete the corresponding resource. A lock on the APIM instance will prevent this from working.

Thank you. Never mind.

authors: DibyaRanjan1 guythetechie waelkdouh

repo: Azure/apiops


text:
Add linux-arm64 into release

Fixes #369

@ross-p-smith thank you for your contributions!

authors: ross-p-smith waelkdouh


text:
[Discussion] Azure Functions Runtime 2.0.12427 release

Discussion issue for the Azure Functions runtime release 2.0.12427

Deployment is complete.

authors: brettsam soninaren


text:
Any thoughts of having a secure backend?

I'm a new comer of Azure with some past experience of Kubernetes and EKS.
I'm just wondering if there will be a secure backend options after the ingress has done SSL termination. For example: Annotation: Nginx ingress controller
I would like to get more features in this ingress controller with Azure App Gateway, hopefully more feature will attract more people to use it: Ingress controller base on cloud platform customized CNI is a nice approach to avoid extra hops inside the cluster, hence reduce latency.
Please feel free to reference and close the issue if there's a similar one.

Yes, Backend HTTPS is in the pipeline.

We are working on this but we don't have an ETA yet.

Similar issue: https://github.com/Azure/application-gateway-kubernetes-ingress/issues/187

Is there a comparison of the Application Gateway featureset and this Ingress Controller featureset? Like what is implemented and what not?
Because the FAQ says Application Gateway already supports this.

@akshaysngupta - any update on this and how to configure? As per https://docs.microsoft.com/en-us/azure/application-gateway/application-gateway-faq#does-application-gateway-support-reencryption-of-traffic-to-the-backend .
I work in environments where all traffic between cloud components must be encrypted so this is an essential feature. Thanks.

If you are using certificate signed well-known CAs. You can reference this document: https://github.com/Azure/application-gateway-kubernetes-ingress/blob/master/docs/annotations.md#backend-protocol
If you have your own PKI/self-signed certificate, we still some work left on AGIC.

@akshaysngupta Do you have more information on how the communication between AGW and backend service when configured by AGIC is happening?
We have certs signed by LetsEncrypt but of course they are only valid for mysvc.ourcluster.company.com. Does AGIC and AGW use mysvc.ourcluster.company.com for connection (the example from the annotation docs does not include any hostnames in Ingress definition)? If so, how does it actually determine the hosts etc? And is there any way to verify it in for example Azure Portal? And if it's not configured correctly, where do we go to check for logs or errors?

@StianOvrevage You can now use:

appgw.ingress.kubernetes.io/backend-hostname to modify the hostname used while talking to the backend.
appgw.ingress.kubernetes.io/appgw-trusted-root-certificate can be used to provide the root certificate that will used to verify backend certs.

authors: StianOvrevage akshaysngupta draychev kwaazaar marrobi solacens


text:
[Dpg][Bug] Support type narrow down

Describe the issue or request
For instance we could have this in tsp:
model Foo {
	p: int64;
}

model Bar extends Foo {
	p: int32;
}

in which the model Bar extends Foo and narrows down the type of property p inherited from Foo.
We currently are not supporting this properly (the generator throws key already added exception).

Narrow down could also happen with union types, such as:
model Foo {
	p: string | int32;
}

model Bar extends Foo {
	p: string;
}

or with literal unions
model Foo {
	p: "a" | "b";
}

model Bar extends Foo {
	p: "b";
}

Even this could compile as a tsp:
model Foo {
  p: string;
}

model Bar extends Foo {
  p?: string;
}


text:
Simplify the generation script

Description
I noticed that we have too many configurations inside our eng/Generate.ps1 script. Such as, some projects need to have some special flags to work, the name list of the projects we are going to generate and run. These things make our generate script cumbersome and hard to read.
In this PR,

I removed the special options for some cadlRanch projects, instead, I introduced cadl-project.yaml file in those projects to hold their special options.
I extracted the list of cadl ranch project name list and test server test name list into a json file, so that in the future if we have a new test to add, we do not have to modify the script.

Checklist
To ensure a quick review and merge, please ensure:

[ ] The PR has a understandable title and description explaining the why and what.
[ ] The PR is opened in draft if not ready for review yet.

If opened in draft, please allocate sufficient time (24 hours) after moving out of draft for review

[ ] The branch is recent enough to not have merge conflicts upon creation.

Ready to Land?

[ ] Build is completely green

Submissions with test failures require tracking issue and approval of a CODEOWNER

[ ] At least one +1 review by a CODEOWNER
[ ] All -1 reviews are confirmed resolved by the reviewer

Override/Marking reviews stale must be discussed with CODEOWNERS first

Hi @m-nash could you take a look at this PR?


text:
tsp, upgrade TCGC version to 0.44.2

code: 88f6c1cd86704f2069ae124824ed6bdc31dbbcc0
logics change mainly on:

built in types change
multipart form data handling logic change

Multipart is handled in this pr, I will fix CI and merge this.

code LGTM
I forgot multipart also has behavior break (on the isMulti and its type)... If it is close to work, you can finish it. If it seems still having problem, I can take the rest of the PR.


text:
toolchain installation failure

Version
1.0.33+
When running the ./toolset/scripts/install.sh not being root, if the /tmp folder contains unaccessible files or folders, the following ansible task will failed to return the location of the azcopy extraction
    - name: "AzCopy: Find azcopy (CentOS)"
      find:
        paths: /tmp
        patterns: "azcopy"
        file_type: file
        recurse: true
      register: azcopy_file_path

Yeah, there were some rough-edges in the original PR and this was one of them.  A simple solution is to create a build directory in the az-hop source dir and use that instead of /tmp.  Do you see any issues with that?

#1430 address this

authors: xpillons yosoyjay

repo: Azure/az-hop


text:
using zerolog

Description
using zerolog logging framework
Checklist
Please make sure you've completed the relevant tasks for this PR, out of the following list:

[x] Code compiles correctly
[ ] Created/updated tests
[x] Unit tests passing

Codecov Report

Merging #111 (8c8334a) into main (ae7580f) will not change coverage.
The diff coverage is 0.00%.

@@           Coverage Diff           @@
##             main     #111   +/-   ##
=======================================
  Coverage   46.19%   46.19%
=======================================
  Files          48       48
  Lines        2392     2392
=======================================
  Hits         1105     1105
  Misses       1279     1279
  Partials        8        8

Impacted Files
Coverage Δ

internal/scanners/afd/afd.go
0.00% <0.00%> (ø)

internal/scanners/afw/afw.go
0.00% <0.00%> (ø)

internal/scanners/agw/agw.go
0.00% <0.00%> (ø)

internal/scanners/aks/aks.go
0.00% <0.00%> (ø)

internal/scanners/apim/apim.go
0.00% <0.00%> (ø)

internal/scanners/appcs/appcs.go
0.00% <0.00%> (ø)

internal/scanners/appi/appi.go
0.00% <0.00%> (ø)

internal/scanners/cae/cae.go
0.00% <0.00%> (ø)

internal/scanners/ci/ci.go
0.00% <0.00%> (ø)

internal/scanners/cosmos/cosmos.go
0.00% <0.00%> (ø)

... and 15 more

authors: cmendible codecov-commenter

repo: Azure/azqr


text:
remove section about turning off Enhanced Network Security

Edit the doc to remove the section about turning off Enhanced Network Security. Basically, have them download the installer executable first, then drag it to the VM to install.

Tyler, was there a conscious decision to only talk about setting up the PBI gateway, and that's it? We had other documentation that went further and showed them how to create a sample dashboard using PBI online - do we want that? I'm guessing yes, since Emmanuel is working on this I believe, but wanted to double check.

Let me summarize my thoughts and hopefully this will bring some clarity. In all the TRI presentations we reference Power BI as the interactive reporting endpoint. Due to this promise, it is incumbent upon us to make sure we document how to get Power BI connected to the system and running a report. Beyond this initial setup, we need to limit the amount of time we spend documenting because most of this documentation should be left to Power BI itself.
With that said, if there is documentation about PBI dashboards that has not been properly transferred from VSO to GitHub, this was not a conscious decision but simply got lost in the shuffle. I know you personally worked on this documentation so, by all means, please move it over to the GitHub repository as you see fit or have Emmanuel do it with his work.
From: Robert Alexander [mailto:notifications@github.com]
Sent: Wednesday, November 15, 2017 1:15 PM
To: Azure/azure-arch-enterprise-bi-and-reporting azure-arch-enterprise-bi-and-reporting@noreply.github.com
Cc: Tyler Clintworth tyclintw@microsoft.com; Review requested review_requested@noreply.github.com
Subject: Re: [Azure/azure-arch-enterprise-bi-and-reporting] remove section about turning off Enhanced Network Security (#36)
Tyler, was there a conscious decision to only talk about setting up the PBI gateway, and that's it? We had other documentation that went further and showed them how to create a sample dashboard using PBI online - do we want that? I'm guessing yes, since Emmanuel is working on this I believe, but wanted to double check.
—
You are receiving this because your review was requested.
Reply to this email directly, view it on GitHubhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FAzure%2Fazure-arch-enterprise-bi-and-reporting%2Fpull%2F36%23issuecomment-344730537&data=02|01|tyclintw%40microsoft.com|623479442338409b888508d52c6dfd8b|72f988bf86f141af91ab2d7cd011db47|1|0|636463773272579744&sdata=n3WBLnVJMwBzo%2FWstRHc%2FilrxerhxhDsNbWSGsYyG80%3D&reserved=0, or mute the threadhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FASmEMS_crFLCG7LSlGmLperqv98Qmjr3ks5s21RsgaJpZM4Qfi7C&data=02|01|tyclintw%40microsoft.com|623479442338409b888508d52c6dfd8b|72f988bf86f141af91ab2d7cd011db47|1|0|636463773272579744&sdata=H9CpJI2%2FofBx6ib8mVsyOcylnLQ3nbmiW5qlB5U8dwo%3D&reserved=0.

Got it - thanks Tyler. Between Emmanuel and me we'll get the dashboard creation content in.

authors: roalexan tyclintw


text:
az logic workflow list not working

This is autogenerated. Please review and update as needed.
Describe the bug
Command Name
az logic workflow list Extension Name: logic. Version: 0.1.0.
Errors:
Unable to deserialize to object: type, KeyError: 'FlowAccessControlConfiguration'
Traceback (most recent call last):
pip-install-0h14b6sb\msrest\msrest\serialization.py, ln 1297, in _deserialize
pip-install-0h14b6sb\msrest\msrest\serialization.py, ln 1452, in deserialize_data
KeyError: 'FlowAccessControlConfiguration'

...

pip-install-0h14b6sb\msrest\msrest\serialization.py, ln 1297, in _deserialize
pip-install-0h14b6sb\msrest\msrest\serialization.py, ln 1452, in deserialize_data
msrest.exceptions.DeserializationError: Unable to deserialize to object: type, KeyError: 'FlowAccessControlConfiguration'

To Reproduce:
Steps to reproduce the behavior. Note that argument values have been redacted, as they may contain sensitive information.

Put any pre-requisite steps here...
az logic workflow list

Expected Behavior
Environment Summary
Windows-10-10.0.19041-SP0
Python 3.6.6
Installer: MSI

azure-cli 2.8.10 *

Extensions:
azure-devops 0.18.0
logic 0.1.0

Additional Context

logic

hi @yonzhan Logic RP is transferred from Rodge's team to your team :)
Desktop Virtualization and Logic.

logic

Do you need other prerequisites to reproduce this problem? I did not find the same problem in the following versions.
azure-cli: 2.27.0
logic: 0.1.4

authors: PARADISSEEKR mickelsonm yonzhan yungezz

repo: Azure/azure-cli-extensions


text:
az aks kollect fails with error: the server doesn't have a resource type "apd"

Describe the bug
Command Name
az aks kollect Extension Name: aks-preview. Version: 0.5.0.
Errors:
error: the server doesn't have a resource type "apd"
CLIInternalError: The command failed with an unexpected error. Here is the traceback:
Command '['kubectl', '--kubeconfig', 'C:\\Users\\Misha\\AppData\\Local\\Temp\\tmpvcvcwh5c', 'get', 'apd', '-n', 'aks-periscope', '--no-headers']' returned non-zero exit status 1.
Traceback (most recent call last):
Temp\pip-unpacked-wheel-49qlvzn7\knack\cli.py, ln 215, in invoke
cli\core\commands\__init__.py, ln 654, in execute
cli\core\commands\__init__.py, ln 718, in _run_jobs_serially
cli\core\commands\__init__.py, ln 711, in _run_job
Local\Temp\pip-unpacked-wheel-tle01379\six.py, ln 703, in reraise
...
subprocess.py, ln 438, in run
subprocess.CalledProcessError: Command '['kubectl', '--kubeconfig', 'C:\\Users\\Misha\\AppData\\Local\\Temp\\tmpvcvcwh5c', 'get', 'apd', '-n', 'aks-periscope', '--no-headers']' returned non-zero exit status 1.

To Reproduce:
Steps to reproduce the behavior. Note that argument values have been redacted, as they may contain sensitive information.

Put any pre-requisite steps here...
az aks kollect -g {} -n {} --storage-account {}

Expected Behavior
Environment Summary
Windows-10-10.0.18362-SP0
Python 3.6.8
Installer: MSI

azure-cli 2.14.0 *

Extensions:
aks-preview 0.5.0

Additional Context

route to appropriate team

This works now with the latest version of az cli. Please reopen if you are still facing this issue.

authors: RakeshMohanMSFT Skybladev2 yungezz


text:
aks-preview version since 0.5.69 does not support multi AZs while add nodepool in China north3

If the issue is to do with Azure CLI 2.0 in-particular, create an issue here at Azure/azure-cli

Related command

az aks nodepool add --name apl01 \

--resource-group $k8s_service_resource_group
--subscription $subscription_id
--cluster-name $cluster_name
--mode user
--vnet-subnet-id $vnet_subnet_id
--kubernetes-version $k8s_version
--node-vm-size Standard_D2s_v3
--os-sku $os_sku
--node-count 3
--min-count 3
--enable-cluster-autoscaler
--max-count 10
--zones 1 2 3

Extension name (the extension in question)
aks-preview
Description of issue (in as much detail as possible)
We found the aks-preview since 0.5.69 does not support multi AZs while add nodepool in China north3 .
az cli version is 2.35.0

vmadmin@reh-sharedservices-jumpbox-ubuntu:~$ az aks nodepool add --name apl01 \

--resource-group $k8s_service_resource_group
--subscription $subscription_id
--cluster-name $cluster_name
--mode user
--vnet-subnet-id $vnet_subnet_id
--kubernetes-version $k8s_version
--node-vm-size Standard_D2s_v3
--os-sku $os_sku
--node-count 3
--min-count 3
--enable-cluster-autoscaler
--max-count 10
--zones 1 2 3
The behavior of this command has been altered by the following extension: aks-preview
{
"availabilityZones": null,
"capacityReservationGroupId": null,
"count": 3,
"creationData": null,
"currentOrchestratorVersion": null,
"enableAutoScaling": true,
"enableCustomCaTrust": false,
"enableEncryptionAtHost": false,
"enableFips": false,
"enableNodePublicIp": false,
"enableUltraSsd": false,
"gpuInstanceProfile": null,
"hostGroupId": null,
"id": "/subscriptions/efe0bd3e-c9a6-4339-8d0f-62cce5d68fe8/resourcegroups/aks-reh-poc/providers/Microsoft.ContainerService/managedClusters/my-aks-poc/agentPools/apl01",
"kubeletConfig": null,
"kubeletDiskType": "OS",
"linuxOsConfig": null,
"maxCount": 10,
"maxPods": 110,
"messageOfTheDay": null,
"minCount": 3,
"mode": "User",
"name": "apl01",
"nodeImageVersion": "AKSUbuntu-1804gen2containerd-2022.05.16",
"nodeLabels": null,
"nodePublicIpPrefixId": null,
"nodeTaints": null,
"orchestratorVersion": "1.21.7",
"osDiskSizeGb": 128,
"osDiskType": "Managed",
"osSku": "Ubuntu",
"osType": "Linux",
"podSubnetId": null,
"powerState": {
"code": "Running"
},
"provisioningState": "Succeeded",
"proximityPlacementGroupId": null,
"resourceGroup": "aks-reh-poc",
"scaleDownMode": "Delete",
"scaleSetEvictionPolicy": null,
"scaleSetPriority": null,
"spotMaxPrice": null,
"tags": null,
"type":
Issue Scope:

We did the test with various aks-preview version and 0.5.68 may be the last version to support mutli AZs in China north3.
Would you please check this ?
vmadmin@reh-sharedservices-jumpbox-ubuntu:~$ az extension list
[
{
"experimental": false,
"extensionType": "whl",
"name": "aks-preview",
"path": "/home/vmadmin/.azure/cliextensions/aks-preview",
"preview": true,
"version": "0.5.68"
}
]

route to CXP team

@singvey999 Thanks for reaching out to us and sharing this feedback. We are looking into this. We will provide an update once we have more details.

@singvey999 I see that you are using an older version of aks-preview. Could you please update it to the most recent version using the below command and then test again ?

az extension update -n aks-preview

Hope this helps. Awaiting your reply.

Dear All,
We tried with aks-preview 0.5.79 and still the same issue no AZs.
vmadmin@reh-sharedservices-aks-jumpbox-ubuntu:~$  az version
{
"azure-cli": "2.37.0",
"azure-cli-core": "2.37.0",
"azure-cli-telemetry": "1.0.6",
"extensions": {
"aks-preview": "0.5.79"
}
}
vmadmin@reh-sharedservices-aks-jumpbox-ubuntu:~$
vmadmin@reh-sharedservices-aks-jumpbox-ubuntu:~$  az aks nodepool add --name apl01   --resource-group $k8s_service_resource_group   --subscription $subscription_id   --cluster-name $cluster_name   --mode user   --vnet-subnet-id $vnet_subnet_id   --kubernetes-version $k8s_version   --node-vm-size Standard_D2s_v3   --os-sku $os_sku   --node-count 3   --min-count 3   --enable-cluster-autoscaler   --max-count 10   --zones 1 2 3 &
[1] 3553
vmadmin@reh-sharedservices-aks-jumpbox-ubuntu:~$  The behavior of this command has been altered by the following extension: aks-preview
g | Running ..
az aks nodepool add --name apl01 --resource-group $k8s_service_resource_group --subscription $subscription_id --cluster-name $cluster_name --mode user --vnet-subnet-id $vnet_subnet_id --kubernetes-version $k8s_version --node-vm-size Standard_D2s_v3 --os-sku $os_sku --node-count 3 --min-count 3 --enable-cluster-autoscaler --max-count 10 --zones 1 2 3
{
"availabilityZones": null,
"capacityReservationGroupId": null,
"count": 3,
"creationData": null,
"currentOrchestratorVersion": null,
"enableAutoScaling": true,
"enableCustomCaTrust": false,
"enableEncryptionAtHost": false,
"enableFips": false,
"enableNodePublicIp": false,
"enableUltraSsd": false,
"gpuInstanceProfile": null,
"hostGroupId": null,

Hi @singvey999, sorry for the inconvenience, this error was caused by a change in the PR #4748 to the deprecated --node-zones option.
I’ve opened this PR #4970 to fix the issue and a new version (0.5.80) of aks-preview has been released. Please update aks-preview to latest version via az extension update -n aks-preview.

Dear All,
We tried with 0.5.80 and got the zonal vmss .

@singvey999 Thanks for getting back. We will now proceed with closure of this github issue. If you need any further assistance on this issue in future, please feel free to reopen this thread. We would be happy to help.

authors: FumingZhang navba-MSFT singvey999 yonzhan


text:
operationstatusresult api cli

This checklist is used to make sure that common guidelines for a pull request are followed.
Related command

General Guidelines

[x] Have you run azdev style <YOUR_EXT> locally? (pip install azdev required)
[x] Have you run python scripts/ci/test_index.py -q locally? (pip install wheel==0.30.0 required)
[x] My extension version conforms to the Extension version schema

For new extensions:

[ ] My extension description/summary conforms to the Extension Summary Guidelines.

About Extension Publish
There is a pipeline to automatically build, upload and publish extension wheels.
Once your pull request is merged into main branch, a new pull request will be created to update src/index.json automatically.
You only need to update the version information in file setup.py and historical information in file HISTORY.rst in your PR but do not modify src/index.json.

Thank you for your contribution! We will review the pull request and get back to you soon.

please resolve the code conflict.

@yanzhudd  @wangzelin007 , Can you help review again?

authors: wenhug yanzhudd yonzhan


text:
'az pack build' fails with Heroku Buildpacks due to incompatible platform API

Incompatible Platform API
Heroku example fails due to Platform API being incompatible with builder, source: https://docs.microsoft.com/sv-se/cli/azure/acr/pack?view=azure-cli-latest
Command Name
az acr pack build
Errors:
ERROR: pack v0.4.1 (git sha: 90e88e7b1dc02ca65e22548fdfbeabec4c9879a6) (Platform API version 0.1) is incompatible with builder heroku/buildpacks:18 (Platform API version 0.3)
2020/05/27 01:01:59 Container failed during run: acb_step_0. No retries remaining.
failed to run step ID: acb_step_0: exit status 1

Run ID: ca6 failed after 1m9s. Error: failed during run, err: exit status 1
Run failed

To Reproduce:
Fill in <registryname> with a valid value.

az acr pack build -r <registryname> -t {{.Run.Registry}}/node-app:{{.Run.ID}} --pull --builder heroku/buildpacks:18 https://github.com/Azure-Samples/nodejs-docs-hello-world.git

Expected Behavior
Expected buildpack to be produced and deployed to registry.
Environment Summary
macOS-10.15.4-x86_64-i386-64bit
Python 3.8.2
Installer: HOMEBREW

azure-cli 2.6.0

Additional Context

routing to appropriate team

@northtyphoon, please investigate

Is there any update on this? We're running into the same issue.

@dorfire is there any known issue with "Heroku Buildpacks"?

Thanks for reporting this @ericmichael!
Seems like it's related to an outdated version of the pack CLI tool. I'm working on a new pack runner image with pack 0.12.0; I'll let you know if it resolves the issue and post exact instructions.

Hey @ericmichael,
this seems to resolve the issue:
az acr pack build -r MyRegistry -t {{.Run.Registry}}/node-app:{{.Run.ID}} --pack-image-tag 20200715.1-patch1 --pull --builder heroku/buildpacks:18 https://github.com/Azure-Samples/nodejs-docs-hello-world.git

Can you confirm that it works for you?

@ericmichael Apologies for the late reply. Could you please run the sample command mentioned here using the most recent CLI version and check if you are still facing the issue ? This issue is open for quite sometime. Please let us know if you need any further assistance on this. Awaiting your reply.

authors: dorfire ericmichael navba-MSFT northtyphoon rmachielse yugangw-msft yungezz

repo: Azure/azure-cli


text:
AZ CLI join command doesn't appear to work

This is autogenerated. Please review and update as needed.
Describe the bug
Trying to concatenate 2 files in ADLS Gen1 using the Azure CLI throws Python exception
Command Name
az dls fs join
Errors:
should_retry() takes 1 positional argument but 4 were given
Traceback (most recent call last):
python3.6/site-packages/knack/cli.py, ln 206, in invoke
    cmd_result = self.invocation.execute(args)
cli/core/commands/__init__.py, ln 608, in execute
    raise ex
cli/core/commands/__init__.py, ln 666, in _run_jobs_serially
    results.append(self._run_job(expanded_arg, cmd_copy))
...
azure/datalake/store/core.py, ln 816, in concat
    retry_policy=NoRetryPolicy())
azure/datalake/store/lib.py, ln 429, in call
    if request_successful or not retry_policy.should_retry(response, last_exception, retry_count):
TypeError: should_retry() takes 1 positional argument but 4 were given

To Reproduce:
Steps to reproduce the behavior. Note that argument values have been redacted, as they may contain sensitive information.

Put any pre-requisite steps here...
az login
az dls fs join --destination-path '/user/someuser/test_folder2' --source-paths '/user/someuser/test_folder/*.csv' --ids {REDACTED}
az dls fs join --destination-path '/user/someuser/test_folder2' --source-paths '/user/someuser/test_folder/file1.csv /user/someuser/test_folder/file2.csv' --ids {REDACTED}
az dls fs join --destination-path '/user/someuser/test_folder2/all.csv' --source-paths '/user/someuser/test_folder/file1.csv /user/someuser/test_folder/file2.csv' --ids {REDACTED}

All versions of the command listed above fail with same error.
Expected Behavior
Having a single concatenated file in test_folder2
Environment Summary
Run from a Bastion connection on an Azure GPU machine (also replicates on locally installed AZ CLI)
Linux-5.3.0-1022-azure-x86_64-with-debian-buster-sid
Python 3.6.5
Shell: bash

azure-cli 2.0.80 *
azure-cli-ml 1.0.85

Extensions:
azure-cli-ml 1.0.85

Additional Context

add to S174

SDK issue. Report here https://github.com/Azure/azure-data-lake-store-python/issues/314

The error and the fix in sdk was in retry code, which for concat is not supposed to retry anyway.
That code will only get triggered if there was an error in the first attempt itself. @ragnarwessels Can you run this with debug flag and check on what error occurred in the first attempt?

Hi @akharit, it seems although there is sdk issue, the root cause should be error occurred during implementation, right?
Anyway I think we should upgrade the package version for sdk issue. Could you help take a look at my #14689?

@Juliehzl
So this code did a concat operation, which failed for some reason. It went into the retry loop with policy NoRetryPolicy, which had a bug. The sdk fix only makes sure that the NoRetryPolicy is correct. I don't know why it failed on the first attempt. Could be anything from user error to server error.
After sdk update, if this issue still occurs, we will get a better exception message that we can use to debug. So upgrade is good to have. I have approved the pull request.

authors: Juliehzl akharit ragnarwessels yonzhan


text:
setting min-capacity with az sql db update --min-capacity does not appear to actually set the capacity.

az feedback auto-generates most of the information requested below, as of CLI version 2.0.62

Describe the bug
I am attempting to use the azure cli to change the min-capacity on a mssql database on an basic sku elastic pool.
I've created the elastic pool with per database settings of min-capacity = 0 and max-capacity = 5.
When I create the sql database through the portal, it creates a sql database with the minCapactiy set to null. When I then try to update that on the azure cli, no matter what value I give for --min-capacity, the resulting output is always "minCapacity": null,
To Reproduce
Create sql database in an elastic pool with min-capacity of 0
Attempt to change the min-capacity via the azure cli.
az sql db update -g fssa-dfr-dev-impact-rg -s fssa-dfr-dev-impact-sqlsvr -n fssa-dfr-dev-impact-db --min-capacity 0.5
Expected behavior
I expect this
"minCapacity": null,
to change to
"minCapacity": 0.5,
Environment summary

Additional context
I'm building out my environment with terraform, but because of various bugs like, cannot create sql database with terraform and issues with terraform and a 0 min-capacity I'm trying to find workarounds to import the sql database I must create via the portal and not terraform into my terraform state.

sql

authors: jwshive yonzhan


text:
Publish Azure CLI to Microsoft Store

PowerShell and Windows Terminal are in Microsoft Store, would be great if Azure CLI could join the party by being distributed the same way as well.

PowerShell
PowerShell Preview
Windows Terminal
Windows Terminal Preview

hi @o-l-a-v thanks for the feedback. Azure CLI is releasing per different platforms via package manager. We don't have plan to support Microsoft Store yet. To install it, pls try out guideline at https://docs.microsoft.com/en-us/cli/azure/install-azure-cli, and let us know if met any problem. thanks.

Hi @youngezz
I had no problems installing it with the MSI. Just wish all the things would auto update and be as easy to push in a MDM scenario as Microsoft Store (for Business) makes it.

authors: o-l-a-v yungezz


text:
az ad app permission admin-consent --id  $appid Forbidden Message

Describe the bug
az ad app permission admin-consent --id  $appid
is giving me a Forbidden error.
Forbidden({"ClassName":"Microsoft.Portal.Framework.Exceptions.ClientException","Message":"Graph call failed with httpCode=Forbidden, errorCode=Authorization_RequestDenied, errorMessage=This operation can only be performed by an administrator.
To Reproduce
I am following in Azure sample:
https://github.com/Azure-Samples/azure-cli-samples/blob/master/aks/azure-ad-integration/azure-ad-integration.sh
The failure occurs on line 59.
Expected behavior
I expect to be able to consent to permissions for my application ID have registered in active directory.
Environment summary
Run WSL / Ubuntu on Windows. Following the example here:
https://github.com/Azure-Samples/azure-cli-samples/blob/master/aks/azure-ad-integration/azure-ad-integration.sh
Additional context
Here is an image of the error:

I may also be locked down as I am using the MS Tenant:

az ad

az ad

Ok, it worked from another subscription that I owned, not MS. Makes more sense.
az ad app permission grant --id 6efcb928-a0ac-49f7-90e4-211377cd1234 --api 00000003-0000-0000-c000-000000000000
{
"clientId": "aaaaa1-cc95-4600-b8f9-cf979ab2369e",
"consentType": "AllPrincipals",
"expiryTime": "2022-01-05T00:11:44.372243",
"objectId": "cfsadfsadfAEa4-c-XmrI2nsJ5wvaAC05OnOnzUdX1TXc",
"odata.metadata": "https://graph.windows.net/ade82855-7143-4a84-950e-c9007506f8bb/$metadata#oauth2PermissionGrants/@Element",
"odatatype": null,
"principalId": null,
"resourceId": "f6c279c2dsaffd9ce9-f351d5f54d77",
"scope": "user_impersonation",
"startTime": "2021-01-05T00:11:44.372243"
}

Ok, it worked from another subscription that I owned, not MS. Makes more sense.
az ad app permission grant --id 6efcb928-a0ac-49f7-90e4-211377cd1234 --api 00000003-0000-0000-c000-000000000000
{
"clientId": "aaaaa1-cc95-4600-b8f9-cf979ab2369e",
"consentType": "AllPrincipals",
"expiryTime": "2022-01-05T00:11:44.372243",
"objectId": "cfsadfsadfAEa4-c-XmrI2nsJ5wvaAC05OnOnzUdX1TXc",
"odata.metadata": "https://graph.windows.net/ade82855-7143-4a84-950e-c9007506f8bb/$metadata#oauth2PermissionGrants/@Element",
"odatatype": null,
"principalId": null,
"resourceId": "f6c279c2dsaffd9ce9-f351d5f54d77",
"scope": "user_impersonation",
"startTime": "2021-01-05T00:11:44.372243"
}

authors: brunoterkaly yonzhan


text:
Support restore/create a disk from diskRestorePoint

Related command
az disk create --resource-group “ExampleRg” --name “ExampleOSDisk” --sku Premium_LRS --size-gb 128 --source $osDiskRestorePoint
Resource Provider
Microsoft.Compute/Disks
Description of Feature or Work Requested
DiskRestorePoints are similar to managed disk snapshots and we should be able to restore disks using them, however currently its failing with the following error:
“usage error: --source {SNAPSHOT | DISK} | --source VHD_BLOB_URI [--source-storage-account-id ID]”
Minimum API Version Required
2021-03-01
Swagger PR link
https://github.com/Azure/azure-rest-api-specs/blob/main/specification/compute/resource-manager/Microsoft.Compute/stable/2022-03-01/ComputeRP/restorePoint.json
Request Example
No response
Target Date
2022-07-19
Additional context
No response

Compute

@dikethir I'd like to confirm with you that $osDiskRestorePoint can be obtained by the id returned by az restore-point show command, right?

This feature request will be released by PR #22898 on 07-05

authors: dikethir yonzhan zhoxing-ms


text:
is there an equivalent for show-default in az ml cli v2?

Related command
az ml datastore show-default -w workspace-name -g rg-name --query name -o tsv
Describe the solution you'd like
trying to build azure ml pipeline with Github actions, and for using some of the commands I need to use azure ml v2
is there an equivalent for show-default command in v2?
Describe alternatives you've considered
I tried looking for the isDefault key using the v2 command:
az ml datastore list
but no isDefault key was found on the dictionary
this was the result
{
    "account_name": "****",
    "container_name": "****",
    "credentials": {},
    "endpoint": "core.windows.net",
    "id": "****",
    "name": "workspaceblobstore",
    "protocol": "https",
    "resourceGroup": "****",
    "tags": {},
    "type": "****"
  }

route to CXP team

Hi
We don’t have default properties exposed in V2.
@Amar @.***> FYI
Thanks,
Mayank Kumar
Sent from Mailhttps://go.microsoft.com/fwlink/?LinkId=550986 for Windows
From: @.>
Sent: Wednesday, July 27, 2022 7:02 PM
To: @.>
Cc: @.>; @.>
Subject: Re: [Azure/azure-cli] is there an equivalent for show-default in az ml cli v2? (Issue #23322)
Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @azureml-githubhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fazureml-github&data=05|01|Mayank.Kumar%40microsoft.com|60a941faa5cd46576d1208da703d4195|72f988bf86f141af91ab2d7cd011db47|1|0|637945705662985017|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000|||&sdata=r%2BtXea7RdgBVObp3JcRbUgaKPzht4SOZ7uj4PTqLLqE%3D&reserved=0.
Issue Details
Related command
az ml datastore show-default -w workspace-name -g rg-name --query name -o tsv
Describe the solution you'd like
trying to build azure ml pipeline with Github actions, and for using some of the commands I need to use azure ml v2
is there an equivalent for show-default command in v2?
Describe alternatives you've considered
I tried looking for the isDefault key using the v2 command:
az ml datastore list
but no isDefault key was found on the dictionary
this was the result
{
"account_name": "****",

"container_name": "****",

"credentials": {},

"endpoint": "core.windows.net",

"id": "****",

"name": "workspaceblobstore",

"protocol": "https",

"resourceGroup": "****",

"tags": {},

"type": "****"

}
Author:
dorlugasigal
Assignees:
Labels:
Service Attention, Machine Learning, customer-reported, Auto-Assign
Milestone:
—
Reply to this email directly, view it on GitHubhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FAzure%2Fazure-cli%2Fissues%2F23322%23issuecomment-1197565431&data=05|01|Mayank.Kumar%40microsoft.com|60a941faa5cd46576d1208da703d4195|72f988bf86f141af91ab2d7cd011db47|1|0|637945705662985017|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000|||&sdata=ykbnR3WxvlNWbdMyQGEEFTdR7DPQQFn0NI05Om5j7eM%3D&reserved=0, or unsubscribehttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAOVYYXRJANQ6VKDISUPXIUTVWHS4DANCNFSM54S7AA5Q&data=05|01|Mayank.Kumar%40microsoft.com|60a941faa5cd46576d1208da703d4195|72f988bf86f141af91ab2d7cd011db47|1|0|637945705662985017|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000|||&sdata=gk7YyaJZmbReKPq%2BZGo4N%2F02vBZu2mB1TfQf6qtU8bA%3D&reserved=0.
You are receiving this because you were mentioned.Message ID: @.***>

We don’t have default properties exposed in V2. @AmarBadal

authors: MayankKumar91 azureml-github dorlugasigal yonzhan


text:
az advisor recommendation list --refresh -r having bunch of errors

This is autogenerated. Please review and update as needed.
Describe the bug
Command Name
az advisor recommendation list
Errors:
The command failed with an unexpected error. Here is the traceback:
Session.request() got an unexpected keyword argument 'raw'
Traceback (most recent call last):
  File "/usr/local/Cellar/azure-cli/2.37.0/libexec/lib/python3.10/site-packages/knack/cli.py", line 231, in invoke
    cmd_result = self.invocation.execute(args)
  File "/usr/local/Cellar/azure-cli/2.37.0/libexec/lib/python3.10/site-packages/azure/cli/core/commands/__init__.py", line 663, in execute
    raise ex
  File "/usr/local/Cellar/azure-cli/2.37.0/libexec/lib/python3.10/site-packages/azure/cli/core/commands/__init__.py", line 726, in _run_jobs_serially
    results.append(self._run_job(expanded_arg, cmd_copy))
  File "/usr/local/Cellar/azure-cli/2.37.0/libexec/lib/python3.10/site-packages/azure/cli/core/commands/__init__.py", line 697, in _run_job
    result = cmd_copy(params)
  File "/usr/local/Cellar/azure-cli/2.37.0/libexec/lib/python3.10/site-packages/azure/cli/core/commands/__init__.py", line 333, in __call__
    return self.handler(*args, **kwargs)
  File "/usr/local/Cellar/azure-cli/2.37.0/libexec/lib/python3.10/site-packages/azure/cli/core/commands/command_operation.py", line 121, in handler
    return op(**command_args)
  File "/usr/local/Cellar/azure-cli/2.37.0/libexec/lib/python3.10/site-packages/azure/cli/command_modules/advisor/custom.py", line 13, in list_recommendations
    _generate_recommendations(client)
  File "/usr/local/Cellar/azure-cli/2.37.0/libexec/lib/python3.10/site-packages/azure/cli/command_modules/advisor/custom.py", line 139, in _generate_recommendations
    response = client.generate(raw=True)
  File "/usr/local/Cellar/azure-cli/2.37.0/libexec/lib/python3.10/site-packages/azure/mgmt/advisor/operations/_recommendations_operations.py", line 84, in generate
    pipeline_response = self._client._pipeline.run(request, stream=False, **kwargs)
  File "/usr/local/Cellar/azure-cli/2.37.0/libexec/lib/python3.10/site-packages/azure/core/pipeline/_base.py", line 211, in run
    return first_node.send(pipeline_request)  # type: ignore
  File "/usr/local/Cellar/azure-cli/2.37.0/libexec/lib/python3.10/site-packages/azure/core/pipeline/_base.py", line 71, in send
    response = self.next.send(request)
  File "/usr/local/Cellar/azure-cli/2.37.0/libexec/lib/python3.10/site-packages/azure/core/pipeline/_base.py", line 71, in send
    response = self.next.send(request)
  File "/usr/local/Cellar/azure-cli/2.37.0/libexec/lib/python3.10/site-packages/azure/core/pipeline/_base.py", line 71, in send
    response = self.next.send(request)
  [Previous line repeated 2 more times]
  File "/usr/local/Cellar/azure-cli/2.37.0/libexec/lib/python3.10/site-packages/azure/mgmt/core/policies/_base.py", line 47, in send
    response = self.next.send(request)
  File "/usr/local/Cellar/azure-cli/2.37.0/libexec/lib/python3.10/site-packages/azure/core/pipeline/policies/_redirect.py", line 158, in send
    response = self.next.send(request)
  File "/usr/local/Cellar/azure-cli/2.37.0/libexec/lib/python3.10/site-packages/azure/core/pipeline/policies/_retry.py", line 445, in send
    response = self.next.send(request)
  File "/usr/local/Cellar/azure-cli/2.37.0/libexec/lib/python3.10/site-packages/azure/core/pipeline/policies/_authentication.py", line 119, in send
    response = self.next.send(request)
  File "/usr/local/Cellar/azure-cli/2.37.0/libexec/lib/python3.10/site-packages/azure/core/pipeline/_base.py", line 71, in send
    response = self.next.send(request)
  File "/usr/local/Cellar/azure-cli/2.37.0/libexec/lib/python3.10/site-packages/azure/core/pipeline/_base.py", line 71, in send
    response = self.next.send(request)
  File "/usr/local/Cellar/azure-cli/2.37.0/libexec/lib/python3.10/site-packages/azure/core/pipeline/_base.py", line 71, in send
    response = self.next.send(request)
  [Previous line repeated 1 more time]
  File "/usr/local/Cellar/azure-cli/2.37.0/libexec/lib/python3.10/site-packages/azure/core/pipeline/_base.py", line 103, in send
    self._sender.send(request.http_request, **request.context.options),
  File "/usr/local/Cellar/azure-cli/2.37.0/libexec/lib/python3.10/site-packages/azure/core/pipeline/transport/_requests_basic.py", line 327, in send
    response = self.session.request(  # type: ignore
TypeError: Session.request() got an unexpected keyword argument 'raw'

To Reproduce:
Steps to reproduce the behavior. Note that argument values have been redacted, as they may contain sensitive information.

Put any pre-requisite steps here...
az advisor recommendation list --refresh -r

Expected Behavior
Environment Summary
macOS-12.4-x86_64-i386-64bit, Darwin 21.5.0
Python 3.10.4
Installer: HOMEBREW

azure-cli 2.37.0 *

Extensions:
aks-preview 0.5.88
azure-devops 0.25.0

Dependencies:
msal 1.18.0b1
azure-mgmt-resource 21.1.0b1

Additional Context

route to CXP team

@TRIVEDISAGAR37 Thank you for reaching out, we are looking into it.

The cli command is working as expected and is not facing any issues. az advisor recommendation list --refresh -r works fine, please close the issue if the CX is not facing any concern

authors: RakeshMohanMSFT TRIVEDISAGAR37 mojayara yonzhan