text:
Unable to initialize operation details for swagger based operation - List_existing_Applications

Describe the Bug with repro steps
NB: This is affecting all logic apps in the estate.

Open https://portal.azure.com/#view/Microsoft_Azure_EMA/WorkflowMenuBlade/~/workflowOverview/resourceId/%2fsubscriptions%2f8806b676-346c-4ce7-9dd2-18e688b05027%2fresourceGroups%2frg-ais-admissions-dev-uksouth%2fproviders%2fMicrosoft.Web%2fsites%2fla-ais-admissions-dev-uksouth%2fworkflows%2fwf-DfE-applicant-dev/location/UK%20South/isReadOnly~/false
Scroll to a Dataverse / API connection.
Note the error:

"Unable to initialize operation details for swagger based operation - List_existing_Applications. Error details - The API '@appsetting('CommonDataService_connectionApiId')' could not be found."

What type of Logic App Is this happening in?
Standard (Portal)
Are you using new designer or old designer
New Designer
Did you refer to the TSG before filing this issue? https://aka.ms/lauxtsg
Yes
Workflow JSON
{
    "definition": {
        "$schema": "https://schema.management.azure.com/providers/Microsoft.Logic/schemas/2016-06-01/workflowdefinition.json#",
        "actions": {
            "Compose_updated_Programme_data_array": {
                "inputs": "@array(body('Parse_Banner_response')?['payload']?['items'])",
                "runAfter": {
                    "Parse_Banner_response": [
                        "SUCCEEDED"
                    ]
                },
                "type": "Compose"
            },
            "Get_programme_last_run_date_from_storage_account_settings_table": {
                "inputs": {
                    "body": {
                        "defaultValue": "2020-12-10",
                        "settingEntity": "@parameters('BANNER_PROGRAMME_DATA_INTEGRATION_ENTITY_KEY')",
                        "settingName": "@parameters('LAST_RUN_DATE_TIME_PROPERTY')"
                    },
                    "host": {
                        "workflow": {
                            "id": "wf-core-setting-read"
                        }
                    }
                },
                "runAfter": {
                    "Initialize_last_run_date_variable": [
                        "SUCCEEDED"
                    ]
                },
                "type": "Workflow"
            },
            "HTTP_to_get_updated_programme_data_from_apim": {
                "inputs": {
                    "headers": {
                        "Api-Version": "v1",
                        "Ocp-Apim-Subscription-Key": "@{parameters('admissions-dynamics-product-api-key')}"
                    },
                    "method": "GET",
                    "uri": "@{parameters('core-apim-base-url')}academic/student/registry/reference/programme?updatedfrom=@{variables('lastRunDate')}"
                },
                "runAfter": {
                    "Set_last_run_date_variable": [
                        "SUCCEEDED"
                    ]
                },
                "runtimeConfiguration": {
                    "contentTransfer": {
                        "transferMode": "Chunked"
                    }
                },
                "type": "Http"
            },
            "If_none_of_the_programmes_updated": {
                "actions": {},
                "else": {
                    "actions": {
                        "Compose_Dataverse_Campuses_Array": {
                            "inputs": "@body('List_Campuses_from_Dataverse_reference_table')?['value']",
                            "runAfter": {
                                "List_Campuses_from_Dataverse_reference_table": [
                                    "SUCCEEDED"
                                ]
                            },
                            "type": "Compose"
                        },
                        "Compose_Dataverse_Degrees_Array": {
                            "inputs": "@body('List_Degrees_from_Dataverse_reference_table')?['value']",
                            "runAfter": {
                                "List_Degrees_from_Dataverse_reference_table": [
                                    "SUCCEEDED"
                                ]
                            },
                            "type": "Compose"
                        },
                        "Compose_Dataverse_Study_Levels_Array": {
                            "inputs": "@body('List_Study_levels_from_Dataverse_reference_table')?['value']",
                            "runAfter": {
                                "List_Study_levels_from_Dataverse_reference_table": [
                                    "SUCCEEDED"
                                ]
                            },
                            "type": "Compose"
                        },
                        "List_Campuses_from_Dataverse_reference_table": {
                            "inputs": {
                                "headers": {
                                    "accept": "application/json;odata.metadata=full",
                                    "organization": "https://devsandboxuobtsap.crm11.dynamics.com",
                                    "prefer": "odata.include-annotations=*"
                                },
                                "host": {
                                    "connection": {
                                        "referenceName": "commondataservice"
                                    }
                                },
                                "method": "get",
                                "path": "/api/data/v9.1/@{encodeURIComponent(encodeURIComponent('uob_campuses'))}",
                                "queries": {
                                    "$select": "uob_campusid, uob_code"
                                }
                            },
                            "type": "ApiConnection"
                        },
                        "List_Degrees_from_Dataverse_reference_table": {
                            "inputs": {
                                "headers": {
                                    "accept": "application/json;odata.metadata=full",
                                    "organization": "https://devsandboxuobtsap.crm11.dynamics.com",
                                    "prefer": "odata.include-annotations=*"
                                },
                                "host": {
                                    "connection": {
                                        "referenceName": "commondataservice"
                                    }
                                },
                                "method": "get",
                                "path": "/api/data/v9.1/@{encodeURIComponent(encodeURIComponent('uob_degrees'))}",
                                "queries": {
                                    "$select": "uob_degreeid, uob_code"
                                }
                            },
                            "runAfter": {
                                "Compose_Dataverse_Study_Levels_Array": [
                                    "SUCCEEDED"
                                ]
                            },
                            "type": "ApiConnection"
                        },
                        "List_Study_levels_from_Dataverse_reference_table": {
                            "inputs": {
                                "headers": {
                                    "accept": "application/json;odata.metadata=full",
                                    "organization": "https://devsandboxuobtsap.crm11.dynamics.com",
                                    "prefer": "odata.include-annotations=*"
                                },
                                "host": {
                                    "connection": {
                                        "referenceName": "commondataservice"
                                    }
                                },
                                "method": "get",
                                "path": "/api/data/v9.1/@{encodeURIComponent(encodeURIComponent('uob_studylevels'))}",
                                "queries": {
                                    "$select": "uob_studylevelid, uob_code"
                                }
                            },
                            "runAfter": {
                                "Compose_Dataverse_Campuses_Array": [
                                    "SUCCEEDED"
                                ]
                            },
                            "type": "ApiConnection"
                        },
                        "Loop_through_the_array_of_programmes": {
                            "actions": {
                                "Compose_Campus_Code": {
                                    "inputs": "@item()['programmeLocations'][0]['campusCode']",
                                    "type": "Compose"
                                },
                                "Compose_Campus_ID": {
                                    "inputs": "@body('Filter_Campuses_Array_to_get_Campus_ID')[0]['uob_campusid']",
                                    "runAfter": {
                                        "Filter_Campuses_Array_to_get_Campus_ID": [
                                            "SUCCEEDED"
                                        ]
                                    },
                                    "type": "Compose"
                                },
                                "Compose_Degree_ID": {
                                    "inputs": "@body('Filter_Degrees_Array_to_get_degree_ID')[0]['uob_degreeid']",
                                    "runAfter": {
                                        "Filter_Degrees_Array_to_get_degree_ID": [
                                            "SUCCEEDED"
                                        ]
                                    },
                                    "type": "Compose"
                                },
                                "Compose_List_of_existing_Programme_records_Row_Output_Body": {
                                    "inputs": "@body('List_existing_Programme_record_rows')?['value']",
                                    "runAfter": {
                                        "List_existing_Programme_record_rows": [
                                            "SUCCEEDED"
                                        ]
                                    },
                                    "type": "Compose"
                                },
                                "Compose_Programme_Level_Code": {
                                    "inputs": "@item()['programmeLevelCode']",
                                    "runAfter": {
                                        "Compose_Campus_ID": [
                                            "SUCCEEDED"
                                        ]
                                    },
                                    "type": "Compose"
                                },
                                "Compose_Qualification_Code": {
                                    "inputs": "@item()['qualificationCode']",
                                    "runAfter": {
                                        "Compose_Study_Level_ID": [
                                            "SUCCEEDED"
                                        ]
                                    },
                                    "type": "Compose"
                                },
                                "Compose_Study_Level_ID": {
                                    "inputs": "@body('Filter_Study_Levels_Array_to_get_study_level_ID')[0]['uob_studylevelid']",
                                    "runAfter": {
                                        "Filter_Study_Levels_Array_to_get_study_level_ID": [
                                            "SUCCEEDED"
                                        ]
                                    },
                                    "type": "Compose"
                                },
                                "Filter_Campuses_Array_to_get_Campus_ID": {
                                    "inputs": {
                                        "from": "@outputs('Compose_Dataverse_Campuses_Array')",
                                        "where": "@equals(item()?['uob_code'],outputs('Compose_Campus_Code'))"
                                    },
                                    "runAfter": {
                                        "Compose_Campus_Code": [
                                            "SUCCEEDED"
                                        ]
                                    },
                                    "type": "Query"
                                },
                                "Filter_Degrees_Array_to_get_degree_ID": {
                                    "inputs": {
                                        "from": "@outputs('Compose_Dataverse_Degrees_Array')",
                                        "where": "@equals(item()?['uob_code'],outputs('Compose_Qualification_Code'))"
                                    },
                                    "runAfter": {
                                        "Compose_Qualification_Code": [
                                            "SUCCEEDED"
                                        ]
                                    },
                                    "type": "Query"
                                },
                                "Filter_Study_Levels_Array_to_get_study_level_ID": {
                                    "inputs": {
                                        "from": "@outputs('Compose_Dataverse_Study_Levels_Array')",
                                        "where": "@equals(item()?['uob_code'],outputs('Compose_Programme_Level_Code'))"
                                    },
                                    "runAfter": {
                                        "Compose_Programme_Level_Code": [
                                            "SUCCEEDED"
                                        ]
                                    },
                                    "type": "Query"
                                },
                                "List_existing_Programme_record_rows": {
                                    "inputs": {
                                        "headers": {
                                            "accept": "application/json;odata.metadata=full",
                                            "organization": "https://devsandboxuobtsap.crm11.dynamics.com/",
                                            "prefer": "odata.include-annotations=*"
                                        },
                                        "host": {
                                            "connection": {
                                                "referenceName": "commondataservice"
                                            }
                                        },
                                        "method": "get",
                                        "path": "/api/data/v9.1/@{encodeURIComponent(encodeURIComponent('uob_programmes'))}",
                                        "queries": {
                                            "$filter": "uob_code eq '@{item()['programmeCode']}'",
                                            "$select": "uob_code"
                                        }
                                    },
                                    "runAfter": {
                                        "Compose_Degree_ID": [
                                            "SUCCEEDED"
                                        ]
                                    },
                                    "type": "ApiConnection"
                                },
                                "Programme_already_exists": {
                                    "actions": {
                                        "Get_rowid_of_the_programme_record": {
                                            "inputs": "@outputs('Compose_List_of_existing_Programme_records_Row_Output_Body')[0]['uob_programmeid']",
                                            "type": "Compose"
                                        },
                                        "Update_the_Programme_Data": {
                                            "inputs": {
                                                "body": {
                                                    "uob_CampusId@odata.bind": "uob_campuses/@{outputs('Compose_Campus_ID')}",
                                                    "uob_DegreeId@odata.bind": "uob_degrees/@{outputs('Compose_Degree_ID')}",
                                                    "uob_name": "@{item()['programmeShortTitle']}",
                                                    "uob_programmeportaltitle": "@{item()['programmeShortTitle']}",
                                                    "uob_studylevelid_uob_StudyLevel@odata.bind": "uob_studylevels/@{outputs('Compose_Study_Level_ID')}",
                                                    "uob_ucascode": "@{item()['programmeLocations'][0]['programmePathways'][0]?['ucasCode']}"
                                                },
                                                "headers": {
                                                    "accept": "application/json;odata.metadata=full",
                                                    "organization": "https://devsandboxuobtsap.crm11.dynamics.com/",
                                                    "prefer": "return=representation,odata.include-annotations=*"
                                                },
                                                "host": {
                                                    "connection": {
                                                        "referenceName": "commondataservice"
                                                    }
                                                },
                                                "method": "patch",
                                                "path": "/api/data/v9.1/@{encodeURIComponent(encodeURIComponent('uob_programmes'))}(@{encodeURIComponent(encodeURIComponent(outputs('Get_rowid_of_the_programme_record')))})"
                                            },
                                            "runAfter": {
                                                "Get_rowid_of_the_programme_record": [
                                                    "SUCCEEDED"
                                                ]
                                            },
                                            "type": "ApiConnection"
                                        }
                                    },
                                    "else": {
                                        "actions": {
                                            "Add_a_new_Programme_record": {
                                                "inputs": {
                                                    "body": {
                                                        "uob_CampusId@odata.bind": "uob_campuses/@{outputs('Compose_Campus_ID')}",
                                                        "uob_DegreeId@odata.bind": "uob_degrees/@{outputs('Compose_Degree_ID')}",
                                                        "uob_code": "@{item()['programmeCode']}",
                                                        "uob_name": "@{item()['programmeShortTitle']}",
                                                        "uob_studylevelid_uob_StudyLevel@odata.bind": "uob_studylevels/@{outputs('Compose_Study_Level_ID')}",
                                                        "uob_ucascode": "@{item()['programmeLocations'][0]['programmePathways'][0]?['ucasCode']}"
                                                    },
                                                    "headers": {
                                                        "organization": "https://devsandboxuobtsap.crm11.dynamics.com/",
                                                        "prefer": "return=representation,odata.include-annotations=*"
                                                    },
                                                    "host": {
                                                        "connection": {
                                                            "referenceName": "commondataservice"
                                                        }
                                                    },
                                                    "method": "post",
                                                    "path": "/api/data/v9.1/@{encodeURIComponent(encodeURIComponent('uob_programmes'))}"
                                                },
                                                "type": "ApiConnection"
                                            }
                                        }
                                    },
                                    "expression": {
                                        "and": [
                                            {
                                                "not": {
                                                    "equals": [
                                                        "@length(outputs('Compose_List_of_existing_Programme_records_Row_Output_Body'))",
                                                        0
                                                    ]
                                                }
                                            }
                                        ]
                                    },
                                    "runAfter": {
                                        "Compose_List_of_existing_Programme_records_Row_Output_Body": [
                                            "SUCCEEDED"
                                        ]
                                    },
                                    "type": "If"
                                }
                            },
                            "foreach": "@outputs('Compose_updated_Programme_data_array')",
                            "runAfter": {
                                "Compose_Dataverse_Degrees_Array": [
                                    "SUCCEEDED"
                                ]
                            },
                            "type": "Foreach"
                        }
                    }
                },
                "expression": {
                    "and": [
                        {
                            "equals": [
                                "@length(outputs('Compose_updated_Programme_data_array'))",
                                0
                            ]
                        }
                    ]
                },
                "runAfter": {
                    "Compose_updated_Programme_data_array": [
                        "SUCCEEDED"
                    ]
                },
                "type": "If"
            },
            "Initialize_last_run_date_variable": {
                "inputs": {
                    "variables": [
                        {
                            "name": "lastRunDate",
                            "type": "string",
                            "value": "2024-02-13"
                        }
                    ]
                },
                "runAfter": {},
                "type": "InitializeVariable"
            },
            "Parse_Banner_response": {
                "inputs": {
                    "content": "@json(body('HTTP_to_get_updated_programme_data_from_apim'))",
                    "schema": {
                        "properties": {
                            "content": {
                                "properties": {
                                    "payload": {
                                        "properties": {
                                            "has_more": {
                                                "type": "boolean"
                                            },
                                            "items": {
                                                "items": {
                                                    "properties": {
                                                        "programmeCode": {
                                                            "type": "string"
                                                        },
                                                        "programmeLevelCode": {
                                                            "type": "string"
                                                        },
                                                        "programmeLevelDescription": {
                                                            "type": "string"
                                                        },
                                                        "programmeLocations": {
                                                            "items": {
                                                                "properties": {
                                                                    "campusCode": {
                                                                        "type": "string"
                                                                    },
                                                                    "campusDescription": {
                                                                        "type": "string"
                                                                    }
                                                                },
                                                                "required": [
                                                                    "campusCode",
                                                                    "campusDescription"
                                                                ],
                                                                "type": "object"
                                                            },
                                                            "type": "array"
                                                        },
                                                        "programmeShortTitle": {
                                                            "type": "string"
                                                        },
                                                        "qualificationAbbreviated": {
                                                            "type": "string"
                                                        },
                                                        "qualificationCode": {
                                                            "type": "string"
                                                        },
                                                        "qualificationTitle": {
                                                            "type": "string"
                                                        },
                                                        "updatedOn": {
                                                            "type": "string"
                                                        }
                                                    },
                                                    "required": [
                                                        "programmeCode",
                                                        "programmeShortTitle",
                                                        "programmeLevelCode",
                                                        "programmeLevelDescription",
                                                        "qualificationCode",
                                                        "qualificationAbbreviated",
                                                        "qualificationTitle",
                                                        "updatedOn",
                                                        "programmeLocations"
                                                    ],
                                                    "type": "object"
                                                },
                                                "type": "array"
                                            },
                                            "links": {
                                                "properties": {
                                                    "next": {
                                                        "type": "string"
                                                    },
                                                    "prev": {
                                                        "type": "string"
                                                    },
                                                    "self": {
                                                        "type": "string"
                                                    }
                                                },
                                                "type": "object"
                                            },
                                            "page_number": {
                                                "type": "integer"
                                            },
                                            "page_size": {
                                                "type": "integer"
                                            }
                                        },
                                        "type": "object"
                                    },
                                    "status": {
                                        "type": "string"
                                    }
                                },
                                "type": "object"
                            }
                        },
                        "type": "object"
                    }
                },
                "runAfter": {
                    "HTTP_to_get_updated_programme_data_from_apim": [
                        "SUCCEEDED"
                    ]
                },
                "type": "ParseJson"
            },
            "Set_last_run_date_variable": {
                "inputs": {
                    "name": "lastRunDate",
                    "value": "@{if(greater(indexOf(body('Get_programme_last_run_date_from_storage_account_settings_table'), '+'), -1), substring(body('Get_programme_last_run_date_from_storage_account_settings_table'), 0, indexOf(body('Get_programme_last_run_date_from_storage_account_settings_table'), '+')), body('Get_programme_last_run_date_from_storage_account_settings_table'))}"
                },
                "runAfter": {
                    "Get_programme_last_run_date_from_storage_account_settings_table": [
                        "SUCCEEDED"
                    ]
                },
                "type": "SetVariable"
            },
            "Update_programme_last_run_date_in_storage_account_settings_table": {
                "inputs": {
                    "body": {
                        "overwriteValue": true,
                        "settingEntity": "@parameters('BANNER_PROGRAMME_DATA_INTEGRATION_ENTITY_KEY')",
                        "settingName": "@parameters('LAST_RUN_DATE_TIME_PROPERTY')",
                        "settingValue": "@{utcNow('yyyy-MM-dd')}"
                    },
                    "host": {
                        "workflow": {
                            "id": "wf-core-setting-write"
                        }
                    }
                },
                "runAfter": {
                    "If_none_of_the_programmes_updated": [
                        "SUCCEEDED"
                    ]
                },
                "type": "Workflow"
            }
        },
        "contentVersion": "1.0.0.0",
        "outputs": {},
        "triggers": {
            "Recurrence": {
                "recurrence": {
                    "frequency": "Day",
                    "interval": 1,
                    "schedule": {
                        "hours": [
                            "2"
                        ]
                    },
                    "timeZone": "GMT Standard Time"
                },
                "type": "Recurrence"
            }
        }
    },
    "kind": "Stateful"
}

Screenshots or Videos
No response
Browser
Chrome.
Additional context
Have also tried the old designer but no difference there.

@mattyjbennett I'm going to have you try a few things.

If you are able, could you share your connections json file with me?  My email is rileyevans@microsoft.com
Could you also get your portal extension version from Designer and send that as well?  You can find steps to do that here:

https://purple-pebble-0e11de71e.1.azurestaticapps.net/tsg#finding-your-session-id-or-portal-extension-version

Also could you try loading one of the affected workflows from our hotfix environment?  We have a fix rolling out that I think is related to your issue.  You can access it here: https://ms.portal.azure.com/?Microsoft_Azure_EMA=hotfix#home

(I would just access it for this instance, accessing the hotfix env in the future might have other unexpected hotfixes so I wouldn't recommend it)

App settings in connection data is supposed to be resolved at initialization in Designer, it looks like your instance of Designer isn't doing that for some reason.

Good afternoon Riley. Thank you for looking into this.
The fallback designer https://aka.ms/lafallback works but is a little limiting for moving actions around.
The connections export is enclosed.
The Session ID: 26c155ea81cb4f16bcc6da77f56eb6de
Extensions:
HubsExtension: 14ms | Version: 13.216.0.1578480.240308-0645
Microsoft_Azure_Copilot: 17ms | Version: 1.200.02629.244
Microsoft_Azure_EMA: 5ms | Version: 2.40311.1.7
WebsitesExtension: 6ms | Version: 5.12.235.22
Hotfix link: https://portal.azure.com/?Microsoft_Azure_EMA=hotfix#view/Microsoft_Azure_EMA/WorkflowMenuBlade/~/designer/resourceId/%2Fsubscriptions%2F8806b676-346c-4ce7-9dd2-18e688b05027%2FresourceGroups%2Frg-ais-admissions-dev-uksouth%2Fproviders%2FMicrosoft.Web%2Fsites%2Fla-ais-admissions-dev-uksouth%2Fworkflows%2Fwf-DfE-applicant-dev/location/UK South/isReadOnly~/false
However the API connections are still not initialising.
@.***
Kind regards,
Matthew B.
(He/Him) | #MyNameIs Ma-thew Ben-nit
From: Riley Evans @.>
Sent: Tuesday, March 26, 2024 3:02 PM
To: Azure/LogicAppsUX @.>
Cc: Matthew Bennett (Application Services) @.>; Mention @.>
Subject: Re: [Azure/LogicAppsUX] Unable to initialize operation details for swagger based operation - List_existing_Applications (Issue #4444)
CAUTION: This email originated from outside the organisation. Do not click links or open attachments unless you recognise the sender and know the content is safe.
@mattyjbennetthttps://github.com/mattyjbennett I'm going to have you try a few things.

If you are able, could you share your connections json file with me? My email is @.@.>
Could you also get your portal extension version from Designer and send that as well? You can find steps to do that here:

 *   https://purple-pebble-0e11de71e.1.azurestaticapps.net/tsg#finding-your-session-id-or-portal-extension-version

Also could you try loading one of the affected workflows from our hotfix environment? We have a fix rolling out that I think is related to your issue. You can access it here: https://ms.portal.azure.com/?Microsoft_Azure_EMA=hotfix#home

 *   (I would just access it for this instance, accessing the hotfix env in the future might have other unexpected hotfixes so I wouldn't recommend it)

App settings in connection data is supposed to be resolved at initialization in Designer, it looks like your instance of Designer isn't doing that for some reason.
—
Reply to this email directly, view it on GitHubhttps://github.com/Azure/LogicAppsUX/issues/4444#issuecomment-2020674642, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BFMOH7DX6DJMA6SQIP4Z4DLY2GEWZAVCNFSM6AAAAABFIV7G7CVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMRQGY3TINRUGI.
You are receiving this because you were mentioned.Message ID: @.@.>>

Did you send the email to me directly?  I'm not seeing it yet, my email is RileyEvans@microsoft.com

@mattyjbennett , I took a look at your connections json and I'm not seeing it match up to the errors you are showing.  The error you gave initially is talking about the value: @appsetting('CommonDataService_connectionApiId'), and I should be seeing that somewhere but it's not in your connections data or anywhere in your workflow.
The connections data you sent also didn't look like what I was expecting, can you send the connections json accessed from here (under the workflows menu section, then the JSON tab):

I am rolling out a hotfix tomorrow that I think might fix your issue.  I will let you know when it's ready to be tested in the morning and I'll have you try your repro in a hotfix environment to be sure.

Good morning Riley,
We’re using Terraform to generate these objects. The LA is a standard logic app, not consumption. I’ve enclosed the connections data. Please ignore the ‘commondataservice-1’ connection. I recreated the same one manually and that worked.
Kind regards,
Matthew B.
(He/Him) | #MyNameIs Ma-thew Ben-nit
From: Riley Evans @.>
Sent: Tuesday, March 26, 2024 5:44 PM
To: Azure/LogicAppsUX @.>
Cc: Matthew Bennett (Application Services) @.>; Mention @.>
Subject: Re: [Azure/LogicAppsUX] Unable to initialize operation details for swagger based operation - List_existing_Applications (Issue #4444)
CAUTION: This email originated from outside the organisation. Do not click links or open attachments unless you recognise the sender and know the content is safe.
@mattyjbennetthttps://github.com/mattyjbennett , I took a look at your connections json and I'm not seeing it match up to the errors you are showing. The error you gave initially is talking about the value: @appsetting('CommonDataService_connectionApiId'), and I should be seeing that somewhere but it's not in your connections data or anywhere in your workflow.
The connections data you sent also didn't look like what I was expecting, can you send the connections json accessed from here (under the workflows menu section, then the JSON tab):
Screenshot.2024-03-26.at.12.42.43.PM.png (view on web)https://github.com/Azure/LogicAppsUX/assets/25409734/f431d989-89a2-40e8-9e62-84f0229fede6
—
Reply to this email directly, view it on GitHubhttps://github.com/Azure/LogicAppsUX/issues/4444#issuecomment-2021089104, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BFMOH7E2Y3IHALVHV44C2Z3Y2GXXTAVCNFSM6AAAAABFIV7G7CVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMRRGA4DSMJQGQ.
You are receiving this because you were mentioned.Message ID: @.@.>>

repo: Azure/LogicAppsUX


text:
CIS benchmark gaps: k8s v1.8 master

$ kubectl get nodes -o wide
NAME                        STATUS    ROLES     AGE       VERSION   EXTERNAL-IP   OS-IMAGE             KERNEL-VERSION      CONTAINER-RUNTIME
k8s-agentpool1-12380904-0   Ready     agent     16m       v1.8.15   <none>        Ubuntu 16.04.4 LTS   4.15.0-1013-azure   docker://1.13.1
k8s-agentpool1-12380904-1   Ready     agent     14m       v1.8.15   <none>        Ubuntu 16.04.4 LTS   4.15.0-1013-azure   docker://1.13.1
k8s-master-12380904-0       Ready     master    19m       v1.8.15   <none>        Ubuntu 16.04.4 LTS   4.15.0-1013-azure   docker://1.13.1

Showing master failures from $ ./kube-bench master --version 1.8:
[INFO] 1.1 API Server

[ ] [FAIL] 1.1.6 Ensure that the --insecure-port argument is set to 0 (Scored)
[ ] [FAIL] 1.1.12 Ensure that the admission control policy is set to DenyEscalatingExec (Scored)
[ ] [FAIL] 1.1.13 Ensure that the admission control policy is set to SecurityContextDeny (Scored)
[ ] [FAIL] 1.1.21 Ensure that the --kubelet-certificate-authority argument is set as appropriate (Scored)
[ ] [FAIL] 1.1.24 Ensure that the admission control policy is set to PodSecurityPolicy (Scored)
[ ]  [FAIL] 1.1.32 Ensure that the admission control policy is set to NodeRestriction (Scored)
[ ]  [FAIL] 1.1.33 Ensure that the --experimental-encryption-provider-config argument is set as appropriate (Scored)
[ ] [FAIL] 1.1.35 Ensure that the admission control policy is set to EventRateLimit (Scored)

[INFO] 1.3 Controller Manager

[ ] [FAIL] 1.3.7  Ensure that the RotateKubeletServerCertificate argument is set to true (Scored)

[INFO] 1.4 Configuration Files

[ ] [FAIL] 1.4.7 Ensure that the etcd pod specification file permissions are set to 644 or more restrictive (Scored)
[ ] [FAIL] 1.4.8 Ensure that the etcd pod specification file ownership is set to root:root (Scored)
[ ] [FAIL] 1.4.11 Ensure that the etcd data directory permissions are set to 700 or more restrictive (Scored)
[ ] [FAIL] 1.4.13 Ensure that the admin.conf file permissions are set to 644 or more restrictive (Scored)
[ ] [FAIL] 1.4.14 Ensure that the admin.conf file ownership is set to root:root (Scored)

[INFO] 1.5 etcd

[ ] [FAIL] 1.5.2 Ensure that the --client-cert-auth argument is set to true (Scored)
[ ] [FAIL] 1.5.5 Ensure that the --peer-client-cert-auth argument is set to true (Scored)
[ ] [FAIL] 1.5.7 Ensure that the --wal-dir argument is set as appropriate (Scored)
[ ] [FAIL] 1.5.8 Ensure that the --max-wals argument is set to 0 (Scored)

Just updating the results from 1.11.
Master
[INFO] 1 Master Node Security Configuration
[INFO] 1.1 API Server
[PASS] 1.1.1 Ensure that the --anonymous-auth argument is set to false (Scored)
[PASS] 1.1.2 Ensure that the --basic-auth-file argument is not set (Scored)
[PASS] 1.1.3 Ensure that the --insecure-allow-any-token argument is not set (Scored)
[PASS] 1.1.4 Ensure that the --kubelet-https argument is set to true (Scored)
[PASS] 1.1.5 Ensure that the --insecure-bind-address argument is not set (Scored)
[FAIL] 1.1.6 Ensure that the --insecure-port argument is set to 0 (Scored)
[PASS] 1.1.7 Ensure that the --secure-port argument is not set to 0 (Scored)
[PASS] 1.1.8 Ensure that the --profiling argument is set to false (Scored)
[PASS] 1.1.9 Ensure that the --repair-malformed-updates argument is set to false (Scored)
[PASS] 1.1.10 Ensure that the admission control plugin AlwaysAdmit is not set (Scored)
[PASS] 1.1.11 Ensure that the admission control plugin AlwaysPullImages is set (Scored)
[FAIL] 1.1.12 Ensure that the admission control plugin DenyEscalatingExec is set (Scored)
[FAIL] 1.1.13 Ensure that the admission control plugin SecurityContextDeny is set (Scored)
[FAIL] 1.1.14 Ensure that the admission control plugin NamespaceLifecycle is set (Scored)
[PASS] 1.1.15 Ensure that the --audit-log-path argument is set as appropriate (Scored)
[PASS] 1.1.16 Ensure that the --audit-log-maxage argument is set to 30 or as appropriate (Scored)
[PASS] 1.1.17 Ensure that the --audit-log-maxbackup argument is set to 10 or as appropriate (Scored)
[PASS] 1.1.18 Ensure that the --audit-log-maxsize argument is set to 100 or as appropriate (Scored)
[PASS] 1.1.19 Ensure that the --authorization-mode argument is not set to AlwaysAllow (Scored)
[PASS] 1.1.20 Ensure that the --token-auth-file parameter is not set (Scored)
[FAIL] 1.1.21 Ensure that the --kubelet-certificate-authority argument is set as appropriate (Scored)
[PASS] 1.1.22 Ensure that the --kubelet-client-certificate and --kubelet-client-key arguments are set as appropriate (Scored)
[PASS] 1.1.23 Ensure that the --service-account-lookup argument is set to true (Scored)
[FAIL] 1.1.24 Ensure that the admission control plugin PodSecurityPolicy is set (Scored)
[PASS] 1.1.25 Ensure that the --service-account-key-file argument is set as appropriate (Scored)
[PASS] 1.1.26 Ensure that the --etcd-certfile and --etcd-keyfile arguments are set as appropriate (Scored)
[PASS] 1.1.27 Ensure that the admission control plugin ServiceAccount is set(Scored)
[PASS] 1.1.28 Ensure that the --tls-cert-file and --tls-private-key-file arguments are set as appropriate (Scored)
[PASS] 1.1.29 Ensure that the --client-ca-file argument is set as appropriate (Scored)
[FAIL] 1.1.30 Ensure that the API Server only makes use of Strong Cryptographic Ciphers (Not Scored)
[PASS] 1.1.31 Ensure that the --etcd-cafile argument is set as appropriate (Scored)
[PASS] 1.1.32 Ensure that the --authorization-mode argument is set to Node (Scored)
[FAIL] 1.1.33 Ensure that the admission control plugin NodeRestriction is set (Scored)
[FAIL] 1.1.34 Ensure that the --experimental-encryption-provider-config argument is set as appropriate (Scored)
[WARN] 1.1.35 Ensure that the encryption provider is set to aescbc (Scored)
[FAIL] 1.1.36 Ensure that the admission control plugin EventRateLimit is set (Scored)
[FAIL] 1.1.37 Ensure that the AdvancedAuditing argument is not set to false (Scored)
[PASS] 1.1.38 Ensure that the --request-timeout argument is set as appropriate (Scored)
[FAIL] 1.1.39 Ensure that the API Server only makes use of Strong Cryptographic Ciphers ( Not Scored)
[INFO] 1.2 Scheduler
[PASS] 1.2.1 Ensure that the --profiling argument is set to false (Scored)
[PASS] 1.2.2 Ensure that the --address argument is set to 127.0.0.1 (Scored)
[INFO] 1.3 Controller Manager
[PASS] 1.3.1 Ensure that the --terminated-pod-gc-threshold argument is set as appropriate (Scored)
[PASS] 1.3.2 Ensure that the --profiling argument is set to false (Scored)
[PASS] 1.3.3 Ensure that the --use-service-account-credentials argument is set to true (Scored)
[PASS] 1.3.4 Ensure that the --service-account-private-key-file argument is set as appropriate (Scored)
[PASS] 1.3.5 Ensure that the --root-ca-file argument is set as appropriate (Scored)
[FAIL] 1.3.6 Ensure that the RotateKubeletServerCertificate argument is set to true (Scored)
[PASS] 1.3.7 Ensure that the --address argument is set to 127.0.0.1 (Scored)
[INFO] 1.4 Configuration Files
[FAIL] 1.4.1 Ensure that the API server pod specification file permissions are set to 644 or more restrictive (Scored)
[FAIL] 1.4.2 Ensure that the API server pod specification file ownership is set to root:root (Scored)
[FAIL] 1.4.3 Ensure that the controller manager pod specification file permissions are set to 644 or more restrictive (Scored)
[FAIL] 1.4.4 Ensure that the controller manager pod specification file ownership is set to root:root (Scored)
[FAIL] 1.4.5 Ensure that the scheduler pod specification file permissions are set to 644 or more restrictive (Scored)
[FAIL] 1.4.6 Ensure that the scheduler pod specification file ownership is set to root:root (Scored)
[FAIL] 1.4.7 Ensure that the etcd pod specification file permissions are set to 644 or more restrictive (Scored)
[FAIL] 1.4.8 Ensure that the etcd pod specification file ownership is set to root:root (Scored)
[WARN] 1.4.9 Ensure that the Container Network Interface file permissions are set to 644 or more restrictive (Not Scored)
[WARN] 1.4.10 Ensure that the Container Network Interface file ownership is set to root:root (Not Scored)
[FAIL] 1.4.11 Ensure that the etcd data directory permissions are set to 700 or more restrictive (Scored)
[FAIL] 1.4.12 Ensure that the etcd data directory ownership is set to etcd:etcd (Scored)
[FAIL] 1.4.13 Ensure that the admin.conf file permissions are set to 644 or more restrictive (Scored)
[FAIL] 1.4.14 Ensure that the admin.conf file ownership is set to root:root (Scored)
[FAIL] 1.4.15 Ensure that the scheduler.conf file permissions are set to 644 or more restrictive (Scored)
[FAIL] 1.4.16 Ensure that the scheduler.conf file ownership is set to root:root (Scored)
[FAIL] 1.4.17 Ensure that the controller-manager.conf file permissions are set to 644 or more restrictive (Scored)
[FAIL] 1.4.18 Ensure that the controller-manager.conf file ownership is set to root:root (Scored)
[INFO] 1.5 etcd
[PASS] 1.5.1 Ensure that the --cert-file and --key-file arguments are set as appropriate (Scored)
[FAIL] 1.5.2 Ensure that the --client-cert-auth argument is set to true (Scored)
[PASS] 1.5.3 Ensure that the --auto-tls argument is not set to true (Scored)
[WARN] 1.5.4 Ensure that the --peer-cert-file and --peer-key-file arguments are set as appropriate (Scored)
[WARN] 1.5.5 Ensure that the --peer-client-cert-auth argument is set to true (Scored)
[WARN] 1.5.6 Ensure that the --peer-auto-tls argument is not set to true (Scored)
[WARN] 1.5.7 Ensure that a unique Certificate Authority is used for etcd (Not Scored)
[INFO] 1.6 General Security Primitives
[WARN] 1.6.1 Ensure that the cluster-admin role is only used where required (Not Scored)
[WARN] 1.6.2 Create administrative boundaries between resources using namespaces (Not Scored)
[WARN] 1.6.3 Create network segmentation using Network Policies (Not Scored)
[WARN] 1.6.4 Ensure that the seccomp profile is set to docker/default in your pod definitions (Not Scored)
[WARN] 1.6.5 Apply Security Context to Your Pods and Containers (Not Scored)
[WARN] 1.6.6 Configure Image Provenance using ImagePolicyWebhook admission controller (Not Scored)
[WARN] 1.6.7 Configure Network policies as appropriate (Not Scored)
[WARN] 1.6.8 Place compensating controls in the form of PSP and RBAC for privileged containers usage (Not Scored)
[INFO] 1.7 PodSecurityPolicies
[WARN] 1.7.1 Do not admit privileged containers (Not Scored)
[WARN] 1.7.2 Do not admit containers wishing to share the host process ID namespace (Not Scored)
[WARN] 1.7.3 Do not admit containers wishing to share the host IPC namespace (Not Scored)
[WARN] 1.7.4 Do not admit containers wishing to share the host network namespace (Not Scored)
[WARN] 1.7.5  Do not admit containers with allowPrivilegeEscalation (Not Scored)
[WARN] 1.7.6 Do not admit root containers (Not Scored)
[WARN] 1.7.7 Do not admit containers with dangerous capabilities (Not Scored)

source: gharchive/issue

authors: jackfrancis sylus

repo: Azure/acs-engine

license: mit

license_type: permissive

license_source: bigquery


text:
Implement containerD logs collector for arc team requirements

The container logs collector class got removed from the periscope repo in this PR: https://github.com/Azure/aks-periscope/pull/97
For arc requirements, we need container logs for the azure-arc namespace as long as the collector is configurable to any namespace, we should be fine.
Implementation details of this new collector class can be worked out in this thread or offline.

Cool, Thanks for Clarification @sophsoph321, so this means we need Pod-Container logs which makes sense:
As a help, I could land up a feature branch for you with fetch of pods-container-logs and other pod level information, you can improve on it. (If this helps)

Here is a sample implementation and we can do that using client-go https://github.com/kubernetes/kubernetes/blob/c2e90cd1549dff87db7941544ce15f4c8ad0ba4c/pkg/kubectl/cmd/log.go#L141

Cool, Thanks for Clarification @sophsoph321, so this means we need Pod-Container logs which makes sense:
As a help for you, I could land up a feature branch for you with client-go implementation of fetch of pods-container-logs and other pod level information, you can improve on it. (If this helps)

Here is a sample implementation and we can do that using client-go https://github.com/kubernetes/kubernetes/blob/c2e90cd1549dff87db7941544ce15f4c8ad0ba4c/pkg/kubectl/cmd/log.go#L141

+1 to this. We can use the sample implementation outlined in the link as a baseline for how to retrieve pod-container logs.

repo: Azure/aks-periscope

license: MIT

license_source: github-api


text:
Simplified Verification for Referenced Parameters / Variables. (Fix for 5308)

Fixing by simplifying: no longer attempting to match a reference before the parameter/variable start

double check that the regex is correct too - pipe char looks out of place

try fixing the original expression - look at regex options that span line breaks
could also remove line breaks from the text we test but this may cause a problem with reporting the line number
fix this PR to work (see comment above)

try in the order specified above...

source: gharchive/pull-request

authors: StartAutomating bmoore-msft

repo: Azure/arm-ttk


text:
depth-coverage: compute: parameter assignment issue in custom.py

swagger branch:
https://github.com/changlong-liu/azure-rest-api-specs/tree/20210224-depth-coverage-compute
repo command:
autorest --az --use=. c:\zz\projects\codegen\azure-rest-api-specs\specification\compute\resource-manager\readme.md --azure-cli-folder=..\azure-cli   --target-mode=core  --debug

merged to master


text:
Decide on our story for flattening DPG-generated models in .NET

Per @m-nash:
Is there any position on flattening single property models?  I know flattening in general has some pitfalls but in MPG we were able to come up with a way that is safe for single property models.  It is common practice in mgmt plane to make place holder models even if it starts with 1 property to be able to add things in the future, but initially it makes the client harder to work with.
[Description TBD]

@KrzysztofCwalina and @tg-msft Do you guys have an opinion on this?
In management plane this was more valuable because we didn't necessarily analyze the structure of every model due to sheer volume.  In data plane there will be a lot more scrutiny on each model and if we decide that a model with one property is appropriate that means we most likely believe there is a high likelihood of getting more properties later.
For reference here is an example of the pattern in mgmt plane when we hide a 1 property model.  Our release valve if the single property model gets a second property is to make the internal property public and EB.Never the unwrapped property.
My recommendation here would be to not have this on by default but potentially be able to opt into this for specific scenarios.  The reason being is the release valve explained above is not exactly ideal but in management plane case we believe that the overwhelming majority of of the single property models will never get a second property so it should be rare we have to enable the release valve.  In dataplane given we will curate models more the opposite will most likely be true.

For dataplane, archboard will review typespec files, and it is confirmed that the model which only has one property will grow-up to more properties. So it is not valid to flatten the model.
So this flatten feature will not be supported in DPG. @m-nash  will confirm this.
Move it to Backlog and wait for the final conclusion.

authors: annelo-msft chunyu3 m-nash


text:
Update generate code target to use new common scripts

Description
Update to consume the new common location for the cadl scripts https://github.com/Azure/azure-sdk-tools/pull/5231
Checklist
To ensure a quick review and merge, please ensure:

[ ] The PR has a understandable title and description explaining the why and what.
[ ] The PR is opened in draft if not ready for review yet.

If opened in draft, please allocate sufficient time (24 hours) after moving out of draft for review

[ ] The branch is recent enough to not have merge conflicts upon creation.

Ready to Land?

[ ] Build is completely green

Submissions with test failures require tracking issue and approval of a CODEOWNER

[ ] At least one +1 review by a CODEOWNER
[ ] All -1 reviews are confirmed resolved by the reviewer

Override/Marking reviews stale must be discussed with CODEOWNERS first

Hello @m-nash There are two copies of Cadl-Project-Sync.ps1 and Cadl-Project-Generate.ps1, one is under eng\common\scipts, the other is under eng\scripts. Will we remove the copy under eng\scripts?

Yes this will be updated after this build target change in this PR https://github.com/Azure/azure-sdk-for-net/pull/33681

Looks like there is some azure core upstream changes we need to apply.

authors: archerzz m-nash


text:
eng, sdk repo now contains emitter-package-lock.json

and need to call a script to update it when update typespec-java in SDK repo (besides the emitter-package.json file)
tested in patch release pipeline https://dev.azure.com/azure-sdk/internal/_build/results?buildId=3536666&view=logs&j=c28f120c-e125-5ec5-8d4c-ba1a4d871fcc&t=b83a11c4-9f3c-5115-167f-68dcfe6f5445
result https://github.com/Azure/azure-sdk-for-java/pull/38984
context https://github.com/Azure/azure-sdk-for-java/pull/38883

May need to call "New-EmitterPackage.ps1" as well.
Checking with Patrick.

/check-enforcer override


text:
[bug] client hierarchy

https://teams.microsoft.com/l/message/19:4844af8fce9742a98d06e1debf60bab2@thread.skype/1677511844121?tenantId=72f988bf-86f1-41af-91ab-2d7cd011db47&groupId=3e17dcb0-4257-4a30-b843-77f47f1d4121&parentMessageId=1677511844121&teamName=Azure SDK&channelName=DPG Support&createdTime=1677511844121&allowXTenantAccess=false

It has been fixed in latest emitter


text:
[typespec-python] model with enum property returns string instead

The SchemaProperties model generated from typespec here [has a format property of type enum SchemaFormat]
Issue 1: In the generated code, this returns a string rather than a SchemaFormat enum value. I expect format to return a SchemaFormat enum, so the str should be removed from the return type of the format property.
Issue 2: The type is defined as "_models.SchemaFormat". I believe it should be "_models._enums.SchemaFormat".

issue 1: In python, we usually annotate enum to Union[XXX, enum_type] (XXX could be "str/int/..." which depends on enum value type) so that users can input raw value or enum as they like. It is different with C#.
issue 2: Since you mark enum type SchemaFormat as internal, it is not exposed, so we have to type it as  "_models._enums.SchemaFormat" instead of "_models.SchemaFormat". It is a bug and we will fix it.

Hi @msyyc - I explained Issue 1 in more detail here: https://github.com/Azure/autorest.python/issues/2276. For more clarity, this is not just an issue with the annotations, but the returned value is incorrect.

Now DPG model can't deserialize it to string instead of related enum type. SDK team will discuss about it.
As for but the returned value is incorrect., what do you mean incorrect? In python, users can also input str even if its type is enum so I understand it shall not block usage.

yep that sounds good! to clarify, return value is incorrect meaning that I would expect the getter to return the enum rather than string. sorry, I linked the wrong issue above originally! It's fixed now, but here is the issue I created with a detailed description: https://github.com/Azure/autorest.python/issues/2383

https://github.com/Azure/autorest.python/issues/2383 is already closed so @swathipil could you try latest python emitter?

Hey @msyyc - sorry about the delay in response! We actually are now adding the SchemaProperties and SchemaFormat models to the _patch.py file, so they are not generated.
Feel free to close this issue for now. If I run into the same issue in the future, I will re-open it.

authors: msyyc swathipil


text:
imageReference in avd-session-hosts.bicep don't pass Azure/PSRule.Rules.Azure gives error

https://github.com/Azure/PSRule.Rules.Azure/issues/1656

Did try several things like.
imageReference: useSharedImage ? json(concat('{"id": "', avdImageTemplataDefinitionId, '"}')) : marketPlaceGalleryWindows

but then I get the following warning from linter in vscode:
Use string interpolation instead of the concat function.

This is solved by a https://github.com/Azure/PSRule.Rules.Azure/issues/1656
And release v1.20.0

authors: aavdberg oxbo-andre

repo: Azure/avdaccelerator


text:
How to set accepted protocols to both HTTP and HTTPS

The docs state that --accepted-protocols takes a "space separated list", I've tried every combination and it doesn't work. I just get BadRequest - "Value blah is not allowed for property 'Frontdoor.RoutingRules.AcceptedProtocols'"
I've also tried a comma separated list, I don't get any error but the setting is never changed
Please advise how to set Accepted Protocols to both HTTP and HTTPS as you can in the portal

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: bc41d7b5-ab21-fe9b-2f2e-93ac02e5af86
Version Independent ID: 67398425-8b96-f515-72af-22255ea1ae49
Content: az network front-door routing-rule
Content Source: latest/docs-ref-autogen/ext/front-door/network/front-door/routing-rule.yml
GitHub Login: @rloutlaw
Microsoft Alias: routlaw

add to S169

add to S171

@benc-uk Hi. I just tried to create a routing rule and it works. Could you please try --accepted-protocols Http Https?
az network front-door routing-rule create -f clifrontdoor20200605 -g 20200605 -n rule1 --frontend-endpoints DefaultFrontendEndpoint --route-type Forward --backend-pool DefaultBackendPool --patterns /forward1 --accepted-protocols Http Https --debug

closed this issue since cannot reproduce. Feel free to open new issue if you still encounter this one.

authors: MyronFanQiu benc-uk yonzhan

repo: Azure/azure-cli-extensions


text:
Email service - send email with attachments bug fix

Email services:
Email service - send email with attachments bug fix.

This checklist is used to make sure that common guidelines for a pull request are followed.
Related command
General Guidelines

[x] Have you run azdev style <YOUR_EXT> locally? (pip install azdev required)
[ ] Have you run python scripts/ci/test_index.py -q locally? (pip install wheel==0.30.0 required)
[ ] My extension version conforms to the Extension version schema

For new extensions:

[ ] My extension description/summary conforms to the Extension Summary Guidelines.

About Extension Publish
There is a pipeline to automatically build, upload and publish extension wheels.
Once your pull request is merged into main branch, a new pull request will be created to update src/index.json automatically.
You only need to update the version information in file setup.py and historical information in file HISTORY.rst in your PR but do not modify src/index.json.

Thank you for your contribution! We will review the pull request and get back to you soon.

authors: v-vprasannak yonzhan


text:
Adding tests for workload identity

This checklist is used to make sure that common guidelines for a pull request are followed.
Related command

General Guidelines

[ ] Have you run azdev style <YOUR_EXT> locally? (pip install azdev required)
[ ] Have you run python scripts/ci/test_index.py -q locally? (pip install wheel==0.30.0 required)
[ ] My extension version conforms to the Extension version schema

For new extensions:

[ ] My extension description/summary conforms to the Extension Summary Guidelines.

About Extension Publish
There is a pipeline to automatically build, upload and publish extension wheels.
Once your pull request is merged into main branch, a new pull request will be created to update src/index.json automatically.
You only need to update the version information in file setup.py and historical information in file HISTORY.rst in your PR but do not modify src/index.json.

Thank you for your contribution! We will review the pull request and get back to you soon.


text:
CLI for Virtual WAN Point to site feature.

Is your feature request related to a problem? Please describe.
Virtual WAN Point to site feature is already GA but we missed to add the CLI support for the same, and hence the CLI need.
Swagger (Developer to contact is Nilambari Deshpande)
https://github.com/Azure/azure-rest-api-specs/blob/master/specification/network/resource-manager/Microsoft.Network/stable/2020-03-01/virtualWan.json
Swagger PRs:-

https://github.com/Azure/azure-rest-api-specs/pull/7238
https://github.com/Azure/azure-rest-api-specs/pull/7498
https://github.com/Azure/azure-rest-api-specs/pull/7529

Describe the solution you'd like
Brief about Virtual WAN : Azure Virtual WAN is a networking service providing optimized and automated branch to branch connectivity through Azure. A point-to-site (P2S) VPN lets you create a secure connection to your virtual WAN from an individual client computer. A P2S connection is established by starting it from the client computer.
Describe alternatives you've considered
LI is needed as feature is already GA and we missed to add CLI support.
Additional context
Please contact me nilamd@microsoft.com if any questions on Virtual WAN Point to site feature CLI request.

@MyronFanQiu to help take a look.

add to S169

@Nilambari Hi. Could you give me the mock commands or the set of Powershell commands?

Virtual Wan Point to Site feature total 11 command lets:-
Resource: VppnServerConfiguration 4 commands:-
PS commadlets @https://github.com/Azure/azure-powershell/tree/master/src/Network/Network/Cortex/VpnServerConfiguration
New-AzVpnServerConfiguration
Update-AzVpnServerConfiguration
Get-AzVpnServerConfiguration
Remove-AzVpnServerConfiguration
Resource: P2SVpnGateway 7 commands:-
PS commadlets @https://github.com/Azure/azure-powershell/tree/master/src/Network/Network/Cortex/P2SVpnGateway
New-AzP2sVpnGateway
Update-AzP2sVpnGateway
Get-AzP2sVpnGateway
Remove-AzP2sVpnGateway
Get-AzP2sVpnGatewayConnectionHealth
Get-AzP2sVpnGatewayDetailedConnectionHealth
Disconnect-AzP2SVpnGatewayVpnConnection
Sample PS command lets test @https://raw.githubusercontent.com/Azure/azure-powershell/master/src/Network/Network.Test/ScenarioTests/CortexTests.ps1
Test-P2SCortexCRUD
Let me know if you have more queries. Thanks!

authors: MyronFanQiu Nilambari qianwens yonzhan

repo: Azure/azure-cli


text:
az postgres up: Extension install doesn't work on Mac OS Catalina

az feedback auto-generates most of the information requested below, as of CLI version 2.0.62

Describe the bug

To Reproduce

On macOS Catalina 10.15.4
Install az cli with brew:
$ brew install az

Attempt to install the preview extension to use az postgres up following the instructions in the quickstart.
$ az extension add --name db-up

Expected behavior

The extension should be installed successfully.
Instead, an error message is printed.
$ az extension add --name db-up
An error occurred. Pip failed with status code 1. Use --debug for more information.

Environment summary

System Python: 3.7.7
Az Python: 3.8.2 (Installed as a dependency via brew)
macOS-10.15.4-x86_64-i386-64bit
Python 3.8.2
Installer: HOMEBREW
azure-cli 2.6.0
Additional context

Stack trace seen when running with debug flags below.
I'm not 100% sure, but one issue may have to do with the az cli extension relying on Python 3.8, while the az db extension relies on Python 3.6. There might also be an issue with an older version of the psycopg2-binary library that the extension depends on.
g2-binary
    running install
    running build
    running build_py
    creating build
    creating build/lib.macosx-10.15-x86_64-3.8
    creating build/lib.macosx-10.15-x86_64-3.8/psycopg2
    copying lib/_json.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2
    copying lib/extras.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2
    copying lib/errorcodes.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2
    copying lib/tz.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2
    copying lib/_range.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2
    copying lib/_ipaddress.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2
    copying lib/__init__.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2
    copying lib/psycopg1.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2
    copying lib/extensions.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2
    copying lib/sql.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2
    copying lib/pool.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2
    creating build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/test_transaction.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/dbapi20.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/test_extras_dictcursor.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/test_with.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/test_types_basic.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/test_bug_gc.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/test_module.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/test_psycopg2_dbapi20.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/test_async.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/test_dates.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/test_async_keyword.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/testutils.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/test_connection.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/test_copy.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/test_bugX000.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/__init__.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/test_cursor.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/test_types_extras.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/test_sql.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/test_fast_executemany.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/test_green.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/test_ipaddress.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/test_cancel.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/test_quote.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/testconfig.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/test_errcodes.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/test_replication.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/test_lobject.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/test_notify.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    copying tests/dbapi20_tpc.py -> build/lib.macosx-10.15-x86_64-3.8/psycopg2/tests
    Skipping optional fixer: buffer
    Skipping optional fixer: idioms
    Skipping optional fixer: set_literal
    Skipping optional fixer: ws_comma
    running build_ext
    building 'psycopg2._psycopg' extension
    creating build/temp.macosx-10.15-x86_64-3.8
    creating build/temp.macosx-10.15-x86_64-3.8/psycopg
    clang -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -isysroot /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk -I/Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include -I/Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/System/Library/Frameworks/Tk.framework/Versions/8.5/Headers -DPSYCOPG_DEFAULT_PYDATETIME=1 -DPSYCOPG_VERSION=2.7.7 (dt dec pq3 ext lo64) -DPG_VERSION_NUM=120003 -DHAVE_LO64=1 -I/usr/local/opt/python@3.8/Frameworks/Python.framework/Versions/3.8/include/python3.8 -I. -I/usr/local/include -I/usr/local/include/postgresql/server -c psycopg/psycopgmodule.c -o build/temp.macosx-10.15-x86_64-3.8/psycopg/psycopgmodule.o
    psycopg/psycopgmodule.c:689:18: error: incomplete definition of type 'struct _is'
        while (interp->next)
               ~~~~~~^
    /usr/local/opt/python@3.8/Frameworks/Python.framework/Versions/3.8/include/python3.8/pystate.h:20:8: note: forward declaration of 'struct _is'
    struct _is;
           ^
    psycopg/psycopgmodule.c:690:24: error: incomplete definition of type 'struct _is'
            interp = interp->next;
                     ~~~~~~^
    /usr/local/opt/python@3.8/Frameworks/Python.framework/Versions/3.8/include/python3.8/pystate.h:20:8: note: forward declaration of 'struct _is'
    struct _is;
           ^
    2 errors generated.

    It appears you are missing some prerequisite to build the package from source.

    You may install a binary package by installing 'psycopg2-binary' from PyPI.
    If you want to install psycopg2 from source, please install the packages
    required for the build and try again.

    For further information please check the 'doc/src/install.rst' file (also at
    <http://initd.org/psycopg/docs/install.html>).

    error: command 'clang' failed with exit status 1
    Running setup.py install for psycopg2-binary: finished with status 'error'
ERROR: Command errored out with exit status 1: /usr/local/Cellar/azure-cli/2.6.0/libexec/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/sp/2xl8pg3d4l501xtxl_ncn4n40000gn/T/pip-install-8iewgpi_/psycopg2-binary/setup.py'"'"'; __file__='"'"'/private/var/folders/sp/2xl8pg3d4l501xtxl_ncn4n40000gn/T/pip-install-8iewgpi_/psycopg2-binary/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /private/var/folders/sp/2xl8pg3d4l501xtxl_ncn4n40000gn/T/pip-record-fn1judrv/install-record.txt --single-version-externally-managed --home /private/var/folders/sp/2xl8pg3d4l501xtxl_ncn4n40000gn/T/pip-target-890sc0zw --compile --install-headers /usr/local/Cellar/azure-cli/2.6.0/libexec/bin/../include/site/python3.8/psycopg2-binary Check the logs for full command output.
Exception information:
Traceback (most recent call last):
  File "/usr/local/Cellar/azure-cli/2.6.0/libexec/lib/python3.8/site-packages/pip/_internal/req/req_install.py", line 827, in install
    success = install_legacy(
  File "/usr/local/Cellar/azure-cli/2.6.0/libexec/lib/python3.8/site-packages/pip/_internal/operations/install/legacy.py", line 86, in install
    raise LegacyInstallFailure
pip._internal.operations.install.legacy.LegacyInstallFailure

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/Cellar/azure-cli/2.6.0/libexec/lib/python3.8/site-packages/pip/_internal/cli/base_command.py", line 188, in _main
    status = self.run(options, args)
  File "/usr/local/Cellar/azure-cli/2.6.0/libexec/lib/python3.8/site-packages/pip/_internal/cli/req_command.py", line 185, in wrapper
    return func(self, options, args)
  File "/usr/local/Cellar/azure-cli/2.6.0/libexec/lib/python3.8/site-packages/pip/_internal/commands/install.py", line 398, in run
    installed = install_given_reqs(
  File "/usr/local/Cellar/azure-cli/2.6.0/libexec/lib/python3.8/site-packages/pip/_internal/req/__init__.py", line 67, in install_given_reqs
    requirement.install(
  File "/usr/local/Cellar/azure-cli/2.6.0/libexec/lib/python3.8/site-packages/pip/_internal/req/req_install.py", line 845, in install
    six.reraise(*exc.parent)
  File "/usr/local/Cellar/azure-cli/2.6.0/libexec/lib/python3.8/site-packages/pip/_vendor/six.py", line 703, in reraise
    raise value
  File "/usr/local/Cellar/azure-cli/2.6.0/libexec/lib/python3.8/site-packages/pip/_internal/operations/install/legacy.py", line 74, in install
    runner(
  File "/usr/local/Cellar/azure-cli/2.6.0/libexec/lib/python3.8/site-packages/pip/_internal/utils/subprocess.py", line 270, in runner
    call_subprocess(
  File "/usr/local/Cellar/azure-cli/2.6.0/libexec/lib/python3.8/site-packages/pip/_internal/utils/subprocess.py", line 241, in call_subprocess
    raise InstallationError(exc_msg)
pip._internal.exceptions.InstallationError: Command errored out with exit status 1: /usr/local/Cellar/azure-cli/2.6.0/libexec/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/sp/2xl8pg3d4l501xtxl_ncn4n40000gn/T/pip-install-8iewgpi_/psycopg2-binary/setup.py'"'"'; __file__='"'"'/private/var/folders/sp/2xl8pg3d4l501xtxl_ncn4n40000gn/T/pip-install-8iewgpi_/psycopg2-binary/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /private/var/folders/sp/2xl8pg3d4l501xtxl_ncn4n40000gn/T/pip-record-fn1judrv/install-record.txt --single-version-externally-managed --home /private/var/folders/sp/2xl8pg3d4l501xtxl_ncn4n40000gn/T/pip-target-890sc0zw --compile --install-headers /usr/local/Cellar/azure-cli/2.6.0/libexec/bin/../include/site/python3.8/psycopg2-binary Check the logs for full command output.
Removed build tracker: '/private/var/folders/sp/2xl8pg3d4l501xtxl_ncn4n40000gn/T/pip-req-tracker-us649el3'

Command '['/usr/local/Cellar/azure-cli/2.6.0/libexec/bin/python', '-m', 'pip', 'install', '--target', '/Users/nina/.azure/cliextensions/db-up', '/var/folders/sp/2xl8pg3d4l501xtxl_ncn4n40000gn/T/tmp1cl12mfa/db_up-0.1.13-py2.py3-none-any.whl', '-vv', '--disable-pip-version-check', '--no-cache-dir']' returned non-zero exit status 1.
Homebrew patch: Deleting the temporarily created /Users/nina/.pydistutils.cfg
Pip failed so deleting anything we might have installed at /Users/nina/.azure/cliextensions/db-up
cli.azure.cli.core.util : An error occurred. Pip failed with status code 1. Use --debug for more information.
An error occurred. Pip failed with status code 1. Use --debug for more information.
Event: Cli.PostExecute [<function AzCliLogging.deinit_cmd_metadata_logging at 0x10ce634c0>]
az_command_data_logger : exit code: 1
telemetry.save : Save telemetry record of length 2579 in cache
telemetry.check : Negative: The /Users/nina/.azure/telemetry.txt was modified at 2020-05-22 09:29:07.662102, which in less than 600.000000 s
command ran in 57.619 seconds.

add to S171

dupe of #12340

It is fixed in latest db-up. Please upgrade your version with az extension update -n db-up.

@Juliehzl could you provide some info or link to what the fix was? I have this issue with the same exact error but am not using az.

Same problem here. I tried to install psycog2 in a python3 venv and it keeps throwing out this error.

Same problem here. I tried to install psycog2 in a python3 venv and it keeps throwing out this error. I'm not using az either.

May I know which is the installed version for psycog2?

@Juliehzl Zunli Hu FTE could you provide some info or link to what the fix was? I have this issue with the same exact error but am not using az.

The fix is to update psycopg2-binary yo 2.8.5.

One important thing to notice is that you might also need to install openssl and add that to your library path.

In case relevant to anyone else who ends up here -
I had a very similar error after upgrading to Big Sur. Just in case anyone else does too, mine actually ended up being an issue with Big Sur changing clang to an unsupported version. I ran the fix suggested here and the extension now installs fine.

authors: Juliehzl bkjones jackchau102 ninadicara nnja yonzhan


text:
az account get-access-token --resource https://cognitiveservices.azure.com <Response 400> from Cloud shell

Describe the bug
when run "az account get-access-token --resource https://cognitiveservices.azure.com" to get access token will receive error:
az_command_data_logger: Failed to connect to MSI. Please make sure MSI is configured correctly.
Get Token request returned: <Response [400]>
command is executed from Azure portal - Cloud shell, user should be automatically signed in.
az account get-access-token --resource https://management.azure.com would work without any issue.
Related command
az account get-access-token --resource https://cognitiveservices.azure.com
Errors
az_command_data_logger: Failed to connect to MSI. Please make sure MSI is configured correctly.
Get Token request returned: <Response [400]>
Issue script & Debug output
cli.knack.cli: Event: CommandInvoker.OnPostParseArgs [<function OutputProducer.handle_output_argument at 0x7f745c04fdc0>, <function CLIQuery.handle_query_parameter at 0x7f745bfe63a0>, <function register_ids_argument..parse_ids_arguments at 0x7f745b408280>]
urllib3.connectionpool: Starting new HTTP connection (1): localhost:50342
urllib3.connectionpool: http://localhost:50342 "POST /oauth2/token HTTP/1.1" 400 133
msrestazure.azure_active_directory: MSI: Retrieving a token from http://localhost:50342/oauth2/token, with payload {'resource': 'https://cognitiveservices.azure.com'}
msrestazure.azure_active_directory: MSI: Failed to retrieve a token from 'http://localhost:50342/oauth2/token' with an error of '400 Client Error: Bad Request for url: http://localhost:50342/oauth2/token'. This could be caused by the MSI extension not yet fully provisioned.
cli.azure.cli.core.auth.adal_authentication: throw requests.exceptions.HTTPError when doing MSIAuthentication:
Traceback (most recent call last):
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/auth/adal_authentication.py", line 75, in set_token
super().set_token()
File "/usr/lib64/az/lib/python3.9/site-packages/msrestazure/azure_active_directory.py", line 598, in set_token
self.scheme, _, self.token = get_msi_token(self.resource, self.port, self.msi_conf)
File "/usr/lib64/az/lib/python3.9/site-packages/msrestazure/azure_active_directory.py", line 486, in get_msi_token
result.raise_for_status()
File "/usr/lib64/az/lib/python3.9/site-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 400 Client Error: Bad Request for url: http://localhost:50342/oauth2/token
cli.azure.cli.core.azclierror: Traceback (most recent call last):
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/auth/adal_authentication.py", line 75, in set_token
super().set_token()
File "/usr/lib64/az/lib/python3.9/site-packages/msrestazure/azure_active_directory.py", line 598, in set_token
self.scheme, _, self.token = get_msi_token(self.resource, self.port, self.msi_conf)
File "/usr/lib64/az/lib/python3.9/site-packages/msrestazure/azure_active_directory.py", line 486, in get_msi_token
result.raise_for_status()
File "/usr/lib64/az/lib/python3.9/site-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 400 Client Error: Bad Request for url: http://localhost:50342/oauth2/token
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/auth/adal_authentication.py", line 87, in set_token
.format(err.response.status, err.response.reason))
AttributeError: 'Response' object has no attribute 'status'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib64/az/lib/python3.9/site-packages/knack/cli.py", line 233, in invoke
cmd_result = self.invocation.execute(args)
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/init.py", line 664, in execute
raise ex
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/init.py", line 731, in _run_jobs_serially
results.append(self._run_job(expanded_arg, cmd_copy))
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/init.py", line 701, in _run_job
result = cmd_copy(params)
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/init.py", line 334, in call
return self.handler(*args, **kwargs)
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/command_operation.py", line 121, in handler
return op(**command_args)
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/command_modules/profile/custom.py", line 78, in get_access_token
creds, subscription, tenant = profile.get_raw_token(subscription=subscription, resource=resource, scopes=scopes,
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/_profile.py", line 401, in get_raw_token
msi_creds = MsiAccountTypes.msi_auth_factory(MsiAccountTypes.system_assigned, identity_id,
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/_profile.py", line 734, in msi_auth_factory
return MSIAuthenticationWrapper(resource=resource)
File "/usr/lib64/az/lib/python3.9/site-packages/msrestazure/azure_active_directory.py", line 592, in init
self.set_token()
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/auth/adal_authentication.py", line 89, in set_token
raise AzureResponseError('Failed to connect to MSI. Please make sure MSI is configured correctly.\n'
azure.cli.core.azclierror.AzureResponseError: Failed to connect to MSI. Please make sure MSI is configured correctly.
Get Token request returned: <Response [400]>
cli.azure.cli.core.azclierror: Failed to connect to MSI. Please make sure MSI is configured correctly.
Get Token request returned: <Response [400]>
az_command_data_logger: Failed to connect to MSI. Please make sure MSI is configured correctly.
Get Token request returned: <Response [400]>
cli.knack.cli: Event: Cli.PostExecute [<function AzCliLogging.deinit_cmd_metadata_logging at 0x7f745b496a60>]
Expected behavior
return token without the need of login again
Environment Summary
azure-cli                         2.61.0
core                              2.61.0
telemetry                          1.1.0
Extensions:
ai-examples                        0.2.5
ml                                2.26.0
ssh                                2.0.3
Dependencies:
msal                              1.28.0
azure-mgmt-resource               23.1.1
Additional context
No response

Thank you for opening this issue, we will look into it.

hi team, is there any update on this? thanks.

authors: daisygithuba yonzhan


text:
auth: resolve tenant domain name to tenant id during login

Keyvault will not work with the logic domain name. This means I might have to crack the access token for the id, something i really don't want to do as it is very much discouraged to sniff the token other than relying parties like the ARM.
Repro:

az login -u http://mysp -p secret --service-principal --tenant mydomain.onmicrosoft.com <-- not a guid here
az keyvault create -g myRG -n my-kv
Error: An invalid value was provided for 'tenantId'.

Doable, but so far we only have one user asking for this, so I will hold on the change till I understand their context.

@schaabs, please activate when you get more information from that customer. For lack of user voices, I am not convinced I should hurry to commit the change

FYI, in case we need to do it, the simplest way is to get the json doc from https://login.windows.net/<domaon>.onmicrosoft.com/.well-known/openid-configuration, and tenant id is everywhere in the response payload. Just pick one and extract
{
  "authorization_endpoint":"https://login.windows.net/54826b22-38d6-4fb2-bad9-b7b93a3e9c5a/oauth2/authorize",
   "token_endpoint":"https://login.windows.net/54826b22-38d6-4fb2-bad9-b7b93a3e9c5a/oauth2/token"
}


text:
Feature Request: 'list-usage' for dns zone record-sets

Although az network list-usages -l <region> prints out a nice overview of usages under the network resource domain, it appears to be lacking dns record-set usage.
This feature request is therefore around seeing dns record-set usage, perhaps looking like az network dns record-set list-usage -g <resource group> -z <dns zone>.
Minimally, I would expect to see the current max quota for dns record-sets in a given resource group/dns zone pair as well as current usage of said quota.

This is a service limitation and this is not the right forum for service requests. Please direct your request here:
https://feedback.azure.com/forums/217313-networking

authors: tjprescott vdice


text:
"az consumption budget [list|show]" throws stack trace on azure-cli (2.0.33)

Describe the bug
running az-cli version 2.0.33.
Getting a similar stack trace when running the following two cli commands. Both report "Object of type 'Decimal' is not JSON serializable"
To Reproduce
[parker@parker az-bin]$ az consumption budget list
Object of type 'Decimal' is not JSON serializable
Traceback (most recent call last):
File "/usr/local/Cellar/azure-cli/2.0.33/libexec/lib/python3.6/site-packages/knack/cli.py", line 201, in invoke
self.output.out(cmd_result, formatter=formatter, out_file=out_file)
File "/usr/local/Cellar/azure-cli/2.0.33/libexec/lib/python3.6/site-packages/knack/output.py", line 134, in out
output = formatter(obj)
File "/usr/local/Cellar/azure-cli/2.0.33/libexec/lib/python3.6/site-packages/knack/output.py", line 40, in format_json
separators=(',', ': ')) + '\n'
File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/json/init.py", line 238, in dumps
**kw).encode(obj)
File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/json/encoder.py", line 201, in encode
chunks = list(chunks)
File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/json/encoder.py", line 428, in _iterencode
yield from _iterencode_list(o, _current_indent_level)
File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/json/encoder.py", line 325, in _iterencode_list
yield from chunks
File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/json/encoder.py", line 404, in _iterencode_dict
yield from chunks
File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/json/encoder.py", line 404, in _iterencode_dict
yield from chunks
File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/json/encoder.py", line 404, in _iterencode_dict
yield from chunks
File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/json/encoder.py", line 437, in _iterencode
o = _default(o)
File "/usr/local/Cellar/azure-cli/2.0.33/libexec/lib/python3.6/site-packages/knack/output.py", line 32, in default
return json.JSONEncoder.default(self, o)
File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/json/encoder.py", line 180, in default
o.class.name)
TypeError: Object of type 'Decimal' is not JSON serializable
[parker@parker az-bin]$
 ---------
[parker@parker az-bin]$ az consumption budget show --budget-name
Object of type 'Decimal' is not JSON serializable
Traceback (most recent call last):
File "/usr/local/Cellar/azure-cli/2.0.33/libexec/lib/python3.6/site-packages/knack/cli.py", line 201, in invoke
self.output.out(cmd_result, formatter=formatter, out_file=out_file)
File "/usr/local/Cellar/azure-cli/2.0.33/libexec/lib/python3.6/site-packages/knack/output.py", line 134, in out
output = formatter(obj)
File "/usr/local/Cellar/azure-cli/2.0.33/libexec/lib/python3.6/site-packages/knack/output.py", line 40, in format_json
separators=(',', ': ')) + '\n'
File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/json/init.py", line 238, in dumps
**kw).encode(obj)
File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/json/encoder.py", line 201, in encode
chunks = list(chunks)
File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/json/encoder.py", line 430, in _iterencode
yield from _iterencode_dict(o, _current_indent_level)
File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/json/encoder.py", line 404, in _iterencode_dict
yield from chunks
File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/json/encoder.py", line 404, in _iterencode_dict
yield from chunks
File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/json/encoder.py", line 404, in _iterencode_dict
yield from chunks
File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/json/encoder.py", line 437, in _iterencode
o = _default(o)
File "/usr/local/Cellar/azure-cli/2.0.33/libexec/lib/python3.6/site-packages/knack/output.py", line 32, in default
return json.JSONEncoder.default(self, o)
File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/json/encoder.py", line 180, in default
o.class.name)
TypeError: Object of type 'Decimal' is not JSON serializable
[parker@parker az-bin]$
Expected behavior
Not expecting a traceback
Environment summary
macOS brew install.
Additional context
Add any other context about the problem here.

I've experience the same using the CLI on a Windows 10 environment

authors: olivelawn thewebcritter


text:
[Storage] Fix issues #13012, #13632 and #13657 to remove unused arguments for generate-sas related commands

Description

Fix #13012, #13632, #13657
Because --sas-token is valid for generate-sas command,  just remove it here.
And add check for --auth-mode login in blob and container related command.
Testing Guide

az storage container generate-sas with --account-key or --connection-string
az storage blob generate-sas with --account-key or --connection-string
az storage share generate-sas with --account-key or --connection-string
az storage file generate-sas with --account-key or --connection-string
az storage queue generate-sas with --account-key or --connection-string
az storage table generate-sas  with --account-key or --connection-string
History Notes

[Component Name 1] BREAKING CHANGE: az command a: Make some customer-facing breaking change.
[Component Name 2] az command b: Add some customer-facing feature.

This checklist is used to make sure that common guidelines for a pull request are followed.

[ ] The PR title and description has followed the guideline in Submitting Pull Requests.

[ ] I adhere to the Command Guidelines.

add to S171

authors: Juliehzl yonzhan


text:
[IotHub] Allow tags in IoT DPS create command

Description
Fix partial https://github.com/Azure/azure-cli/issues/13497
Testing Guide

History Notes

[Component Name 1] BREAKING CHANGE: az command a: Make some customer-facing breaking change.
[Component Name 2] az command b: Add some customer-facing feature.

This checklist is used to make sure that common guidelines for a pull request are followed.

[x] The PR title and description has followed the guideline in Submitting Pull Requests.

[x] I adhere to the Command Guidelines.

IotHub

Could this structure of tags be consistent with the tags of other CLI commands?
For example:
az resource tag --ids {resource-id} --tags key1=value1 key2=value2 key3=value3

This tag verification can be referred to https://github.com/zhoxing-ms/azure-cli/blob/master/src/azure-cli/azure/cli/command_modules/resource/_params.py#L57

authors: anusapan yonzhan zhoxing-ms


text:
{Mysql} az mysql flexible-server import create: Adding logic for external migrations DO NOT MERGE

Related command

Description

Testing Guide

History Notes

[Component Name 1] BREAKING CHANGE: az command a: Make some customer-facing breaking change
[Component Name 2] az command b: Add some customer-facing feature

This checklist is used to make sure that common guidelines for a pull request are followed.

[ ] The PR title and description has followed the guideline in Submitting Pull Requests.

[ ] I adhere to the Command Guidelines.

[ ] I adhere to the Error Handling Guidelines.

Mysql


text:
Added extra check for upload telemetry

This checklist is used to make sure that common guidelines for a pull request are followed.

Codecov Report

Merging #6542 into rc38.1 will not change coverage.
The diff coverage is n/a.

@@          Coverage Diff           @@
##           rc38.1   #6542   +/-   ##
======================================
  Coverage       0%      0%
======================================
  Files          11      11
  Lines         133     133
  Branches        9       9
======================================
  Misses        133     133

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5c2ac99...37b69d6. Read the comment docs.

authors: codecov-io williexu


text:
Fix typo.

There was a typo in the URI mentioned in the tutorial.

Hi @lavahot, I'm your friendly neighborhood Azure Pull Request Bot (You can call me AZPRBOT). Thanks for your contribution!

This seems like a small (but important) contribution, so no contribution license agreement is required at this point. Real humans will now evaluate your PR.

TTYL, AZPRBOT;

@lavahot Great catch--thanks for fixing this. We appreciate your help improving Azure docs.

authors: azurecla ggailey777 lavahot

repo: Azure/azure-content


text:
Corrected the description for AKV Principal Secret

Corrected the description of the AKV Principal Secret parameter in the Key Vault Integration section

Hi @AndyHerb, I'm your friendly neighborhood Azure Pull Request Bot (You can call me AZPRBOT). Thanks for your contribution!

This seems like a small (but important) contribution, so no contribution license agreement is required at this point. Real humans will now evaluate your PR.

TTYL, AZPRBOT;

@squillace & @cynthn - VM pull request

authors: AndyHerb azurecla tysonn