Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ContainerRegistry] update for better codegen for data plane Track 2 SDK libraries #13711

Merged
merged 44 commits into from
Jun 28, 2021

Conversation

jeremymeng
Copy link
Contributor

@jeremymeng jeremymeng commented Mar 29, 2021

MSFT employees can try out our new experience at OpenAPI Hub - one location for using our validation tools and finding your workflow.

Changelog

Please ensure to add changelog with this PR by answering the following questions.

  1. What's the purpose of the update?
    • new service onboarding
    • new API version
    • update existing version for new feature
    • update existing version to fix swagger quality issue in s360
    • Other, please clarify: update swagger to allow better codegen for data plane Track 2 SDK libraries
  2. When you are targeting to deploy new service/feature to public regions? Please provide date, or month to public if date is not available yet.
  3. When you expect to publish swagger? Please provide date, or month to public if date is not available yet.
  4. If it's an update to existing version, please select SDKs of specific language and CLIs that require refresh after swagger is published.
    • SDK of .NET (need service team to ensure code readiness)
    • SDK of Python
    • SDK of Java
    • SDK of Js
    • SDK of Go
    • PowerShell
    • CLI
    • Terraform
    • No, no need to refresh for updates in this PR

Contribution checklist:

If any further question about AME onboarding or validation tools, please view the FAQ.

ARM API Review Checklist

  • Ensure to check this box if one of the following scenarios meet updates in the PR, so that label “WaitForARMFeedback” will be added automatically to involve ARM API Review. Failure to comply may result in delays for manifest application. Note this does not apply to data plane APIs, all “removals” and “adding a new property” no more require ARM API review.

    • Adding new API(s)
    • Adding a new API version
    • Ensure to copy the existing version into new directory structure for first commit (including refactoring) and then push new changes including version updates in separate commits. This is required to review the changes efficiently.
    • Adding a new service
  • Please ensure you've reviewed following guidelines including ARM resource provider contract and REST guidelines. Estimated time (4 hours). This is required before you can request review from ARM API Review board.

  • If you are blocked on ARM review and want to get the PR merged with urgency, please get the ARM oncall for reviews (RP Manifest Approvers team under Azure Resource Manager service) from IcM and reach out to them.

Breaking Change Review Checklist

If there are following updates in the PR, ensure to request an approval from Breaking Change Review Board as defined in the Breaking Change Policy.

  • Removing API(s) in stable version
  • Removing properties in stable version
  • Removing API version(s) in stable version
  • Updating API in stable or public preview version with Breaking Change Validation errors
  • Updating API(s) in public preview over 1 year (refer to Retirement of Previews)

Action: to initiate an evaluation of the breaking change, create a new intake using the template for breaking changes. Addition details on the process and office hours are on the Breaking change Wiki.

Please follow the link to find more details on PR review process.

Add a new folder Azure.ContainerRegistry with a copy of
preview/2019-08-15 specs in preparation of further changes to make
better codegen of Track 2 data plane SDK libraries
@openapi-workflow-bot
Copy link

Hi, @jeremymeng Thanks for your PR. I am workflow bot for review process. Here are some small tips.

  • Please ensure to do self-check against checklists in first PR comment.
  • PR assignee is the person auto-assigned and responsible for your current PR reviewing and merging.
  • For specs comparison cross API versions, Use API Specs Comparison Report Generator
  • If there is CI failure(s), to fix CI error(s) is mandatory for PR merging; or you need to provide justification in PR comment for explanation. How to fix?

  • Any feedback about review process or workflow bot, pls contact swagger and tools team. vsswagger@microsoft.com

    @openapi-workflow-bot
    Copy link

    [Call for Action] To better understand Azure service dev/test scenario, and support Azure service developer better on Swagger and REST API related tests in early phase, please help to fill in with this survey https://aka.ms/SurveyForEarlyPhase. It will take 5 to 10 minutes. If you already complete survey, please neglect this comment. Thanks.

    @openapi-pipeline-app
    Copy link

    openapi-pipeline-app bot commented Mar 29, 2021

    Swagger Validation Report

    ️️✔️BreakingChange succeeded [Detail] [Expand]
    There are no breaking changes.
    ️⚠️LintDiff: 6 Warnings warning [Detail]
    The following errors/warnings are introduced by current PR:
    Rule Message
    ⚠️ R2007 - LongRunningOperationsWithLongRunningExtension The operation 'ContainerRegistry_DeleteManifest' returns 202 status code, which indicates a long running operation, please enable 'x-ms-long-running-operation.
    Location: Azure.ContainerRegistry/preview/2019-08-15-preview/containerregistry.json#L172
    ⚠️ R2007 - LongRunningOperationsWithLongRunningExtension The operation 'ContainerRegistryBlob_DeleteBlob' returns 202 status code, which indicates a long running operation, please enable 'x-ms-long-running-operation.
    Location: Azure.ContainerRegistry/preview/2019-08-15-preview/containerregistry.json#L318
    ⚠️ R2007 - LongRunningOperationsWithLongRunningExtension The operation 'ContainerRegistryBlob_UploadChunk' returns 202 status code, which indicates a long running operation, please enable 'x-ms-long-running-operation.
    Location: Azure.ContainerRegistry/preview/2019-08-15-preview/containerregistry.json#L453
    ⚠️ R2007 - LongRunningOperationsWithLongRunningExtension The operation 'ContainerRegistry_DeleteRepository' returns 202 status code, which indicates a long running operation, please enable 'x-ms-long-running-operation.
    Location: Azure.ContainerRegistry/preview/2019-08-15-preview/containerregistry.json#L665
    ⚠️ R2007 - LongRunningOperationsWithLongRunningExtension The operation 'ContainerRegistry_DeleteTag' returns 202 status code, which indicates a long running operation, please enable 'x-ms-long-running-operation.
    Location: Azure.ContainerRegistry/preview/2019-08-15-preview/containerregistry.json#L864
    ⚠️ R2007 - LongRunningOperationsWithLongRunningExtension The operation 'ContainerRegistryBlob_StartUpload' returns 202 status code, which indicates a long running operation, please enable 'x-ms-long-running-operation.
    Location: Azure.ContainerRegistry/preview/2019-08-15-preview/containerregistry.json#L1146
    ️️✔️Avocado succeeded [Detail] [Expand]
    Validation passes for Avocado.
    ️️✔️ModelValidation succeeded [Detail] [Expand]
    Validation passes for ModelValidation.
    ️️✔️SemanticValidation succeeded [Detail] [Expand]
    Validation passes for SemanticValidation.
    ️️✔️Cross-Version Breaking Changes succeeded [Detail] [Expand]
    There are no breaking changes.
    ️️✔️CredScan succeeded [Detail] [Expand]
    There is no credential detected.
    ️⚠️[Staging] SDK Track2 Validation: 1 Warnings warning [Detail]
    The following errors/warnings are introduced by current PR:
    Rule Message
    ⚠️ Modeler/MissingType "readme":"containerregistry/data-plane/Azure.ContainerRegistry/readme.md",
    "tag":"package-2019-08",
    "details":"The schema 'paths·v9pjtw·v2-name-manifests-reference·put·responses·201·content·application-json·schema' has no type or format information whatsoever. Location:\n file:///home/vsts/work/1/azure-rest-api-specs/specification/containerregistry/data-plane/Azure.ContainerRegistry/preview/2019-08-15-preview/containerregistry.json#/components/schemas/paths·v9pjtw·v2-name-manifests-reference·put·responses·201·content·application-json·schema"
    💬 AutorestCore/Exception "readme":"containerregistry/data-plane/Azure.ContainerRegistry/readme.md",
    "tag":"package-2019-08",
    "details":"> Installing AutoRest extension '@microsoft.azure/openapi-validator' (1.8.0)"
    💬 AutorestCore/Exception "readme":"containerregistry/data-plane/Azure.ContainerRegistry/readme.md",
    "tag":"package-2019-08",
    "details":"> Installed AutoRest extension '@microsoft.azure/openapi-validator' (1.8.0->1.8.0)"
    💬 AutorestCore/Exception "readme":"containerregistry/data-plane/Azure.ContainerRegistry/readme.md",
    "tag":"package-2019-08",
    "details":"> Installing AutoRest extension '@autorest/modelerfour' (4.15.456)"
    💬 AutorestCore/Exception "readme":"containerregistry/data-plane/Azure.ContainerRegistry/readme.md",
    "tag":"package-2019-08",
    "details":"> Installed AutoRest extension '@autorest/modelerfour' (4.15.456->4.15.456)"
    ️️✔️[Staging] PrettierCheck succeeded [Detail] [Expand]
    Validation passes for PrettierCheck.
    ️️✔️[Staging] SpellCheck succeeded [Detail] [Expand]
    Validation passes for SpellCheck.
    ️️✔️[Staging] Lint(RPaaS) succeeded [Detail] [Expand]
    Validation passes for Lint(RPaaS).
    Posted by Swagger Pipeline | How to fix these errors?

    @openapi-pipeline-app
    Copy link

    openapi-pipeline-app bot commented Mar 29, 2021

    Swagger pipeline restarted successfully, please wait for status update in this comment.

    @openapi-workflow-bot
    Copy link

    Hi @jeremymeng, Your PR has some issues. Please fix the CI sequentially by following the order of Avocado, semantic validation, model validation, breaking change, lintDiff.

    TaskHow to fixPrioritySupport (Microsoft alias)
    AvocadoFix-AvocadoHighruowan
    Semantic validationFix-SemanticValidation-ErrorHighraychen, jianyxi
    Model validationFix-ModelValidation-ErrorHighraychen,jianyxi
    LintDiffFix-LintDiffhighjianyxi, ruoxuan
    If you need further help, please feedback via swagger feedback."

    @annelo-msft
    Copy link
    Member

    @jeremymeng , if the Track 1 swagger filepath is Microsoft.ContainerRegistry/preview/2019-08-15/, would it make sense to move the Track 2 swagger to a filepath with a different date? Or does the date mean a specific version of the service, and so the Track 2 file describes the same one and we should use the same date?

    @jeremymeng
    Copy link
    Contributor Author

    Or does the date mean a specific version of the service

    yes I believe it is the service version. At least that what I've been seeing in Storage.

    - rename folder to be consistent with api version
    - remove GetAccessToken.json example as the endpoint was removed in this swagger
    @ghost
    Copy link

    ghost commented Jun 13, 2021

    Hi, @jeremymeng. Your PR has no update for 14 days and it is marked as stale PR. If no further update for over 14 days, the bot will close the PR. If you want to refresh the PR, please remove no-recent-activity label.

    python: true
    ```

    ## Suppression
    Copy link
    Contributor Author

    Choose a reason for hiding this comment

    The reason will be displayed to describe this comment to others. Learn more.

    as `azurecr.io` is kust for public cloud and the format can be
    different for every cloud or vanity URLs.
    @tjprescott
    Copy link
    Member

    @jeremymeng is this ready to merge?

    @jeremymeng
    Copy link
    Contributor Author

    @jeremymeng is this ready to merge?

    @tjprescott I contacted and would like to get some review and approval from the service team first.

    {
    "swagger": "2.0",
    "info": {
    "title": "Container Registry",
    Copy link
    Contributor

    Choose a reason for hiding this comment

    The reason will be displayed to describe this comment to others. Learn more.

    Azure Container Registry?

    Copy link
    Contributor Author

    Choose a reason for hiding this comment

    The reason will be displayed to describe this comment to others. Learn more.

    Updated

    "readEnabled": true,
    "listEnabled": true,
    "deleteEnabled": true,
    "writeEnabled": true
    Copy link
    Contributor

    Choose a reason for hiding this comment

    The reason will be displayed to describe this comment to others. Learn more.

    can you add "teleportEnabled": false?

    Copy link
    Contributor Author

    Choose a reason for hiding this comment

    The reason will be displayed to describe this comment to others. Learn more.

    Added

    - Add "Azure" to title
    - add `"teleportEnabled": false` to example
    @tjprescott
    Copy link
    Member

    @jeremymeng please ping me when you are ready to merge this

    Copy link
    Contributor

    @shahzzzam shahzzzam left a comment

    Choose a reason for hiding this comment

    The reason will be displayed to describe this comment to others. Learn more.

    LGTM

    @jeremymeng
    Copy link
    Contributor Author

    @tjprescott It's ready to go!

    @tjprescott tjprescott merged commit e793a8c into Azure:master Jun 28, 2021
    @jeremymeng jeremymeng deleted the acr-track2-swagger branch July 6, 2021 08:12
    mkarmark pushed a commit to mkarmark/azure-rest-api-specs that referenced this pull request Jul 21, 2021
    …SDK libraries (Azure#13711)
    
    * [Track2 Data Plane SDK] prepare folder
    
    Add a new folder Azure.ContainerRegistry with a copy of
    preview/2019-08-15 specs in preparation of further changes to make
    better codegen of Track 2 data plane SDK libraries
    
    * Add Track 2 customizations
    
    * update PATCH return types
    
    * Add a preliminary readme.md
    
    * Fix CI Avocado failures
    
    - rename folder to be consistent with api version
    - remove GetAccessToken.json example as the endpoint was removed in this swagger
    
    * Add timeasc and timedesc to custom-words.txt
    
    also remove sections unrelated to Track 2 SDK
    
    * Update typescript customization
    
    * Fix required-ness for some properties
    
    Fix casing aadAccesstoken => aadAccessToken
    
    * Run prettier
    
    * updates to swagger for Beta 2 API
    
    * bug fix in arch enum
    
    * updates per apiview feedback
    
    * updates to manifest properties
    
    * Move some customization into swagger
    
    * Undo client name customization for `architecture`
    
    Now that we use `architecture` in the new API design.
    
    * Update arch and os types and set readOnly: true
    
    * make change for grant type = password
    
    * editing the correct swagger
    
    * undoing changes to the wrong swagger
    
    * adding internal enum for grant type
    
    * moving grant_type to the end of the parameters for .net
    
    * Incorporate Anne's beta.3 swagger update
    
    and make ManifestAttributes.manifest required so its flattened
    `digest` property can have their proper required-ness.
    
    * small name changes
    
    * updates to separate out ArtifactManifestReference
    
    * flatten writeable property types; add registry property back
    
    * update the delete methods
    
    * Remove property required-ness
    
    as they are used for input and cannot be used together with "readOnly"
    
    * Run prettier
    
    * Fix linting errors in examples
    
    * Remove extraneous brace
    
    * Add custom word for ACR
    
    * Fix more linting errors in examples
    
    * Revert "Remove property required-ness"
    
    This reverts commit 4eba58a.
    
    * Remove default value of "none" for architecture enum
    
    * renames per arch board review
    
    * Copy the existing suppression from master
    
    * Fix spellcheck errors
    
    Add words to custom-words.txt
    
    * More spelling fix
    
    * Suppress R2056 RequiredReadOnlyProperties
    
    Reasoning at Azure/azure-openapi-validator#243
    
    * Remove `:` in reason value
    
    it breaks yaml
    
    * Update description of registryLoginServer
    
    as `azurecr.io` is kust for public cloud and the format can be
    different for every cloud or vanity URLs.
    
    * Address PR feedback
    
    - Add "Azure" to title
    - add `"teleportEnabled": false` to example
    
    * Minor update to tyepscript codegen customization section
    
    Co-authored-by: Anne Loomis Thompson <annelo@microsoft.com>
    Co-authored-by: seankane-msft <seankane@microsoft.com>
    Co-authored-by: Pallavi Taneja <pallavit@users.noreply.github.com>
    Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
    Labels
    None yet
    Projects
    None yet
    Development

    Successfully merging this pull request may close these issues.

    6 participants