Install MSYS2 to Windows. #632

vsafonkin · 2020-03-26T15:50:56Z

Issue: #30

Added scripts for installation and validation MSYS2.

Installation time: 6 - 7 min
Size: ~4.2 Gb

AlenaSviridenko · 2020-03-26T15:55:24Z

/azp run windows2016, windows2019

azure-pipelines · 2020-03-26T15:55:38Z

Azure Pipelines successfully started running 2 pipeline(s).

alepauly · 2020-05-11T14:46:44Z

/azp run windows2016, windows2019

azure-pipelines · 2020-05-11T14:46:57Z

Azure Pipelines successfully started running 2 pipeline(s).

maxim-lobanov · 2020-05-11T15:09:30Z

/azp run windows2016, windows2019

azure-pipelines · 2020-05-11T15:09:43Z

Azure Pipelines successfully started running 2 pipeline(s).

eine · 2020-05-12T12:21:19Z

images/win/scripts/Installers/Install-Msys2.ps1

+Write-Host "bash pacman-key --populate msys2"
+bash.exe -c "pacman-key --populate msys2 2>&1"
+
+Write-Host "pacman --noconfirm -Syyuu"


Ref #342 (comment)

This PR is based on @MSP-Greg suggested one that's why it's here. I'd prefer to wait for image deployment and then we can collect some feedback about working scenarios and decide if this approach suits or not.

#342 was previous, and it was ignored. I don't think that being based on some other PR is meaningful in this case.

Actually, I'm good with the merged solution, even though it constraints the possible use cases. As commented in previous discussions, users can keep using other custom MSYS2 installations through action setup-msys2. I'd just like it to be explicitly documented, so that users of GitHub Actions are aware that this is not a default MSYS2 install.

Could you provide your vision on documentation, please? What points should be mentioned?

Sure. For example:

In order to reduce startup time for most common use cases, the MSYS2 installation provided in windows environments is installed from binaries, then updated, and some packages such as base-devel, compression, clang and cmake are preinstalled. Please open an issue in LINK for requesting additional packages to be preinstalled.

As a result, users willing to use a stable environment should install MSYS2 themselves. See #632 for a reference. Alternatively Action setup-msys2 can be used.

Hi @eine, we will add information about non-default MSYS2 installation to docs, thank you for your participate!

eine · 2020-05-12T12:22:32Z

images/win/scripts/Installers/Install-Msys2.ps1

+
+Write-Host "pacman --noconfirm -Syyuu"
+pacman.exe -Syyuu --noconfirm
+pacman.exe -Syuu --noconfirm


Please, see #342 (comment)

eine · 2020-05-19T13:42:16Z

images/win/scripts/Installers/Install-Msys2.ps1

+$gitPath  = "$env:ProgramFiles\Git"
+
+# get info from https://sourceforge.net/projects/msys2/files/Base/x86_64/
+$msys2Uri  = "http://repo.msys2.org/distrib/x86_64/msys2-base-x86_64-20190524.tar.xz"


A more recent release is available at https://github.com/msys2/msys2-installer/releases. Nightly releases are available too. It might be worth updating. Moreover, releases are hosted on GitHub.

At the same time, since everything is updated anyway, it would be desirable to retrieve the non-base package.

* add ubuntu 20 yml * add ubuntu 20.04 * add toolcache * add config * install ansible from oficial canonical repo * remove azure-cli * remove azure-devops-cli * libcurl3 -> libcurl4 * libcurl4 * install python2 * install clang9 directly from apt-get * remove swift * fix libcurl in the right place * remove docker-moby * remove dotnetcore-sdk * remove haskell * remove azul jdk * remove leingen * remove php * remove sbt * fix lsb release * remove mongodb * remove >> for go installation * install only python3 * remove pip version * remove add-apt-repository -y ppa:apt-fast/stable * remove android * remove powershell * remove python from tests * add java back * change heroku installation * get back leingen * get back android * remove set -e from java installation * get back apt-fast * remove git-lfs install from packagecloud * add pip installation for python2 * get back set -e to java-tools.sh * change ansible installation * add pip to python * Revert "install clang9 directly from apt-get" This reverts commit e7d965f. * Revert "change heroku installation" This reverts commit 4fb3c0c. * Revert "remove php" This reverts commit d64ce16. * change CRLF to LF for php installation * get back heroku to template * get back haskell * get back dotnet * install pwsh via snap * remove netcore 3.0 & 2.2 * add azpowershell * Upgrade to Az 3.8 * Update Validate-AzureModules.ps1 * Fix formatting in doc-string for Rust for Windows-image. Ensure output in ` images/win/Windows2019-Readme.md` looks proper. [Live in master right now](https://github.com/actions/virtual-environments/blob/master/images/win/Windows2019-Readme.md#rust-64-bit), it looks kinda bad. * added workaround for default DNS * revert changes * Don\'t create backup sed file (#792) Co-authored-by: Sergey Dolin <v-sedoli@micorosoft.com> * Updated README with new rules of tool installation. (#793) * Update README with new rules of tool installation. * fixed typo * fix notes * another minor fix * fixed articles * fixed license line * Add Python toolcache installation from Github releases for Ubuntu (#704) Change logic to install Python to Ubuntu images to use GitHub releases from https://github.com/actions/python-versions * Software list: "do not change" label. (#796) * added_advises * change place for hided stirng. * changed to more direct message. * Fail fast in image generation if not enough disk space for customers (#767) * added checking free disk space Co-authored-by: Nikita Bykov <v-nibyko@microsoft.com> * Add FS-iSCSITarget-Server (#805) * Updating readme file for win19 version 20200426.1 * Add Python tools installation from Github releases for Windows (#705) * Add Toolset provision for Windows Co-authored-by: MaksimZhukov <v-mazhuk@microsoft.com> * Updating readme file for macOS version 20200425.1 (#801) * Updating readme file for win16 version 20200426.1 * change min free space to 18000Mb (#814) * Added java 13 package in VM (#795) * Added java 13 package in VM * Fixed var name * Make changes from 11 to 13 * added java 13 for validate-javatool * Fix documentation for containertools * pre-create .composer folder to preserve permission * Fix minor glitch in installer message echo "cmake is already installed" * added workaround for default DNS (#819) * workaround reverted * Improve Windows provisioners stability (#733) * Improve Install-CloudFoundryCli.ps1 * Improve Install-Go.ps1 * Improve Install-Kind.ps1 * Improve Install-MysqlCli.ps1 * Improve Install-Rust.ps1 * Improve Install-SQLPowerShellTools.ps1 * Improve Update-AndroidSDK.ps1 * Fix issue with resolve * Improve Windows Visual Studio provisioners (#758) * Add retries to DotnetSDK provisioner * Improve VS provisioners * Fixes in syntax * Fixes in syntax * Rename Install-VS function * Remove bootstrapperName parameter from Install-VisualStudio * Small fix * Improve Windows browsers provisioners stability (#725) * Improve Chrome provisioner * Improve Edge provisioner * Improve Firefox provisioner * Resolve conflicts in Install-Chrome.ps1 * Add retry logic for javatools (#802) * Add retry logic for javatools * Add retry logic for Selenium server download (#807) * Add retry logic for selenium * Refactoring * Add retries for Selenium release info * Minor fix * Fix kubectl installation (#799) * Fix kubectl installation * Fix kubectl installation * Add --client flag * Fix for ubuntu 16.04 * Move kubectl apt packages installation to basic.sh * Combined separated scripts for kubectl installation to one * Minor fix * Remove apt-transport-https package from basic.sh * Delete helm init * Disable crash reporting (#826) * disable jit debugger * override settings asfter vs installation * Fix maven environment variable (#831) * Updating readme file for macOS version 20200430.1 (#846) * Add nodejs toolcache for windows (#840) * add installation of nodejs Co-authored-by: Dmitry Shibanov <v-dmshib@microsoft.com> * Add nodejs tool cache for linux. (#839) * add nodejs * 4 node versions Co-authored-by: Dmitry Shibanov <v-dmshib@microsoft.com> * Hide packages that are no longer required (#854) * Updating readme file for macOS version 20200430.1 * hide AutomaticRemove info * added SSDT workload to VS 2019 (#844) * Install Go to hostedtoolcache directory on Ubuntu image (#848) * Move go location to the toolcache * Install Go to hostedtoolcache directory on Windows image (#849) * Move installed go versions to toolcache directory * Updating readme file for win19 version 20200430.2 * Updating readme file for ubuntu16 version 20200430.2 * Install Windows 10 SDK (10.0.14393.795) via standalone installer (#862) * add win10 sdk 10.0.14393 * markdown changes * Add msys2 installation and validation (#632) * SQL Server Data-Tier Application Framework latest upgrade. (#863) * DACFx_latest_version_install * Fix the cleanup script. (#856) * Fix the cleanup script.The result is not returned to the variable because of the output redirect * Added the cancel timeout. * Update Haskell tool Stack (#860) * Update Haskell tool Stack * Update haskell script to install stack from get.haskellstack.org * Updating readme file for win16 version 20200505.1 * Updating readme file for ubuntu18 version 20200430.1 * Switch Expand-Archive to 7zip on Windows image generation (#861) * switch expand-archive to 7zip on windows * [Ubuntu] Add Azcopy10 (#871) * Add azcopy10 * Add spaces after azcopy * add condition to ansible * deprecated software Ubuntu 20.04 * install powershell Ubuntu 20.04 * use function in ansible * move preparemetadata.sh to installers folder * update preimagedata.sh ubuntu20 * add confition for dotnetsdk * scripts/installers/2004/android.sh * python.sh ubuntu 20.04 * simplify conditions * remove toolcache.json * get back note in readme * remove workaround for git-lfs * Az 3.8.0 Ubuntu 20.04 * fix kubernetes-tools in template * add helpers script to os.sh * remove old android, old cabal * remove platform tools * remove java7 for ubuntu20 * stay only go 1.14 Ubuntu 20.04 * add helper to python.sh * add os.sh helper to azpwsh and java * remove apis from documented * remove addons google-api * Install Az latest module * get back swift * set java 11 as default * change offer and sku * Revert "change offer and sku" This reverts commit d5d92a5. * Unite mercurial scripts * combine basic scripts for ubuntu 18 & 20 * add os.sh to basic.sh * Revert "set java 11 as default" This reverts commit aada5b1. * set Java11 by default, set Java8 for Androidsdk * rework php script * remove rid of php.sh files * move installation to for loop * add disk space validation Co-authored-by: Christoph Bergmeister [MVP] <c.bergmeister@gmail.com> Co-authored-by: Jostein Kjønigsen <jostein@kjonigsen.net> Co-authored-by: Darii Nurgaleev <Darleev@github.com> Co-authored-by: Sergey Dolin <v-sedoli@microsoft.com> Co-authored-by: Sergey Dolin <v-sedoli@micorosoft.com> Co-authored-by: Alena Sviridenko <alenasviridenko@github.com> Co-authored-by: Vladimir Safonkin <vsafonkin@gmail.com> Co-authored-by: Dariy Nurgaleev <50947177+Darleev@users.noreply.github.com> Co-authored-by: Nikita Bykov <49442273+nikita-bykov@users.noreply.github.com> Co-authored-by: Aleksandr Chebotov <47745270+al-cheb@users.noreply.github.com> Co-authored-by: Image generation service account <no-reply@microsoft.com> Co-authored-by: Maksim Petrov <47208721+vmapetr@users.noreply.github.com> Co-authored-by: Sima Zhu <48036328+sima-zhu@users.noreply.github.com> Co-authored-by: phozzy <arthur.fayzullin@gmail.com> Co-authored-by: Jorgen Thelin <jthelin@microsoft.com> Co-authored-by: Dmitry Shibanov <shibanov-1997@inbox.ru> Co-authored-by: Dmitry Shibanov <v-dmshib@microsoft.com> Co-authored-by: cage200 <patruadrian@yahoo.com> Co-authored-by: Junyoung Clare Jang <jjc9310@gmail.com> Co-authored-by: Dibir Magomedsaygitov <61747324+dibir-magomedsaygitov@users.noreply.github.com> Co-authored-by: Aleksandr Chebotov <v-aleche@microsoft.com>

eine · 2020-05-28T15:03:24Z

Ref #928 #916 #906 #899 #342

Add msys2 installation and validation

39908c2

al-cheb approved these changes Mar 26, 2020

View reviewed changes

vsafonkin requested review from vmapetr, al-cheb, AlenaSviridenko, maxim-lobanov and miketimofeev March 26, 2020 15:51

evandrocoan mentioned this pull request Mar 26, 2020

Revert "Install MSYS2 to Windows." #630

Merged

sunjayBhatia mentioned this pull request Mar 26, 2020

Windows compilation: enable compiling expanded list of extensions in envoy-static envoyproxy/envoy#10542

Merged

al-cheb approved these changes Mar 27, 2020

View reviewed changes

nulano mentioned this pull request Mar 29, 2020

Winbuild rewrite python-pillow/Pillow#4495

Merged

sergey-akhalkov approved these changes Mar 30, 2020

View reviewed changes

AlenaSviridenko mentioned this pull request Apr 14, 2020

Mismatch between Python pei-x86-64 and MinGW-w64 pei-i386 arches #102

Closed

1 task

maxim-lobanov approved these changes May 11, 2020

View reviewed changes

alepauly approved these changes May 11, 2020

View reviewed changes

Merge branch 'master' into v-vlsafo/install-msys2

4c3519c

AlenaSviridenko merged commit d558a8f into actions:master May 12, 2020

eine reviewed May 12, 2020

View reviewed changes

vsafonkin deleted the v-vlsafo/install-msys2 branch May 13, 2020 09:35

maxim-lobanov mentioned this pull request May 14, 2020

Windows: add MSYS2 install scripts #355

Closed

miketimofeev pushed a commit to miketimofeev/virtual-environments that referenced this pull request May 14, 2020

Add msys2 installation and validation (actions#632)

16ef4ef

AtOMiCNebula mentioned this pull request May 18, 2020

Validate-Msys2.ps1 fails on missing tar #898

Closed

5 tasks

evandrocoan mentioned this pull request May 19, 2020

Deprecated pacman usage because its is failing out of nowhere, ankitects/anki#624

Merged

eine reviewed May 19, 2020

View reviewed changes

eine mentioned this pull request May 19, 2020

Add MSYS2 to Windows #30

Closed

5 tasks

eine mentioned this pull request Sep 9, 2020

Switch Unix tools from Git internal tools to MSYS2 tools on Windows images #1525

Closed

2 tasks

This pull request was closed.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Install MSYS2 to Windows. #632

Install MSYS2 to Windows. #632

vsafonkin commented Mar 26, 2020

AlenaSviridenko commented Mar 26, 2020

azure-pipelines bot commented Mar 26, 2020

alepauly commented May 11, 2020

azure-pipelines bot commented May 11, 2020

maxim-lobanov commented May 11, 2020

azure-pipelines bot commented May 11, 2020

eine May 12, 2020

miketimofeev May 12, 2020

eine May 12, 2020 •

edited

Loading

miketimofeev May 12, 2020

eine May 12, 2020

vsafonkin May 14, 2020

eine May 12, 2020

eine May 19, 2020 •

edited

Loading

eine commented May 28, 2020 •

edited

Loading

Install MSYS2 to Windows. #632

Install MSYS2 to Windows. #632

Conversation

vsafonkin commented Mar 26, 2020

AlenaSviridenko commented Mar 26, 2020

azure-pipelines bot commented Mar 26, 2020

alepauly commented May 11, 2020

azure-pipelines bot commented May 11, 2020

maxim-lobanov commented May 11, 2020

azure-pipelines bot commented May 11, 2020

eine May 12, 2020

Choose a reason for hiding this comment

miketimofeev May 12, 2020

Choose a reason for hiding this comment

eine May 12, 2020 • edited Loading

Choose a reason for hiding this comment

miketimofeev May 12, 2020

Choose a reason for hiding this comment

eine May 12, 2020

Choose a reason for hiding this comment

vsafonkin May 14, 2020

Choose a reason for hiding this comment

eine May 12, 2020

Choose a reason for hiding this comment

eine May 19, 2020 • edited Loading

Choose a reason for hiding this comment

eine commented May 28, 2020 • edited Loading

eine May 12, 2020 •

edited

Loading

eine May 19, 2020 •

edited

Loading

eine commented May 28, 2020 •

edited

Loading