Serveradmin by tvartom

An Ansible Collection

What is Serveradmin?

Serveradmin is an Ansible Collection for setting up a basic CentOS 8.2 web server. The main purpose is to easily set up a server with sane security, and all in one configuration to build, deploy and host. A server can also be run locally (As a virtual server) in devmode, offering the exact same setup as your production server.

It has been developed over time as I needed a lot of servers with similar setup, and want to be able to improve and update all servers at once.

Basic components:

• Nginx

• MariaDB

• PHP

• NodeJs

• Redis

• Encrypted backups with Rsnapshot

• SSL-certificate with Letsencrypt (with updates) or Self signed

• When logging in to the server, an admin user sees a splash-screen with information such as valid certificates, last backup and basic help of scripts to manage this server.

• An application is running as a dedicated user, with little access to the rest of the server, and none to other applications.

• Deploy script is generated, which pulls source from a repo, pushes back the version as an annotated git tag, builds the app and deploys it. No need for any extra build server like Jenkins or be dependent on Github Actions.

• As it is just an Ansible script, you can stop using it at any time, and configure your server as you like.

If devmode is used:

• The security is lower, please do not expose the server to incoming connections from internet.
• All git repos for an application is initiated and shared with the host with VirtualBox Shared folder, Samba or NFS
• Debug PHP with Xdebug

The Ansible Collection doesn't work stand-alone, it needs a Git repository with configuration for a server or a group of servers. The configuration repo contains this configuration in group_vars/ and host_vars/:

Repo-global variables:

• serveradmin - Where this configuration repo is hosted. (On github)
• organisation - A name, a prefix for all commands, and a splash screen with ASCII-art
• applications - A list of configuration a all applications
• users_all - A list of all users for the system, including public keys

Variables normally set up per host:

• application_instances - A list of selected instances from applications with settings for this host, like name of environment (dev, test, prod etc), database connection and domain-names.
• users - A list of admin users from users_all to add on this host
• data_migrations - Configuration for generating scripts to copy databases and files from other servers.
• backup - Configuration for backup of this server

Setup

Configuration repository

TODO: Show example. For now you probably have access to an already set up repo.

As a virtual machine (VM) on VirtualBox

To understand the network for VirtualBox, here is a nice guide: nakivo.com/blog/virtualbox-network-setting-guide

Notice: Never use Bridged Adapter with Serveradmin in devmode. This will open up your database and code to the world outside your computer.

First create a network in VirtualBox to be used with the Host-only Adapter. Tools -> Network -> Create. It will be named vboxnet0 (Linux) or VirtualBox Host-Only Ethernet Adapter (Windows). Typically it will be a 192.168.56.1/24 network. Enable DHCP Server. (This is not the same as Preferences -> Network -> NAT Networks, which are called NatNetwork)

To use devmode with Shared Folders, download VirtualBox Guest Additions disc for your current version of VirtualBox, and mount when asked for in point 6 under Bootstrap server. For Linux VM-hosts this exists as a seprate package to install with your packagemanager.

Create a new VM. (Machine -> Create). Make sure to make the maximum capacity of the disc big enough. It is growing dynamicly, so it will not will fill up your harddrive until you filled it.

Before running the VM, go into settings:

Network:

You need 2 network adapters:

• Adapter 1: Host-only Adapter with vboxnet0. This is used to connect from your host (your computer) to the VM.
• Adapter 2: NAT For internet-connection from the VM.

Shared Folders:

For devmode, add a Shared folder:

• Folder Path: Typically C:\mydevstuff or /home/<user>/workspace
• Folder Name: workspace
• Read-only: No
• Auto-mount: No
• Mount point: Leave blank.

Git repositories will be cloned into C:\mydevstuff\<organisationname>\<Repo-name> or /home/<user>/workspace/<organisationname>/<Repo-name>

Klick Start in VirtualBox to launch. You will be asked Select start-up disk. Choose the ISO-image for CentOS. See CentOSfor next step.

To escape your trapped mouse-pointer in VirtualBox use Right Ctrl.

CentOS

Serveradmin require currently CentOS 8.2.2004 (And isn't maintained to support older versions)

On AWS

Search for ami-0474ce84d449ee66f for 8.2.2004 in eu-north-1, or look at wiki.centos.org/Cloud/AWS for other regions.

Don't foreget to setup auto-recover Amazon docs: UsingAlarmActions

As local virtual server

Download CentOS Minimal ISO-image: centos.org/download

If asked for operating system and CentOS 8.2 is missing, choose Red Hat Enterprise Linux 8.2 (rhel8.2)

CentOS setup

1. Choose English (United States) as OS language. (For Googlable error messages) Press Next.

2. Choose keyboard, this may differ from language (Removed unused).

3. Network & Host Name

Enable all network adapters. Ethernet (enp?s?) enabled!

Host Name: Same as in Ansible inventory

4. Time & Date

Choose Time Zone and Network Time: On.

Do this after enabling network for the server. (Turn on and off Network Time will remove warning about networking if you completed step 3.)

5. Software Selection

Change to Minimal Install

6. Installation Destination

Leave default and confirm with Done.

7. Begin installation

Set Root Password and user if wanted. (The user will be set up by <prefix>_ansible_serveradmin, so not needed.)

Wait until completed. Remove CentOS installation disk and reboot.

8. Log in as root to make sure your network is set up and find your ip-address.

Run nmcli.

Run: nmcli connection modify <connection-name> autoconnect yes for every disconnected connection.

This will set ONBOOT=yes for the connection in /etc/sysconfig/network-scripts/ifcfg-<connection-name>.

The reason to do this is that CentOS setup seems to fail to activate all network interfaces/connections for interfaces. You can see this specific settings by: nmcli --fields name,autoconnect connection show

Run: nmcli again to make sure everything looks ok, and find your new ip-address.

(ip addr is an alternative to find your ip-address.)

Log out from the server in the console window. You can even restart the virtual machine with Headless start, meaning you have no visual window for the running machine.

9. You can from now on SSH to the machine from your host OS

Use ssh root@<ip address> or Putty. This mean that copy paste, scroll back, and window resize will work.

10. Continue with Bootstrap a server

Bootstrap a server

When asked for ### Serveradmin-repository on Github ### you need to give details for the configuration repo.

1. Log in as root or a any sudo-user

2. Run:

curl https://raw.githubusercontent.com/tvartom/ansible-collection-serveradmin/master/tools/bootstrap.sh -o bootstrap.sh
sudo bash bootstrap.sh

3. Reboot, log in again. (With root if no sudo-user for serveradmin is created yet)

4. Run: <prefix>_ansible_serveradmin to set up all main components of the server

5. Log out, log in as a sudo-user

It should now be possible with public-key authentication with the sudo-users. The sudo-users must be specified in the serveradmin config. Use ssh -A <ip address> or Putty. Activate agent forwarding.

6. Only for devmode with VirtualBox Shared folders

Run: <prefix>_ansible_vboxsf

7. Run: Any datamigration, if your applications is dependent on it.

Remember to have agent forward activated for your ssh-connection

8. Run: <prefix>_ansible_applications to set up all application-instances on this server. This will configure nginx, redis, php, mariadb, sign ssl-certificate etc.

9. Only for devmode

Run <prefix>_init_devmode (This must be run by the devmode user)

10. Run: <prefix>_ansible_deploy for every application. This will pull down your source code, and deploy it.

Devmode

Prerequirements in Ansilbe to be installed and activated:

• applications_devmode: true (default is false)

See Bootstrap a server for setting up server.

Step 9 will initiate all git repos for your applications. These are placed in /home/<devmode_user>/workspace and accessible with VBox shared folders, Samba or NFS.

Step 10 gives you the option to deploy devmode_infopage. When you've done that, you can reach an infopage by opening that ip-address in your webbrowser. The page gives you some basic information including config to paste in your local hosts-file, to be able to access your applications on the server.

PHP Xdebug

Prerequirements in Ansilbe to be installed and activated:

• php_enable: true (Default is false)
• applications_devmode: true (Default is false)
• applications_devmode_xdebug: true (Default is true)

Any settings from xdebug.org/docs/all_settings can be set. The following is default:

php_xdebug:
  remote_enable: 1
  remote_autostart: 1
  overload_var_dump: 0 # https://xdebug.org/docs/display
  remote_connect_back: 1 # https://xdebug.org/docs/all_settings#remote_connect_back

In your IDE, setup Accept remote session (JIT) for Xdebug on port 9000. (This is not from localhost, prompt is working for Eclipse)

Access local database

MariaDB doesn't listen to any port on any network interface. (Not even localhost).

All connection to the database are made through the unix socket /var/lib/mysql/mysql.sock.

To connect to it from an outside DB-client, you need to set up a SSH-tunnel exposing the unix-socket.

ssh -A -L 127.0.0.1:3307::/var/lib/mysql/mysql.sock <address to server>

If you connect with Putty, this isn't possible. After you're connected, you can expose the socket to a network interface with a local SSH-connection. Do this only on a local virtual machine.

ssh -L <ip-address-of-local-network-interface>:3307:/var/lib/mysql/mysql.sock localhost

Instead of <ip-address-of-local-network-interface>, * can be used, but be sure to not expose it to internet. This method is also possible to use on your local devmode-server, to connect to externel servers with unix-socket-only databases. Then replace localhost with server name.

License

MIT License

Copyright (c) 2020 Tvako AB

Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice (including the next paragraph) shall be included in all copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.