Graphical User Interface powered by Qt and Kirigami for Mycroft AI
The following guide will provide a set of instructions to get you started with installing Mycroft GUI on your system. Note: All non virtual environment setups should generally follow the General Setup Instructions steps.
The interactive Installation script supports installation on KDE Neon, K/Ubuntu 20.04 & Manjaro Linux, It also supports installation and building on other distributions and platforms but system dependencies will be have to installed manually as mentioned in the Installation Script.
-
Fetch Repository and Run Installation Script
cd ~ git clone https://github.com/mycroftai/mycroft-gui cd mycroft-gui bash dev_setup.sh
-
Running Mycroft GUI:
mycroft-gui-app
-
Download and Install VirtualBox
-
Download Latest (Any Supported) Distribution ISO.
-
Open VirtualBox and create a system installation
-
Within the VM, open a terminal session and type:
cd ~ git clone https://github.com/mycroftai/mycroft-gui cd mycroft-gui bash dev_setup.sh
-
(Optional) Customize Plasma settings for GUI debugging purposes
- Disable screensaver
- Click the > icon, type: Screen Locking
- Untick "Lock screen automatically after:"
- Click OK
- Disable screensaver
-
Running Mycroft GUI:
mycroft-gui-app
Mycroft GUI can be used on an Local Environment as well as a Remote Environment
Note: Boot your device or run ./start-mycroft.sh all
-
Invoke using
mycroft-gui-app
in any terminal, or Mycroft icon from your desktop application launcher. -
Click Start button in the middle of the window if Autoconnect is disabled
-
Talk to your Mycroft!
Note: Remote device / server must have mycroft services running or ./start-mycroft.sh all
on remote device / server
-
Invoke using
mycroft-gui-app
in any remote terminal session, or Mycroft icon from your remote desktop/platform application launcher. -
Configuring Mycroft GUI for externally hosted Mycroft-Core:
-
Click on the hamburger menu in the lower left
-
Select 'Settings'
-
Enter the IP address of your device. If your device is at 192.168.2.2, enter 'ws://192.168.2.2'
-
Close
-
-
Click Start button in the middle of the window if Autoconnect is disabled
-
Talk to your Mycroft!
-
Additional Notes:
-
CAUTION: The Mycroft messagebus is an open websocket with no built-in security measures by default. We strongly recommend that you do not expose the messagebus ports outside a secure LAN/PAN unless you have other security measures in place.
-
For Externally Hosted Mycroft-Core, one would require to sync skills, one can simply use the provided sync script from the repository to perform a sync
- Run
bash sync_skills.sh 192.168.1.1 [replace with your remote ip]
- Run
-
For Externally Hosted Mycroft-Core, but sure to disable the firewall on the Raspberry Pi. You can do this via
sudo ufw disable
-
Generally, the GUI interaction is managed by an enclosure-specific skill that orchestrates things. For example, the Mark 2 uses skill-mark-2.
-
Lightweight debugging can be done from Mycroft's CLI. You can see commands being sent to GUI clients by hitting Ctrl+G within the CLI
-
Multiple GUIs can safely run against a single Mycroft Core instance.
-
Users & Developers can contribute in advancement of Mycroft GUI in several ways, below mentioned methods will help you identify contribution targets.
Mycroft GUI API is the protocol layer designed to talk and integrate with Mycroft Core Services, It handles various functions some of which include setting, managing and parsing session data and handling delegate activities for skill instances, API Implementation documentation can be found at:
Mycroft enabled devices with displays such as the Mark II, KDE Plasmoid provide skill developers the opportunity to create skills that can be empowered by both voice and screen interaction. The display interaction technology is based on the QML user interface markup language that gives you complete freedom to create in-depth innovative interactions without boundaries, A detailed documentation on getting started with developing skills with an user Interface is available at Mycroft Documentation - Displaying Information
Having trouble or facing issues with Mycroft GUI ? You can use the below guide to debug Mycroft GUI
-
Debugging Mycroft GUI Application:
-
Run Mycroft GUI application from a terminal
-
Errors should be visible on teriminal output, copy output to a log file
-
Open a relevant issue and post your log file
-
-
Debugging Skills & Session Data:
-
Start Mycroft CLI client and use ctrl+g to view session data being passed to Mycroft GUI
-
For more detailed logging add { "log_level": "debug"} to your mycroft system configuration
-
More detailed logs can be retrived from "/var/logs/mycroft/enclosure.log" & "/var/logs/mycroft/skills.log"
-
-
Debugging on Remote Device (Example: Mark-1):
-
SSH to the Mark 1
-
Run
sudo service mycroft-enclosure-client stop
-
Run
sudo su mycroft
-
Run
mycroft-enclosure-client
This will start the client and show Debug() messages on the console.
-