## Basics *** [(Back to Top)](#table-of-contents) ``` :x (Anytime you are in VIM, MAN page, LESS, etc, this is how you exit) whereis bash (find absolute location of bash, or any file) whatis ls (tells you about the command) man ls (manual to give you a list of all command arguments for any command) locate crontab (I like mlocate more) which python (location of a program) clear (dlears the terminal) date (current datetime) echo (output to terminal) env (See environment variables) hostname (See your hostname) ``` ## Apt *** [(Back to Top)](#table-of-contents) Apt (Or Aptitude) is the package manager for Ubuntu to manage packages and remove them. > Tip: You can use the `-y` flag in any apt command to skip the `[Y/n]` dialog. ### Apt Install You need super user permissions, or `sudo` before the command. To install packages, let's use an example such as ruby which should have a list of items. ``` sudo apt-get install rub ; Press the tab key to see a list, type :q to exit the list sudo apt-get install ruby2.3 ``` ### Apt Update This updates the sources list located in `/etc/apt/sources.list.d/` which is where the OS knows where to download files from. You will do this time to time if it's been a while. ``` sudo apt-get update ``` ### Apt Upgrade This will upgrade packages that have newer versions. ``` sudo apt-get upgrade ``` ### Apt Remove Removing a package is quite simple. However, this will not remove configuration files, so if you were to re-install it they would be preserved. You would use `apt-get purge ruby2.3*` to purge all files. ``` sudo apt-get remove ruby2.3 ``` ### Apt Lock Error If you get an error such as `Unable to lock the administration directory (/var/lib/dpkg/) is another process`, follow these steps: - Make sure you are not logged in as another user running apt - Delete the lock and archive file files: - `sudo rm /var/lib/apt/lists/lock` - `sudo rm /var/cache/apt/archives/lock` - `sudo dpkg --configure -a` - If nothing works, attempt rebooting the server # Listing and Navigating *** [(Back to Top)](#table-of-contents) ``` ; Navigating ls (list files) ls -la (list all files, permissions, and hidden too) pwd (print working directory) cd .. (go down a directory) cd / (go to lowest level) cd ~ (go to logged in user's home) cd /var/www (go to absolute path) ; Manage Files and Folders mkdir (create a directory) rmdir (remove an empty directory) rm -rf (remove a directory with contents) touch (create an empty file) mv (move file from location to new location) cp (copy file from location to new location) mv (move directory from location to new location) cp -R (copy directory from location to new location) ; Reading Files cat (read entire file) head (read top of a file) head -n 20 (read top of file 20 lines) tail (read bottom of a file) tail -n 20 (read bottom of file 20 lines) tail -f (stream file as it's updated, eg: an error log) ``` # Users *** [(Back to Top)](#table-of-contents) ``` su - username (switch users) sudo su (switch to root) passwd (change logged in users password) passwd username (change another users password) useradd -m -s /bin/bash username usermod -a -G existing_group existing_user who (show all logged in users) whoami (show which user you are) ``` # Groups *** [(Back to Top)](#table-of-contents) Do not delete groups you don't know what they are used for, that's dangerous! ``` groups (see what groups current user belongs to) groupadd name (create a group) groupadd -g 900 name (create a group with custom GroupID aka gid) groupdel name (delete a group) useradd (add current user to a group) usermod -aG (append any user to an additional group) cat /etc/group (list all groups) cut -d: -f1 /etc/group (list all groups, cleaner) ``` # Permissions *** [(Back to Top)](#table-of-contents) There are two ways to manage permissions, one is by text the other is by an octal value. ### Easy Permissions ``` ; Change Mode ; Options: (O)wner (U)sers (G)roup or (A)ll ; File: Owner: rwx, Group: rwx, User: rwx ; Misc: Besides rwx there is: ; s = setuid of owner for old/new files ; Single File read/write permissions chmod g+rw file chmod og+rw file.txt ; Change Ownership chown user:group files_or_folder chgrp group files_or_folder ; Recursively: chown -R user:group files_or_folder chgrp -R group files_or_folder chmod -R og+rw files_or_folder chmod -R g+s files_or_folder ``` ### Preserve Group Permissions A fantastic way to structure your users is within groups. A common example would be your `www-data` group. If I have a user `jesse`, I can add him with `sudo usermod -aG www-data jesse`. After adding any users I would like, I want to have a folder where all the members of the `www-data` group can read/write a folder. If they are using git, I also want the permissions to stay the same, meaning if they pull the permissions will not change. To accomplish this, here is an example: ``` sudo chown -R deploy:www-data /var/www sudo chmod -R g+rws /var/www ``` The `g+s` sets the file(s)/folder(s) a gid (`setgid`) so that new files will inherit the original group! ### Octal Permissions You may have seen this a lot, you can use octal or decimal (begins with a 0) to do the same thing. ``` Permissions: 0 = None 1 = Execute (e) 2 = Write (w) 4 = Read (r) ``` - There are 3 Permission types (Read, Write, Execute), or 4 if you count "None". - There are 3 Sets: Owner/User/Group (In that order) - So if you did `chmod 700 file.txt` it would allow the user to Read, Write and Execute - Because `7` is the total of `4 + 2 + 1` ### Octal Examples ``` chmod 600 file.txt – Owner Read, Write chmod 660 file.txt – Owner Read, Write; User Read, Write chmod 770 file.txt – Owner Read, Write, Execute chmod 770 file.txt – Owner Read, Write, Execute; User Read, Write, Execute chmod 666 file.txt – All Read, Write chmod 777 file.txt – All Read, Write, Execute ``` # OS Details *** [(Back to Top)](#table-of-contents) Get fundamental information about your OS with the following commands, you may have to run them as `sudo`, eg: `sudo lsb_release -a`. ## Operating System ``` lsb_release lsb_release -a lsb_release -as # Short Information lsb_release --help ``` ### CPU Info ``` nproc # How many Processing Units cpuid # Must install cpuid from terminal cat /proc/cpuinfo # Lots of info ``` ### Usage Info ``` free -h # Human readable, or do --help for options vmstat -s cat /proc/meminfo # Lots of info ``` ### Disk Space ``` df df -B MB (In Megabtyes, KB for Kilobytes, GB for Gigabytes) ``` ### System Processes ``` top htop # If you installed it ``` ### IP Address Your IP is after `inet addr`. If you are connect via ethernet it's under `eth0 (Ethernet)` otherwise, wirelessly it is likely under `wlan0 (Wireless LAN)`. ``` ifconfig ip ip addr show ip addr show wlan ip addr show eth0 ``` ### GUI Processes ``` gnome-system-monitor ``` ### CLI Processes ``` top htop (My favorite, sudo apt-get install htop) nmon ``` # List all Keybindings *** [(Back to Top)](#table-of-contents) ``` gsettings list-recursively org.gnome.desktop.wm.keybindings | sort | more ``` ### See Keypressed [(Back to Top)](#table-of-contents) ``` xev ; Or for a lot of details: xev | grep KeyPress ``` # Kernal *** [(Back to Top)](#table-of-contents) The Kernal is the lowest level item that ties everything together from hardware to software. Without a kernal you cannot do anything on linux. ### Remove Old Kernals See What version you are currently using ``` sudo uname -a ``` See all the Kernals on the OS ``` sudo dpkg --get-selections | grep linux ``` The BYOBU is quite nice ``` sudo apt install byobu sudo purge-old-kernels ``` # OS Shutdown *** [(Back to Top)](#table-of-contents) ``` shutdown reboot shutdown -h now shutdown -h +10 (shutdown 10 mins) shutdown -r now (reboot now) ``` # Crontab *** [(Back to Top)](#table-of-contents) ``` crontab -e (edit crontab for current user) crontab -l (list crontab for other user) crontab -u jesse -l (see crontabs for specific user) ``` # Services *** [(Back to Top)](#table-of-contents) ## Service Commands Use the service command *(Requires sudo)* ``` service ssh status (service status) service --status-all (all services status) ``` Almost every service has the following commands, some may have more like apache `graceful-restart`: ``` service servicename start service servicename stop service servicename restart service servicename status service servicename force-reload ``` ## Autostart Add Service links: ``` sudo update-rc.d servicename defaults ``` Whether you get a warning if they already exist or not, enable it now: ``` sudo update-rc.d servicename enable ``` ## Remove Autostart Pass the Force flag ``` sudo update-rc.d -f servicename remove ``` ## Autostart Daemons There is are several startup popular daemons: - CentOS uses SystemV - Ubuntu 14 uses Upstart - Ubuntu 14.10+ uses SystemD (15, 16, 17..) Focus on **SystemD**. ## SystemD Commands This would only apply to Ubuntu 14.10+, otherwise you would use Upstart. ``` systemctl <-- You'll use this more often journalctl <-- You'll use this more often update-rc.d <-- You'll use this more often -------------------------- Installs/Removes System-V style init script links Note: System-V Style, but it's really SystemD. (Confusing huh?) "NNname" is the runlevel, lower means startup sooner ---------------------------------------------------- The Location is: /etc/rcrunlevel.d/NNname The Target is: /etc/init.d/name. notify analyze cgis cgtop loginctl nspawn ``` # System State *** [(Back to Top)](#table-of-contents) ``` uname -a (get linux info) top (See running processes/system status, I suggest installing `htop`) top -u www-data htop -u www-data df (display disk space in bytes, default) df -h (display disk space human readable) df -Th (display disk space with partitions) free (see memory used) free -g (in gigabytes) ``` # Processes *** [(Back to Top)](#table-of-contents) ``` ps -ef | more (current running processes) ps -efH | more (current running processes in a tree) ps -ef | grep vim (find vim process id) kill -9 (no brackets) ``` # Bash *** [(Back to Top)](#table-of-contents) Bash is my shell of choice, which is why I have a `.bashrc` file. ### Bash Paths Executables and commands are automatically in the path, see your path with: ``` echo $PATH ``` ### Add to Path ``` # I suggest editing your ~/.profile vim ~/.profile if [ -d "/path/to/your/bin" ] ; then PATH="$PATH:/path/to/your/bin" fi ``` *Note: Order of Linux Reading files: ~/.bash_profile, ~/.bash_login, and ~/.profile, so don't try to use a ~/.profile variable within ~/.bash_profile* ### Bash Completions The locations for bash completio0ns can be found at: ``` cd /usr/share/bash-completion/completions.d/ cd /etc/bash_completions.d/ ``` ### Fix Broken Bash Completions ``` sudo apt-get install --reinstall bash-completion ``` ### Log Script from Bash At the top of your file, find the executable you are using one of these, eg: ``` which bash # /usr/bin/bash which python # /usr/bin/python which php # /usr/bin/php ``` At the top of your [shebang](https://en.wikipedia.org/wiki/Shebang_(Unix)) for the executable file add: ``` #!/bin/bash #!/usr/bin/php #!/usr/bin/python ``` make sure to `+x` it: ``` chmod +x app.sh chmod +x app.php chmod +x app.py ``` You can then run the script via Bash: ``` /scripts/app.sh >> /scripts/output.log 2>&1 /scripts/app.php >> /scripts/output.log 2>&1 /scripts/app.py >> /scripts/output.log 2>&1 ``` You could even crontab it the same way: ``` */10 * * * * app.php >> /output.log 2>&1 */10 * * * * app.py >> /output.log 2>&1 ``` # Finding Files *** [(Back to Top)](#table-of-contents) Generally the following arguments are as follows: - `-type f` file - `-type d` directory - `-iname` case insensistive (book.txt would the same as BOOK.TXT) - `*` is a wildcard to find anything, usually you put it at the start or end of a filename. ``` find . -name tecmint.txt find /home -name tecmint.txt find /home -iname tecmint.txt (case ignore) find / -type d -name Tecmint (directory) find . -type f -perm 0777 -print (with perms) find / -type f ! -perm 777 (find without) find . -type f -name "tecmint.txt" -exec rm -f {} \; (find and remove a file) find . -type f -name "*.txt" -exec rm -f {} \; (find and remove multiple) find /tmp -type f -empty (Find empty files) find /tmp -type d -empty (find empty directories) find / -size +50M -size -100M (findby swize) ``` # Find in Files (GREP) *** [(Back to Top)](#table-of-contents) GREP means: Global Regular Expression Pattern (or Parser) Some common GREP flags: - `-r` is Recursive - `-n` is Line Number - `-w` Match the whole word - `-l` is lowercase only - `-c` supresses normal output and counts number of matching lines ``` grep -rn /path - "pattern_or_string" ; Output results to File grep -rnw /path - "pattern_or_string" > output.txt ``` Look only in certain filetypes ``` ; notice I used a regex ^ starts with, you can use a string or regex grep --include=*.sh '^mysql' ./ ``` More Examples: ``` grep "hello" file.txt (if in file) grep "hello" files* (if in many files) grep -i "hello" file.txt (case insesitive) grep -iw "is" file.txt (get full words, case insensitive) grep "regex" file.txt ``` ### Pipe Grep ``` php -i | grep ini ``` # Reading Files *** [(Back to Top)](#table-of-contents) Without having to open a file you can simply read a part of it without `nano`, `pico, `vi`, or `vim`: ``` cat file.txt (view file contents) tail file.txt (view end of file contents) tail -n20 file.txt (view top 20 lines) tail -f filetxt (follow a filename keep updating) head file.txt (view top of file contents) head -n20 file.txt (view top 20 lines) ``` # Downloading Files *** [(Back to Top)](#table-of-contents) ### Using Wget ``` wget http://file.com/something.txt (Download a file locally) wget -O newname.txt http://file.com/something.txt (Download file locally w/new name) ``` You can also use `SCP`, yet the above are easier for non-SSH connections. ### Using cURL ``` curl -O http://file.com/something.txt (Download a file locally) curl -o newname.txt http://file.com/something.txt (Download file locally w/new name) curl -O http://url_1 -O http://url_2 (Download multiple files) ``` # Compressing and Uncompressing Files *** [(Back to Top)](#table-of-contents) To Compress a file you can use a variety of tools. You can type `man gzip` to see the full manual and line of commands, and use `esc` + `:x` and `ENTER` to exit from the Manual (It usually uses the Vi editor). Most often in the Linux word you use and create `*.tar.gz` files, it has the most options. Whatever you prefer is up to you. What the flags often stand for: - `-c` is create - `-f` is file - `-k` is for Keep - `gzip` & `bzip2` will remove the original file once compressed - Or they will remove the `.gz` when decompressing is done - `-r` is recursive (for gzip and zip) - `-v` is verbose (show details of what's happening) - `-z` is for tar to gzip as well - `--exclude='file'` is for tar (+gz if needed) to exclude certain files) ### Compressing Files Note: You can compress more than one file at a time eg: `bzip2 file1.txt file2.txt file3.txt` ``` gzip -vk file.txt (Creates file.txt.gz) bzip2 file.txt (Creates file.txt.bz2) tar -cvf file.tar file.txt (Creates tar) tar -czvf file.tar.gz file.txt (Creates tar.gz) zip filename.zip file.txt (Creates filename.zip) zip -r folder.zip path/to/folder (Creates folder.txt.bz2) ``` Include/Exclude a few files: ``` ; Exclude certain files tar -czvf file.tar.gz / --exclude='*.jpg' --exclude='bigfile.sql' ; Include one file type tar -czvf file.tar.gz /*.sh ; Include multiple files types tar -czvf file.tar.gz `find | grep '.sh\|.py'` ``` ### Decompressing Files To Uncompress we use similar commands for most of them ``` gunzip -dvk file.txt.gz gzip -dvk file.txt.gz (Same as above) bzip2 -d file.txt.bz2 tar -xvf file.tar tar -zxvf file.tar.gz unzip test.zip ``` # SCP *** [(Back to Top)](#table-of-contents) ### Download from server to local ``` scp root@server.com:/path/to/file.txt file.txt ``` ### Upload from local to server ``` scp file.txt root@server.com:/path/to/file.txt ``` # SSH *** [(Back to Top)](#table-of-contents) ### Connecting to a server ``` ssh name@server.com (default port is 22) ssh name@server.com -p 8000 (connect to specific port) ssh name@server.com -i ~/.ssh/rsa_key.pub (connect with ssh key) ``` ### .SSH Permissions These are safe permissions to use for SSH ``` chmod 700 ~/.ssh chmod 644 ~/.ssh/id_rsa.pub chmod 600 ~/.ssh/id_rsa # Put your pubkeys (one per line) for SSH login chmod 600 ~/.ssh/authorized_keys ``` ### Using the Config You can also create a `~/.ssh/config` file and store entries such as: ``` Host aws Hostname ec2-50-50-130-50.compute-1.amazonaws.com Port 22 Identityfile ~/.ssh/id_rsa User myusername Host my-vps Hostname 50.50.130.50 Port 22 User root ``` You can then simply type: ``` ssh aws ssh my-vps ``` # Firewall *** [(Back to Top)](#table-of-contents) A firewall prevents unauthorized access to your machine, you should use `UFW` (Uncomplicated Firewall). You must always run this with `sudo`. If you don't have UFW installed, run: ``` sudo apt-get install ufw ``` ### UFW Status To see the Firewall Status run one of these: ``` sudo ufw status sudo ufw status verbose ``` ### UFW Enable/Disable ``` sudo ufw enable sudo ufw disable ``` ### UFW Example Customization Please do not do this unless you know what you are doing. You could start out with blocking all incoming connections. ``` sudo ufw default deny incoming sudo ufw default allow outgoing ``` Then we allow only what we want ``` sudo ufw allow ssh sudo ufw allow http sudo ufw allow https sudo ufw allow ftp ``` These are the same as: ``` sudo ufw allow 22 # same as ssh sudo ufw allow 80 # same as http sudo ufw allow 443 # same as https ``` ### UFW More Options If SSH was on port `3333` rather than the default `22` you would do: ``` sudo ufw allow 3333/tcp ``` Some more options: ``` sudo ufw allow 25 # SMTP sudo ufw allow 110 # POP3 sudo ufw allow 995 # POP3S sudo ufw allow 143 # IMAP sudo ufw allow 993 # IMAPS sudo ufw allow 3306 # MySQL sudo ufw allow 5432 # Postgres sudo ufw allow from 192.168.255.255 # Custom IP Address ``` ### UFW Deleting Rules Easily delete named rules ``` sudo ufw delete allow ssh ``` Delete rules that are numbered ``` sudo ufw status numbered sudo ufw delete [number] ``` ### UFW Reset Rules ``` sudo ufw reset ``` # Regex *** [(Back to Top)](#table-of-contents) Regex stands for Regular Expression. It's used for locating or replacing files or strings of text. It is used all the time. These can be used in Linux itself and programming languages. ``` ; Symbolism ; ------------------ () (captures groups) [] (set) {} (quantifier) ? (optional, matches 0 or 1 character) * (matches 0 or more characters) . (match any character) + (match one or more character) \ (escape character) ! (false, is not) ^ (starts with) $ (ends with) | (or statement, eg: (jesse|dan|jenkins) ) ; Basic Primer ; ------------------ \w (word) \W (non-word) \s (whitespace) \S (non-whitespace) \d (digit) \D (non-digit) [ab] (character set) [^ab] (negated set) [a-m] (range) (hello) (group) (hello)+ (group, more than once) ; Groups ; ------------------ (hi) (gets all "hi" occurances) (^hi) (gets all text starting with "hi") (es$) (gets all text ending with "es") (hi)\1 (gets the first occurance of "hi") ; Flags ; ------------------ /i (case insensitive) /g (global) /m (multiline) ; Escaped Characters ; ------------------ ; Since characters such as ".", "+", etc are actual Regex pattern makers, if you ; need to check your content for the literal item you must escape them. \. (matches . character) \+ (matches + character) \? (matches ? character) \* (matches * character) \^ (matches ^ character) \$ (matches $ character) \[ (matches [ character) \( (matches ( character) \t (matches tab character) \n (matches newline) \r (matches return carriage) \0 (matches NULL character) \\ (matches \ character) \/ (matches / character) ``` ### Regex Examples ``` Put Examples here, like phones, names, etc.. ``` # MySQL *** [(Back to Top)](#table-of-contents) - `-u` is for User (default: root) - `-p` is for Password - `-p password` is for password which skips the prompt (not recommended) - `-h` is for host (default: localhost) - `-port or -P` is for a port, default is 3306 - `-f` will force SQL import and skips errors - `-v` will display verbose output - In the `mysql>` terminal you can get clean data by doing `\g`: - `mysql> SELECT * FROM users LIMIT 10\g";` ### Connecting ``` mysql -u root -p (username, password prompt) mysql -u root -p -h localhost (username, password prompt, host) mysql -u root -p password -h localhost -P 3306 ; AWS Example (AWS Defaults to 3306 as most MySQL connections do) mysql -u username -p password -h myinstance.123456789012.us-east-1.rds.amazonaws.com ``` ### Exporting Database to SQL You can dump a single database easily: ``` mysqldump -u root -p DATABASE_NAME > file.sql ``` Or Dump all databases on your MySQL server with the `--all-databases` flag: ``` mysqldump -u root -p --all-databases > file.sql ``` ### Importing SQL Files You can do this through the shell only, or MySQL, first is the shell: ``` mysql -u root DATABASE_NAME < path/to/file.sql ``` To continue when there are MySQL Errors use -f or --force below: ``` mysql -u root DATABASE_NAME < path/to/file.sql --force ``` To use a password, just pass in the -p flag and type it in after running: ``` mysql -u root -p DATABASE_NAME < path/to/file.sql --force ``` Second, you can do it through MySQL once you connect: ``` mysql> use DATABASE_NAME; mysql> source path/to/file.sql; ``` ### Exporting Compressed Database This will save a lot of space in this one liner: ``` mysqldump -u root -p DATABASE_NAME | tar -cvzf > output.sql.tar.gz mysqldump -u root -p DATABASE_NAME | gzip -v > output.sql.gz ``` ### Importing Compressed Database Here is how you can import with the one liner: ``` mysql -u root -p DATABASE_NAME | tar -xzOf output.sql.tar.gz mysql -u root -p DATABASE_NAME | gunzip < output.sql.gz ``` ### Get Database Encoding ``` USE DATABASE_NAME; SELECT @@collation_database; ``` ### Get Table Encoding ``` SELECT default_character_set_name FROM information_schema.SCHEMATA WHERE schema_name = "TABLE_NAME"; ``` ### Get Column Encoding Look at the collation table. Numeric fields won't have a collation. ``` SHOW FULL COLUMNS FROM TABLE_NAME ``` ### Fix Broken Characters First, try this query without affecting anything to see: ``` SELECT CONVERT(BINARY CONVERT('We’re Here!' using latin1) using utf8); ``` That should fix the encoding problem. To update a column: ``` UPDATE TABLE_NAME SET COLUMN_NAME = CONVERT(BINARY CONVERT(COLUMN_NAME using latin1) USING utf8); ``` # Git *** [(Back to Top)](#table-of-contents) ### Populate a Repository You have to first create a repostory, through BitBucket, GitHub, GitLab, etc. ``` git init touch README.md git remote add origin git@github.com/username/yourrepo.git git add . git commit -m "Starting with one file" git push origin master ``` ### Add or Remove Files ``` git add file.txt git rm file.txt ``` ### Ignoring files Create a `.gitignore` file, and place something like this in it: ``` .tmp .py[co] .cache .DS_Store ``` ### Create a Branch Branches are used like when you don't want to ruin a main branch with working code. ``` git checkout -b develop git push origin develop ``` ### Switch Branches ``` git checkout master git checkout develop ``` ### Pull One File From Another Branch If you were on your `master` branch and only wanted to pull a single file from `develop` branch, you can do this: ``` ; Make sure you're on the branch you want to pull into git checkout master ; Pull a single file into master from develop git checkout develop -- relative/path.txt ; Continue by comitting and pushing to master ``` ### Create a Tag Tags create a snapshots of current code, you may name it as a version such as `1.0.1` and it produces a `tar.gz` and `zip` format for downloads. ``` git tag -a 1.0 git tag -a 1.0 -m "Optional Message" git push --tags ``` ### Remove a Tag This will remove a tag from the Git host. ``` git tag -d 1.0 git push origin :refs/tags/1.0 ``` ### Clone a Respository ``` git clone git@github.com/username:your_repo.git ``` Clone into current directory ``` git clone git@github.com/username:your_repo.git . ``` ### Current Status ``` git status ``` ### Commit Log and Show To see log data and more details use the short or long commit ID. ``` git log git show eb7c86a5fbdc6c64df608f4c143c2718a100983b ``` ### Reset Hard This will reset your repository to the last revision and undo everything, use with caution. ``` git reset --hard HEAD ``` ### Prune Removes cached items no longer read by git ``` git prune ``` # Docker *** [(Back to Top)](#table-of-contents) To install visit [https://docs.docker.com/engine/installation/linux/ubuntulinux/](https://docs.docker.com/engine/installation/linux/ubuntulinux/) - **Images**: (Blueprints of an application) - **Image BASE**: No parent Image (An OS) - **Image CHILD**: Builds on a Base Image (Eg: Webserver, MySQL) - **Containers**: Created from an IMAGE and run an application. - **Docker Daemon**: Background service that builds, runs, and does everything. - **Docker Client**: Allows us to interact with the Docker Daemon. - **Docker Hub**: A registry of images (Like: npmjs, pip, packagist, bower) ### Docker Compose This is a great utility that makes managing docker easier from a `docker-compose.yml` file, you should install this after playing around with the below options. See: [https://docs.docker.com/engine/installation/linux/ubuntulinux/](https://docs.docker.com/engine/installation/linux/ubuntulinux/) ``` docker-compose up open http://localhost:3000 ``` ### Test Box Run This is a sample box to test once you installed docker ``` dock pull busybox docker images docker run busybox "Hi from the box" ``` ### See Running Containers ``` docker ps (running containers) docker ps -a (see all containers that ran) ``` ### Run Container Interactively This allows you to get inside the container ``` docker run -it busybox sh (interactive) ``` ### Remove Container Removes a CONTAINER, not an IMAGE ``` docker ps -a docker rm ``` ### Bulk Remove Containers You can remove containers based on their status in bulk, eg: ``` docker rm $(docker ps -a -q -f status=exited) docker rm $(docker ps -a -q -f status=created) ``` ### Webserver Test Image This will download the IMAGE and run it if it doesn't exist ``` docker run prakhar1989/static-site ``` This doesn't expose ports for us to use, so we do the following: ``` docker run -d -P --name static-site prakhar1989/static-site ``` - `-d` detaches terminal so we can run commands in our terminal - `-P` publishes all exposed ports to random ports By doing the above command we are given random ports, eg: ``` 443/tcp -> 0.0.0.0:32768 80/tcp -> 0.0.0.0:32769 ``` Your ports may be different, you can use specific ports with a lowercase `-p`: ``` docker run -p 8888:80 prakhar1989/static-site ``` ### Stop Container ``` docker stop static-site ``` ### Get New Docker Image This would be a docker BASE IMAGE ``` docker pull ubuntu:14.04 ``` ### Create Docker Image This is a flask Example using a Python-3 Base IMAGE - Create `requirements.txt` and just put `flask` - Create an `app.py` - Use the following sample code in `app.py`: ``` from flask import Flask app = Flask(__name__) @app.route('/') def hello_world(): return 'Hello, World!' ``` - Create a docker file, title it `Dockerfile` - Enter the following ``` FROM python:3-onbuild EXPOSE 5000 CMD ["python", "./app.py"] ``` Now build the image ``` docker build -t boyus . docker images ``` ### Remove Docker Image Get a list of images, then just delete by image id with `rmi` aka `remove image`: ``` docker images docker rmi ``` ### Pushing Images You need a repository at docker.io to push this, or probably some private hosting. ``` docker push boyus ``` # Installing GUI's *** [(Back to Top)](#table-of-contents) Linux has a lot of GUI's and you are not limited to what you get. I'll list a few popular ones with the installation instructions in Ubuntu. You can have as many GUI options as you like, just change the default at the login screen. > Tip: After you install, logout and in the login menu or the top right you can select what GUI you want to login with. Whenever you install a new GUI you can select a Display Manager, I recommend using `lightdm`. -- ### Unity [**Unity Website**](https://unity.ubuntu.com/) ``` Installed in Ubuntu 12+ by Default (`ubuntu-desktop`) ``` ### XUbuntu [**XUbuntu Website**](https://xubuntu.org/) ``` ; Install: sudo apt-get install xubuntu-desktop ; Remove: sudo apt-get remove xubuntu-desktop ``` ### Cinnamon (Linux Mint) [**Linux Mint Website**](https://www.linuxmint.com/) ``` ; Install: sudo add-apt-repository ppa:moorkai/cinnamon sudo apt-get update && sudo apt-get install cinnamon ; Remove sudo ppa-purge ppa:moorkai/cinnamon ``` ### GNOME [**GNOME Website**](https://www.gnome.org) This has been one of the all time most popular GUI's for Linux ever made, in particular the `gnome-classic`. ``` ; Install: sudo apt-get install ubuntu-gnome-desktop (For legacy gnome use you can use gnome-shell, this install both) ; Remove: sudo apt-get remove ubuntu-gnome-desktop (Removes gnome-shell as well) ``` > Gnome3 has been my favorite GUI due to how I can customize it. However, for unknown reasons I have issues running only Gnome3 in VMWare Workstation 11. It works fine as a complete install. Noteworthy: Visit [Gnome Shell Extensions](https://extensions.gnome.org/) to customize anything you want. Make sure to use Firefox. ### KDE [**KDE Website**](https://www.kde.org/) This is a very popular GUI for people that are used to Windows Desktops. ``` ; Install: sudo add-apt-repository ppa:kubuntu-ppa/backports sudo apt-get update && sudo apt-get dist-upgrade sudo apt-get install kubuntu-desktop ; Remove: sudo apt-get remove kubuntu-desktop ``` ### LXQT [**LXQT Website**](http://lxqt.org/) ``` ; Install: sudo apt-get install lxqt ; Remove: sudo apt-get remove lxqt ``` ### Pantheon (ElementaryOS) [**Elementary OS Website**](https://elementary.io/) For the best stability I use Elementary OS which is based off of Ubuntu. ``` ; Install: sudo add-apt-repository ppa:elementary-os/stable sudo apt-get update sudo apt-get install elementary-desktop ; Remove: sudo apt-get remove elementary-desktop ``` ### XFCE [**XFCE Website**](http://www.xfce.org/) ``` ; Install: sudo apt-get install xfce4 ; Remove: sudo apt-get remove xfce4 ``` # Troubleshooting *** [(Back to Top)](#table-of-contents) Sometimes the system has problems, seldmoly but I'll list things that helped me fix rare occasions. ### Ubuntu Infinite Login When you try to login to Ubuntu and it relogs you back into the login screen, this is an infinite loop. The only way I was able to fix it depsite all the guides was combining a few of these together for Ubuntu 16.04. If you are using Gnome as I do, I would jump down to the **Apt Auto Remove Problem** in the list. The first step is to login to a terminal. ``` CTRL + ALT + F1 (Or F3) ``` Next, Login as your user who must be able to run `sudo`. - **Temp Folder Permissions** - `ls -ld /tmp` should have these permission exactly as: `drwxrwxrwt` - The user:group must be `root:root` on `/tmp`. - To Fix: `sudo chmod a+wt /tmp` - **Xauthority Ownership** - `ls -lta | grep .Xa` should be owned by your user, for example `jesse jesse` - If it is `root root` or anything than your user/group it's wrong. - To Fix: `sudo chown jesse:jesse .Xauthority` - **Xsession Errors** - This is just to make sure there are no syntax errors for your reference: - To Check: `cat ~/.xsession-errors` - You don't need to do anything if there are syntax errors, we will move the file. - **Try Moving XAuthority** - Sometimes it's as easy to moving Xauthority so a new is generated at login. - To Fix: `sudo ~/.Xauthority ~/.Xauthority.bkup` - **Try Reconfiguring LightDM** - Fix: `dpkg-reconfigure lightdm`, then select lightdm in the menu - Lastly restart lightdm: `sudo service lightdm restart` - **Apt Auto Remove Problem** - I read that it's possible `apt-autoremove` may accidentally remove `xubuntu-desktop`, `ubuntu-desktop` and LightDM reports no errors. - The `ubuntu-desktop` will load the Unity interface - The `xubuntu-desktop` will load a different interface I'm not familiar with. - To Fix: `sudo apt-get install xubuntu-desktop ubuntu-desktop` - **If you are using Gnome**, try following the post at [OMGUbuntu](http://www.omgubuntu.co.uk/2016/05/install-gnome-3-20-ubuntu-16-04-lts) - After the Above Try: `sudo apt-get autoremove gnome-software && sudo apt-get install gnome-software` - I was able to get Gnome-Classic working but not Gnome. - **How to Ensure it Works** - You might be able to login after one of the steps above if you don't reboot. However, to be certain, you want to reboot to ensure it is fixed, otherwise you'll be doing this over and over. # Linux Facts *** [(Back to Top)](#table-of-contents) - **Linux Versions** refers to The Kernel which ties the OS together. - **Linux Distributions** are the named Linux "Flavors" below. - **Debian** - **Linux Mint** (LMDE) forked from Debian - **Ubuntu** forked from Debian - **Elementary OS** forked from Ubuntu - **Linux Mint** forked from Ubuntu - **Kubuntu** forked from Ubuntu - **Fedora** - **Red Hat Enterprise Linux** (RHEL) forked from Fedora - **CentOS** forked from RHEL (Community Edition of RHEL) - **Gentoo** - ..And many others. Debian -> Ubuntu has been the most popular.