![8vl3onvznkopxa6ny9995yrc4gw[1]](https://i0.wp.com/www.krazyworks.com/wp-content/uploads/2021/10/8vl3onvznkopxa6ny9995yrc4gw1-175x150.jpg "Awk & sed Snippets for SysAdmins")
Books have been written on the subject of awk and sed. Here’s a small sample of commands I put together over the years that are useful for everyday system administration tasks. Most of these tasks …
Read the full story »Find Large Folders
When you get a filesystem space alert (and they tend to arrive at 3:37 on Saturday morning), deleting various supersized log files is one option I already covered in adequate detail. That is if you get so lucky as to find such a file to delete…
Automating Web Page Screenshots
Automatic Web page screenshots are commonly used for various monitoring tasks, such as detecting copyright infringement, website defacement, and other legal and security matters. Automatic screenshotting can also be a useful tool for researchers, developers, and journalists. There are free and open-source tools out there that can help you automate the task of creating Web page screenshots.
The Future of Spaghetti Code
In his new book “The Future of Work: Robotics, AI, and Automation”1, Darrell West of the Brookings Institution makes some very extravagant predictions. Here’s a short but entirely sufficient summary from the book’s presentation by …
AWS CLI Cheat Sheet
The installation and configuration process for AWS CLI is fairly simple. The package itself is installed with pip (yum -y install python-pip):
Copying X11 Magic Cookies
I rarely use GUIs, but when I do, it’s from CLI and every time I run into the annoying MIT-MAGIC-COOKIE-1 data did not match error. It’s easy to fix, but it happens to me so …
Verify Network Port Access
There are several tools you can use to verify access to a remote network port: nc, tcping, telnet. Unfortunately, nc from the netcat package has been replaced by the one from nmap, which lacks the -z option, making …
Deleting Hidden Files
This simplest of problems just never fails to find a new victim. For whatever reason you want to delete all hidden files in the current directory and subfolders. Without much thinking you just type rm …
Quickly Grow tmpfs filesystem
Just a quick command to double the size of the /tmp filesystem that uses tmpfs. This is for those situations when you can’t be bothered to think.
Late Night Rant: Agile
CollabNet VersionOne has released it’s 12th annual “State of Agile” report. The survey involved more than 1,400 software professionals in various roles and industries over the fourth quarter of 2017.
Only 12% responded that their organizations …
Duck Duck Go Search from Shell
The ddgr python script is a command line interface for Duck Duck Go – a privacy-oriented search engine that, unlike Google, will not give away your data to the likes of Cambridge Analytica. In the …
Document Conversion with Unoconv
The other day I ran into the “Flexible Import/Export” article by Bruce Byfield in the March 2018 issue of Linux Pro Magazine and thought it could use some more detail. So here’s some more detail.
How Not to Prepare for a SysAdmin Interview
The Linux Foundation just gave birth to seven supposedly interesting tips on how to prepare for a Linux SysAdmin job interview. Unfortunately, the research behind all this probably excellent advice was based on interviewing hiring …
Obfuscating Shell Scripts
Unix shell scripting language is run by the command-line interpreter and, as such, can be read and understood by anyone with sufficient access and experience. Sometimes this is not a good thing. Sometimes you want …
The Mystery of a Hemisphere
To make this long (and embarrassing) story short: a friend’s kid had a homework assignment in geometry to calculate the surface area of a conjoined cone, a cylinder, and a hemisphere.
Raspbian ‘partitions on different devices’ Error
After downloading a Raspbian image and writing it to an SD card, you get the following error when trying to boot the Pi: “Could not expand filesystem, please try raspi-config or rc_gui. Boot and root …
Automating Web Page Screenshots
Automatic Web page screenshots are commonly used for various monitoring tasks, such as detecting copyright infringement, website defacement, and other legal and security matters. Automatic screenshotting can also be a useful tool for researchers, developers, …
Encrypted Volumes and Portable Apps
This is a description of an uncomplicated setup for an encrypted volume and portable applications for a Windows laptop consisting of a USB3 storage device, VeraCrypt OSS OTFE, a hardware password wallet, and portableapps.com software.
Detect SSL Certificate Injection
When the SSL Digital Certificate is intercepted and replaced by a device between your browser and the Web site, we call it certificate injection. This method is more commonly used not by hackers, but by …
Tmux Bootstrap Configuration
Just a list of commands to quickly configure tmux with some of the best (i.e. my favorite) plugins and options. Feel free to disagree – you may be right – but I don’t think so.
Find Large Files
Every time a filesystem is running out of space and I need to find something to delete, I end up googling the syntax for the find command to make sure it stays off NFS and …
SSL For Self-Hosted WordPress
Just some notes for setting up SSL with your self-hosted WordPress hosting installation. Just got around to doing this the other day. Yeah, I know, about time…
Show Logged In Users During a Time Window
Let’s say you want to see who was logged in on the server during last weekend. This includes users who, say, logged in on Thursday and haven’t logged out until Saturday afternoon.
Commands & Shells »
Plundering Facebook Photo Albums
![wyryr1sn52gntzn65v4fpz5lc6v[1]](https://i2.wp.com/www.krazyworks.com/wp-content/uploads/2021/08/wyryr1sn52gntzn65v4fpz5lc6v1-80x80.jpg "Plundering Facebook Photo Albums")
Let’s imagine you need to download all the photos in a Facebook photo album. It can be a public album, a friend’s, or even your own. Sure, you can do this manually, but you probably …
Scraping a Web Page in Bash
![clfud46mxf2t5zph2l04zlpgl1d[1]](https://i2.wp.com/www.krazyworks.com/wp-content/uploads/2021/08/clfud46mxf2t5zph2l04zlpgl1d1-80x80.jpg "Scraping a Web Page in Bash")
Just a scripting exercise because I need to do something important, but I am procrastinating. The idea is simple: grab some URL with text containing somewhat structured data and convert it into a spreadsheet. I …
Applications »
Processing Videos with ffmpeg and Lightroom
![DSCF5361[1]](https://i1.wp.com/www.krazyworks.com/wp-content/uploads/2020/10/DSCF53611-80x80.jpg "Processing Videos with ffmpeg and Lightroom")
On occasion I wondered how to apply advanced photo filters to my lackluster GoPro and drone videos. You know, not the basic exposure/contrast/saturation or the cheesy special effects you find in video editors, but something …
Searching Twitter
![Cat-Devouring-A-Bird-Pablo-Picasso[1]](https://i0.wp.com/www.krazyworks.com/wp-content/uploads/2020/10/Cat-Devouring-A-Bird-Pablo-Picasso1-80x80.jpg "Searching Twitter")
Here are just a few hopefully useful tips for searching Twitter to get more relevant results and buy cheap twitter followers.
Data »
Scraping a Web Page in Bash
Just a scripting exercise because I need to do something important, but I am procrastinating. The idea is simple: grab some URL with text containing somewhat structured data and convert it into a spreadsheet. I …
Generating Random Text Files for Testing
![91ebozy1e3b138waujy28agrngy[1]](https://i2.wp.com/www.krazyworks.com/wp-content/uploads/2021/08/91ebozy1e3b138waujy28agrngy1-80x80.jpg "Generating Random Text Files for Testing")
Sometimes you need dummy folder structures populated with random data for testing your various scripts and processes – backups, file transfers, encryption, compression, etc. Every time I need something like this, I end up writing …
Monitoring »
Finding Cron Jobs
![iwoau71okwxqh4jv3k4ook32qps[1]](https://i2.wp.com/www.krazyworks.com/wp-content/uploads/2021/08/iwoau71okwxqh4jv3k4ook32qps1-80x80.jpg "Finding Cron Jobs")
Cron is an indispensable tool for system administration. The difficulties in working with cron in a large environment stem from its decentralized nature. Cron jobs multiply like rabbits, and keeping track of them is not …
Understanding Memory Utilization in Linux
![5gtysva4wkc8mzc1k3e66vaycxx[1]](https://i1.wp.com/www.krazyworks.com/wp-content/uploads/2021/08/5gtysva4wkc8mzc1k3e66vaycxx1-80x80.jpg "Understanding Memory Utilization in Linux")
This is a depressing – and all-too-common – scenario: a user runs the free command and opens a support case because he sees zero “free” memory on the server.
Networking »
Validating HTTPS Cache Peers for Squid
![sy2zeb1vp2h8itlxfbbylw0jrm0[1]](https://i0.wp.com/www.krazyworks.com/wp-content/uploads/2019/12/sy2zeb1vp2h8itlxfbbylw0jrm01-80x80.jpg "Validating HTTPS Cache Peers for Squid")
I have a squid proxy server that uses a long list of authenticated cache peers in a round-robin configuration. The process looks something like this:
Verifying SNMP Connectivity on Multiple Hosts
![Photo-2019-10-07-14-39-03_0266[1]](https://i1.wp.com/www.krazyworks.com/wp-content/uploads/2019/11/Photo-2019-10-07-14-39-03_02661-80x80.jpg "Verifying SNMP Connectivity on Multiple Hosts")
I needed to check if SNMP was accessible on whatever live servers that existed in a particular subnet. Here’s a quick script to do this.
Editor
Igor
Sr. Unix SysAdmin with twenty years experience supporting Solaris, HP-UX, AIX, IRIX, and Linux servers in a large distributed environment.
Latest Comments