Which Linux command or utility is simple, powerful, and surprisingly unknown to many people or used less often?
This could be a command or a piece of software or an application.
For example I’m surprised to find that many people are unaware of Caddy, a very simple web server that can make setting up a reverse proxy incredibly easy.
Another example is fzf. Many people overlook this, a fast command-line fuzzy finder. It’s versatile for searching files, directories, or even shell history with minimal effort.
Underrated? I’d say lftp is the best FTP command line client there is. And Midnight Commander is a very very good file browser. I don’t see either praised enough.
Gripes:
-
starship and all these shell frameworks are overbloated. Just write your own prompt command and be done with it.
-
restic, ongoing issue with the author to allow people to backup without a password. Seems like a no-brainer but he’s being difficult
Why would you want password less backups?
I understand if the reason is ‘just because’, but seriously, why? I just write down the password in a text file for restic --password and I am done.
write down the password where though, somewhere I can guarantee it will always be there 10 years from now? That’s a big ask of me
10 years? Boy you are joung :)
I have encrypted files from w 20 years ago, and unencrypted files from 30 years ago.
And digitized stuff from analogic of 40 and 50 years ago.
That is true for lots of things.
Moreover I use one easy “default” password for all basic stuff, and its always the same known to my spouse and written down on paper.
At least my offsite backups are protected from prying eyes. Maybe uneeded for local backups, but doesn’t hurt to have.
I keep mine in Bitwarden, I export that data every 3 months and store it in a Backblaze backup, I have it written on a piece of paper stored in a locked fire box in my house, and that paper scanned in my phone.
I can’t imagine not having at least one of those in 10 years and I can’t imagine all four failing in the same week.
Does that give you any helpful ideas that would work for you?
None that I can see persisting, as I move around a lot and my backups tend to get boxed up for periods of time before being unboxed. But, I appreciate the effort
-
Not powerful, but often useful,
column -t
aligns columns in all lines. EG$ echo {a,bb,ccc}{5,10,9999,888} | xargs -n3 a5 a10 a9999 a888 bb5 bb10 bb9999 bb888 ccc5 ccc10 ccc9999 ccc888 $ echo {a,bb,ccc}{5,10,9999,888} | xargs -n3 | column -t a5 a10 a9999 a888 bb5 bb10 bb9999 bb888 ccc5 ccc10 ccc9999 ccc888
Pandoc, FFMpeg, ImageMagick
FFMpeg Simple and underrated? Not sure about that.
Not in and of itself, but I find that I have a handful of common tricks that I can put into aliases. Also, there’s ffmpeg.app!
I only use it for simple things
I was surprise to learn that we couldn’t remove remove metadata from video zith
exiftool
but have to use ffmpegYeah ffmpeg is powerful but far from easy to master and get It right when working with encoding.
similar to ImageMagick,
jpegtran
is great for lossless jpeg transformations. You can even extend jpegs using the “crop” function, which can be very useful for batch-processing images, even though it’s hardcoded to middle grey.
A few that I use every day:
- Fish shell
- Starship.rs
- Broot (a brilliant filesystem navigator)
- Helix editor (My favorite editor / IDE, truly the successor to vim IMO)
- Topgrade (updates everything)
Just commenting to give more love to helix. It’s my favorite “small quick edits” editor.
Once Helix gets plugin support and someone makes a Clojure REPL plugin as good as Conjure I am never touching
vim
again!It does have clojure lsp support, but you’ll probably have to use a command line for most repls.
Yeah the clojure lsp support is top notch, but there being no support for “jacking in” to a repl is the big thing keeping me from using helix full time. There’s a way of doing it if you use kitty, but it’s pretty janky.
Helix is great thanks
I’ve actually been testing with fish recently coming from zsh, though I might wait until 4.0 fully releases before I make a more conclusive decision to move or not.
With that said, I remember looking through omf themes and stumbled onto Starship that branched off one of the themes and really liked the concept.
One thing that holds people back sometimes is that bash scripts that set environment variables don’t work by default. https://github.com/edc/bass is an easy solution
Could you explain them in more depth? I opened them and don’t know
Helix is a terminal based text editor. It’s much like vim / neovim, but unlike those editors it’s good to go right out of the box, no configuration or plugins needed to make it work well.
Topgrade is one I haven’t used, but it looks like its intended purpose is to let you upgrade your apps with one command, even if you use multiple different package managers (I.e. if you were on Ubuntu, you could use it to upgrade your apt packages, at the same time as your snap packages, as well as flatpak, nix, and homebrew if you’ve added those.)
Thank you for explaining. I would never have understood topgrade without your example :)
Fish is a replacement of bash that’s a bit more user friendly (has some cool auto completion features out of the box and more sane behaviour like handling of spaces when expanding variables). I personally started to use nutshell recently but unlike fish it’s very different from bash.
Starship is a “prompt” for various shells (that bit of text in terminal before you enter the command that shows current user and directory in bash). I haven’t used it but AFAIK it has many features like showing current time, integration with git, etc.
Yep, here’s my Starship prompt, for example:
So, I have it configured to show:
- the exit code of the last command (if it’s non-zero),
- the duration of the last command (if it’s longer than 2 seconds),
- the time (when the last command ended),
- the current directory,
- the current Git branch, and it also shows some Git status information, for example the
means I have something stashed,
- and finally the technology in use in a repository/directory, so in this case that repo uses Rust and the compiler version is 1.83.
This is sick!! Would you mind sharing your config?
Nope, I’m glad to share.
I personalized it from the “Gruvbox Rainbow” preset from here: https://starship.rs/presets/
So, you might prefer that, if you’re not, well, me.You will need to set up a NerdFont, like the Starship installation guide says.
Here’s my configuration:
Spoiler
"$schema" = 'https://starship.rs/config-schema.json' format = """ [$status](bg:color_red fg:color_fg0)\ [](fg:color_red bg:color_orange)\ [$cmd_duration](bg:color_orange fg:color_fg0)\ [](fg:color_orange bg:color_yellow)\ [$time](bg:color_yellow fg:color_fg0)\ [](fg:color_yellow)\ $line_break\ [$directory](bg:color_aqua fg:color_fg0)\ [](fg:color_aqua bg:color_blue)\ [$git_branch\ $git_status](bg:color_blue fg:color_fg0)\ [](fg:color_blue bg:color_bg3)\ [$c\ $rust\ $golang\ $nodejs\ $php\ $java\ $kotlin\ $haskell\ $python\ $docker_context](bg:color_bg3 fg:color_fg0)\ [](fg:color_bg3)\ $line_break\ $line_break""" palette = 'gruvbox_dark' [palettes.gruvbox_dark] color_fg0 = '#ffffff' color_bg1 = '#3c3836' color_bg3 = '#665c54' color_blue = '#458588' color_aqua = '#689d6a' color_green = '#98971a' color_orange = '#d65d0e' color_purple = '#b16286' color_red = '#cc241d' color_yellow = '#d79921' [status] disabled = false symbol = "" format = ' $symbol $status ' [username] format = ' $user ' [directory] format = " $path " truncation_length = 3 truncation_symbol = "…/" [directory.substitutions] "Documents" = " " "Downloads" = " " "Music" = " " "Pictures" = " " "Projects" = " " [git_branch] symbol = "" format = ' $symbol $branch ' [git_status] style = "bg:color_aqua" format = '$all_status$ahead_behind ' [nodejs] symbol = "" format = ' $symbol $version ' [c] symbol = " " format = ' $symbol $version ' [rust] symbol = "" format = ' $symbol $version ' [golang] symbol = "" format = ' $symbol $version ' [php] symbol = "" format = ' $symbol $version ' [java] symbol = " " format = ' $symbol $version ' [kotlin] symbol = "" format = ' $symbol $version ' [haskell] symbol = "" format = ' $symbol $version ' [python] symbol = "" format = ' $symbol $version ' [cmd_duration] format = ' $duration ' [time] disabled = false time_format = "%R" format = ' $time ' [line_break] disabled = false
Thanks for adding this. What does stashed mean
Oh, when you’re coding something in a Git repo and you realize that you need to make a different change before you continue coding (e.g. switch to a branch, pull newest changes, or just create a separate smaller commit for part of your change), then you can run
git stash push
to put away your current changes, then make your other change, and then rungit stash pop
to bring your ongoing changes back. I recommend readinggit stash --help
, if you want to use it.Sometimes, though, you might end up just taking it into a different direction altogether or simply forget that you had something stashed. That’s when that indicator comes in handy. Because while you can have multiple things stashed, I do find it’s best not to keep them around for too long. If you do want to keep them for longer, then you can always create a branch and commit it as WIP onto there, so that you can push it onto a remote repo.
Thanks!
I heard about helix from you and I’ve used it for a year and a half or so now, it’s by far the best editor I’ve used so far and I can definitely vouch for it
Nice!
edir, can use GUI editors too.
Control+r == search through your bash history.
I used linux for ten years before finding out about that one.
mlocate
I love locate! I have a cronjob that updates the db every night, then I can just find a file without having to think about where it is
Do you have to wear the fedora to run this command?
No sorry, I should have elaborated. The package name is
mlocate
but the command islocate
. Occasionally runupdatedb
as it populates an sqlite db with every file on your system that you can then list out usinglocate
followed by the filename you want to locate.EDIT: Lol. Sorry barely read your reply. Yes, you should wear a fedora while installing
mlocate
.
I immediately had flashbacks of diagnosing bad I/O performance on CentOS 5 servers. That was the week when I learned what updatedb is and why it was always running in the background (there was a lot of files)
sshfs
- xargs
- parallel
- PXE (ohai cobbler)
- tee
- task-spooler (ts aka tsp)
- rpm -V
Nothing new, just forgotten.
task-spooler (ts aka tsp)
This looks amazing. Do you know how well it works in dispatching and tracking jobs over remote servers (over SSH)?
We’ve been using tsp at my work for years and it works well. It is just a very basic queueing system so if you can run the job from the command line then you can run it via tsp.
Our workflow is to have concurrent jobs run on the remote servers with cron and tsp but you should be able to trigger remote jobs over SSH also if you prefer to have a single machine in charge of task allocation.
I abused debfoster for years… it kept my machines running very, very clean.
Cool. I’d never heard of this and I’ve used Debian for years.
tmux - makes managing remote SSH sessions a breeze.
tomb - A little FOSS encryption utility that runs in the CLI. Easy, cute, effective. Tomb Utility
tmsu is pretty cool - it creates a little db and uses that to track tags on your files without ever touching them. It also has it’s own little tag based filesystem.
jq?
yq can do both JSON and YAML :)
Funny how this was one of the first tools I learnt once I “seriously” started my linux journey, lol
I use it occasionally but every time I need to do something a tiny bit more complex than “extract field from an object” I have to spend half an hour studying its manual, at which point it’s faster to just write a Python script doing exactly what I need it to do.
Check out https://www.nushell.sh/ I use it for exactly that, i.e. complex extract and convert files
I actually installed it recently out of curiosity, but I’m hesitant about learning its advanced features like that. At least jq is a standalone tool that’s more ubiquitous than nushell, so you can rely on it even in environments that you don’t fully control (e.g. CI like GitHub Actions). And if you use it in some public code/scripts then other people will be more familiar with it too.
https://github.com/johnkerl/miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON
On the subject of editors,
joe
is just awesome: lightweight, powerful, had coffee coloring and line numbers, and you can choose it with Ctrl+C:)