| Misc Links |
|
Forum Archive News Archive File DB |
| Ads |
| Advertisement |
|
Age of Valor - Ultima Online Free Shard AoS/SE/ML/Custom - advanced code, dedicated staff, peerless bosses, non overpowered customs + much much more |
| Latest Forum Topics |
|
Vmware Shifts Pricing Strategy Posted by Red Squirrel on Sep 02 2010, 7:09:04 pm Badass Chipmunk Posted by Triple6_wild on Sep 01 2010, 1:06:15 am Evony Farming And Building Helper Tool Posted by Red Squirrel on Sep 01 2010, 4:40:12 pm I Just Thought Of A Cool Invention Posted by rovingcowboy on Aug 31 2010, 12:21:50 am Shocks Dangerous? Posted by Triple6_wild on Aug 30 2010, 10:26:12 pm |
Send spam to: website@xeonlive.com nick@xeonlive.com georgiapeach1241@aol.com
"Reach out and grep someone" - Bell Labs Unix
By Red Squirrel
Grep is a wonderful command in Linux and makes the Linux environment that much easier to process large files or large amounts of data. Try opening a 30Gig file in windows, and then performing a string search, and if you have 20 of these files...... good luck! You can transfer it all over to a linux box on a 10mbps connection and then use grep, and the transfer wait will be well worth it.
The two main uses for grep is finding a line in a file that matches with a keyword, and finding a line in a command output, that matches a keyword. We'll start with files first.
Working with files I personally ran into this problem, I had 30 mysql backups where 1 was a day old, 2 was 2 days old etc... and because the main backup restore after a reformat did not work properly, I needed to go fetch the tables from a previous backup, in hopes they were there. So here am I trying to open these 1 gig sql files in my text editor in Windows, it would take like 10 minutes just to open, and performing a search was also very slow and tedious. Even after closing it, the PC would be very sluggish and require a reboot.
That's when I found out about grep so I transfered these files to the linux box, thankfully over 100mbps and not 10 like said in the above example situation. You can search in 1 file, or directory and it will return the lines that have the specified string. You can also specify with the A and B tags how many lines before and after you want to see.
This command would search for "a string" and return 3 lines before and 4 lines after. To give it a test create a file called testfile.txt and put a bunch of random stuff in it and on a few lines put "a string" without the quotes.
grep -B3 -A4 "a string" testfile.txt >grepout.log
This would output the results to grepout.log, but you can remove the >grepout.log part to have it right on the screen. Outputting to a file is not a bad idea when searching huge amounts of files since you will probably get lot of matching stuff so afterwards it will be easier to sort through.
Here's how you'd do the same thing, but instead of searching testfile.txt you want to search all the files in /etc.
grep -R -B3 -A4 "a string" /etc/*
This is surprisingly pretty quick too, here's some of what it got on my system. Just part of what appears to be a configuration file. From this point on I know that "a string" is in that file so I can vim to it and do a search (using /a string in the vim command line) and voila, found a string, without having to manually check in each file. Funny how it's talking about regular expressions, since we'll be looking at those later.
Grep with commands
Grep is not only limited to searching for files, you can also limit command output to a specified string. For example
locate spam | grep ^/etc/
Returns:
The locate command is used to locate files on the hard drive. So typically locate spam would list every single file that matches spam, but that's a huge list, so using a command such as the one above will limit to /etc folder. The ^ tells it that it has to start with that. So /data/etc/spam would not match. Without the ^, it would match.
You can use grep with dir as well. If you're looking for the hosts file but don't remember if it has an extension, or if it has an s then you could use this command:
dir | grep "host"
Returns:
Remember, it goes by line, so this is why pam.d and vsftpd.conf and other files are listed, as long as "host" is somewhere on that line.
Another command you can use grep with is top. Top is used to show system usage (sort of like the task manager in windows) and it updates every few seconds.
So issuing top | grep "httpd" would execute top, but only show the lines which httpd is in, so every few seconds, a new line would be printed, if, and only if, httpd is in the top section of cpu usage. This is especially good if you are monitoring a program that is using too much resources since every few seconds it will print a new line with the usage info. And if it stops printing, then you know the program ceased using up enough cpu to apear in the top list.
Grep can be used in conjunction with any command, as far as I know and it has many features not mentioned so far so the next page will simply show some examples of advanced uses of grep.
Next Page
| 115017 Hits | Pages: [1] [2] | 3 Comments |
|
| Top Articles | Latest Articles |
|
- What are .bin files for? (592340 reads) - Big Brother and Ndisuio.sys (143051 reads) - PSP User's Guide (127665 reads) - Text searching in linux with grep (115015 reads) - SPFDisk (Special Fdisk) Partition Manager (101076 reads) |
- Dynamic Forum Signatures (version 2) (4640 reads) - Successfully Hacking your iPhone or iTouch (14321 reads) - Ultima Online Newbie Guide (25017 reads) - BBcode editor: PHP - The sensible approach (17876 reads) - The Hitch Hikers guide to "the mouse" (15273 reads) |
