Shell Script List All Top IP Address Accessing Apache / Lighttpd Web Server

in Categories Web Server last updated December 30, 2008
#!/bin/bash
# Shell Script To List All Top Hitting IP Address to your webserver.
# This may be useful to catch spammers and scrappers.
# -------------------------------------------------------------------------
# Copyright (c) 2004 nixCraft project <http://www.cyberciti.biz/fb/>
# This script is licensed under GNU GPL version 2.0 or above
# -------------------------------------------------------------------------
# This script is part of nixCraft shell script collection (NSSC)
# Visit http://bash.cyberciti.biz/ for more information.
# ----------------------------------------------------------------------
 
# where to store final report?
DEST=/var/www/reports/ips
 
# domain name
DOM=$1
 
# log file location
LOGFILE=/var/logs/httpd/$DOM/access.log
 
# die if no domain name given 
[ $# -eq 0 ] && exit 1
 
# make dir 
[ ! -d $DEST ] && mkdir -p $DEST
 
# ok, go though log file and create report 
if [ -f $LOGFILE ]
then
	echo "Processing log for $DOM..."
	awk '{ print $1}' $LOGFILE | sort  | uniq -c  | sort -nr > $DEST/$DOM.txt
	echo "Report written to $DEST/$DOM.txt"
fi

How do I run this script?

Simply run it as follows:
./script nixcraft.com
Sample output (1st coloum is counter and 2nd is IP address):

  13687 72.30.87.116
   7416 66.249.71.138
   7402 66.249.71.140
   7261 66.249.71.139
   6510 74.86.49.130
   4879 67.195.37.159
   4121 66.90.104.20
   3958 93.158.144.27
   3262 122.172.49.89

You can block all spammers and content scrappers bots using Linux iptables or BSD pf firewall itself.


Share this on:

Tagged as: Tags , , , , , , , , , , ,

9 comment

  2. The sort on ip’s is alphabetic which is not quite right for looking at the numbered segments. so your script only works because the second sort is working on the count produced by uniq -c. Is the first sort even needed?

  3. I think you should pipe the output of the report generating command to tail, otherwise you will get “every” address logged to your resulting report file. And the title of the script is top ip addresses accessing apache / lighthttpd not all unique ip addresses which is what your script is producing.

    Here a what i mean, with this you get the top 20 hitters only.
    awk ‘{ print $1}’ $LOGFILE | sort | uniq -c | sort -nr | tail -20 > $DEST/$DOM.txt

    1. Use “head” instead of tail, this way output shows only last 20 IP hit your website just one time.

      Top 20 IPs hits site multiple times.
      awk ‘{ print $1}’ $LOGFILE | sort | uniq -c | sort -nr | head -20 > $DEST/$DOM.txt

  6. hello when i stored it on my server i use this command:
    chmod +x ipcacher.sh
    and then when i try ./ipcacher.sh
    i dont see anything

    plz help me and reply my comment by sendig mail to me tnx

  7. hi ,

    i want to know, how i restart the script from zero or what is restart command..

    normally it begins from zero every midnight(00.00)

    thx

    best regards

  8. Great script !! I made a script somewhat like this to check secure logs for failed ssh connections.
    Keep up the good work!

    Have a question? Post it on our forum!