I use Logstash to consolidate the logs from all my servers, which uses ElasticSearch for the back-end and Kibana 3 for the front-end. It isn't PHP based, but it does give you sexy AJAX graphs, allows you to drill-down in logs and do simple and complex searches (with accompanying graphs), such as how many failed SSH login attempts or how many 404 errors Nginx spat out, or like you said, how many visits a particular page had from a particular IP address. I use a service for log shipping (Lumberjack), though you could use rsyslog's built-in features to do so as well. I also prefer the service indexing/storing over on-demand, due to the amount of servers - much faster this way.
crowarth
30-12-2013, 21:47
Originally Posted by
Iray
that looks good - running that against the vhost for my centos mirror i can see who/what is spamming me with requests so i can iptables them to death!
Originally Posted by
crowarth
i just use multitail to view vhost log files, i don't need fancy graphs or a fancy ui even, old fashioned works for me :]
http://weezel.co.uk/img/12-2013/multitail.png
Code:
sudo multitail -ts -ci green /var/log/apache2/centos.mirror.crcrepairs.com.log -ci red -I /var/log/apache2/log_file1.log -ci yellow -I /var/log/apache2/log_file2.log
difficulty level: matrix?
i don't think i'd be able to do that :P have you come across GoAccess? Its run in the terminal and is opensource
http://goaccess.prosoftcorp.com/screenshotscrowarth
30-12-2013, 19:35
Originally Posted by
Iray
Want to discover a better server side log viewer but can't really find what Im looking for on Google or Serverfault, have been using awstats for ages and pretty happy with it.
- PHP based?
Why not? PHP should be able to do everything python can to view logs with the help of sql to cache data of course.
- Real time?
See visitors as they come in on virtual hosts (view by last 30 mins)
- Web 2.0
Utilize sexy graphs instead of the tired looking sort.
- No services (bonus)
Don't want another service running in the background. On demand analysis .
- Most importantly : Filtering / Search
Always wondered why log viewers don't have things like (view visited page by user IP) or even "Show attempted XSS / SQL injection attempts", just a bit of regex dammit dammit !?
i just use multitail to view vhost log files, i don't need fancy graphs or a fancy ui even, old fashioned works for me :]
http://weezel.co.uk/img/12-2013/multitail.png
Code:
sudo multitail -ts -ci green /var/log/apache2/centos.mirror.crcrepairs.com.log -ci red -I /var/log/apache2/log_file1.log -ci yellow -I /var/log/apache2/log_file2.log
Want to discover a better server side log viewer but can't really find what Im looking for on Google or Serverfault, have been using awstats for ages and pretty happy with it.
- PHP based?
Why not? PHP should be able to do everything python can to view logs with the help of sql to cache data of course.
- Real time?
See visitors as they come in on virtual hosts (view by last 30 mins)
- Web 2.0
Utilize sexy graphs instead of the tired looking sort.
- No services (bonus)
Don't want another service running in the background. On demand analysis .
- Most importantly : Filtering / Search
Always wondered why log viewers don't have things like (view visited page by user IP) or even "Show attempted XSS / SQL injection attempts", just a bit of regex dammit dammit !?
