Visually explore Linux file system

Linux Kernel map

Persistent Terminals

Screen

• Beginners Tutorial

Xpra

Automate

Installation, configuration, deployment, and management of many machines using following:

SystemImager

CVSup

Subcon

Debug regular expressions

Using Visual REGEXP

Statistics

Octave

Design Patterns

1. Concurrent Request Processing
   

Nagios config

monarch

XML

1. C parser and Toolkit
2. Validation
3. Expat

Package Manager

1. yum
   
2. Smart
3. apt-get

Network Backup Tool

Bacula

Real Time System Tracing

"premature optimization is the root of all evil(or at least most of it) in programming."

1. DTrace
   
2. SystemTap
3. Frysk
4. OProfile
5. LTTng

Monitoring Comparative

Cacti:

1. Graphing Monitoring Data
2. Data Store in RRDtool
3. No reporting
4. Plugin support for extension

Ganglia:

1. Highly Scalable Monitoring system
2. Designed for grid and cluster computing
   
3. XML for data representation
4. XDR for compact portable data transport
5. RRDtool for data storage and visualization
6. Ideal for large monitoring environments
7. No support for events or notifications
8. Does not support thresholds
9. Extension by pluggable modules similar to apache
10. Gmond – Metric gathering agent installed on individual servers
11. Gmetad – Metric aggregation agent installed on one or more specific task oriented servers
12. Ported to various different platforms (Linux, FreeBSD, Solaris, others)
    
13. Apache Web Frontend – Metric presentation and analysis server
14. Attributes:

• Multicast – All gmond nodes are capable of listening to and reporting on the status of the entire cluster
• Failover – Gmetad has the ability to switch which cluster node it polls for metric data
• Lightweight and low overhead metric gathering and transport
  
  

Nagios:

1. Monitor hosts, service and network
2. Plugin extension
3. Automatic log file rotation
4. Redundant monitoring hosts
5. web interface for viewing current network status, notification and problem history, log file, etc.
6. Supports thresholds
7. Generates events or notifications against thresholds
8. Supports "active checks" and "passive checks"
   

RRDtool:

1. Data logging and graphing system for time series data
2. Constant data storage size
3. Data storage is created upfront

Munin:

1. Written in Perl
2. Uses RRDTool
3. Plugins can be written in any language
4. Master/Node Architecture
5. Default plugins like load average, memory usage, CPU usage and network traffic

Hyperic:

Remote Execution

Ganglia Execution Environment

SELinux

"God is a challenge because there is no proof of his existence and therefore the search must continue."

IBM Article

Linux Blogs

All about Linux

Graphing

"People think that computer science is the art of geniuses but the actual reality is the opposite,  just many people doing things that build on each other, like a wall of mini stones."

1. RRDtool
   
2. Cacti
3. MRTG
   

Bigtable

HBase

Distributed File System

"A list is only as strong as its weakest link."

1. Hadoop

• Hadoop Summit - March 25, 2008

  
  

Binary Compatibility Issues

BCI With C++

SSL Data

Use SSL Dump

Documentation

DocBook

Make

Cross Platform Make

Multi-Processing Modules

The different Processing Modules supported in Apache 2.

Perpetual Data

"An algorithm must be seen to be believed."

This is pretty cool

Cross Language RPC

Thrift from Facebook

Monitoring Tools

1. MySQL Replication
2. MMAIM
   
3. Ganglia
4. nagios
   
5. MUNIN

Testing

"Beware of bugs in the above code; I have only proved it correct, not tried it."

1. STAF
   

Performance

"The hardest thing is to go to sleep at night, when there are so many urgent things needing to be done. A huge gap exists between what we know is possible with today's machines and what we have so far been able to finish."

1. Yahoo! Exceptional Performance
   
2. Google Tools
   
3. MySQL
4. High Performance MySQL
   

Wiki

1. dedicated to performance
   

Logging Services

"The most important thing in the kitchen is the waste paper basket and it needs to be centrally located."

1. apache software foundation
   
2. LogAnalysis
3. socklog
4. Swatch
5. LogStatistics

Hash Map

"If you optimize everything, you will always be unhappy."

Google Sparse Hash

Unix Tools

"I define UNIX as 30 definitions of regular expressions living under one roof."

A site which lists tools for Unix

For Linux:

• OProfile

From GOOG:

• Performance
  

Guru of the Week (gotw)

Guru of the Week is a regular series of C++ programming problems created and written by Herb Sutter. Since 1997, it has been a regular feature of the Internet newsgroup comp.lang.c++.moderated, where you can find each issue's questions and answers (and a lot of interesting discussion).

ZooKeeper

Building distributed systems is a zoo...

Service Monitoring

• Ganglia

Capacity Planning

Talk on how flickr uses ganglia to help with capacity planning.