Information theory and inference by David MacKay One of my favourite textbooks
Convex Optimization by Boyd and Vandenberghe Also available in pdf.
Kevin Murphy's advice page to grad students from tools tips like latex and matlab to very general advice.
Philip Guo's page fellowship apps, grad school apps, grad student tips, and essays on various topics.