Cost function

What do you mean by cost function and for what purpose does it serve for? What are the various methods used to estimate cost functions? Explain each method with suitable numerical examples.