Graphics Processing Unit (GPU) is a computer chip that performance various mathematical calculations at high speeds. It is used to render images. The CPU was used to complete these calculations before the GPU was invented. As more graphic intensive applications were made, the GPU was invented to free up the CPU which couldn’t handle all the calculations.
(image from http://www.geforce.com)