What is Cayenne Pepper

The use of cayenne pepper to spice up a dish or boost circulation has a long history in many cultures around the world. There is sometimes confusion from the fact that a cayenne pepper is always a chili pepper, but a hot chili is not always a cayenne. So what is it?