The Bible clearly states that there was no death of humans, or animals (including dinosaurs) before Adam sinned. It teaches that the actions of one man, Adam brought death into the world and that the entire creation has suffered the consequences.
Evolutionists, on the other hand believe that death has been going on for millions of years. It requires the death of billions of animals slowly evolving to bring humans into existence.
Many (not all) who believe in evolution don't believe there is a God, they don't believe man was created, and they don't believe there is any such thing as sin. You are free to think what you like on either end of this debate as well.
As for cavemen, the caveman theory is not biblical at all. Evolutionists, who do not believe in Creation, theorize that men came from the apes and in millions of years they evolved into a primitive man, such as the caveman.