So I guess that’s actually several questions, and they each have different answers.
Why does combat feature heavily in D&D? It doesn’t. Or at least, not necessarily. How much or little it features is dependent on your DM.
Ok, so why has it historically been featured heavily? Because of D&D’s lineage. The game evolved mechanically from wargames, where combat was the whole thing, and thematically from works like Conan the Barbarian and Tolkein, where fighting monsters featured prominently.
Why so many types of monsters, then, if works like The Hobbit only had a half dozen or so? Because The Hobbit is a single story, whereas D&D is a framework for creating lots of stories. Maybe one short campaign or a campaign arc has as many monsters as a Tolkein story, but then you go on to the next arc, the next campaign, and you need something new. You can obviously recycle lots; orc bandits are different from orc soldiers are different from orc cultists. But with (tens of?) thousands of games going on continuously, year after year, there’s always a demand for new content to slot in, and monster design is often a handy thing for DMs to outsource. Hence, there are a lot of kinds of monster because there is demand for them.
Blast off and nuke the site from orbit, it’s the only way to be sure.