Absolutely.
I find Star Wars, in particular, really cuts both directions. Because it's easy to start a cascade of 'getting rid of' because so many of the characters are inter-connected to the point where not having X and Y means you don't need A, B, C, D, or G. The other side of that is, there's ensemble casts all over the place where it's basically impossible to get just one.
For the most part, I firmly agree. Like Rogue One, I only have K2SO and the new troopers from that movie. I have nothing from Andor at all. I have three figures from the entire ST. I even got my Mandalorian/BOBF/Ahsoka era stuff down to eight figures. But some stuff... like I have Ben, then I have Luke, Leia, Han, Lando, the droids, Yoda, and Chewie all from ESB. Then I had to get Luke, Leia, Han, Chewie, and Lando as they appear in Jabba's Palace for my creature shelf. But it's the OT and I'll allow it.
If you go buy a Phantom Menace figure, you're probably gonna end up with a bunch of Phantom Menace figures.
And I saw myself going that way, so I did something really weird for myself and got rid of all my named Clones, just have a plain P1 and plain P2 now. I have AOTC Padme, CW Obi-Wan and Ahsoka, and ROTS Anakin, along with Ventress but got rid of Dooku. Kept Plo Koon (and will get Barriss) but got rid of every other Jedi. It doesn't even make my eye twitch. I got rid of every non-masked Imperial but Palpatine and Tarkin. It's weird and some of it doesn't make sense even to me but it's sorta freeing.
Classified though, there are a few I ended up not keeping, usually because I got something to do a custom and realized I was going too far. I need to save room for the actual figures because there's gonna be too many eventually!
But the new thing I hit upon, for me at least, is how I do a custom file card for every figure I get, so I do have some made for figures I didn't keep. I 'stamped' them "INACTIVE", and have them in a different file on the computer, and realized.... holy shit, I need to do that with all the figures I sorta want but not really, such as the Dreadnoks. And it makes sense for a lot of these characters to be inactive now because while some may have left or been discharged, a lot of them have likely died. That's why I was gathering pictures of Vipers and found that dark one on hisstank I posted this morning. Yeah, I know that is way obsessive, but if you really want to hear how ridiculous I am... when I was helping do articles for the Star Wars parody wiki, Banthapedia, that no longer exists, I did articles for a TON of Stormtroopers where I gave them distinct TK designations and little backstories. Any still I could find of a Stormtrooper from any of the movies, I named him. There came a point where I freaked out and completely abandoned that site because I realized how much creative energy I was pissing away there, heh. but clearly, with my filecard project, I still need to have a dumb, inconsequential little creative outlet with no stakes at all. Just fun, no publishing.