I'm always obviously hunting for samples. I wouldn't say it's getting more difficult, but I'm never satisfied. I never feel like I have enough, since it's a trial-and-error based process for me. The more loops I have, the more potentially interesting results I can get.
I'm open, even if you're not a fan of the music as a whole, you could get elements of it. It's kinda like gambling You never know when you're going to hit. For me, hitting is finding a combination of things, where both of them are completely removed from the original context and taken somewhere else.