looking for opinions on sample use

I have been working a little bit more seriously on electronic styles of music. I mostly worked in rock and folk, until recently. I have had more than a few people express interest in listening to it or even having me in a producer type position for them. The only thing is I feel a little awkward about it to begin with because I have never really done it before.

To make me feel a little bit worse I have never really used any kind of samples in my music. So far I pretty much work any sound out of an actual keyboard or I use a soft-synth. I don't really know if it's limiting me in making music or not. Besides I have never really felt the impulse to use a sample from another musical source, theres also the legality I get worried about slightly. I try to read up on it but I get confused at best.

So I was wondering if anyone had any good advice on how to go about starting a little bit or if it is even worth it. Plus any personal experience any one has had with actually releasing music that used samples. Thank you for your time.