the seeds are not poisonous, but they have the same bitter taste as orange seeds. if you're feeling dainty, slice the kumquat in half and pluck out the seeds. you can easily spit the seeds out as you eat instead, or even chew them up if you don't mind the flavor.