Either I did not understand the question or my example works good. If you take G=Z/6Z with + operation modulo 6 then what quotients do you have? Non-trivial quotients are Z/2Z of order 2 and Z/3Z of order 3. In the first case 0 and 4 are equal mod 2, hence {0,4}={0}, in the second one {0,4} is not a coset.
And what happens if one considers, say, the simple alternating group A_5 of order 60 with no non-trivial quotients? Any subset of order 30 is not a coset.
you are right. because, the discussion is on finite groups. in the case of infinite groups, some more things are to be considered like {0, 1} is a subset of the groups (Z,+) as well as (R, +). however, the order of the subgroup dividing the order of the group is another puzzle.
By and large, your explanation will throw light onto the discussion and to the satisfaction of the reader.