It is indeed impolite for a host to indulge in food he is not willing to share - even if you thought you could get away with it before your guest woke up.
An acceptable solution might have been to purchase enough for part of it: two croissants, for example, or only the fruit.
[
add
]
[
|
|
...
]