Mystery Fruit

I have been wondering whether this tree really deserves a place in the garden. It must have heard my deliberations as this year it has produced these two small plum-like fruit, clearly in a bid for a reprieve.

I still don't know what it is, nor whether I dare sample the fruit.